Science Group at Columbia University Safeguards Troves of Environmental Research Data with JetStor

Columbia University’s science group secures vast environmental research data with JetStor, ensuring long-term reliability and protection.

The organization

Download solution PDF

Since its creation in 1949, the Lamont-Doherty Earth Observatory (LDEO) at Columbia University’s Earth Institute has been a leader in Earth science. Its mission is to gain “knowledge about the origin, evolution, and future of the natural world.” Located along the Hudson River just north of Manhattan, LDEO’s scientists were the first to map the seafloor; develop a computer model that could predict an El Niño weather event; prove the theory of plate tectonics, and reveal the oceans’ role in triggering climate change.

The challenge

With support from the National Science Foundation, LDEO provides a central repository where scientists can store their data on Earth’s marine, terrestrial and atmospheric systems. Their efforts, however, produce huge amounts of information. For example, a fleet of 25 oceanographic research vessels sails around the globe year-round with sensors that measure everything from the atmosphere to the water column to the seafloor. Datasets, which are stored indefinitely, range from a small spreadsheet of rock samples to 400 Gb of sonar data from an oceanographic expedition, to terabytes of video data from a volcano observatory.

“Curating data for the national Earth science research community is a big responsibility,” said Robert A., Lead Systems Analyst/Programmer at LDEO. “Collecting the datasets is costly and time-consuming, and they must always be safe. We can’t lose anything.”

This critical role in scientific research is becoming even more challenging. Scientists are deploying more and more sensors on ships and elsewhere that create exponentially growing troves of data. “Datasets are exploding in size and we need enterprise solutions to store them reliably and quickly,” added Robert.

The solution

Four JetStor SAS 716FD 16-bay RAID Arrays from JetStor

No items found.

System configuration

• Two JetStor SAS 716FD 16-bay RAID Arrays, each providing 128Tb of storage capacity using sixteen 8Tb SAS drives

• Five rack-mounted Dell PowerEdge 420 Servers, two with QLogic QLE2562 (8Gb) adapters

• Two QLogic SANbox 5802V switches with 10Gb Fibre Channel links

Benefits Immediately realized

LDEO is addressing its burgeoning datasets with JetStor SAS 716FD storage arrays from AC&NC. LDEO has long stored research data on JetStor RAID storage systems. “JetStor has been one of Columbia University’s more popular vendors and there are many JetStor solutions on our main campus,” explained Robert.

The JetStor 716FD solutions greatly expand LDEO’s storage strategy. To ensure the safety of every dataset, LDEO maintains two matching clusters of JetStor RAID chassis, each in separate buildings on its campus. All data are replicated across the two clusters. Each cluster consisted of five JetStor arrays, but the introduction of the JetStor 716FD systems increases both their capacity and performance.

The JetStor 716FD solutions each feature 128 terabytes of storage, significantly larger than LDEO’s legacy arrays. Additionally, these systems link with 8Gb Fibre Channel speeds rather than the gigabit iSCSI or SCSI connections of the earlier chassis.

“By switching to the high-speed fiber connectivity of the JetStor 716FD arrays, we gain the outstanding throughput needed to ingest even the largest datastores,” said  Robert. “Researchers also have much faster random access to their data, avoiding bottlenecks and improving productivity.”

By turning to solutions like the JetStor 716FD systems, LDEO is also easing the burden of storing so much research data. “It’s simpler to maintain a few larger arrays than many smaller ones,” said  Robert. “Moreover, we’ll trim our operating costs by consuming less electricity.”

Perhaps most importantly, by continuing to rely on JetStor solutions, LDEO meets its primary objective of safeguarding data critical to the scientific community.

“Our JetStor RAID arrays always deliver the dependability we demand,” said  Robert. “In fact, until we replaced them with the JetStor 716FD solutions, the first JetStor chassis we bought in 2006 was still providing us trouble-free operation, which is remarkable after all these years. The solutions are rock solid and the staff at JetStor continues to be responsive to our every need. I don’t have to submit a request ticket. Instead, they respond promptly to emails, which we greatly appreciate.”

How we did it

LDEO upgraded its storage clusters at each site by replacing a JetStor 412S chassis and a JetStor 516iS chassis with two JetStor 716FD RAID solutions. It installed QLogic QLE2562 adapters in two of the five rack-mounted Dell PowerEdge 420 Servers that link to the JetStor chassis in each cluster, providing the new JetStor systems with robust 8Gb Fibre Channel connectivity to the servers. The organization also deployed a four-port QLogic 5802V switch at each cluster and links them to the fiber-capable servers and the JetStor 716FDs via Fibre Channel.

All the JetStor platforms are configured for RAID 6, which provides block-level data striping and avoids data loss even if two disks fail within an array.

The 16-bay JetStor 716FD arrays are provisioned with 8Tb SAS drives, increasing the operational capacity of each cluster to over 330Tb. The solutions are engineered for non-stop operation. A fully cableless design improves reliability. Dual hot-swappable power supplies with integrated turbo-cooling and separate power connections and dual hot-swappable controllers provide system tolerance for any component failure. Robert frequently uses the systems’ RAID Manager browser-based management and monitoring software to remotely configure and manage all of the JetStor systems. The application will forward e-mail notifications in the unlikely event that issues arise, helping to ensure availability.

About

JETSTOR

JetStor meets the evolving needs for data storage, protection, and management. We leverage leading technologies to offer high-value solutions for NAS, SANs, clouds, and hyper-converged infrastructures (HCIs).  Since 1994, our customers have spanned virtually every industry, and range from Fortune 500 enterprises to small and medium-sized firms.  We support environments from data centers and clouds to branch offices and remote sites.

Conclusion

With its fibre-capable, enterprise-class JetStor 716FD arrays, LDEO will continue to support scientists’ efforts to better understand our planet and its systems. “Our new JetStor chassis provide the research community with greater performance, more capacity, and the same availability we’ve enjoyed since we began using JetStor products nearly a decade ago,” concluded Robert. “We’re proud and pleased to know we’ll continue our mission well into the future.”

Another JetStor Solutions

Penns Valley Area Affordably Supports Students, Operations & Video Surveillance with JetStor® Arrays

Penns Valley Area schools efficiently support students, operations, and video surveillance with cost-effective JetStor storage solutions.

More
Down arrow
JetStor Brings Flash Storage to a Broad Audience

JetStor brings cutting-edge flash storage to a wide range of industries, offering high-speed, reliable solutions that drive performance and efficiency.

More
Down arrow
Leading Production Studio Counts on JetStor® RAID Solutions

Uncover the storage strategy that keeps a top production studio running smoothly, safeguarding creativity and powering seamless workflows.

More
Down arrow
JetStor® X AFA Solution Accelerates eDiscovery, IT Forensics, and Information Governance Services

JetStor X-AFA solution enhances eDiscovery, IT forensics, and information governance services with speed and precision. See the transformation it brings to data handling.

More
Down arrow
Penn State Turns to JetStor for Mission Critical Testing

Penn State trusts JetStor for mission-critical testing, ensuring reliable data storage and seamless operations for their high-stakes research.

More
Down arrow
School District Lowers Costs and Improves Performance with JetStor RAID Arrays

A school district reduces costs and boosts performance with JetStor RAID arrays, ensuring efficient data management and improved operations.

More
Down arrow