High-performance data processing

Processing and storing large datasets

Do you want to process and store large amounts of data? Our team of experts will support you in using our high-throughput data processing systems and storage solutions.

Apply for access

Close-up microscoop met hand onderzoeker

Advantages

For large, structured datasets

Ideal for projects where you need to process large, structured datasets

Collaborate

Collaborate on a shared set of data and software, even when they are in different locations

Data storage

Easy access to scalable data storage solutions

Do you have a question about high-performance Dataprocessing? Get in touch.

Or contact us via the service desk portal

For large, structured datasets

Our high-throughput data processing services are suitable for projects that require the processing of large, structured data sets. Such as instrument data from sensors, DNA sequencers, telescopes and satellites.

Use data processing services for:

Collaborating on a shared set of data and software
Parallel processing of large amounts of data, from many terabytes to petabytes
Processing large independent simulations and workflows
Optimised data transport thanks to a scalable high-bandwidth network
Easy access to scalable data storage solutions

Nobel Prize-winning research into gravitational waves uses the Grid

Read the case study

Tailored support

High-performance data processing projects need support in transmitting, storing, accessing and processing large volumes of data. We have extensive experience in all aspects of large-scale data processing. We offer specialised support in building customised production solutions for your research community.

Data processing platforms

We have two powerful data processing platforms to cater for different needs:

Grid: for scalability and collaboration

Grid offers limitless computing potential thanks to a chain of international clusters connected by a high-speed network. These clusters are located in data centres around the world.

Benefits of Grid:

Access to the European Grid for federated data processing
Huge processing capacity focused on steady production processes
Possibility to collaborate with large research communities in different locations

Spider: for more flexibility

Spider is a dynamic, flexible and customisable platform hosted locally at SURF. It is optimised for collaboration and supported by an ecosystem of tools that allow data-intensive projects to be launched quickly and easily.

Benefits of the Spider platform:

Interactive processing with a user-friendly interface
Private nodes and clusters for customised production and availability
Collaboration in a private and secure project environment

Technical specs and user documentation

More (technical) information on using these platforms:

Case studies

Alzheimer's research collaboration hub: "We are pioneering"

Case study

Making Dutch DNA data available to researchers from other countries is complicated by strict privacy laws. A new platform should make it possible.

Case study
A new piece of the climate puzzle

Case study

What role do particulate matter and clouds play in global warming? That is what a Dutch-developed measurement instrument aboard a new NASA climate satellite is investigating. The data gets processed and stored at SURF and made available to science.

Case study
Digging into a genetic goldmine

Case study

MinE is an international project to trace the genetic causes of ALS, a deadly muscle nerve disease. SURF provides storage and analysis of the mountain of DNA produced by the project.

Case study