The Cooperative Computing Lab

We design software that enables our collaborators to easily harness large scale distributed systems such as clusters, clouds, and grids. We perform fundamental computer science research that enables new discoveries through computing in fields such as physics, chemistry, bioinformatics, biometrics, and data mining.

All of our software is open source and available on GitHub. We are always eager to welcome new collaborators—whether you want to explore our software, contribute to development, or receive support. Explore our tools to see how they can power your distributed computing needs, and visit the getting help section if you need assistance.

CCL Launches Redesigned Website (Jan 06, 2026)

Open Source Software

TaskVine is our third-generation workflow system for building scalable data intensive applications that run on HPC clusters, cloud services, and other clusters.

Floability is an NSF funded research project to enable the rapid and portable deployment of notebooks expressing complex scientific workflows across a wide range of cyberinfrastructure.

Work Queue is an application framework for creating and managing dynamic manager-worker style programs that scale up to tens of thousands of machines on clusters, clouds, and grids.

See all software

Research Projects

XGFabric : Coupling Sensor Networks and HPC Facilities with Advanced Wireless Networks for Near Real-Time Simulation of Digital Agriculture (DOE ASCR)

This project will explore the design of systems for connecting remote wireless sensor networks with high performance computing systems.

SADE: A Safety-Aware Ecosystem of Reputable sUAS

The overall goal of the project is to develop technology for safety zones that permit only trusted drones to operate in congested or sensitive airspace.

Pledge: Accelerating Data Intensive Scientific Workflows with Consistency Contracts

Expresses workflow I/O intentions using consistency contracts to enable efficient, cluster-wide storage and execution optimizations.

NBFlow: From Notebook to Workflow and Back Again (CSSI Framework)

NBFlow brings together interactive notebook technologies (Jupyter), reproducibility tools (SciUnit), and distributed workflows (TaskVine) to enable easy execution of large-scale notebook workflows on heterogeneous HPC clusters.

TaskVine: A User Level Framework for Data Intensive Scientific Applications (CSSI Element)

TaskVine is open source software for building large scale data intensive dynamic workflows that run on HPC clusters, GPU clusters, and commercial clouds.

See all projects

Community Highlights

Workshop on Harmonizing Python Workflows at IEEE e-Science 2025

We helped host the Workshop on Harmonizing Python Workflows at IEEE International Conference on e-Science on Monday, 15 Sep 2025. This workshop is one compon…

OpenTopography + EEMT + Makeflow

The OpenTopography service provides online access to geospatial data and computational tools in support of earth sciences. The Effective Energy and Mass Tra…

Analyzing Agriculture with Work Queue

The Field Scanalyzer at the University of Arizona is a massive robot that uses sensors, cameras, and GPS devices to collect vast quantities of agricultural d…

Summer REU Projects

In summer 2019, REU students TJ Dasso and Eamon Marmion worked at the CCL on large scale distributed applications. They completed the integration between th…

IceCube Flies with Parrot and CVMFS

IceCube is a neutrino detector built at the South Pole by instrumenting about a cubic kilometer of ice with 5160 light sensors. The IceCube data is analyzed …

See all highlights

Latest News and Posts

May 05, 2026	TaskVine Insights: Shipping Worker Builds to Remote Nodes and Debugging There
Apr 28, 2026	TaskVine Insights: Submitting Workers to a Cluster
Apr 21, 2026	Congratulations to Colin Thomas on Passing His Candidacy Exam
Apr 16, 2026	Congratulations to Thanh Son Phung on Passing His Doctoral Defense
Apr 09, 2026	Introducing X-Bucket

See all posts

Recent Publications

SciWIND: Effectively Exploiting Node-Local Storage for Data-Intensive High-Energy Physics Workflows

Jin Zhou, Colin Thomas, Barry Sly-Delgado, Connor Moore, Benjamin Tovar, Kevin Lannon, and Douglas Thain

In IEEE International Parallel and Distributed Processing Symposium (IPDPS), 2026

Bib PDF

@inproceedings{sciwind-ipdps-2026,
  author = {Zhou, Jin and Thomas, Colin and Sly-Delgado, Barry and Moore, Connor and Tovar, Benjamin and Lannon, Kevin and Thain, Douglas},
  title = {{SciWIND: Effectively Exploiting Node-Local Storage for Data-Intensive High-Energy Physics Workflows}},
  booktitle = {{IEEE International Parallel and Distributed Processing Symposium (IPDPS)}},
  year = {2026},
  cclpaperid = {1007},
}

SADE-SIM: A Scalable Simulation Platform for Validating City-Scale Multi-sUAS Missions

In Workshop on Software Engineering for Engineering Simulations, and Simulation Engineering for Engineering Software (SE4ES) 2026, 2026

doi: 10.1145/3803437.3805540

Bib PDF

@inproceedings{sade-sim-2026,
  author = {},
  title = {{SADE-SIM: A Scalable Simulation Platform for Validating City-Scale Multi-sUAS Missions}},
  booktitle = {{Workshop on Software Engineering for Engineering Simulations, and Simulation Engineering for Engineering Software (SE4ES) 2026}},
  pages = {8},
  year = {2026},
  cclpaperid = {1006},
  keywords = {sade},
  note = {{doi: 10.1145/3803437.3805540 }},
}

A terminology for scientific workflow systems

Frédéric Suter, Tainã Coleman, İlkay Altintaş, Rosa M. Badia, Bartosz Balis, Kyle Chard, Iacopo Colonnelli, Ewa Deelman, Paolo Di Tommaso, Thomas Fahringer, Carole Goble, Shantenu Jha, Daniel S. Katz, Johannes Köster, Ulf Leser, Kshitij Mehta, Hilary Oliver, J.-Luc Peterson, Giovanni Pizzi, Loïc Pottier, Raül Sirvent, Eric Suchyta, Douglas Thain, Sean R. Wilkinson, Justin M. Wozniak, and Rafael Ferreira Silva

Future Generation Computing Systems, Jan 2026

DOI Bib PDF

@article{terms-fgcs-2025,
  author = {Suter, Frédéric and Coleman, Tainã and Altintaş, İlkay and Badia, Rosa M. and Balis, Bartosz and Chard, Kyle and Colonnelli, Iacopo and Deelman, Ewa and Tommaso, Paolo Di and Fahringer, Thomas and Goble, Carole and Jha, Shantenu and Katz, Daniel S. and Köster, Johannes and Leser, Ulf and Mehta, Kshitij and Oliver, Hilary and Peterson, J.-Luc and Pizzi, Giovanni and Pottier, Loïc and Sirvent, Raül and Suchyta, Eric and Thain, Douglas and Wilkinson, Sean R. and Wozniak, Justin M. and da Silva, Rafael Ferreira},
  title = {A terminology for scientific workflow systems},
  journal = {Future Generation Computing Systems},
  year = {2026},
  volume = {17},
  month = jan,
  number = {107974},
  doi = {10.1016/j.future.2025.107974}
}

See all publications