About the CCL
We design software that enables our collaborators to easily harness large scale distributed systems such as clusters, clouds, and grids. We perform fundamental computer science research that enables new discoveries through computing in fields such as physics, chemistry, bioinformatics, biometrics, and data mining.CCL News and Blog
- Reshaping High Energy Physics Applications Using TaskVine @ SC24 (14 Jan 2025)
- Shepherd Paper at WORKS/SC 2024 (07 Jan 2025)
- Data Pruning Mechanism in Daskvine (09 Dec 2024)
- TaskVine + Parsl Integration (01 Dec 2024)
- Accelerating Function-Centric Applications via Reusable Function Context in Workflow Systems (11 Nov 2024)
- A New Visualization Tool for TaskVine Released (04 Nov 2024)
- Integrating TaskVine with Merlin (16 Oct 2024)
- Introducing Shepherd: Simplifying Integration of Service Workflows into Task-Based Workflows (14 Oct 2024)
- TaskVine at ParslFest 2024 (07 Oct 2024)
- (more news)
Community Highlight
The CMS physics group at Notre Dame has created Lobster, a data analysis system that runs on O(10K) cores to process data produced by the CMS experiment at the LHC. Lobster uses Work Queue to dispatch tasks to thousands of machines, Parrot with CVMFS to deliver the complex software stack from CERN, XRootD to deliver the LHC data, and Chirp and Hadoop to manage the output data.
By using these technologies, Lobster is able to harness arbitrary machines and bring along the CMS computing environment wherever it goes. At peak, Lobster at ND delivers capacity equal to that of a dedicated CMS Tier-2 facility! (read more here)