About the CCL
We design software that enables our collaborators to easily harness large scale distributed systems such as clusters, clouds, and grids. We perform fundamental computer science research that enables new discoveries through computing in fields such as physics, chemistry, bioinformatics, biometrics, and data mining.CCL News and Blog
- Intro to TaskVine at GCASR 2023 (28 Apr 2023)
- CCTools version 7.5.2 released (17 Apr 2023)
- TaskVine System Architecture (22 Feb 2023)
- A Preview of TaskVine (22 Feb 2023)
- Landlord Container Paper in TPDS 2023 (07 Feb 2023)
- Mufasa: Robust Meta-Workflow Management at eScience 2022 (12 Oct 2022)
- pyHEP 2022: Automatic resource management with Coffea and WorkQueue (16 Sep 2022)
- US-CMS PURSUE internship project: Searching for Extreme Events in Multi-lepton Data from the LHC (17 Aug 2022)
- Demo of the Work Queue executor at Coffea User's meeting (17 Aug 2022)
- (more news)
Community Highlight
"At
Seattle Pacific University we have used Work Queue in the CSC/CPE 4760
Advanced Computer Architecture course in Spring 2014 and Spring 2016.
Work Queue serves
as our primary example of a distributed system in our “Distributed and
Cloud Computing” unit for the course. Work Queue was chosen because it
is easy to deploy, and undergraduate students can quickly get started
working on projects that harness the power
of distributed resources."
The main project in this unit had the
students obtain benchmark results for three systems: a high performance workstation; a cluster of 12 Raspberry Pi 2 boards, and a cluster of A1 instances in
Microsoft Azure. The task for each benchmark
used Dr. Peter Bui’s Work Queue MapReduce framework; the students
tested both a Word Count and Inverted Index on the Linux
kernel source. In testing the three systems the students were exposed to
the principles of distributed computing and the MapReduce model as they investigated tradeoffs in price, performance, and overhead.
- Prof. Aaron Dingler, Seattle Pacific University.