REU Project: Coffea + Work Queue

This spring, undergraduate researchers Zoe Surma and Emily Strout worked to integrate the Coffea data analysis framework for high energy physics with the Work Queue distributed execution framework from the CCL.  Zoe presented initial results from testing at the Coffea user's meeting last week.  We are seeing some good scaling behavior, but there is still some tuning needed to go to large scale.  Many thanks to Lindsay Grey and the Coffea team for help and support.  The next step is to get this up and running on the CMS HTCondor cluster at Notre Dame!




Enjoy Reading This Article?

Here are some more articles you might like to read next:

  • The Vine CMS Analysis Stack: Use Case at Notre Dame
  • Demystifying Cluster Storage: CephFS, Scratch, and I/O Bottlenecks
  • Kicking Off the New Semester: Welcome Andrés and Lab Updates
  • Shell Survival Skills: Terminal Tools Every HPC User Needs
  • How to Read HPC Error Logs (And What Common Failures Actually Mean)