REU Project: Coffea + Work Queue

This spring, undergraduate researchers Zoe Surma and Emily Strout worked to integrate the Coffea data analysis framework for high energy physics with the Work Queue distributed execution framework from the CCL.  Zoe presented initial results from testing at the Coffea user's meeting last week.  We are seeing some good scaling behavior, but there is still some tuning needed to go to large scale.  Many thanks to Lindsay Grey and the Coffea team for help and support.  The next step is to get this up and running on the CMS HTCondor cluster at Notre Dame!




Enjoy Reading This Article?

Here are some more articles you might like to read next:

  • Graduate Students Share Research and Systems Insights at SC25
  • CCL Launches Redesigned Website
  • Accelerating Coffea Workflows with Persistent Preprocessing Cache
  • Exploring Execution Strategies and Compositional Trade-Offs in the Context of Large-Scale HEP Workflows
  • TaskVine Insights - Storage Management: Depth-Aware Pruning