Searching for Exo-Planets with Makeflow and Work Queue

Created on March 22, 2016 by Douglas Thain

2016

Students at the University of Arizona made use of Makeflow and Work Queue to build an image processing pipeline on the Chameleon cloud testbed at TACC .

The course project was to build an image processing pipeline to accelerate the research of astronomer Jared Males , who designs instruments to search for exo-planets by observing the changes in appearance of a star.  This results in hundreds of thousands of images of a single star, which must then be processed in batch to eliminate noise and align the images.

The students built a solution (Find-R) which consumed over 100K CPU-hours on Chameleon, distributed using Makeflow and Work Queue.

Read more here:
https://www.tacc.utexas.edu/-/in-search-of-a-planet



Enjoy Reading This Article?

Here are some more articles you might like to read next:

  • Hybrid Workflow Composition for Extreme-Scale Data Processing on the HL-LHC
  • Reshaping and Fusing Hidden Task Graphs: Optimizing Distributed HEP Workflows in Dask Vine
  • Declare, Resolve, Reuse: Portable Data Handling for Notebook Workflows in Floability
  • CCL at eScience'26
  • SADE Drone Simulation at NASA ULI