CCL Research Publications
Sort By Date | Sort By Type | Download BibTeX | Download JSON
2024
|
Thanh Son Phung, Colin Thomas, Logan Ward, Kyle Chard, Douglas Thain, Accelerating Function-Centric Applications by Discovering, Distributing, and Retaining Reusable Context in Workflow Systems, ACM International Symposium on High-Performance Parallel and Distributed Computing (HPDC), June, 2024. DOI: 10.1145/3625549.3658663
|
2023
|
Barry Sly-Delgado, Thanh Son Phung, Colin Thomas, David Simonetti, Andrew Hennessee, Ben Tovar, Douglas Thain, TaskVine: Managing In-Cluster Storage for High-Throughput Data Intensive Workflows, 18th Workshop on Workflows in Support of Large-Scale Science, November, 2023. DOI: 10.1145/3624062.3624277
|
2022
|
Kevin Lannon, Paul Brenner, Michael Hildreth, Kenya Hurtado Anampa, Alan Malta, Rodrigues, Kelci Mohrman, Douglas Thain, and Ben Tovar, Analysis Cyberinfrastructure: Challenges and Opportunities, Snowmass, pages 1-14, March, 2022.
|
|
Sanda Gesing, Ewa Deelman, Rafael Ferreira da Silva, Michael Hildreth, Mary Ann McDowell, Natalie K. Meyers, and Douglas Thain, VisDict: A Visual Dictionary in a Science Gateway, Gateways, January, 2022.
|
2021
|
Tim Shaffer, Zhuozhao Li, Ben Tovar, Yadu Babuji, TJ Dasso, Zoe Surma, Kyle Chard, Ian Foster, and Douglas Thain, Lightweight Function Monitors for Fine-Grained Management in Large Scale Python Applications, IEEE International Parallel and Distributed Processing Symposium, May, 2021. DOI: 10.1109/IPDPS49936.2021.00088
|
2020
2019
2018
|
Chao Zheng, Lukas Rupprecht, Vasily Tarasov, Douglas Thain, Mohamed Mohamed, Dimitrios Skourtis, Amit S. Warke and Dean Hildrebarnd, Wharf: Sharing Docker Images in a Distributed File System, ACM Symposium on Cloud Computing, pages 12, October, 2018. DOI: 10.1145/3267809.3267836
|
|
Lincoln Bryant, Jeremy Van, Benedikt Riedel, Robert Gardner, Jose Caballero, John Hover, Ben Tovar, and Douglas Thain, VC3: A Virtual Cluster Service for Community Computation, PEARC: Practice and Experience in Advanced Research Computing, pages 1-8, July, 2018. DOI: 10.1145/3219104.3219125
|
|
Benjamin Tovar, Rafael Ferreira da Silva, Gideon Juve, Ewa Deelman, William Allcock, Douglas Thain, and Miron Livny, A Job Sizing Strategy for High-Throughput Scientific Workflows, IEEE Transactions on Parallel and Distributed Systems, 29(2), pages 240-253, February, 2018. DOI: 10.1109/TPDS.2017.2762310
|
|
Nicholas Hazekamp, Nathaniel Kremer-Herman, Benjamin Tovar, Haiyan Meng, Olivia Choudhury, Scott Emrich, and Douglas Thain, Combining Static and Dynamic Storage Management for Data Intensive Scientific Workflows, IEEE Transactions on Parallel and Distributed Systems, 29(2), pages 338-350, February, 2018. DOI: 10.1109/TPDS.2017.2764897
|
2017
|
Chao Zheng, Lukas Rupprecht, Vasily Tarasov, Mohamed Mohamed, Dimitrios Skourtis, Amit S. Warke, Dean Hildebrand, Douglas Thain, Poster: Wharf: Sharing Docker Images across Hosts from a Distributed Filesystem, IEEE International Conference for High Performance Computing, Networking, Storage and Analysis, November, 2017.
|
|
Daniel (Yue) Zhang, Charles (Chao) Zheng, Dong Wang, Doug Thain, Chao Huang, Xin Mu, Greg Madey, Towards Scalable and Dynamic Social Sensing Using A Distributed Computing Framework, The 37th IEEE International Conference on Distributed Computing Systems (ICDCS 2017), June, 2017. DOI: 10.1109/ICDCS.2017.196
|
2016
|
Haiyan Meng, Douglas Thain, Alexander Vyushkov, Matthias Wolf, and Anna Woodard, Conducting Reproducible Research with Umbrella: Tracking, Creating, and Preserving Execution Environments, IEEE Conference on e-Science, October, 2016. DOI: 10.1109/eScience.2016.7870889
|
|
Matthias Wolf, Anna Woodard, Wenzhao Li, Kenyi Hurtado Anampa, Yannakopoulos, Benjamin Tovar, Patrick Donnelly, Paul Brenner, Kevin Lannon, Mike Hildreth, and Douglas Thain, Opportunistic Computing with Lobster: Lessons Learned from Scaling up to 25K Non-Dedicated Cores, International Conference on Computing in High Energy Physics, October, 2016. DOI: 10.1088/1742-6596/898/5/052036
|
2015
|
Jakob Blomer, Predrag Buncic, Rene Meusel, Gerardo Ganis, Igor Sfiligoi and Douglas Thain, The Evolution of Global Scale Filesystems for Scientific Software Distribution, IEEE/AIP Computing in Science and Engineering, 17(6), pages 61-71, December, 2015. DOI: 10.1109/MCSE.2015.111
|
|
Anna Woodard, Matthias Wolf, Charles Mueller, Nil Valls, Ben Tovar, Patrick Donnelly, Peter Ivie, Kenyi Hurtado Anampa, Paul Brenner, Douglas Thain, Kevin Lannon and Michael Hildreth, Scaling Data Intensive Physics Applications to 10k Cores on Non-Dedicated Clusters with Lobster, IEEE Conference on Cluster Computing, September, 2015.
|
|
Gideon Juve, Benjamin Tovar, Rafael Ferreira da Silva, Dariusz Krol, Douglas Thain, Ewa Deelman, William Allcock, and Miron Livny, Practical Resource Monitoring for Robust High Throughput Computing, Workshop on Monitoring and Analysis for High Performance Computing Systems Plus Applications at IEEE Cluster Computing, September, 2015.
|
|
Matthew Staffelbach, Peter Sempolinski, Tracy Kijewski-Correa, Douglas Thain, Daniel Wei, Ahsan Kareem, Gregory Madey, Lessons Learned from Crowdsourcing Complex Engineering Tasks, PLOS One, 10(9), September, 2015. DOI: 10.1371/journal.pone.0134978
|
|
Haiyan Meng, Rupa Kommineni, Quan Pham, Robert Gardner, Tanu Malik and Douglas Thain, An Invariant Framework for Conducting Reproducible Computational Science, Journal of Computational Science, 9, pages 137-142, July, 2015. DOI: 10.1016/j.jocs.2015.04.012
|
|
Anna Woodard, Matthias Wolf, Charles Nicholas Mueller, Ben Tovar, Patrick Donnelly, Kenyi Hurtado Anampa, Paul Brenner, Kevin Lannon, and Michael Hildreth, Exploiting Volatile Opportunistic Computing Resources with Lobster, Computing in High Energy Physics, January, 2015.
|
2014
|
Badi Abdul-Wahid, Haoyun Feng, Dinesh Rajan, Ronan Costaouec, Eric Darve, Douglas Thain, and Jesus A. Izaguirre, AWE-WQ: Fast-Forwarding Molecular Dynamics using the Accelerated Weighted Ensemble, Journal of Chemical Information and Modeling, 54(10), pages 3033-3043, September, 2014. DOI: 10.1021/ci500321g
|
|
Andrew Thrasher, Zachary Musgrave, Brian Kachmark, Douglas Thain, and Scott Emrich, Scaling Up Genome Annotation with MAKER and Work Queue, International Journal of Bioinformatics Research and Applications, 10(4-5), pages 447-460, June, 2014. DOI: 10.1504/IJBRA.2014.062994
|
|
Dillon Skeehan, Paul Brenner, Ben Tovar, Douglas Thain, Nil Valls, Anna Woodard, Matthew Wolf, Tessa Pearson, Sean Lynch, and Kevin Lannon, Opportunistic High Energy Physics Computing in User Space with Parrot, IEEE Symposium on Cluster, Cloud, and Grid Computing (CCGrid), pages 170-175, May, 2014. DOI: 10.1109/CCGrid.2014.34
|
|
Matthew Staffelbach, Peter Sempolinski, David Hachen, Ahsan Kareem, Tracy Kijewski-Correa, Douglas Thain, Daniel Wei and Gregory Madey, Lessons Learned from an Experiment in Crowdsourcing Complex Citizen Engineering Tasks with Amazon Mechanical Turk, Collective Intelligence, April, 2014.
|
|
Nicholas Hazekamp, Olivia Choudhury, Sandra Gesing, Scott Emrich, and Douglas Thain, Poster: Expanding Tasks of Logical Workflows into Independent Workflows for Improved Scalability, IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, pages 548-549, January, 2014. DOI: 10.1109/CCGrid.2014.84
|
2013
|
Rafael Ferreira da Silva, Gideon Juve, Ewa Deelman, Tristan Glatard, Frederic Desprez, Douglas Thain, Benjamin Tovar, and Miron Livny, Toward Fine Grained Online Task Chracteristics Estimation in Scientific Workflows, Workshop on Workflows in Support of Large Scale Science (WORKS), pages 58-67, November, 2013. DOI: 10.1145/2534248.2534254
|
|
Dinesh Rajan, Andrew Thrasher, Badi Abdul-Wahid, Jesus A Izaguirre, Scott Emrich, and Douglas Thain, Case Studies in Designing Elastic Applications, 13th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid), May, 2013. DOI: 0.1109/CCGrid.2013.46
|
|
Brenden Kokoszka, Patrick Donnelly, and Douglas Thain, Search Should be a System Call, University of Notre Dame, Computer Science and Engineering Department, Technical Report 2013-03, April, 2013.
|
2012
|
Christopher Moretti, Andrew Thrasher, Li Yu, Michael Olson, Scott Emrich, and Douglas Thain, A Framework for Scalable Genome Assembly on Clusters, Clouds, and Grids, IEEE Transactions on Parallel and Distributed Systems, 23(12), December, 2012. DOI: 10.1109/TPDS.2012.80
|
|
Badi Abdul-Wahid, Li Yu, Dinesh Rajan, Haoyun Feng, Eric Darve, Douglas Thain, Jesus A. Izaguirre, Folding Proteins at 500 ns/hour with Work Queue, 8th IEEE International Conference on eScience (eScience 2012), October, 2012. DOI: 10.1109/eScience.2012.6404429
|
|
Douglas Thain, Michael Albrecht, Hoang Bui, Peter Bui, Rory Carmichael, Scott Emrich, and Patrick Flynn, Data Intensive Computing with Clustered Chirp Servers, Tevfik Kosar, Data Intensive Distributed Computing: Challenges and Solutions for Large Scale Information Management, pages 140-154, IGI, January, 2012. ISBN: 9781615209712
|
2011
|
Peter Bui, Dinesh Rajan, Badi Abdul-Wahid, Jesus Izaguirre, Douglas Thain, Work Queue + Python: A Framework For Scalable Scientific Ensemble Applications, Workshop on Python for High Performance and Scientific Computing (PyHPC) at the ACM/IEEE International Conference for High Performance Computing, Networking, Storage, and Analysis (Supercomputing) , November, 2011.
|
|
Peter Bui, Li Yu, Andrew Thrasher, Rory Carmichael, Irena Lanc, Patrick Donnelly, Douglas Thain, Scripting distributed scientific workflows using Weaver, Concurrency and Computation: Practice and Experience, 24(15), November, 2011. DOI: 10.1002/cpe.1871
|
2010
|
Andrew Thrasher, Rory Carmichael, Peter Bui, Li Yu, Douglas Thain, and Scott Emrich, Taming Complex Bioinformatics Workflows with Weaver, Makeflow, and Starch, Workshop on Workflows in Support of Large Scale Science, pages 1-6, November, 2010. DOI: 10.1109/WORKS.2010.5671858
|
|
Li Yu, Christopher Moretti, Andrew Thrasher, Scott Emrich, Kenneth Judd, and Douglas Thain, Harnessing Parallelism in Multicore Clusters with the All-Pairs, Wavefront, and Makeflow Abstractions, Journal of Cluster Computing, 13(3), pages 243-256, September, 2010. DOI: 10.1007/s10586-010-0134-7
|
|
Christopher Moretti, Hoang Bui, Karen Hollingsworth, Brandon Rich, Patrick Flynn, and Douglas Thain, All-Pairs: An Abstraction for Data Intensive Computing on Campus Grids, IEEE Transactions on Parallel and Distributed Systems, 21(1), pages 33-46, January, 2010. DOI: 10.1109/TPDS.2009.49
|
2009
|
Ioan Raicu, Ian Foster, Yong Zhao, Alex Szalay, Philip Little, Christopher Moretti, Amitabh Chaudhary, and Douglas Thain, Towards Data Intensive Many Task Computing, Tevfik Kosar, Data Intensive Distributed Computing: Challenges and Solutions for Large-Scale Information Management, IGI, 2009.
|
|
T. Kosar, A. Hutanu, J. McLaren and D. Thain, Coordination of Access to Large-scale Datasets in Distributed Environments, A. Shoshani and D. Rotem, Scientific Data Management: Challenges, Existing Technology, and Deployment, Chapman and Hall / CRC Press, August, 2009. ISBN: 978-1420069808
|
|
Hoang Bui, Michael Kelly, Christopher Lyon, Mark Pasquier, Deborah Thomas, Patrick Flynn, and Douglas Thain, Experience with BXGrid: A Data Repository and Computing Grid for Biometrics Research, Journal of Cluster Computing, 12(4), pages 373, April, 2009. DOI: 10.1007/s10586-009-0098-7
|
2008
|
Hoang Bui, Deborah Thomas, Michael Kelly, Christopher Lyon, Douglas Thain, and Patrick J. Flynn, Poster: BXGrid: A Data Repository and Workflow Abstraction for Biometrics Research, IEEE International Conference on e-Science, pages 394-395, December, 2008. DOI: 10.1109/eScience.2008.135
|
|
Paul Brenner, Justin Wozniak, Douglas Thain Aaron Striegel, Jeffrey Peng, and Jesus Izaguirre, Biomolecular Committor Probability Calculation Enabled by Processing in Network Storage, Journal of Parallel Computing, 34(11), pages 652-660, November, 2008. DOI: 10.1016/j.parco.2008.08.001
|
|
Justin Wozniak, Paul Brenner, Douglas Thain, Aaron Striegel, and Jesus Izaguirre, Making the Best of a Bad Situation: Prioritized Storage Management in GEMS, Future Generation Computing Systems, 24(1), pages 10-16, January, 2008. DOI: 10.1016/j.future.2007.04.003
|
2007
|
Jeffrey Hemmes, Douglas Thain, Christian Poellabauer, Christopher Moretti, Phil Snowberger, and Brendan McNutt, Lessons Learned Building TeamTrak: An Urban/Outdoor Mobile Testbed, International Conference on Wireless Architectures Systems and Applications, pages 219-224, October, 2007. DOI: 10.1109/WASA.2007.35
|
|
Paul Brenner, Justin Wozniak, Douglas Thain, Aaron Striegel, Jeffrey Peng, and Jesus Izaguirre, Biomolecular Path Sampling Enabled by Processing in Network Storage, Workshop on High Performance Computational Biology at IEEE IPDPS, pages 1-6, April, 2007. DOI: 10.1109/IPDPS.2007.370446
|
2006
|
Sander Klous, Jamie Frey, Se-Chang Son, Douglas Thain, Alain Roy, Miron Livny, and Jo van den Brand, Transparent Access to Grid Resources for User Software, Concurrency and Computation: Practice and Experience, 18(7), pages 787-801, June, 2006. DOI: 10.1002/cpe.961
|
|
Stefano Belforte, Matthew Normal, Subir Sarkar, Ifor Sfiligoi, Douglas Thain, Frank Wuerthwein, Using Condor Glide-Ins and Parrot to Move from Dedicated Resources to the Grid, Lecture Notes in Informatics, 81, pages 285-292, March, 2006.
|
2005
|
Douglas Thain, Sander Klous, Justin Wozniak, Paul Brenner, Aaron Striegel, and Jesus Izaguirre, Separating Abstractions from Resources in a Tactical Storage System, IEEE/ACM Supercomputing, pages 55-67, November, 2005. DOI: 10.1109/SC.2005.64
|
2004
2003
|
Douglas Thain, Todd Tannenbaum, and Miron Livny, Condor and the Grid, Fran Berman and Anthony Hey and Geoffrey Fox, Grid Computing: Making the Global Infrastructure a Reality, John Wiley, 2003. ISBN: 0-470-85319-0
|
2002
2001
2000
|