ParslFest 2023 - The Parsl Community Meeting (Oct 19-20)

The fifth ParslFest Community Meeting was held as a hybrid meeting on October 19-20, 2023. It started around noon on the 19th, with talks that day, and on the morning of the 20th. The afternoon of the 20th was an open hacking session for hands-on work, hacking, testing, bring-your-own-code, etc. The in-person component was held at the University of Chicago.

The meeting brought together researchers, developers, and cyberinfrastructure experts from around the world to discuss experiences using and developing Parsl and Globus Compute (formerly funcX) - a federated function-as-a-service platform related to Parsl.

Attended ParslFest? Please take a few moments to complete our post-event feedback survey.

Logistics

Contact us at parsl@googlegroups.com.

Agenda

Thursday, October 19, 12 pm - 5 pm CDT (17:00 - 22:00 UTC)

12:00 - 12:50 pm Lunch

12:50 pm - Welcome! - Kyle Chard, University of Chicago/Argonne National Laboratory.

1:10 pm - Session 1 (Chair: Ben Clifford)

• Alex Brace: Coupling Streaming AI and HPC Ensembles to achieve 100-1000x Faster Biomolecular Simulations - video, slides
• Abdullah Syed: Integrating Parsl and OpenAI into Phylogenetic Workflows - video
• Sander Vandenhaute: Psiflow: An All-in-One Companion for Your Born-Oppenheimer Adventures- video, slides
• Jianshu Liu: MoStream: Enabling Ml-Guided Molecular Simulations on Real-Time Stateful Stream Processing Systems - video, slides
• Zilinghan Li: APPFLx.Link: Providing Privacy-Preserving Cross-Silo Federated Learning as a Service - video, slides
• Paul Camacho: MaPPeRTrac: A Massively Parallel, Portable, and Reproducible Tractography Pipeline - video, slides
• Logan Ward: Parsl for Intelligent Workflows on Exascale HPC - video, slides
• Zhao Zhang: Diamond: Democratizing Large Neural Network Model Training for Science - video
• Jonathan Ozik and Valerie Hayot-Sasson: Developing Distributed High-performance Computing Capabilities of an Open Science Platform for Robust Epidemic Analysis - video, slides
• Benjamin Galewsky: Building Apptainer Containers Using a Globus Compute Task - video, slides

3:00 pm - Break

3:30 - Session 2 (Chair: Yadu Babuji)

• Dante Domizzi Sanchez Gallegos: Creating Services on the Edge-Fog-Cloud with Data Containers and Globus Compute - video, slides
• Christine Simpson: Nexus: IRI Computing at ALFC with Globus Flows - video
• Mousa AbuGhosh: Introducing Falcon as a Parsl Data Provider - video, slides
• Thanh Son Tran Phung: TaskVine and Parsl integration - video, slides
• Alex Brace: Serving Scientific Foundation Models on Leadership Computing Platforms - video, slides
• Aditya Dhakal: Spatial Sharing of GPU with Parsl - video, slides
• Stefan Gary: The architecture for running Parsl multi-site workflows on the Parallel Works platform - video, slides
• John Raicu: ParslDock: Accelerating Virtual Drug Screening with Parallelism and Machine Learning - video
• Ben Clifford: Code and Community - slides

5:00 pm - Closing

6:00 pm - Dinner and mini-golf at Puttery

Friday, October 20 14, 8:30 am - 1 pm CDT (13:30 - 18:00 UTC)

8:30 am - Breakfast

9:00 am - Session 3 (Chair: Daniel S. Katz)

• Josh Bryan: Where Globus Compute is Now and Where It's Headed, slides
• Reid Mello: Globus Compute: Running Tasks with globus_compute_sdk.Executor - video, slides
• Kevin Hunter Kesling: Globus Compute Multi-User Endpoint - slides, speaker notes, video
• Yifei Li: UniFaaS: Programming across Distributed Cyberinfrastructure with Federated Function Serving - video, slides
• Greg Pauloski: ProxyStore: a Data Fabric for Workflow Systems - video, slides
• Will Engler: Garden: Using Globus Compute for AI Inference - video, slides
• Matt Baughman: Automating FaaS-based Federated Learning - video, slides
• Ved Kommalapati: Globus Compute (funcX) Executor in Parsl - Exploring the Intersection - slides, video
• Douglas Friedel: Using Parsl and Globus Compute to Port Running Jobs Between HPC Resources - video

10:30 am - Break

11:00 am - Session 4 (Chair: Kevin Hunter Kesling)

• Yadu Babuji: MPI support in Parsl and Globus Compute, slides, video
• Christopher Harrop: Toward Diversified Workflows for Numerical Weather Prediction - video, slides
• Rohan Basu Roy: What to do when HPC FaaS problems stare in your face? - video, slides
• Pete Mendygral: A High-Performance Parsl Executor Based on Dragon - video, slides
• Wen Guan: Globus Compute integration with Harvester for PanDA jobs - video, slides
• Temidayo Adeluwa: Parsl for parallelized inference and modelling at scale - video
• Nathaniel Hudson: Hierarchical Federated Learning on Globus Compute using Flox - video
• Ben Clifford: 10000 to 1 (tasks per second) - How can some Parsl runs be so slow? - slides, video
• Jamison Kerney: Supercharging Scientific Serverless: Slashing Cold Start Times with Python UniKernel - slides, video
• Tyler Skluzacek: Parsl in Zambeze: rafting down your distributed science river - video
• Kyle Chard: Closing notes - video

12:40 - Lunch

13:30 - Office hours/hackathon

Prior ParslFest Meetings

Parsl community meetings have brought together hundreds of researchers, developers, and cyberinfrastructure experts for meetings that included presentations and discussions.

The ParslFest 2019 page includes the agenda and all presentations (slides) from ParslFest 2019.

The ParslFest 2020 page includes the agenda and all presentations (slides and videos) from ParslFest 2020.

The Parsl & funcXFest 2021 page includes the agenda and all presentations (slides and videos) from Parsl & funcXFest 2021.

The Parsl & funcXFest 2022 page includes the agenda and all presentations (slides and videos) from Parsl & funcXFest 2022.