Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG)EELA...
Transcript of Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG)EELA...
![Page 1: Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG)EELA Grid School – December 04, 2006 Enhancing SegHidro/BRAMS.](https://reader033.fdocumentos.tips/reader033/viewer/2022051820/552fc0f9497959413d8b6771/html5/thumbnails/1.jpg)
Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG) EELA Grid School – December 04, 2006
Enhancing SegHidro/BRAMS experience through EELA
José Flávio M. V. Júnior
Paulo Ricardo M. Gomes
SegHidro
![Page 2: Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG)EELA Grid School – December 04, 2006 Enhancing SegHidro/BRAMS.](https://reader033.fdocumentos.tips/reader033/viewer/2022051820/552fc0f9497959413d8b6771/html5/thumbnails/2.jpg)
Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG) EELA Grid School – December 04, 2006
Introduction to SegHidro
• Segurança Hídrica
• Aims at improving water management
• Brazilian Northeast – Semi-Arid Region
• Provides a Grid Portal
• Helps researchers and decision-makers
• Better management of water resources
• Coupling of hydro-meteorological models
![Page 3: Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG)EELA Grid School – December 04, 2006 Enhancing SegHidro/BRAMS.](https://reader033.fdocumentos.tips/reader033/viewer/2022051820/552fc0f9497959413d8b6771/html5/thumbnails/3.jpg)
Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG) EELA Grid School – December 04, 2006
SegHidro Portal
• Web-based framework to run simulations
• Coupling of computational models
• Need for computational power
• OurGrid middleware– Open, Free-to-Join, Cooperative– Supports Bag-of-Tasks (BoT) applications
• Easy interface to use the grid
![Page 4: Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG)EELA Grid School – December 04, 2006 Enhancing SegHidro/BRAMS.](https://reader033.fdocumentos.tips/reader033/viewer/2022051820/552fc0f9497959413d8b6771/html5/thumbnails/4.jpg)
Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG) EELA Grid School – December 04, 2006
SegHidro Interface
• Products/Applications
![Page 5: Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG)EELA Grid School – December 04, 2006 Enhancing SegHidro/BRAMS.](https://reader033.fdocumentos.tips/reader033/viewer/2022051820/552fc0f9497959413d8b6771/html5/thumbnails/5.jpg)
Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG) EELA Grid School – December 04, 2006
Introduction to BRAMS
• Brazilian Regional Atmospheric Modeling System
• Numerical prediction model• Simulates atmospheric circulations on limited areas
• Based on RAMS
• Targets PC Clusters under Linux
• Open-Source
![Page 6: Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG)EELA Grid School – December 04, 2006 Enhancing SegHidro/BRAMS.](https://reader033.fdocumentos.tips/reader033/viewer/2022051820/552fc0f9497959413d8b6771/html5/thumbnails/6.jpg)
Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG) EELA Grid School – December 04, 2006
BRAMS – Compilation and Setup
• Based on C and Fortran 90• Compiling tests : Intel and GNU Compilers• Best option: Intel Compilers (free for non-
commercial use)
• Alternative: Portland Group Compilers
• Necessary libraries: HDF and MPI(mpich)
![Page 7: Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG)EELA Grid School – December 04, 2006 Enhancing SegHidro/BRAMS.](https://reader033.fdocumentos.tips/reader033/viewer/2022051820/552fc0f9497959413d8b6771/html5/thumbnails/7.jpg)
Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG) EELA Grid School – December 04, 2006
BRAMS – Execution
• Steps:– 1. Conversion into a format that BRAMS
understands (GRIB2DP)– 2. BRAMS MAKEVFILE MODE– 3. BRAMS INITIAL MODE
• MPI mode is evoked
– 4. Post-Processing (RAMSPOST50)– 5. Image generation (GrADS)
![Page 8: Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG)EELA Grid School – December 04, 2006 Enhancing SegHidro/BRAMS.](https://reader033.fdocumentos.tips/reader033/viewer/2022051820/552fc0f9497959413d8b6771/html5/thumbnails/8.jpg)
Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG) EELA Grid School – December 04, 2006
BRAMS – Execution
• Execution Diagram
![Page 9: Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG)EELA Grid School – December 04, 2006 Enhancing SegHidro/BRAMS.](https://reader033.fdocumentos.tips/reader033/viewer/2022051820/552fc0f9497959413d8b6771/html5/thumbnails/9.jpg)
Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG) EELA Grid School – December 04, 2006
SegHidro/BRAMS – Daily Production
• BRAMS Daily forecasting datasets
![Page 10: Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG)EELA Grid School – December 04, 2006 Enhancing SegHidro/BRAMS.](https://reader033.fdocumentos.tips/reader033/viewer/2022051820/552fc0f9497959413d8b6771/html5/thumbnails/10.jpg)
Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG) EELA Grid School – December 04, 2006
SegHidro/BRAMS – Daily Production
• 2 HP Clusters – 10 Nodes• Double Intel Xeon 2.4Ghz processors each node
• 6 Day Forecasting ~ 9 Hours
• 15 Day Forecasting ~ 23 Hours
• Output data is published on a server and in a data catalog that are used by the portal
![Page 11: Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG)EELA Grid School – December 04, 2006 Enhancing SegHidro/BRAMS.](https://reader033.fdocumentos.tips/reader033/viewer/2022051820/552fc0f9497959413d8b6771/html5/thumbnails/11.jpg)
Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG) EELA Grid School – December 04, 2006
SegHidro/BRAMS – Meteorologic Portlet
• Validation– Parameters– Data Availability
• Data automatically downloaded, everyday, and stored on a server shared via NFS by special grid nodes
• Simulation is sent to OurGrid via API• Job Description
– Selects appropriate machines– Decides which mode will BRAMS run:
Parallel(MPI) or Sequential(one processor)
![Page 12: Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG)EELA Grid School – December 04, 2006 Enhancing SegHidro/BRAMS.](https://reader033.fdocumentos.tips/reader033/viewer/2022051820/552fc0f9497959413d8b6771/html5/thumbnails/12.jpg)
Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG) EELA Grid School – December 04, 2006
SegHidro/EELA
• Current grid infrastructure: OurGrid– Resource availability– Great for independent tasks
• No direct support to tightly-coupled applications(MPI)• Meteorologic Portlet’s perfomance will depend on grid’s
cluster availability• Grid community formed mainly by desktop computers,
clusters generally busy running daily production• MPI support from EELA Grid Infrastructure
![Page 13: Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG)EELA Grid School – December 04, 2006 Enhancing SegHidro/BRAMS.](https://reader033.fdocumentos.tips/reader033/viewer/2022051820/552fc0f9497959413d8b6771/html5/thumbnails/13.jpg)
Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG) EELA Grid School – December 04, 2006
SegHidro/EELA
• Porting steps:– Get acquainted with EELA’s gLite middleware– Explore gLite’s components, in order to
optimize the run and make the new system compatible with the Portal architecture
– Finally, make SegHidro’s and gLite’s API communicate
![Page 14: Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG)EELA Grid School – December 04, 2006 Enhancing SegHidro/BRAMS.](https://reader033.fdocumentos.tips/reader033/viewer/2022051820/552fc0f9497959413d8b6771/html5/thumbnails/14.jpg)
Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG) EELA Grid School – December 04, 2006
Expectations
• Enhance SegHidro Portal performance
• SegHidro Team will acquire useful Grid knowledge
• Relationship narrowing between EELA and LSD, UFCG
![Page 15: Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG)EELA Grid School – December 04, 2006 Enhancing SegHidro/BRAMS.](https://reader033.fdocumentos.tips/reader033/viewer/2022051820/552fc0f9497959413d8b6771/html5/thumbnails/15.jpg)
Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG) EELA Grid School – December 04, 2006
Questions?
![Page 16: Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG)EELA Grid School – December 04, 2006 Enhancing SegHidro/BRAMS.](https://reader033.fdocumentos.tips/reader033/viewer/2022051820/552fc0f9497959413d8b6771/html5/thumbnails/16.jpg)
Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG) EELA Grid School – December 04, 2006
Thank you!
Merci!
Danke!
Grazie!
Gracias!
Obrigado!
SegHidro