Hello OpenMRS Community,
Exciting news! The MambaETL core Release v1.0.0 is now out . A big thanks to all the contributors: Derrick Baluku (UgandaEMR) and the UCSF team (Laureen Omare, Amoso Laboso, Arthur D. Mugume, Eudson Bambo) for their invaluable input.
What is MambaETL? MambaETL (or Mamba) is designed as an OpenMRS implementation to streamline data Extraction, Loading, and Transforming (ETL) into a denormalized format, addressing the challenge of OpenMRS’s long-format storage that results in the Obs table rapidly amassing millions of records per encounter, thereby impeding efficient data retrieval and analysis in medium-sized facilities.
Highlights of Release v1.0.0
- Automated Flattening of obs/encounter data: Flatten obs/encounter data for a more accessible wide data format, simplifying reporting tasks.
- Automated Flattening of Obs Groups: Extends automated flattening to obs groups for improved reporting.
- Separate Reporting Data: Configure whether reporting data is stored in the same schema as OpenMRS transactional data or a separate schema.
- MambaETL Reporting API: Introducing an extra channel to fetch MambaETL reports from the reporting schema via a configurable endpoint.
- Database Compatibility: Extensively tested on MySQL v5.7 and above, MariaDB, supporting only SQL-compliant reporting queries.
- Fast Build with Template Module: A provided template/reference module allows you to set up your reporting module or add MambaETL support to your existing infrastructure, in under 15 minutes.
- Deployment Through Liquibase: Run a single Maven command (mvn clean install), and Mamba prepares an SQL-compliant build script containing all reporting data ready for deployment on your target reporting schema.
- Improved Performance: Significant focus on performance improvement, showcasing faster ETL times on large datasets (up to 11 million obs).
How Can You Contribute?
As we finalize steps to transition this work to OpenMRS community repositories, we invite you, especially those passionate about reporting and ETL, to participate in testing.
Check out the quick start reference module on GitHub
Explore detailed instructions for implementers in the readme file and dive into the comprehensive MambaETL Documentation.
Let’s discuss and revolutionize OpenMRS reporting together! #MambaETL openmrs #DataOptimization
cc: @eudson @gomare @dbaluku @amugume @grace @mwaririm @wamz @OHRI @METS @UCSF