Slides for the #OMRS15 Friday morning presentation:
Pros and cons of assessing distributions
The Friday presentation and the discussion at the end of the Bahmni session Friday late afternoon reminded me of some additional points on the pros and cons of evaluation distributions, whether for ācertificationā or "endorsement. These principles apply to endorsement of services providers as well, though I was not at that session, and am not sure exactly how that was discussed.
These issues are very relevant to the reference application and service provider disussions, so Iāll cross post a link to this talk topic there:
Ways in which distributions can be assessed:
Distributions can be assessed individually, taking into account their goals, unique features, trajectories and stated intents, etc. This may appear to be the most generous, inclusive type of assessment, but inherent in this is a huge amount of subjectivity. The results of such an assessment are easily subject to challenge. I believe this was the basis for the early CDC and WHO EMR assessment in Kenya.
Alternatively, distribution against a set of common criteria. This is āunfairā as the criteria cannot take into account individual strengths, but it does provide an āabove the lineā Measure of how well a distribution fit a common vision. The success of thisapproach lies in selecting criteria on which theere truly is consensus, such as security, deployability, active clinical use, and and on keeping those criteria fairly minimal and as objective as possible. This is the approach taken by the assessment which followed development of the Kenya Standards and Guidelines document, and the adoption of that document by the ministry.
Assessing distributions, through either method, can provide āguidepostsā to help implementers and usually an understanding some Basic attributes of different distribution. Obviously, the goal of this is to improve trust in distributions that assess well and support implementers in choosing the distribution that best fits their needs.
However, itās important to note that both types of assessments weaken the community of developers. Distribution switch feel unfairly judged by the more tailored assessment methods, or distributions that are ābelow the lineā in a more objective system, have a tremendous incentive to fork in order to preserve their self assessed value. This is what played out in Kenya ā the EMRs that felt unfairly judged by the first to assessments manage to block any use of those assessments and move the country forward. The standards and guidelines approach in Kenya managed to identify for EMRās which could go forward on a national level, but the other already implemented EMRās in Kenya essentially disappeared, and those developers and organizations no longer contributed to improving public sector health information management.
The value of weakening the developer community (better software, more focus, etc.), may be worth the cost (fewer participants, more political resistance), or it may not be. Tough call.
General-Purpose and Special-Purpose distributions make sense. I donāt understand the benefit of calling out āSingle-Purpose Distributionsā as distributions rather than just referring to those as implementations (perhaps āpackaged implementationsā if the distinguishing them from non-packaged implementations has some purpose).
Bill, i agree with your assessment of the potential to weaken the developer community. What i donāt see in this evaluation, though, is the impact on clinical care and clinical outcomes. Perhaps that should be one of the primary factors that guide the decision? If that is the case, then i think the ācommon criteriaā may have more bearing ( assuming that the common criteria reflect best of practice clinical functionality to achieve better outcomes).
Our next phone call will be tomorrow:
- 17-Dec, 8:30am PST = 11:30am EST = 16:30 UTC.
- https://www.uberconference.com/openmrs