Gsoc 2020: Expose System Metrics For Monitoring.

Community GSoC
1

Continuing the discussion from Exposing system metrics for monitoring OpenMRS servers:

2

Hi @judeniroshan @suthagar23

I would like to continue talk thread for this project since I saw that you guys will be my mentors for the project.

Btw I got some great input from @cintiadr @ibacher. From what they said I felt like it’s much broad scope for the project. Will it be possible to narrow down the scope by identifying which are the metrics that will be exposing outside through this project.

  1. Infrastructure based metrics
  2. Data analytics points (Ex :- No of users used the patient registration forms)
3

For the infrastructure/JVM, I’d just try and get what https://metrics.dropwizard.io/4.1.2/manual/servlets.html#manual-servlets offers by default. Ensure that show-jvm-metrics is true

I could see https://micrometer.io/docs/concepts#_supported_monitoring_systems as well, which could be useful later.

2 Likes
4

Hi @cintiadr @judeniroshan @suthagar23

I think it’s good to have a module that aggregates and exposes metric data.

For now it contains endpoints which exposes

  1. JVM based metrics collected from the openMRS core. With the help of metrics.dropwizard.io
  2. It should have support to micrometer plugin which has the capability to publish data to different monitoring systems based on the data structure monitoring systems required the data points to be (example dimensional and hierarchical)
  3. Creating an observer class that triggers for specific events that we required as data points in the end. (for an example how long it took for some one to register a patient) and exposes data when requested by an admin from an http call or when requested by the montoring platform
1 Like
5

Hi @cintiadr @judeniroshan @suthagar23

I thought of an architecture like this with an hibernate interceptor which sits in core since all queries will be going through core I think it’s the best place for it to be.

Account Handling classic (2)
Account Handling classic (2)1800×1800 266 KB

6

@ayesh If you’re going to be intercepting Hibernate events, it may be better handle that via the Event Module or even the Atom Feed Module rather than having to re-invent the wheel. Or maybe just break my suggestion of UI based reporting out from the main project of system monitoring data.

2 Likes
7

Hi @ibacher

I think that is a great idea.Btw this is the first time am hearing about event module @ibacher. Thanks alot for suggesting this way.

Btw I hope openmrs modules are subscribed as listners.

8

Hi @ibacher

I see the atom feed module is based on event module which basically an active_mq publisher. Which I think we can use in the new module we will be creating

I see the atom module already logs few of the main components data points what about we extend it to get the data points which we are looking for ?

9

That seems to me like it could be a reasonable solution. There are two things about it that makes me a little hesitant in fully endorsing the idea. One is that I’m not sure that Atom (the format or the feed technology) is the future. The other is that I’m not sure how widely deployed the Atom feed module is outside of Bahmni. Maybe the best immediate target is just something built on top of the Events module.

I’d love to hear insight from others in the community on this point, however.

10

Hi @ibacher

Agreed. And we can use atom feed as a starting point since it already has the functionality to extract data from events.

1 Like
11

Hi @ibacher

I see a PIH module which was not actively in development has a monitoring solution .

I can see it record java run time metrics. But there seems to be lot more in that module. Any idea about this module ?

I see @mseaton as a core developer in this module.

12

@ayesh thanks for noticing! :slight_smile: I’m happy to connect over this module. I am definitely interested in this project and would be interested to see this existing module evolve to meet these needs rather than starting from scratch. This was not a throw-away module, and did have some design put into it, but never took off, and I’d love to see it evolve to where it was useful. @ibacher also, please feel free to connect with me over Slack or we could set up a time to talk.

2 Likes
13

@ayesh Thanks for digging that out. I knew something like that existed but I wasn’t sure entirely where.

1 Like
14

@ibacher @mseaton

Agreed with you guys :smiley:

15

@mseaton yeah having a small session will be great to have an idea.

cc :- @ibacher @judeniroshan

16

That sounds good to me. We should engage @judeniroshan and @suthagar23 on such a session, however!

1 Like
17

@mseaton, Please let me know, if you would like to be one of the mentor for this project?

18

Hi All

I am not sure weather we have a doodle account for openmrs.

Btw I created a doodle to get an idea about when we can have a meeting

cc :- @mseaton @ibacher @cintiadr @suthagar23 @judeniroshan

19

Screen Shot 2020-03-26 at 9.53.41 pm

:smiley: I will pass this time! Probably it’s better for me to continue with the async comms.

20

Loool, that is too terrible for you!!! :smile: