event-counts slow and unresponsive

[withnale]

Is it just me or when puppetdb gets to a certain size the duration of the event-count requests goes crazy to about 30-50 seconds. At that point puppetboard becomes unusable. This is for a puppetdb managing many hundreds of nodes.

I notice from the puppetdb documentation that this api endpoint is experimental and 'subject to change' and also from tickets.puppetlabs.com it seems that this endpoint might disappear because another endpoint has been established for this sort of query.

Has anyone else seen this problem?

[daenney]

What's your node count?

[corey-hammerton]

What is your node count and have you updated to 0.0.5?

[corey-hammerton]

And can you include the query and other parameters you are using?

[corey-hammerton]

Closing issue due to lack of activity

[gdubicki]

If you are having the same problem as reported here then please check #430 . It helped me to speed up event-counts queries from 75-90s to < 0.08-0.8 s (!) (the 500 in the middle is Postgres restart after tuning its config):

127.0.0.1 - - [15/Jun/2019:11:34:29 +0000] "GET /pdb/query/v4/event-counts?query=%5B%22%3D%22%2C+%22latest_report%3F%22%2C+true%5D&summarize_by=certname HTTP/1.1" 200 104776 "-" "-" 74983
127.0.0.1 - - [15/Jun/2019:11:36:25 +0000] "GET /pdb/query/v4/event-counts?query=%5B%22%3D%22%2C+%22latest_report%3F%22%2C+true%5D&summarize_by=certname HTTP/1.1" 200 104776 "-" "-" 76961
127.0.0.1 - - [15/Jun/2019:11:38:19 +0000] "GET /pdb/query/v4/event-counts?query=%5B%22%3D%22%2C+%22latest_report%3F%22%2C+true%5D&summarize_by=certname HTTP/1.1" 200 104636 "-" "-" 75119
127.0.0.1 - - [15/Jun/2019:11:40:18 +0000] "GET /pdb/query/v4/event-counts?query=%5B%22%3D%22%2C+%22latest_report%3F%22%2C+true%5D&summarize_by=certname HTTP/1.1" 200 104636 "-" "-" 80166
127.0.0.1 - - [15/Jun/2019:11:42:17 +0000] "GET /pdb/query/v4/event-counts?query=%5B%22%3D%22%2C+%22latest_report%3F%22%2C+true%5D&summarize_by=certname HTTP/1.1" 200 104636 "-" "-" 79932
127.0.0.1 - - [15/Jun/2019:11:44:10 +0000] "GET /pdb/query/v4/event-counts?query=%5B%22%3D%22%2C+%22latest_report%3F%22%2C+true%5D&summarize_by=certname HTTP/1.1" 200 104636 "-" "-" 74907
127.0.0.1 - - [15/Jun/2019:11:46:05 +0000] "GET /pdb/query/v4/event-counts?query=%5B%22%3D%22%2C+%22latest_report%3F%22%2C+true%5D&summarize_by=certname HTTP/1.1" 200 104636 "-" "-" 75997
127.0.0.1 - - [15/Jun/2019:11:47:59 +0000] "GET /pdb/query/v4/event-counts?query=%5B%22%3D%22%2C+%22latest_report%3F%22%2C+true%5D&summarize_by=certname HTTP/1.1" 200 104636 "-" "-" 75476
127.0.0.1 - - [15/Jun/2019:11:49:08 +0000] "GET /pdb/query/v4/event-counts?query=%5B%22%3D%22%2C+%22latest_report%3F%22%2C+true%5D&summarize_by=certname HTTP/1.1" 500 0 "-" "-" 29569
127.0.0.1 - - [15/Jun/2019:11:56:30 +0000] "GET /pdb/query/v4/event-counts?query=%5B%22%3D%22%2C+%22latest_report%3F%22%2C+true%5D&summarize_by=certname HTTP/1.1" 200 104223 "-" "-" 70696
127.0.0.1 - - [15/Jun/2019:11:59:54 +0000] "GET /pdb/query/v4/event-counts?query=%5B%22%3D%22%2C+%22latest_report%3F%22%2C+true%5D&summarize_by=certname HTTP/1.1" 200 103958 "-" "-" 713
127.0.0.1 - - [15/Jun/2019:12:00:15 +0000] "GET /pdb/query/v4/event-counts?query=%5B%22%3D%22%2C+%22latest_report%3F%22%2C+true%5D&summarize_by=certname HTTP/1.1" 200 103958 "-" "-" 256
127.0.0.1 - - [15/Jun/2019:12:00:45 +0000] "GET /pdb/query/v4/event-counts?query=%5B%22%3D%22%2C+%22latest_report%3F%22%2C+true%5D&summarize_by=certname HTTP/1.1" 200 103958 "-" "-" 272
127.0.0.1 - - [15/Jun/2019:12:00:53 +0000] "GET /pdb/query/v4/event-counts?query=%5B%22%3D%22%2C+%22latest_report%3F%22%2C+true%5D&summarize_by=certname HTTP/1.1" 200 103958 "-" "-" 82
127.0.0.1 - - [15/Jun/2019:12:01:05 +0000] "GET /pdb/query/v4/event-counts?query=%5B%22%3D%22%2C+%22latest_report%3F%22%2C+true%5D&summarize_by=certname HTTP/1.1" 200 103958 "-" "-" 245
127.0.0.1 - - [15/Jun/2019:12:01:14 +0000] "GET /pdb/query/v4/event-counts?query=%5B%22%3D%22%2C+%22latest_report%3F%22%2C+true%5D&summarize_by=certname HTTP/1.1" 200 103958 "-" "-" 167