Skip to content
This repository has been archived by the owner on Nov 2, 2022. It is now read-only.

postgres: pgtune configs for m5a/t3a types and pgbench testing on separate machine #29

Merged
merged 4 commits into from
Apr 30, 2022

Conversation

steve-chavez
Copy link
Member

Also move postgrest pgtune settings to config file

@steve-chavez
Copy link
Member Author

Used those configs to get the pgbench numbers on supabase/benchmarks#9 (comment)

Also move postgrest pgtune settings to config file
min_wal_size = "2GB";
};
"m5a.8xlarge" = {
max_connections = 300;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I've been using slightly hand-tuned numbers for the instances above, adapted from what we use in prod, rather than pgtune's default output. Notice that the max_conns is dropping down from 4xl here to 8xl

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I've modified these with bigger max_connections

Comment on lines +1 to +3
<!--pgrbench-all-pg-instances repeat 3 pgrbench-pgbench -c 100 > PGBENCH_RESULTS.md -->

Running on a m5a.large
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Uploaded the results obtained by this command:

pgrbench-all-pg-instances repeat 3 pgrbench-pgbench -c 100 > PGBENCH_RESULTS.md

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Contributor

@darora darora left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks a lot better :) There's a few more things I'd like to try here but I can do that as a follow-up at some point:

  • testing varying the number of connections being used
  • increasing the client size (typically, I'd want the machine driving the load to be at least as big as the target, to avoid any chance that we're bottlenecking on the client)

@steve-chavez
Copy link
Member Author

increasing the client size (typically, I'd want the machine driving the load to be at least as big as the target, to avoid any chance that we're bottlenecking on the client)

True. In fact this might already be happening because I'm now unable to get more TPS past m5a.8xlarge by increasing the number of clients.

Will follow up on this on a new PR.

@steve-chavez steve-chavez changed the title postgres: pgtune configs for missing m5a/t3a types postgres: pgtune configs for m5a/t3a types and pgbench testing on separate machine Apr 30, 2022
@steve-chavez steve-chavez merged commit bccb2c2 into supabase:master Apr 30, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants