Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Running yb-admin and other tools produces a few lines of extra output #208

Closed
mbautin opened this issue Apr 23, 2018 · 3 comments
Closed
Assignees
Labels
area/docdb YugabyteDB core features kind/bug This issue is a bug priority/medium Medium priority issue

Comments

@mbautin
Copy link
Contributor

mbautin commented Apr 23, 2018

Jira Link: DB-1737
yb-admin outputs the following regardless of the command:

I0328 17:21:27.967152 15789 flags.cc:37] Auto setting FLAGS_yb_num_shards_per_tserver to 8
I0328 17:21:27.968122 15789 mem_tracker.cc:158] MemTracker: hard memory limit is 12.483986 GB
I0328 17:21:27.968154 15789 mem_tracker.cc:160] MemTracker: soft memory limit is 10.611388 GB
@mbautin mbautin self-assigned this Apr 23, 2018
@bmatican bmatican added the area/docdb YugabyteDB core features label Mar 3, 2022
@bmatican bmatican added good first issue This is a good issue to start contributing! help wanted We welcome your contributions for this issue! and removed help wanted We welcome your contributions for this issue! good first issue This is a good issue to start contributing! labels Mar 3, 2022
@yugabyte-ci yugabyte-ci added kind/bug This issue is a bug priority/medium Medium priority issue labels Jun 8, 2022
@bmatican
Copy link
Contributor

bmatican commented Jul 8, 2022

Also happens in PG logs on new connections.

I0705 13:17:49.294610 30967168 mem_tracker.cc:299] MemTracker: hard memory limit is 10.400000 GB
I0705 13:17:49.294703 30967168 mem_tracker.cc:301] MemTracker: soft memory limit is 8.840000 GB
I0705 13:17:49.295032 30967168 thread_pool.cc:170] Starting thread pool { name: pggate_ybclient queue_limit: 10000 max_workers: 1024 }

Since this comes from the root tracker, we could probably just default to not logging anything and just allow a one time logging in master & tserver.

@bmatican bmatican assigned joe-maley and unassigned mbautin Jul 8, 2022
@joe-maley joe-maley self-assigned this Jul 12, 2022
@joe-maley
Copy link
Contributor

  1. I realize this ticket is 4+ years old. The yb-admin tool no longer outputs the extra output by default. I am only able to reproduce the memory limit reporting by using the -minloglevel 1 flag.

  2. The memory limit reporting happens in the root tracker. As Bogdan suggested, we can avoid reporting the memory limits in the yb-admin and PG logs by only reporting these stats when the master and tserver classes are constructed.

  3. The Starting thread pool … log is just a standard log statement that is generated whenever a ThreadPool is constructed. We could do something like introducing a flag into the ThreadPoolOptions to control whether or not we print this log statement, but I suspect that this issue isn’t really bloating the code with such a rigid fix. What do you think @bmatican?

joe-maley pushed a commit that referenced this issue Jul 15, 2022
Summary:
Currently, the soft and hard memory limits are reported whenever the root memory tracker is
constructed. This patch removes that behavior. With this patch, the Master and TabletServer classes
now explicitly log the hard and soft memory limits during their construction.

Test Plan:
Manually verified the following:
1. The `yb-admin` no longer prints memory limits when using the `-minloglevel 1` flag.
2. The PG logs no longer print memory limits whenever a connection is established.
3. The master and tserver logs print the memory limits exactly as they did before, but in a slightly
different order.

Reviewers: asrivastava, amitanand, hsunder

Reviewed By: asrivastava, amitanand, hsunder

Subscribers: ybase, bogdan

Differential Revision: https://phabricator.dev.yugabyte.com/D18290
@joe-maley
Copy link
Contributor

Fixed by 0d6e495

jasonyb pushed a commit that referenced this issue Mar 18, 2024
Hierarchical Query identifys the leaves
devansh-ism pushed a commit to devansh-ism/yugabyte-db that referenced this issue Jul 17, 2024
Fix syntax error in the docs. Thanks to PeteDevoy for the patch.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/docdb YugabyteDB core features kind/bug This issue is a bug priority/medium Medium priority issue
Projects
None yet
Development

No branches or pull requests

4 participants