Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: prevent spam logs #6312

Merged

Conversation

hansieodendaal
Copy link
Contributor

Description

Prevent spam logs from lmdb_db.rs when many inputs and outputs are present in the blockchain.

Motivation and Context

With many inputs and outputs in the blockchain the base node logs are filled up with logs fetching inputs and outputs. Important log messages go missing due to being rolled over when the file and size limits are reached.

The image below illustrates this, where 200MB log files are rolled over in less than 10 minutes.

image

How Has This Been Tested?

System-level stress testing.

What process can a PR reviewer use to test or verify this change?

Review code change.

Breaking Changes

  • None
  • Requires data directory on base node to be deleted
  • Requires hard fork
  • Other - Please specify

Prevent spam logs from lmdb_db.rs when many inputs and outputs are present in the blockchain.
@hansieodendaal hansieodendaal requested a review from a team as a code owner April 30, 2024 05:56
Copy link

Test Results (CI)

    3 files    120 suites   36m 16s ⏱️
1 277 tests 1 277 ✅ 0 💤 0 ❌
3 823 runs  3 823 ✅ 0 💤 0 ❌

Results for commit 1be5789.

@ghpbot-tari-project ghpbot-tari-project added P-acks_required Process - Requires more ACKs or utACKs P-reviews_required Process - Requires a review from a lead maintainer to be merged labels Apr 30, 2024
Copy link

Test Results (Integration tests)

 2 files  + 2  11 suites  +11   22m 38s ⏱️ + 22m 38s
33 tests +33  31 ✅ +31  0 💤 ±0  2 ❌ +2 
36 runs  +36  32 ✅ +32  0 💤 ±0  4 ❌ +4 

For more details on these failures, see this check.

Results for commit 1be5789. ± Comparison against base commit b7b0ea3.

@ghpbot-tari-project ghpbot-tari-project removed the P-reviews_required Process - Requires a review from a lead maintainer to be merged label Apr 30, 2024
@SWvheerden SWvheerden merged commit 3e4bb70 into tari-project:development Apr 30, 2024
14 of 16 checks passed
@hansieodendaal hansieodendaal deleted the ho_prevent_spam_logs branch May 6, 2024 05:25
@hansieodendaal hansieodendaal mentioned this pull request May 6, 2024
4 tasks
SWvheerden pushed a commit that referenced this pull request May 6, 2024
Description
---
Prevent spam logs from lmdb_db.rs when many inputs and outputs are
present in the blockchain - follow on to #6312.

Motivation and Context
---
More spam logs existed.

How Has This Been Tested?
---
System-level testing.

What process can a PR reviewer use to test or verify this change?
---
See code changes.

<!-- Checklist -->
<!-- 1. Is the title of your PR in the form that would make nice release
notes? The title, excluding the conventional commit
tag, will be included exactly as is in the CHANGELOG, so please think
about it carefully. -->


Breaking Changes
---

- [x] None
- [ ] Requires data directory on base node to be deleted
- [ ] Requires hard fork
- [ ] Other - Please specify

<!-- Does this include a breaking change? If so, include this line as a
footer -->
<!-- BREAKING CHANGE: Description what the user should do, e.g. delete a
database, resync the chain -->
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
P-acks_required Process - Requires more ACKs or utACKs
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants