Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DocDB] Fatal encountered in packed toggle off/on test in 2024.1.3.1-b4 #24825

Closed
1 task done
shamanthchandra-yb opened this issue Nov 7, 2024 · 2 comments
Closed
1 task done
Assignees
Labels
2024.1.3.1_blocker area/docdb YugabyteDB core features kind/bug This issue is a bug priority/high High Priority

Comments

@shamanthchandra-yb
Copy link

shamanthchandra-yb commented Nov 7, 2024

Jira Link: DB-13929

Description

During the regression run for RC 2024.1.3.1-b4 qualification, a corruption issue was observed in the packed toggle off/on test case.

Please find stress report in JIRA description.

F20241106 18:14:17 ../../src/yb/tablet/tablet.cc:1634] T e9e58e0e2ec948b2bdf59e02af850078 P 3bd5d50eb9424618acadbb859f604a61: Failed to write a batch with 0 operations into RocksDB: Corruption (yb/docdb/docdb_compaction_context.cc:403): Unable to pack old value for 213
    @     0x5615c4393c77  google::LogMessage::SendToLog()
    @     0x5615c4394bad  google::LogMessage::Flush()
    @     0x5615c43951f9  google::LogMessageFatal::~LogMessageFatal()
    @     0x5615c58365a3  yb::tablet::Tablet::WriteToRocksDB()
    @     0x5615c5831b85  yb::tablet::Tablet::ApplyIntents()
    @     0x5615c5832c22  yb::tablet::Tablet::ApplyIntents()
    @     0x5615c58f8e36  yb::tablet::TransactionParticipant::Impl::ProcessReplicated()
    @     0x5615c580fd5c  yb::tablet::UpdateTxnOperation::DoReplicated()
    @     0x5615c58034ae  yb::tablet::Operation::Replicated()
    @     0x5615c580585f  yb::tablet::OperationDriver::ReplicationFinished()
    @     0x5615c487a73b  yb::consensus::ConsensusRound::NotifyReplicationFinished()
    @     0x5615c48c958f  yb::consensus::ReplicaState::ApplyPendingOperationsUnlocked()
    @     0x5615c48c88f9  yb::consensus::ReplicaState::AdvanceCommittedOpIdUnlocked()
    @     0x5615c48a4500  yb::consensus::RaftConsensus::UpdateMajorityReplicated()
    @     0x5615c486e7e1  yb::rpc::StrandTaskWithErrorFunc<>::Run()
    @     0x5615c57640a9  yb::rpc::Strand::Done()
    @     0x5615c576dccb  yb::rpc::(anonymous namespace)::Worker::Execute()
    @     0x5615c5fab9e3  yb::Thread::SuperviseThread()
    @     0x7fcb9727d1ca  start_thread
    @     0x7fcb974cee73  __GI___clone

Issue Type

kind/bug

Warning: Please confirm that this issue does not contain any sensitive information

  • I confirm this issue does not contain any sensitive information.
@rthallamko3
Copy link
Contributor

rthallamko3 commented Nov 8, 2024

This is not a crash loop. The tserver recovered after the crash. Per @Huqicheng , This is a DUP of #24050

@rthallamko3 rthallamko3 removed the status/awaiting-triage Issue awaiting triage label Nov 8, 2024
@rthallamko3 rthallamko3 assigned Huqicheng and unassigned spolitov and rthallamko3 Nov 8, 2024
@yugabyte-ci yugabyte-ci reopened this Nov 8, 2024
@rthallamko3 rthallamko3 changed the title [DocDB] Corruption encountered in packed toggle off/on test in 2024.1.3.1-b4 [DocDB] Crash encountered in packed toggle off/on test in 2024.1.3.1-b4 Nov 12, 2024
@rthallamko3 rthallamko3 changed the title [DocDB] Crash encountered in packed toggle off/on test in 2024.1.3.1-b4 [DocDB] Fatal encountered in packed toggle off/on test in 2024.1.3.1-b4 Nov 12, 2024
@yugabyte-ci yugabyte-ci added priority/high High Priority and removed priority/highest Highest priority issue labels Nov 13, 2024
@rthallamko3
Copy link
Contributor

Backports tracked in #24050

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
2024.1.3.1_blocker area/docdb YugabyteDB core features kind/bug This issue is a bug priority/high High Priority
Projects
None yet
Development

No branches or pull requests

5 participants