data is corrupted after adding vector index with encryption-at-rest enabled

[JaySon-Huang]

Bug Report

Please answer these questions before submitting your issue. Thanks!

1. Minimal reproduce step (Required)

1. deploy a cluster with encryption-at-rest enabled tiflash instance
2. load data with vector data
3. create vector index

ref #9032

2. What did you expect to see? (Required)

vector index created successfully

3. What did you see instead (Required)

[2024/10/10 09:55:00.299 +08:00] [ERROR] [SegmentReader.cpp:92] ["ErrMsg: frame length (header = 16, body = 13950026005578937309, read = 650790) mismatch for /DATA/disk2/jaysonhuang/clusters/tiflash-5040/data/data/t_149/stable/dmf_119/1.dat: (while reading from DTFile: /DATA/disk2/jaysonhuang/clusters/tiflash-5040/data/data/t_149/stable/dmf_119, column: 1:id) StackTrace \n  0x55eef5e53113\tStackTrace::StackTrace() [tiflash+34812179]\n                \tdbms/src/Common/StackTrace.cpp:23\n  0x55eef5e7a90b\tDB::TiFlashException::TiFlashException(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, DB::TiFlashError const&) [tiflash+34973963]\n                \tdbms/src/Common/Exception.h:46\n  0x55eefb67ec00\tDB::FramedChecksumReadBuffer<DB::Digest::XXH3>::doSeek(long, int) [tiflash+127265792]\n                \tdbms/src/IO/Checksum/ChecksumBuffer.h:464\n  0x55eefb68931e\tDB::CompressedReadBufferFromFileImpl<false>::seek(unsigned long, unsigned long) [tiflash+127308574]\n                \tdbms/src/IO/Compression/CompressedReadBufferFromFile.cpp:68\n  0x55eefb3d879d\tstd::__1::__function::__func<DB::DM::DMFileReader::readFromDisk(DB::DM::ColumnDefine const&, COWPtr<DB::IColumn>::mutable_ptr<DB::IColumn>&, unsigned long, unsigned long)::$_0, std::__1::allocator<DB::DM::DMFileReader::readFromDisk(DB::DM::ColumnDefine const&, COWPtr<DB::IColumn>::mutable_ptr<DB::IColumn>&, unsigned long, unsigned long)::$_0>, DB::ReadBuffer* (std::__1::vector<DB::IDataType::Substream, std::__1::allocator<DB::IDataType::Substream>> const&)>::operator()(std::__1::vector<DB::IDataType::Substream, std::__1::allocator<DB::IDataType::Substream>> const&) [tiflash+124487581]\n                \tdbms/src/Storages/DeltaMerge/File/DMFileReader.cpp:615\n  0x55eef602c2ca\tDB::IDataType::deserializeBinaryBulkWithMultipleStreams(DB::IColumn&, std::__1::function<DB::ReadBuffer* (std::__1::vector<DB::IDataType::Substream, std::__1::allocator<DB::IDataType::Substream>> const&)> const&, unsigned long, double, bool, std::__1::vector<DB::IDataType::Substream, std::__1::allocator<DB::IDataType::Substream>>&) const [tiflash+36750026]\n                \t/DATA/disk1/ra_common/tiflash-env-17/sysroot/bin/../include/c++/v1/__functional/function.h:517\n  0x55eefb3d7dee\tDB::DM::DMFileReader::readFromDisk(DB::DM::ColumnDefine const&, COWPtr<DB::IColumn>::mutable_ptr<DB::IColumn>&, unsigned long, unsigned long) [tiflash+124485102]\n                \tdbms/src/DataTypes/IDataType.h:178\n  0x55eefb3d7b41\tDB::DM::DMFileReader::readFromDiskOrSharingCache(DB::DM::ColumnDefine const&, COWPtr<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, unsigned long, unsigned long) [tiflash+124484417]\n                \tdbms/src/Storages/DeltaMerge/File/DMFileReader.cpp:652\n  0x55eefb3d72bb\tDB::DM::DMFileReader::readColumn(DB::DM::ColumnDefine const&, unsigned long, unsigned long, unsigned long) [tiflash+124482235]\n                \tdbms/src/Storages/DeltaMerge/File/DMFileReader.cpp:543\n  0x55eefb3d64e0\tDB::DM::DMFileReader::read() [tiflash+124478688]\n                \tdbms/src/Storages/DeltaMerge/File/DMFileReader.cpp:390\n  0x55eefb376375\tDB::DM::DMFileBlockInputStream::read() [tiflash+124085109]\n                \tdbms/src/Storages/DeltaMerge/File/DMFileBlockInputStream.h:65\n  0x55eef5f6958f\tDB::IBlockInputStream::read(DB::PODArray<unsigned char, 4096ul, Allocator<false>, 15ul, 16ul>*&, bool) [tiflash+35952015]\n                \tdbms/src/DataStreams/IBlockInputStream.h:80\n  0x55eefb31bf93\tDB::DM::ConcatSkippableBlockInputStream<false>::read(DB::PODArray<unsigned char, 4096ul, Allocator<false>, 15ul, 16ul>*&, bool) [tiflash+123715475]\n                \tdbms/src/Storages/DeltaMerge/SkippableBlockInputStream.cpp:131\n  0x55eefb2d75f1\tDB::DM::readBlockWithReturnFilter(std::__1::shared_ptr<DB::DM::SkippableBlockInputStream>&, std::__1::shared_ptr<DB::DM::SkippableBlockInputStream>&, DB::PODArray<unsigned char, 4096ul, Allocator<false>, 15ul, 16ul>*&) [tiflash+123434481]\n                \tdbms/src/Storages/DeltaMerge/ReadUtil.cpp:64\n  0x55eefb334644\tDB::DM::BitmapFilterBlockInputStream::readImpl(DB::PODArray<unsigned char, 4096ul, Allocator<false>, 15ul, 16ul>*&) [tiflash+123815492]\n                \tdbms/src/Storages/DeltaMerge/BitmapFilter/BitmapFilterBlockInputStream.cpp:66\n  0x55eefb334328\tDB::DM::BitmapFilterBlockInputStream::read(DB::PODArray<unsigned char, 4096ul, Allocator<false>, 15ul, 16ul>*&, bool) [tiflash+123814696]\n                \tdbms/src/Storages/DeltaMerge/BitmapFilter/BitmapFilterBlockInputStream.cpp:46\n  0x55eefb334cd5\tDB::DM::BitmapFilterBlockInputStream::read() [tiflash+123817173]\n                \tdbms/src/Storages/DeltaMerge/BitmapFilter/BitmapFilterBlockInputStream.h:46\n  0x55eefb52dae5\tDB::AddExtraTableIDColumnInputStream::read() [tiflash+125885157]\n                \tdbms/src/DataStreams/AddExtraTableIDColumnInputStream.cpp:32\n  0x55eefb30f3c2\tDB::DM::SegmentReadTaskPool::readOneBlock(std::__1::shared_ptr<DB::IBlockInputStream>&, std::__1::shared_ptr<DB::DM::SegmentReadTask> const&) [tiflash+123663298]\n                \tdbms/src/Storages/DeltaMerge/SegmentReadTaskPool.cpp:239\n  0x55eefb498d16\tDB::DM::MergedTask::readOneBlock() [tiflash+125275414]\n                \tdbms/src/Storages/DeltaMerge/ReadThread/MergedTask.cpp:91\n  0x55eefb49e3cd\tDB::DM::SegmentReader::readSegments() [tiflash+125297613]\n                \tdbms/src/Storages/DeltaMerge/ReadThread/SegmentReader.cpp:67\n  0x55eefb49e268\tDB::DM::SegmentReader::run() [tiflash+125297256]\n                \tdbms/src/Storages/DeltaMerge/ReadThread/SegmentReader.cpp:122\n  0x55eefb49f712\tvoid* std::__1::__thread_proxy[abi:ue170006]<std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct>>, void (DB::DM::SegmentReader::*)(), DB::DM::SegmentReader*>>(void*) [tiflash+125302546]\n                \t/DATA/disk1/ra_common/tiflash-env-17/sysroot/bin/../include/c++/v1/__type_traits/invoke.h:308\n  0x7f908b931802\tstart_thread [libc.so.6+653314]\n  0x7f908b8d1450\tclone3 [libc.so.6+259152]"] [source="MPP<gather_id:1, query_ts:1728525300278929405, local_query_id:16, server_id:1620, start_ts:453122536303755265,task_id:1> table_id=149"] [thread_id=28]

4. What is your TiFlash version? (Required)

02784a4