Disaggregated arch failed to run on on KS3

[JaySon-Huang]

Bug Report

Please answer these questions before submitting your issue. Thanks!

1. Minimal reproduce step (Required)

https://docs.ksyun.com/products/25

• Deploy a disaggregated cluster on KS3
• Start tiflash

2. What did you expect to see? (Required)

tiflash starts without error

3. What did you see instead (Required)

tiflash fail to start

[2023/05/15 17:17:15.840 +08:00] [INFO] [PocoHTTPClient.cpp:312] ["URI=http://analytical-storage.ks3-cn-beijing-internal.ksyuncs.com?list-type=2&prefix=jayson%2Fj2%2Fs109%2Fmanifest%2F, Response status: 400, Bad Request"] [source=AWSClient] [thread_id=69]
[2023/05/15 17:17:15.840 +08:00] [WARN] [S3Common.cpp:147] ["tag=AWSErrorMarshaller message=Unable to generate a proper httpResponse from the response stream.   Response code: 400"] [source=AWSClient] [thread_id=69]
[2023/05/15 17:17:15.840 +08:00] [ERROR] [S3Common.cpp:147] ["tag=AWSXmlClient message=HTTP response code: 400\nResolved remote host IP address: 198.18.96.41:80\nRequest ID: \nException name: \nError message: \n5 response headers:\nconnection : close\ncontent-length : 578\ncontent-type : text/html\ndate : Mon, 15 May 2023 09:17:15 GMT\nserver : Tengine"] [source=AWSClient] [thread_id=69]
[2023/05/15 17:17:15.840 +08:00] [WARN] [S3Common.cpp:147] ["tag=AWSClient message=If the signature check failed. This could be because of a time skew. Attempting to adjust the signer."] [source=AWSClient] [thread_id=69]
[2023/05/15 17:17:15.840 +08:00] [ERROR] [Exception.cpp:90] ["Code: 11000, e.displayText() = DB::Exception: S3 ListObjectV2s failed, bucket=analytical-storage root=jayson/j2/ prefix=s109/manifest/ s3error=UNKNOWN s3msg= request_id=, e.what() = DB::Exception, Stack trace:\n\n\n       0x7ed5c78\tDB::Exception::Exception<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&>(int, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) [tiflash+132996216]\n                \tdbms/src/Common/Exception.h:53\n       0x7ec64ce\tDB::Exception DB::S3::fromS3Error<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&>(Aws::S3::S3Error const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) [tiflash+132932814]\n                \tdbms/src/Storages/S3/S3Common.h:52\n       0x7eceaca\tDB::S3::listPrefix(DB::S3::TiFlashS3Client const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::function<DB::S3::PageResult (Aws::S3::Model::Object const&)>) [tiflash+132967114]\n                \tdbms/src/Storages/S3/S3Common.cpp:833\n       0x7eaacee\tDB::S3::CheckpointManifestS3Set::getFromS3(DB::S3::TiFlashS3Client const&, unsigned long) [tiflash+132820206]\n                \tdbms/src/Storages/S3/CheckpointManifestS3Set.cpp:30\n       0x75fb006\tDB::PS::V3::S3LockLocalManager::initStoreInfo(unsigned long, std::__1::shared_ptr<DB::S3::IS3LockClient>, std::__1::unique_ptr<DB::PS::V3::PageDirectory<DB::PS::V3::universal::PageDirectoryTrait>, std::__1::default_delete<DB::PS::V3::PageDirectory<DB::PS::V3::universal::PageDirectoryTrait> > > const&) [tiflash+123711494]\n                \tdbms/src/Storages/Page/V3/Universal/S3LockLocalManager.cpp:66\n       0x75f4929\tDB::UniversalPageStorage::initLocksLocalManager(unsigned long, std::__1::shared_ptr<DB::S3::IS3LockClient>) [tiflash+123685161]\n                \tdbms/src/Storages/Page/V3/Universal/UniversalPageStorage.cpp:407\n       0x7745938\tstd::__1::__function::__func<DB::UniversalPageStorageService::create(DB::Context&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::shared_ptr<DB::PSDiskDelegator>, DB::PageStorageConfig const&)::$_3, std::__1::allocator<DB::UniversalPageStorageService::create(DB::Context&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::shared_ptr<DB::PSDiskDelegator>, DB::PageStorageConfig const&)::$_3>, bool ()>::operator()() [tiflash+125065528]\n                \t/usr/local/bin/../include/c++/v1/__functional/function.h:345\n       0x7e29deb\tvoid* std::__1::__thread_proxy<std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct> >, DB::BackgroundProcessingPool::BackgroundProcessingPool(int, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >)::$_1> >(void*) [tiflash+132292075]\n                \t/usr/local/bin/../include/c++/v1/thread:291\n  0x7ff9942e1802\tstart_thread [libc.so.6+653314]\n  0x7ff994281450\tclone3 [libc.so.6+259152]"] [source="void DB::BackgroundProcessingPool::threadFunction(size_t)"] [thread_id=69]

4. What is your TiFlash version? (Required)

master, release-7.1