out_of_range Exception when running velox_tpch_benchmark #8080

MuteBardTison · 2023-12-17T16:12:21Z

MuteBardTison
Dec 17, 2023

Hi all, I was trying to run the TPC-H benchmark but encountered this problem:

/home/tison/velox-qi/cmake-build-release/velox/benchmarks/tpch/velox_tpch_benchmark --data_path=/home/tison/velox-qi/data/tpch_files --run_query_verbose=1 --num_drivers=1
terminate called after throwing an instance of 'std::out_of_range'
  what():  _Map_base::at
*** Aborted at 1702829092 (Unix time, try 'date -d @1702829092') ***
*** Signal 6 (SIGABRT) (0x17a5) received by PID 6053 (pthread TID 0x7fec616f8d80) (linux TID 6053) (maybe from PID 6053, UID 0) (code: -6), stack trace: ***
/home/tison/velox-qi/cmake-build-release/velox/benchmarks/tpch/velox_tpch_benchmark(_ZN5folly10symbolizer17getStackTraceSafeEPmm+0x80)[0x55e1e09e22c9]
/home/tison/velox-qi/cmake-build-release/velox/benchmarks/tpch/velox_tpch_benchmark(_ZN5folly10symbolizer21SafeStackTracePrinter15printStackTraceEb+0x6a)[0x55e1e09e302a]
/home/tison/velox-qi/cmake-build-release/velox/benchmarks/tpch/velox_tpch_benchmark(+0x67d66d9)[0x55e1e09e06d9]
/home/tison/velox-qi/cmake-build-release/velox/benchmarks/tpch/velox_tpch_benchmark(+0x67d67ba)[0x55e1e09e07ba]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x1441f)[0x7fec63cb041f]
/lib/x86_64-linux-gnu/libc.so.6(gsignal+0xcb)[0x7fec636e800b]
/lib/x86_64-linux-gnu/libc.so.6(abort+0x12a)[0x7fec636c7858]
/lib/x86_64-linux-gnu/libstdc++.so.6(+0x9e8d0)[0x7fec63aa18d0]
/lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa37b)[0x7fec63aad37b]
/lib/x86_64-linux-gnu/libstdc++.so.6(_ZSt9terminatev+0x16)[0x7fec63aad3e6]
/lib/x86_64-linux-gnu/libstdc++.so.6(__cxa_throw+0x48)[0x7fec63aad698]
/home/tison/velox-qi/cmake-build-release/velox/benchmarks/tpch/velox_tpch_benchmark(__cxa_throw+0x15c)[0x55e1e09db36e]
/lib/x86_64-linux-gnu/libstdc++.so.6(_ZSt20__throw_out_of_rangePKc+0x40)[0x7fec63aa433b]
/home/tison/velox-qi/cmake-build-release/velox/benchmarks/tpch/velox_tpch_benchmark(_ZNKSt8__detail9_Map_baseINSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEESt4pairIKS6_N8facebook5velox4exec4test17TpchTableMetadataEESaISE_ENS_10_Select1stESt8equal_toIS6_ESt4hashIS6_ENS_18_Mod_range_hashingENS_20_Default_ranged_hashENS_20_Prime_rehash_policyENS_17_Hashtable_traitsILb1ELb0ELb1EEELb1EE2atERS8_+0x75)[0x55e1dc47cb05]
/home/tison/velox-qi/cmake-build-release/velox/benchmarks/tpch/velox_tpch_benchmark(_ZNK8facebook5velox4exec4test16TpchQueryBuilder10getRowTypeERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKSt6vectorIS9_SaIS9_EE+0x35)[0x55e1dc47ddf5]
/home/tison/velox-qi/cmake-build-release/velox/benchmarks/tpch/velox_tpch_benchmark(_ZNK8facebook5velox4exec4test16TpchQueryBuilder9getQ1PlanEv+0x568)[0x55e1dc450c78]
/home/tison/velox-qi/cmake-build-release/velox/benchmarks/tpch/velox_tpch_benchmark(_ZNK8facebook5velox4exec4test16TpchQueryBuilder12getQueryPlanEi+0x47)[0x55e1dc47a217]
/home/tison/velox-qi/cmake-build-release/velox/benchmarks/tpch/velox_tpch_benchmark(_ZN13TpchBenchmark7runMainERSoR8RunStats+0x75a)[0x55e1dc3af92a]
/home/tison/velox-qi/cmake-build-release/velox/benchmarks/tpch/velox_tpch_benchmark(_Z17tpchBenchmarkMainv+0x20d)[0x55e1dc3ac38d]
/home/tison/velox-qi/cmake-build-release/velox/benchmarks/tpch/velox_tpch_benchmark(main+0xf5)[0x55e1dc3921c5]
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf2)[0x7fec636c9082]
/home/tison/velox-qi/cmake-build-release/velox/benchmarks/tpch/velox_tpch_benchmark(_start+0x2d)[0x55e1dc3a40bd]
(safe mode, symbolizer not available)

Process finished with exit code 134 (interrupted by signal 6: SIGABRT)

My TPC-H data directory is like:

.
├── customer
│   └── customer.tbl
├── lineitem
│   └── lineitem.tbl
├── nation
│   └── nation.tbl
├── orders
│   └── orders.tbl
├── part
│   └── part.tbl
├── partsupp
│   └── partsupp.tbl
├── region
│   └── region.tbl
└── supplier
    └── supplier.tbl

8 directories, 8 files

scripts/info.sh:

Velox System Info v0.0.2
Commit: 79855ce40d5476a52421ed845298bd7ab520c063
CMake Version: 3.16.3
System: Linux-5.15.0-91-generic
Arch: x86_64
C++ Compiler: /usr/bin/c++
C++ Compiler Version: 9.4.0
C Compiler: /usr/bin/cc
C Compiler Version: 9.4.0
CMake Prefix Path: /usr/local;/usr;/;/usr;/usr/local;/usr/X11R6;/usr/pkg;/opt

Reproduced on another machine:

/home/qi/velox-qi/cmake-build-release/velox/benchmarks/tpch/velox_tpch_benchmark --data_path=/home/qi/velox-qi/data/tpch_files
terminate called after throwing an instance of 'std::out_of_range'
  what():  unordered_map::at
*** Aborted at 1702837032 (Unix time, try 'date -d @1702837032') ***
*** Signal 6 (SIGABRT) (0x40c0011ae21) received by PID 1158689 (pthread TID 0x7ffa8132e440) (linux TID 1158689) (maybe from PID 1158689, UID 1036) (code: -6), stack trace: ***
    @ 00000000065cd09f _ZN5folly10symbolizer12_GLOBAL__N_113signalHandlerEiP9siginfo_tPv
                       /home/qi/velox/folly/folly/experimental/symbolizer/SignalHandler.cpp:449
    @ 0000000000000000 (unknown)
    @ 000000000009998b pthread_kill
    @ 0000000000042855 raise
    @ 00000000000268b6 abort
    @ 0000000000000000 (unknown)
    @ 0000000000000000 (unknown)
    @ 00000000000b6ed6 _ZSt9terminatev
    @ 00000000000b7137 __cxa_throw
    @ 00000000065c9b80 __cxa_throw
                       /home/qi/velox/folly/folly/experimental/exception_tracer/ExceptionTracerLib.cpp:108
    @ 00000000000a8291 _ZSt20__throw_out_of_rangePKc
    @ 000000000201a4c7 _ZNKSt8__detail9_Map_baseINSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEESt4pairIKS6_N8facebook5velox4exec4test17TpchTableMetadataEESaISE_ENS_10_Select1stESt8equal_toIS6_ESt4hashIS6_ENS_18_Mod_range_hashingENS_20_Default_ranged_hashENS_20_Prime_rehash_policyENS_17_Hashtable_traitsILb1ELb0ELb1EEELb1EE2atERS8_
    @ 000000000201bce5 _ZNK8facebook5velox4exec4test16TpchQueryBuilder10getRowTypeERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKSt6vectorIS9_SaIS9_EE
    @ 0000000001ffc655 _ZNK8facebook5velox4exec4test16TpchQueryBuilder9getQ1PlanEv
    @ 00000000020182e4 _ZNK8facebook5velox4exec4test16TpchQueryBuilder12getQueryPlanEi
    @ 0000000001f55983 _ZNSt17_Function_handlerIFN5folly6detail12TimeIterDataEjEZNS0_12addBenchmarkIZNS0_12addBenchmarkINL22follyBenchmarkUnused11MUlvE_EEENSt9enable_ifIX14is_invocable_vIT_EEvE4typeEPKcNS0_5RangeISD_EEOS9_EUljE_EENS8_IX14is_invocable_vIS9_jEEvE4typeESD_SF_SG_EUljE_E9_M_invokeERKSt9_Any_dataOj
    @ 0000000006548876 _ZN5follyL29runBenchmarkGetNSPerIterationERKSt8functionIFNS_6detail12TimeIterDataEjEEd
                       /usr/include/c++/13/bits/std_function.h:591
                       -> /home/qi/velox/folly/folly/Benchmark.cpp
    @ 000000000654cddc _ZN5folly12_GLOBAL__N_124runBenchmarksWithPrinterEPNS0_23BenchmarkResultsPrinterE
                       /home/qi/velox/folly/folly/Benchmark.cpp:682
    @ 000000000654d99e _ZN5folly13runBenchmarksEv
                       /home/qi/velox/folly/folly/Benchmark.cpp:756
    @ 0000000001f57897 _Z17tpchBenchmarkMainv
    @ 0000000001f3db4b main
    @ 0000000000000000 (unknown)
    @ 0000000000028188 __libc_start_main
    @ 0000000001f4f0b4 _start

Process finished with exit code 134 (interrupted by signal 6: SIGABRT)

And its info.sh:

Velox System Info v0.0.2
Commit: 2f6154bf78569bd5d697ddeab019345f56be5f33
CMake Version: 3.22.0
System: Linux-6.5.0-10-generic
Arch: x86_64
C++ Compiler: /usr/bin/c++
C++ Compiler Version: 13.2.0
C Compiler: /usr/bin/cc
C Compiler Version: 13.2.0
CMake Prefix Path: /usr/local;/usr;/;/usr/local;/usr/local;/usr/X11R6;/usr/pkg;/opt

Any help please? Thanks in advance.

IronDumpling · 2024-07-19T15:24:35Z

IronDumpling
Jul 19, 2024

I met the same problem here, is there any solution?

0 replies

majetideepak · 2024-07-19T15:37:02Z

majetideepak
Jul 19, 2024
Collaborator

The problem is likely due to invalid parquet files/layout of the data.
We should improve velox_tpch_benchmark to throw an error in the above case instead of this exception.

8 replies

majetideepak Jul 19, 2024
Collaborator

Can you confirm there are Parquet files in each of those directories?

IronDumpling Jul 19, 2024

No, there is no Parquet files. Should I create them before running the test? I thought the Parquet files would be autoly created during the test

IronDumpling Jul 19, 2024

Okay So I have just created Parquet files manually. There is another error shown now:

E0719 18:43:59.651633 769723 Exceptions.h:67] Line: /data/charlie/velox-main/velox/common/file/FileSystems.cpp:61,
Function:getFileSystem, Expression: No registered file system matched with file path 'charlie_test/tpch/supplier/supplier.parquet',
Source: RUNTIME, ErrorCode: INVALID_STATE
terminate called after throwing an instance of 'facebook::velox::VeloxRuntimeError'
what(): Exception: VeloxRuntimeError
Error Source: RUNTIME
Error Code: INVALID_STATE
Reason: No registered file system matched with file path 'charlie_test/tpch/supplier/supplier.parquet'
Retriable: False
Function: getFileSystem
File: /data/charlie/velox-main/velox/common/file/FileSystems.cpp
Line: 61
Stack trace:
0 _ZN8facebook5velox7process10StackTraceC1Ei
1 ZN8facebook5velox14VeloxExceptionC1EPKcmS3_St17basic_string_viewIcSt11char_traitsIcEES7_S7_S7_bNS1_4TypeES7
2 ZN8facebook5velox6detail14veloxCheckFailINS0_17VeloxRuntimeErrorERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEEEEvRKNS1_18VeloxCheckFailArgsET0
3 _ZN8facebook5velox11filesystems13getFileSystemESt17basic_string_viewIcSt11char_traitsIcEESt10shared_ptrIKNS0_6ConfigEE
4 _ZN8facebook5velox4exec4test16TpchQueryBuilder14readFileSchemaERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEESB_RKSt6vectorIS9_SaIS9_EE
5 _ZN8facebook5velox4exec4test16TpchQueryBuilder10initializeERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE
6 _Z17tpchBenchmarkMainv
7 main
8 0x0000000000029d8f
9 __libc_start_main
10 _start

I think the key message here is:

Expression: No registered file system matched with file path 'charlie_test/tpch/supplier/supplier.parquet'
which is caused by: velox/common/file/FileSystems.cpp Line 61

Is there any other settings that I should do to register this file path in the file system?

majetideepak Jul 19, 2024
Collaborator

There is ParquetTpchTest that creates the files, but for the velox_tpch_benchmark benchmark, the user has to provide the files.

No registered file system matched with file path 'charlie_test/tpch/supplier/supplier.parquet'

Can you provide the absolute path to data_path?
./_build/release/velox/benchmarks/tpch/velox_tpch_benchmark --data_path /.../charlie_test/tpch/

IronDumpling Jul 19, 2024

The absolute path is /data/charlie/velox-main/charlie_test/tpch, where the /data/charlie is my home directory, and the /charlie_test/tpch is my data directory. The command I used was:

./_build/release/velox/benchmarks/tpch/velox_tpch_benchmark --data_path charlie_test/tpch

The directory I ran this was /data/charlie/velox-main.

Also, I have run the ParquetTpchTest before, but it creates temporary files, which would be erased after the test. Could that be changed to generate permanent files?

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

out_of_range Exception when running velox_tpch_benchmark #8080

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 2 comments 8 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

Select a reply

out_of_range Exception when running velox_tpch_benchmark #8080

MuteBardTison Dec 17, 2023

Replies: 2 comments · 8 replies

IronDumpling Jul 19, 2024

majetideepak Jul 19, 2024 Collaborator

majetideepak Jul 19, 2024 Collaborator

IronDumpling Jul 19, 2024

IronDumpling Jul 19, 2024

majetideepak Jul 19, 2024 Collaborator

IronDumpling Jul 19, 2024

MuteBardTison
Dec 17, 2023

Replies: 2 comments 8 replies

IronDumpling
Jul 19, 2024

majetideepak
Jul 19, 2024
Collaborator

majetideepak Jul 19, 2024
Collaborator

majetideepak Jul 19, 2024
Collaborator