Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Hang while testing Boost 1.69.0 on Fedora31 / x86_64 #248

Open
trex58 opened this issue Jan 16, 2020 · 4 comments
Open

Hang while testing Boost 1.69.0 on Fedora31 / x86_64 #248

trex58 opened this issue Jan 16, 2020 · 4 comments

Comments

@trex58
Copy link

trex58 commented Jan 16, 2020

Hi,

Using the official boost-1.69.0-9.fc31.spec.src.rpm and .spec file, just adding to the %check phase:
cd status
(../b2 %{?_smp_mflags} || true)
I've got a hang while testing.

I provide here-after some gdb information about what happened.

The x86_64 machine has 16GB Memory, 16GB swap, 16 cores.
The build & tests are done with -j4 .

Regards,
Hope it helps.

Tony Reix
Uploading BuildTest.txt…
Uploading Data.txt…
@trex58
Copy link
Author

trex58 commented Jan 16, 2020

This issue is reproducible on another Fedora/x86_64 machine, which has 48 CPUs and 384GB memory. Build/tests were done with -j48 .
The hang looks the same and at the same time during tests.

@raffienficiaud
Copy link
Member

Hi, the links to the log files are empty. Would you please check that? thanks!

@trex58
Copy link
Author

trex58 commented Jan 17, 2020

Ooops. Sorry. A file was too big. Here they are.

Data.txt
BuildTest.txt.gz

The hang appeared again on the 48 cores big machine (see below) with -j1.
However, on the 16 cores machine, with -j4, the tests ran till the end.

├─rpmbuild -ba boost-1.69.0-9.fc31.spec
│ └─sh -e /var/tmp/rpm-tmp.023ZuK
│ └─sh -e /var/tmp/rpm-tmp.023ZuK
│ └─b2 -j1
│ └─sh -c...
│ └─util_ipc_reliab
│ └─3*[{util_ipc_reliab}]

root 419717 419716 0 Jan16 ? 00:00:00 ../bin.v2/libs/log/test/util_ipc_reliable_mq.test/gcc-9.2.1/debug/threadapi-pthread/threading-multi/util_ipc_reliable_mq

(gdb) info thread
Id Target Id Frame

  • 1 Thread 0x7f6443cbd740 (LWP 419717) "util_ipc_reliab" 0x00007f6443ff8d45 in pthread_cond_wait@@GLIBC_2.3.2 () from /usr/lib64/libpthread.so.0
    2 Thread 0x7f6443cb9700 (LWP 419718) "util_ipc_reliab" 0x00007f6443ff8d45 in pthread_cond_wait@@GLIBC_2.3.2 () from /usr/lib64/libpthread.so.0
    3 Thread 0x7f64434b8700 (LWP 419719) "util_ipc_reliab" 0x00007f6443ff8d45 in pthread_cond_wait@@GLIBC_2.3.2 () from /usr/lib64/libpthread.so.0
    4 Thread 0x7f643acb7700 (LWP 419720) "util_ipc_reliab" 0x00007f6443ff8d45 in pthread_cond_wait@@GLIBC_2.3.2 () from /usr/lib64/libpthread.so.0

@trex58
Copy link
Author

trex58 commented Jan 17, 2020

I saw the same hang on Fedora/PPC64LE :

====== END OUTPUT ======
.........
...failed testing.capture-output ../bin.v2/libs/process/test/environment.test/gcc-9.2.1/debug/visibility-hidden/environment.run...
gcc.compile.c++ ../bin.v2/libs/process/test/async_pipe.test/gcc-9.2.1/debug/visibility-hidden/async_pipe.o
gcc.link ../bin.v2/libs/process/test/async_pipe.test/gcc-9.2.1/debug/visibility-hidden/async_pipe
testing.capture-output ../bin.v2/libs/process/test/async_pipe.test/gcc-9.2.1/debug/visibility-hidden/async_pipe.run

Details:

ps -edf | grep 2486735

root 2486735 1289775 0 déc.04 pts/7 00:01:56 ../b2
root 2594484 2486735 0 03:18 pts/7 00:00:00 /bin/sh -c LD_LIBRARY_PATH="/root/rpmbuild/BUILD/boost_1_69_0/bin.v2/libs/filesystem/build/gcc-9.2.1/debug/visibility-hidden:/root/rpmbuild/BUILD/boost_1_69_0/bin.v2/libs/system/build/gcc-9.2.1/debug/visibility-hidden:/usr/bin:/usr/lib:/usr/lib32:/usr/lib64:$LD_LIBRARY_PATH" export LD_LIBRARY_PATH status=0 if test $status -ne 0 ; then echo Skipping test execution due to testing.execute=off exit 0 fi "../bin.v2/libs/process/test/async_pipe.test/gcc-9.2.1/debug/visibility-hidden/async_pipe" > "../bin.v2/libs/process/test/async_pipe.test/gcc-9.2.1/debug/visibility-hidden/async_pipe.output" 2>&1 < /dev/null status=$? echo >> "../bin.v2/libs/process/test/async_pipe.test/gcc-9.2.1/debug/visibility-hidden/async_pipe.output" echo EXIT STATUS: $status >> "../bin.v2/libs/process/test/async_pipe.test/gcc-9.2.1/debug/visibility-hidden/async_pipe.output" if test $status -eq 0 ; then cp "../bin.v2/libs/process/test/async_pipe.test/gcc-9.2.1/debug/visibility-hidden/async_pipe.output" "../bin.v2/libs/process/test/async_pipe.test/gcc-9.2.1/debug/visibility-hidden/async_pipe.run" fi verbose=0 if test $status -ne 0 ; then verbose=1 fi if test $verbose -eq 1 ; then echo ====== BEGIN OUTPUT ====== cat "../bin.v2/libs/process/test/async_pipe.test/gcc-9.2.1/debug/visibility-hidden/async_pipe.output" echo ====== END OUTPUT ====== fi exit $status

ps -edf | grep 2594484

root 2594484 2486735 0 03:18 pts/7 00:00:00 /bin/sh -c LD_LIBRARY_PATH="/root/rpmbuild/BUILD/boost_1_69_0/bin.v2/libs/filesystem/build/gcc-9.2.1/debug/visibility-hidden:/root/rpmbuild/BUILD/boost_1_69_0/bin.v2/libs/system/build/gcc-9.2.1/debug/visibility-hidden:/usr/bin:/usr/lib:/usr/lib32:/usr/lib64:$LD_LIBRARY_PATH" export LD_LIBRARY_PATH status=0 if test $status -ne 0 ; then echo Skipping test execution due to testing.execute=off exit 0 fi "../bin.v2/libs/process/test/async_pipe.test/gcc-9.2.1/debug/visibility-hidden/async_pipe" > "../bin.v2/libs/process/test/async_pipe.test/gcc-9.2.1/debug/visibility-hidden/async_pipe.output" 2>&1 < /dev/null status=$? echo >> "../bin.v2/libs/process/test/async_pipe.test/gcc-9.2.1/debug/visibility-hidden/async_pipe.output" echo EXIT STATUS: $status >> "../bin.v2/libs/process/test/async_pipe.test/gcc-9.2.1/debug/visibility-hidden/async_pipe.output" if test $status -eq 0 ; then cp "../bin.v2/libs/process/test/async_pipe.test/gcc-9.2.1/debug/visibility-hidden/async_pipe.output" "../bin.v2/libs/process/test/async_pipe.test/gcc-9.2.1/debug/visibility-hidden/async_pipe.run" fi verbose=0 if test $status -ne 0 ; then verbose=1 fi if test $verbose -eq 1 ; then echo ====== BEGIN OUTPUT ====== cat "../bin.v2/libs/process/test/async_pipe.test/gcc-9.2.1/debug/visibility-hidden/async_pipe.output" echo ====== END OUTPUT ====== fi exit $status
root 2594485 2594484 0 03:18 pts/7 00:00:00 ../bin.v2/libs/process/test/async_pipe.test/gcc-9.2.1/debug/visibility-hidden/async_pipe

ps -edf | grep 2594485

root 2594485 2594484 0 03:18 pts/7 00:00:00 ../bin.v2/libs/process/test/async_pipe.test/gcc-9.2.1/debug/visibility-hidden/async_pipe
root 2603242 1289707 0 10:58 pts/0 00:00:00 grep --color=auto 2594485
[root@castordbe SPECS]# pstree 2486735
b2───sh───async_pipe───19*[{async_pipe}]

ps -edf | grep 2594485

root 2594485 2594484 0 03:18 pts/7 00:00:00 ../bin.v2/libs/process/test/async_pipe.test/gcc-9.2.1/debug/visibility-hidden/async_pipe
root 2603251 1289707 0 10:58 pts/0 00:00:00 grep --color=auto 2594485

cd $BUILD

cd boost_1_69_0/

ll ./bin.v2/libs/process/test/async_pipe.test/gcc-9.2.1/debug/visibility-hidden/async_pipe

-rwxr-xr-x 1 root root 7741720 5 déc. 03:18 ./bin.v2/libs/process/test/async_pipe.test/gcc-9.2.1/debug/visibility-hidden/async_pipe

file ./bin.v2/libs/process/test/async_pipe.test/gcc-9.2.1/debug/visibility-hidden/async_pipe

./bin.v2/libs/process/test/async_pipe.test/gcc-9.2.1/debug/visibility-hidden/async_pipe: ELF 64-bit LSB executable, 64-bit PowerPC or cisco 7500, version 1 (GNU/Linux), dynamically linked, interpreter /lib64/ld64.so.2, BuildID[sha1]=349899f6052dec92ad3db92a17ee7cd37d8ebb47, for GNU/Linux 3.10.0, with debug_info, not stripped

gdb ./bin.v2/libs/process/test/async_pipe.test/gcc-9.2.1/debug/visibility-hidden/async_pipe

GNU gdb (GDB) Fedora 8.3.50.20190824-25.fc31
Copyright (C) 2019 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later http://gnu.org/licenses/gpl.html
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
Type "show copying" and "show warranty" for details.
This GDB was configured as "ppc64le-redhat-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
http://www.gnu.org/software/gdb/bugs/.
Find the GDB manual and other documentation resources online at:
http://www.gnu.org/software/gdb/documentation/.

For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from ./bin.v2/libs/process/test/async_pipe.test/gcc-9.2.1/debug/visibility-hidden/async_pipe...
(gdb) attach 2594485
Attaching to program: /root/rpmbuild/BUILD/boost_1_69_0/bin.v2/libs/process/test/async_pipe.test/gcc-9.2.1/debug/visibility-hidden/async_pipe, process 2594485
[New LWP 2594487]
[New LWP 2594488]
[New LWP 2594489]
[New LWP 2594490]
[New LWP 2594491]
[New LWP 2594493]
[New LWP 2594495]
[New LWP 2594497]
[New LWP 2594500]
[New LWP 2594503]
[New LWP 2594506]
[New LWP 2594507]
[New LWP 2594508]
[New LWP 2594510]
[New LWP 2594511]
[New LWP 2594513]
[New LWP 2594514]
[New LWP 2594515]
[New LWP 2594517]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib64/libthread_db.so.1".
0x00007fff94bbb3c4 in __pthread_timedjoin_ex () from /usr/lib64/libpthread.so.0
Missing separate debuginfos, use: dnf debuginfo-install glibc-2.30-7.fc31.ppc64le libgcc-9.2.1-1.fc31.ppc64le libstdc++-9.2.1-1.fc31.ppc64le
(gdb) i thread
Id Target Id Frame

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@trex58 @raffienficiaud