Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ARROW-17246: [Packaging][deb][RPM] Don't use system jemalloc #13739

Merged
merged 3 commits into from
Jul 29, 2022

Conversation

kou
Copy link
Member

@kou kou commented Jul 29, 2022

Because system jemalloc can't be used with dlopen(). If system
jemalloc can't used with dlopen(), our shared libraried can't be
loaded as bindings of script languages such as Ruby:

+ ruby -r gi -e 'p GI.load('\''Arrow'\'')'
(null)-WARNING **: Failed to load shared library 'libarrow-glib.so.900' referenced by the typelib:
   /lib64/libjemalloc.so.2: cannot allocate memory in static TLS block

This is caused because system jemalloc isn't built with
--disable-initial-exec-tls.

See also:

Because system jemalloc can't be used with dlopen(). If system
jemalloc can't used with dlopen(), our shared libraried can't be
loaded as bindings of script languages such as Ruby:

    + ruby -r gi -e 'p GI.load('\''Arrow'\'')'
    (null)-WARNING **: Failed to load shared library 'libarrow-glib.so.900' referenced by the typelib: /lib64/libjemalloc.so.2: cannot allocate memory in static TLS block

This is caused because system jemalloc isn't built with
--disable-initial-exec-tls.

See also:

* https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=951704
* jemalloc/jemalloc#1237
@kou
Copy link
Member Author

kou commented Jul 29, 2022

@github-actions crossbow submit -g linux

@github-actions
Copy link

@github-actions
Copy link

⚠️ Ticket has not been started in JIRA, please click 'Start Progress'.

@github-actions
Copy link

Revision: ff986c0

Submitted crossbow builds: ursacomputing/crossbow @ actions-cd71a0d2d1

Task Status
almalinux-8-amd64 Github Actions
almalinux-8-arm64 TravisCI
almalinux-9-amd64 Github Actions
almalinux-9-arm64 TravisCI
amazon-linux-2-amd64 Github Actions
amazon-linux-2-arm64 TravisCI
centos-7-amd64 Github Actions
centos-8-stream-amd64 Github Actions
centos-8-stream-arm64 TravisCI
centos-9-stream-amd64 Github Actions
centos-9-stream-arm64 TravisCI
debian-bookworm-amd64 Github Actions
debian-bookworm-arm64 TravisCI
debian-bullseye-amd64 Github Actions
debian-bullseye-arm64 TravisCI
ubuntu-bionic-amd64 Github Actions
ubuntu-bionic-arm64 TravisCI
ubuntu-focal-amd64 Github Actions
ubuntu-focal-arm64 TravisCI
ubuntu-jammy-amd64 Github Actions
ubuntu-jammy-arm64 TravisCI

@kou
Copy link
Member Author

kou commented Jul 29, 2022

@github-actions crossbow submit -g linux

@github-actions
Copy link

Revision: e4660d5

Submitted crossbow builds: ursacomputing/crossbow @ actions-ca052f43ca

Task Status
almalinux-8-amd64 Github Actions
almalinux-8-arm64 TravisCI
almalinux-9-amd64 Github Actions
almalinux-9-arm64 TravisCI
amazon-linux-2-amd64 Github Actions
amazon-linux-2-arm64 TravisCI
centos-7-amd64 Github Actions
centos-8-stream-amd64 Github Actions
centos-8-stream-arm64 TravisCI
centos-9-stream-amd64 Github Actions
centos-9-stream-arm64 TravisCI
debian-bookworm-amd64 Github Actions
debian-bookworm-arm64 TravisCI
debian-bullseye-amd64 Github Actions
debian-bullseye-arm64 TravisCI
ubuntu-bionic-amd64 Github Actions
ubuntu-bionic-arm64 TravisCI
ubuntu-focal-amd64 Github Actions
ubuntu-focal-arm64 TravisCI
ubuntu-jammy-amd64 Github Actions
ubuntu-jammy-arm64 TravisCI

Copy link
Member

@kszucs kszucs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @kou!

@kszucs kszucs merged commit 036fdf2 into apache:master Jul 29, 2022
kszucs pushed a commit that referenced this pull request Jul 29, 2022
Because system jemalloc can't be used with dlopen(). If system
jemalloc can't used with dlopen(), our shared libraried can't be
loaded as bindings of script languages such as Ruby:

    + ruby -r gi -e 'p GI.load('\''Arrow'\'')'
    (null)-WARNING **: Failed to load shared library 'libarrow-glib.so.900' referenced by the typelib:
       /lib64/libjemalloc.so.2: cannot allocate memory in static TLS block

This is caused because system jemalloc isn't built with
--disable-initial-exec-tls.

See also:

* https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=951704
* jemalloc/jemalloc#1237

Authored-by: Sutou Kouhei <[email protected]>
Signed-off-by: Krisztián Szűcs <[email protected]>
@kou kou deleted the debian-jemalloc branch July 29, 2022 20:25
@ursabot
Copy link

ursabot commented Jul 29, 2022

Benchmark runs are scheduled for baseline = bb31c9a and contender = 036fdf2. 036fdf2 is a master commit associated with this PR. Results will be available as each benchmark for each run completes.
Conbench compare runs links:
[Failed ⬇️0.0% ⬆️0.0%] ec2-t3-xlarge-us-east-2
[Finished ⬇️0.27% ⬆️0.03%] test-mac-arm
[Finished ⬇️0.0% ⬆️0.0%] ursa-i9-9960x
[Finished ⬇️0.11% ⬆️0.0%] ursa-thinkcentre-m75q
Buildkite builds:
[Failed] 036fdf2d ec2-t3-xlarge-us-east-2
[Finished] 036fdf2d test-mac-arm
[Finished] 036fdf2d ursa-i9-9960x
[Finished] 036fdf2d ursa-thinkcentre-m75q
[Failed] bb31c9a2 ec2-t3-xlarge-us-east-2
[Finished] bb31c9a2 test-mac-arm
[Finished] bb31c9a2 ursa-i9-9960x
[Finished] bb31c9a2 ursa-thinkcentre-m75q
Supported benchmarks:
ec2-t3-xlarge-us-east-2: Supported benchmark langs: Python, R. Runs only benchmarks with cloud = True
test-mac-arm: Supported benchmark langs: C++, Python, R
ursa-i9-9960x: Supported benchmark langs: Python, R, JavaScript
ursa-thinkcentre-m75q: Supported benchmark langs: C++, Java

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants