Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ARROW-16717: [C++] Add support for system jemalloc #13373

Merged
merged 14 commits into from
Jun 16, 2022

Conversation

kou
Copy link
Member

@kou kou commented Jun 13, 2022

No description provided.

@kou
Copy link
Member Author

kou commented Jun 13, 2022

@github-actions crossbow submit -g linux -g conan

@github-actions
Copy link

@github-actions
Copy link

⚠️ Ticket has not been started in JIRA, please click 'Start Progress'.

@github-actions
Copy link

Revision: 2fc3e76

Submitted crossbow builds: ursacomputing/crossbow @ actions-38a5518b88

Task Status
almalinux-8-amd64 Github Actions
almalinux-8-arm64 TravisCI
almalinux-9-amd64 Github Actions
almalinux-9-arm64 TravisCI
amazon-linux-2-amd64 Github Actions
centos-7-amd64 Github Actions
centos-8-stream-amd64 Github Actions
centos-8-stream-arm64 TravisCI
conan-maximum Github Actions
conan-minimum Github Actions
debian-bookworm-amd64 Github Actions
debian-bookworm-arm64 TravisCI
debian-bullseye-amd64 Github Actions
debian-bullseye-arm64 TravisCI
debian-buster-amd64 Github Actions
debian-buster-arm64 TravisCI
ubuntu-bionic-amd64 Github Actions
ubuntu-bionic-arm64 TravisCI
ubuntu-focal-amd64 Github Actions
ubuntu-focal-arm64 TravisCI
ubuntu-impish-amd64 Github Actions
ubuntu-impish-arm64 TravisCI
ubuntu-jammy-amd64 Github Actions
ubuntu-jammy-arm64 TravisCI

@kou
Copy link
Member Author

kou commented Jun 13, 2022

@github-actions crossbow submit -g linux

@github-actions
Copy link

Revision: c69a11e

Submitted crossbow builds: ursacomputing/crossbow @ actions-1431928845

Task Status
almalinux-8-amd64 Github Actions
almalinux-8-arm64 TravisCI
almalinux-9-amd64 Github Actions
almalinux-9-arm64 TravisCI
amazon-linux-2-amd64 Github Actions
centos-7-amd64 Github Actions
centos-8-stream-amd64 Github Actions
centos-8-stream-arm64 TravisCI
debian-bookworm-amd64 Github Actions
debian-bookworm-arm64 TravisCI
debian-bullseye-amd64 Github Actions
debian-bullseye-arm64 TravisCI
debian-buster-amd64 Github Actions
debian-buster-arm64 TravisCI
ubuntu-bionic-amd64 Github Actions
ubuntu-bionic-arm64 TravisCI
ubuntu-focal-amd64 Github Actions
ubuntu-focal-arm64 TravisCI
ubuntu-impish-amd64 Github Actions
ubuntu-impish-arm64 TravisCI
ubuntu-jammy-amd64 Github Actions
ubuntu-jammy-arm64 TravisCI

@kou
Copy link
Member Author

kou commented Jun 13, 2022

almalinux-*-arm64 and centos-*-arm64 failures aren't related. They should be fixed by #13371.

@kou kou force-pushed the cpp-system-jemalloc branch from c69a11e to e35996d Compare June 14, 2022 23:13
@kou
Copy link
Member Author

kou commented Jun 14, 2022

@github-actions crossbow submit -g linux

@github-actions
Copy link

Revision: e35996d

Submitted crossbow builds: ursacomputing/crossbow @ actions-c078080dc9

Task Status
almalinux-8-amd64 Github Actions
almalinux-8-arm64 TravisCI
almalinux-9-amd64 Github Actions
almalinux-9-arm64 TravisCI
amazon-linux-2-amd64 Github Actions
centos-7-amd64 Github Actions
centos-8-stream-amd64 Github Actions
centos-8-stream-arm64 TravisCI
debian-bookworm-amd64 Github Actions
debian-bookworm-arm64 TravisCI
debian-bullseye-amd64 Github Actions
debian-bullseye-arm64 TravisCI
debian-buster-amd64 Github Actions
debian-buster-arm64 TravisCI
ubuntu-bionic-amd64 Github Actions
ubuntu-bionic-arm64 TravisCI
ubuntu-focal-amd64 Github Actions
ubuntu-focal-arm64 TravisCI
ubuntu-impish-amd64 Github Actions
ubuntu-impish-arm64 TravisCI
ubuntu-jammy-amd64 Github Actions
ubuntu-jammy-arm64 TravisCI

To distinct with system malloc() family.
@kou
Copy link
Member Author

kou commented Jun 15, 2022

@github-actions crossbow submit -g conan -g linux

@github-actions
Copy link

Revision: aebd6ac

Submitted crossbow builds: ursacomputing/crossbow @ actions-c1a7ee135a

Task Status
almalinux-8-amd64 Github Actions
almalinux-8-arm64 TravisCI
almalinux-9-amd64 Github Actions
almalinux-9-arm64 TravisCI
amazon-linux-2-amd64 Github Actions
centos-7-amd64 Github Actions
centos-8-stream-amd64 Github Actions
centos-8-stream-arm64 TravisCI
conan-maximum Github Actions
conan-minimum Github Actions
debian-bookworm-amd64 Github Actions
debian-bookworm-arm64 TravisCI
debian-bullseye-amd64 Github Actions
debian-bullseye-arm64 TravisCI
debian-buster-amd64 Github Actions
debian-buster-arm64 TravisCI
ubuntu-bionic-amd64 Github Actions
ubuntu-bionic-arm64 TravisCI
ubuntu-focal-amd64 Github Actions
ubuntu-focal-arm64 TravisCI
ubuntu-impish-amd64 Github Actions
ubuntu-impish-arm64 TravisCI
ubuntu-jammy-amd64 Github Actions
ubuntu-jammy-arm64 TravisCI


} // namespace memory_pool

#define RETURN_IF_JEMALLOC_ERROR(ERR) \
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we #undef it after using it?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done.

@@ -5,7 +5,7 @@ usr/lib/*/cmake/arrow/ArrowTargets*.cmake
usr/lib/*/cmake/arrow/Find*Alt.cmake
usr/lib/*/cmake/arrow/FindArrow.cmake
usr/lib/*/cmake/arrow/FindBrotli.cmake
usr/lib/*/cmake/arrow/Find[STuz]*.cmake
usr/lib/*/cmake/arrow/Find[STjuz]*.cmake
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

er... what's this?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's for reusing the same content in all Debian/Ubuntu distributions.

We can't use system Thrift/utf8proc/Zstandard on some distributions. Find{Thrift,utf8proc,zstd}.cmake aren't installed on these distributions. If we specify FindThrift.cmake explicitly instead of Find[STuz]*.cmake on these distributions, .deb generation is failed because the specified file doesn't exist.

But if we specify Find[STuz]*.cmake, .deb generation isn't failed on these distributions. Because FindSnappy.cmake is always installed and Find[STuz]*.cmake always matches one (FindSnappy.cmake) or more files.

Anyway, we only need one Find*.cmake that is always matched to Find[STuz]*.cmake. We already have FindSnappy.cmake for it. We don't need to add Findjemalloc.cmake to it. So I changed to specify Findjemalloc.cmake explicitly.

@kou
Copy link
Member Author

kou commented Jun 16, 2022

@github-actions crossbow submit debian-* ubuntu-*

@github-actions
Copy link

Revision: 7f99b01

Submitted crossbow builds: ursacomputing/crossbow @ actions-5de55f86f6

Task Status
debian-bookworm-amd64 Github Actions
debian-bookworm-arm64 TravisCI
debian-bullseye-amd64 Github Actions
debian-bullseye-arm64 TravisCI
debian-buster-amd64 Github Actions
debian-buster-arm64 TravisCI
ubuntu-bionic-amd64 Github Actions
ubuntu-bionic-arm64 TravisCI
ubuntu-focal-amd64 Github Actions
ubuntu-focal-arm64 TravisCI
ubuntu-impish-amd64 Github Actions
ubuntu-impish-arm64 TravisCI
ubuntu-jammy-amd64 Github Actions
ubuntu-jammy-arm64 TravisCI

@pitrou pitrou merged commit 07ac9fd into apache:master Jun 16, 2022
@pitrou
Copy link
Member

pitrou commented Jun 16, 2022

Nice addition, thanks @kou !

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants