Skip to content

Arrow: bump to 24.0.0; thrift: bump to 0.22#6177

Open
aalkin wants to merge 8 commits into
alisw:masterfrom
aalkin:enable-thrift-and-parquet
Open

Arrow: bump to 24.0.0; thrift: bump to 0.22#6177
aalkin wants to merge 8 commits into
alisw:masterfrom
aalkin:enable-thrift-and-parquet

Conversation

@aalkin

@aalkin aalkin commented Mar 11, 2026

Copy link
Copy Markdown
Collaborator
  • Bump version of thrift to current (0.22)
  • Move thrift building to cmake instead of configure
  • Add thrift as a dependency to Arrow, so that Parquet is enabled
  • Bump arrow version to current (24.0.0)

@aalkin aalkin requested a review from a team as a code owner March 11, 2026 11:29
@aalkin aalkin changed the title Arrow: enable Parquet Arrow: bump to 23.0.1 and enable Parquet Mar 12, 2026
@aalkin

aalkin commented Mar 12, 2026

Copy link
Copy Markdown
Collaborator Author

Aparently this will require some small changes to O2, as usage of compute functions now requires a call to arrow::compute::Initialize().

@ktf

ktf commented Mar 12, 2026

Copy link
Copy Markdown
Member

Can we hide that behind an #if __has_include?

Comment thread thrift.sh Outdated
Co-authored-by: Giulio Eulisse <10544+ktf@users.noreply.github.com>
@aalkin

aalkin commented Mar 12, 2026

Copy link
Copy Markdown
Collaborator Author

Yes, it can be hidden. From what I understand, now arrow does not preload all the compute libraries by default, which should be good for the memory consumption. So I need to identify contexts where we rely on compute functions (not Gandiva), which are probably only the slicing and index building, where I can call Initialize as late as possible.

@aalkin aalkin marked this pull request as draft March 12, 2026 17:07
@aalkin

aalkin commented Mar 13, 2026

Copy link
Copy Markdown
Collaborator Author

Draft until AliceO2Group/AliceO2#15152 is integrated.

@aalkin aalkin marked this pull request as ready for review March 16, 2026 10:06
Comment thread thrift.sh
Comment thread thrift.sh Outdated
Comment thread thrift.sh
Co-authored-by: Anton Alkin <anton.alkin@cern.ch>
@aalkin

aalkin commented Mar 16, 2026

Copy link
Copy Markdown
Collaborator Author

@singiamtel @ktf it looks like mac CI has bison version 2.3, while thrift requires at least 2.5 (note that the current on homebrew is 3.8.2).

@aalkin

aalkin commented Mar 17, 2026

Copy link
Copy Markdown
Collaborator Author

I've made a PR for homebrew-system-deps to include homebrew-provided bison alisw/homebrew-system-deps#67

Comment thread arrow.sh Outdated
@aalkin aalkin changed the title Arrow: bump to 23.0.1 and enable Parquet Arrow: bump to 23.0.1 Mar 17, 2026
@aalkin aalkin changed the title Arrow: bump to 23.0.1 Arrow: bump to 23.0.1 and thrift to 0.22 Mar 17, 2026
@aalkin aalkin changed the title Arrow: bump to 23.0.1 and thrift to 0.22 Arrow: bump to 23.0.1; thrift: bump to 0.22 Mar 17, 2026
Comment thread arrow.sh Outdated
Comment thread arrow.sh Outdated
Co-authored-by: Anton Alkin <anton.alkin@cern.ch>
@aalkin aalkin changed the title Arrow: bump to 23.0.1; thrift: bump to 0.22 Arrow: bump to 24.0.0; thrift: bump to 0.22 Apr 22, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants