Apache Arrow

We’re excited to announce the first ever Apache Arrow and Apache Parquet meetup in Paris! This meetup will be hosted on June 18th by Datadog, in their offices, 21 Rue de Châteaudun 75009 Paris. Apache Arrow and Apache Parquet are two widely-used, open source, language-agnostic data formats for efficient representation of columnar data. They are often complementary: Arrow for in-memory data, Parquet for disk storage. If you’re using Arrow or Parquet, looking for insights, or wanting to meet other community members, this meetup is for you! See event details for planned talks and content. https://luma.com/6ed1oko1

We’re excited to announce the first ever Apache Arrow and Apache Parquet meetup in Paris! This meetup will be hosted on June 18th by Datadog, in their offices, 21 Rue de Châteaudun 75009 Paris. Apache Arrow and Apache Parquet are two widely-used, open source, language-agnostic data formats for efficient representation of columnar data. They are often complementary: Arrow for in-memory data, Parquet for disk storage. If you’re using Arrow or Parquet, looking for insights, or wanting to meet other community members, this meetup is for you! See event details for planned talks and content. https://luma.com/6ed1oko1

Apache Arrow 24.0.0 is out 🎉 A few highlights from this release: • Up to 50% faster Parquet reads with bit-unpacking optimizations • New Security Model added outlining what users should expect when dealing with Arrow data • Encrypted Parquet bloom filter read support • The pure Ruby implementation keeps growing: writer added and the reader now passes integration tests • PyArrow now builds with scikit-build-core 259 issues resolved across 325 commits from 57 contributors; thanks to everyone who made this release happen. Read more: https://lnkd.in/ebwNEmRg #ApacheArrow #OpenSource #DataEngineering #Parquet

Released this week: Version 23 of the ADBC libraries. This release includes updates to the ADBC (Arrow Database Connectivity) libraries across multiple languages, plus improvements to the PostgreSQL and SQLite drivers maintained in the apache/arrow-adbc repository. Highlights include new TOML-based connection profiles, a new Node.js driver manager on npm, new Go interfaces, expanded functions in the JNI layer, Rust API changes, and Homebrew packages. See the blog post linked in the comments for more details.

Apache Arrow Community Highlights for 2025! Apache Arrow just turned 10, and we are celebrating this milestone by looking back at the progress and accomplishments the community made in 2025. None of it would have been possible without the amazing contributors who make this project what it is. Thanks to everyone who contribute! Read the full 2025 highlights here: https://lnkd.in/dBA4_jXn

Excited to share 𝗠𝗔𝗥𝗥𝗢𝗪 — a native Apache Arrow implementation in #Mojo🔥 Every major data tool speaks 𝗔𝗿𝗿𝗼𝘄. PyArrow alone pulls 300 million downloads a month — one implementation, one distribution channel. Mojo deserves a native implementation. Still in early development, but after a major revamp here's where 𝗺𝗮𝗿𝗿𝗼𝘄 stands: - Arrays, builders, compute kernels - Python bindings with PyArrow-compatible API - Zero-copy PyArrow interop via C Data Interface - SIMD-vectorized bitmap operations and compute kernels - Experimental GPU support for NVIDIA, AMD, Apple Silicon thanks to Mojo Performance is looking exciting, early benchmarks show 1.3–3.9x faster Python-to-Arrow conversions than PyArrow itself and faster bitmap operations. Take the benchmark numbers with a grain of salt since PyArrow is heavily optimized and there can be missing pieces, but marrow is at least in the same ballpark. Compute operations with pre-loaded GPU arrays are showing great numbers too. The implementation is far from being complete, there's a lot to build. As always, if you're into systems programming, data formats, or GPU compute in Mojo, contributions are more than welcome! Special thanks to Marius Seritan for joining the effort! 🔗 https://lnkd.in/dPCkvhhq #Mojo #ApacheArrow #DataEngineering #OpenSource #GPU

We have a new 23.0.1 patch release for Apache Arrow. See the announcement here: https://lnkd.in/es3GaZpQ

Apache Arrow is 10 years old 🎉. The project was officially established and had its first git commit on February 5th 2016, and we are therefore enthusiastic to announce its 10-year anniversary! Looking back over these 10 years, the project has developed in many unforeseen ways and we believe to have delivered on our objective of providing agnostic, efficient, durable standards for the exchange of columnar data. Read our celebratory blog post for some tidbits of early Arrow history, and our outlook on Arrow's present and future. https://lnkd.in/egEQPKsm

Arrow 23.0.0 was released on the 18th of January, check out some of the Release highlights on our announcement blog post: https://lnkd.in/eVZxBKC8

Released this week: Version 22 of the ADBC libraries and drivers. This release includes updates to the ADBC (Arrow Database Connectivity) libraries for 8 languages, and improvements to the 4 ADBC drivers that are maintained in the apache/arrow-adbc repository. See the blog post linked in the comments for more details.