🔥The 9th Round of Easy Loan, Earn $40 Reward is in progress❗️ ⏰ Promotion Period: January 15th - Feburary 15th, 2025 👉 Register now and check more details at gate.io/campaigns/358

3/ More details (including how we built it on Cloudflare's edge network) here: blog.cloudflare.com/logexplorer-ga/

Is Coralogix the first ApacheDataFusion based unicorn? I think we'll see many more over the coming years. techcrunch.com/2025/06/17/obs…

Clearly the answer is yes! 🦄

This is so cool -- an example of embedding a special index (a DistinctValues index no less) inside a Apache Parquet file: github.com/apache/datafus… (coming in ApacheDataFusion 49.0.0)

Thanks to Jax Liu DataFusion 49.0.0 will offer `async` user defined functions: github.com/apache/datafus… 🙏 github.com/goldmedal and Canner

Congratulations to LanceDB -- it is pretty sweet to see (another) ApacheDataFusion backed startup raising. I can't wait to see what comes next

🔒 🥁github.com/apache/datafus… DataFusion will now have parquet modular encryption thanks to Adam Reeve and Corwin Join (courtesy of G-Research)

Two new (reposted) blogs about Optimizing SQL and DataFrames: datafusion.apache.org/blog/2025/06/1… datafusion.apache.org/blog/2025/06/1…

New blog post about cooperative scheduling using tokio and Rust async, and how cancellation works in ApacheDataFusion: datafusion.apache.org/blog/2025/06/3…

We’ve adopted ApacheDataFusion in RisingWave for Apache Iceberg compaction service.

I publicly apologize to snapping at Yuchen Liang and Andy Pavlo (@andypavlo.bsky.social) and CMU Database Group . "You need to have a push based scheduler to do ..." TUM / DuckDB(CWI) created group-think in Databases where push schedulers are required, ClickHouse, Spark, DataFusion, etc not withstanding 🤦

Quite a list of contributors already to the Rust Apache Parquet implementation of Variant (support for semi structured data). I was making some slides to explain what Variant is and made up a list I wanted to share. The feature will be amazing github.com/apache/arrow-r…

Example of the kind of low level obsession we foster in the Rust parquet / arrow / DataFusion community: github.com/apache/arrow-r… I am skeptical that proprietary engines will be able to compete with OSS long term (though I am biased) Huge thanks to Qi Zhu and Daniël Heres @[email protected]

From what I can see, commercial open-source software keeps pulling ahead of closed-source alternatives. Trust is the primary driver - technical excellence comes second. I’ve even seen companies pick a product solely because it’s written in Rust Language.

I am speaking at the #ApacheIceberg NYC Meetup on July 10th about Variant in Apache Parquet which enable more efficient of processing semi structured data such as that found in JSON. lu.ma/95a5qys1

Speaking of Apache Parquet performance obsession, Jörn Horstmann just dropped this 💣 for faster writing github.com/apache/arrow-r…

Sweet VLDB paper from TUM (Mateusz Gienieczko / github.com/v0ldek) proposing extending Apache Parquet using user defined encodings (via WASM). Favorite image shows the ease of integrating into ApacheDataFusion gienieczko.com/anyblox-paper