Living in a place where you can regularly have highly stimulating conversations with highly ambitious, independent-minded people, is an important part of getting "lucky" in life.

I thought that #UnityCatalog can have multiple metastores with catalogs etc. I was wrong 🤷‍♂️ There can be one and only one metastore in UC. ➡️ books.japila.pl/unity-catalog-… Think of UC as HMS++ (assuming that this analogy of C++ being better than C is true 😉)

The books have arrived 🥰📚📦 The pile is exactly how I'm gonna read them (from top to bottom), starting from the one about #ApacheIceberg 🧊🏔️ Thanks O'Reilly Media for these complimentary copies 🙏

#UnityCatalog can create temporary, limited-privilege credentials upon accessing tables in cloud object storages 🥳 Specifically, UC uses #AWS #STS service to vend security credentials to access assets in s3 buckets. ➡️ books.japila.pl/unity-catalog-…

Jane Street has started up our tech talk series after a pandemic-driven hiatus. Our first talk is from Charlie Marsh of Ruff fame, talking about how they made uv, their new package manager for Python, so fast! youtu.be/gSKTfG1GXYQ?si…

A lot of problems in life are solved by waking up early.

In many cases, you'll find the only thing preventing you from learning is your ego. No one enjoys feeling foolish, but attempting something new requires that you climb down from your perch and struggle as a beginner. You must ask questions that reveal your ignorance or attempt

The other books arrived! 📚📖🦀 That was The simplest part. Now time for the hardest = find some spare time to give them a serious read 😬 #books #Rust #MLOps

Blog post from Xiangpeng Hao explaining the different levels of pruning ApacheDataFusion applies when reading Parquet files: blog.haoxp.xyz/posts/parquet-… The diagrams in particular are 🧑‍🍳👌

AI is probably not going to replace you

Finished a #parkrun at 00:23:07 and thought I couldn't be happier 🤭 #UnityCatalog and dennylee showed me how much I was mistaken as...they accepted the PR and I climbed up to No. 1 in the Commits hall of fame 🥳😎 ➡️ github.com/unitycatalog/u…

Basic Server Access Control in #UnityCatalog is built on a OpenAPI spec 📖 Securables, Path Operations, Principal Types, Privileges are all in all.yaml. ➡️ github.com/unitycatalog/u… Any tool that talks OpenAPI can talk to Unity Catalog 👍

I'm actually curious too...

00:22:57 at the #parkrun today made me Happy Me moment already! 🏃‍♂️😀 With a place among the prominent contributors to #UnityCatalog OSS, my happiness skyrocketed! 🥳 ➡️ github.com/unitycatalog/u…

See me at bsky.app/profile/jacekl… 👋 #Bluesky #BlueskySocial

Correction: GlareDB is moving away from DataFusion! Sean Smith's excellent talk discusses problems with building a DBMS using off-shelf parts. Like DuckDB, the GlareDB rewrite borrows ideas from TUM Database Group's HyPer system but it's written in Rust: youtube.com/watch?v=Sor3KZ…

Data Catalogs are getting much-needed attention across #datalakehouse and #datawarehouse as the plot thickens, as they say. We are sharing some of the deep internal research we did to support our multi-catalog sync feature in the Onehouse product in this blog from Kyle Weller .

Vinoth Chandar One thing I did not expect when doing this research was coming to the unfortunate realization that you might need more than one catalog to cover all the bases for a complete data platform solution...

Here's surprising data on GitHub Copilot no longer the IDE of choice across early adopters. All surging IDEs use Sonnet 3.5 primarily AFAIK blog.pragmaticengineer.com/ide-that-softw…

🎉 We’re proud to announce the Apache Hudi  1.0 release! This release has been the result of a massive community effort, with tons of new code (re)written. I want to thank all 60+ contributors who worked on ~180K lines of change. 🗒️ Release blog: hudi.apache.org/blog/2024/12/1… Hudi