We're to build a 100-TB scale geospatial benchmark suite docs.coiled.io/blog/geospatia… We've seen an uptick in geospatial users and in challenges of the Xarray/Dask stack to scale beyond ~500-GiB. This post presents a call for benchmark workloads.

New Post: What Does a Pangeo 2.0 Technology Stack Look Like? matthewrocklin.com/pangeo-2.0.html

I was speaking with some other founders about burnout and quitting and wrote up some thoughts on positions of leverage, the self-sacrifice that naturally arises from them, thoughts of quitting, and becoming creatively selfish. matthewrocklin.com/leverage.html

"Large GeoSpatial Benchmarks: First Pass" Last month we asked for TiB scale geo workloads to form a benchmark suite. We got strong response. Since then we've built out these into a public suite. This post goes over what's implemented and early results docs.coiled.io/blog/geospatia…

Today I voted in the elections of both the United States and the NumFOCUS board!

Some thoughts on constructive communication, venting, and how to tell the difference. matthewrocklin.com/venting.html

True then. True now. President Bill Clinton’s second inauguration — January 20, 1997

I just got my seasonal COVID/Flu shot 💉 A little late for Thanksgiving, but right on time for Christmas holidays and visiting with family!

Driving from Austin TX to Oakland CA for Thanksgiving (I like long drives) Cheapest gas: $2.39 in Lubbock, TX Most expensive gas: $5.99 in Needles, CA Not that I use gas (⚡) but it's interesting to observe the shift around the county.

I'm also at Matthew Rocklin.bsky.social But really I'm mostly posting on LinkedIn these days.

I always advise people to write more technical content. The more you write, the better it gets. Not only it helps to find out the gaps (if any) in your understanding, it also helps you understand the missing parts. Writing with a perspective is the real alpha!

New Post: Cloud Computing is Broken matthewrocklin.com/cloud-is-broke… Investor asks: "What's next for Data/Cloud Infrastructure?" My answer: "Boring stuff. People struggle with basics." Cloud feels like MP3 players before iPod. In theory everything is good. In practice adoption is low

Calculating quantiles, a common application in #geospatial workloads, used to be slow due to GIL contention in NumPy. The new implementation in Dask + Xarray is up to a hundred times faster and scales independently of the number of threads 🥳. docs.coiled.io/blog/array-qua…

Coiled 2024 in Review docs.coiled.io/blog/2024-eoy.… It’s the time when companies issue year-end summaries, acclaiming success (or not), and forecasting incredible growth for the next year (or not). I thought I’d do something similar for Coiled. It’s been quite a year for us ...

Short Post: Hammers and Nailguns matthewrocklin.com/hammers-and-na… Some tools have clear and specific uses, some don't. Surprisingly, it's often the ones that don't have a clear use that we use the most.

Say I wanted a custom Sphinx theme, but didn't want to build it myself. Are there good contractors that know Sphinx and CSS well that anyone can connect me with?

Prefect and Coiled now integrate serverless push work pools. Prefect hosts logic about when to run flow, and Coiled runs those flows on cloud hardware easily and efficiently. This combination makes scalable workflows super easy docs.coiled.io/user_guide/pre…

1/ Today we are launching Flux, a powerful new addition to the Earthmover platform. Flux is a high-performance gateway for exploring, querying, and visualizing geospatial data via standards-compliant APIs (EDR, WMS, and OPeNDAP).