Kyle Barron kylebarron.dev on bsky (@kylebarron2) 's Twitter Profile
Kyle Barron kylebarron.dev on bsky

@kylebarron2

Creating the next generation of geospatial data tools for Python & the browser with GeoArrow, GeoParquet & GeoRust @developmentseed | he/him 🌈

ID: 120641803

linkhttp://kylebarron.dev calendar_today07-03-2010 03:01:59

2,2K Tweet

2,2K Followers

672 Following

Max Lenormand (@maxlenormand) 's Twitter Profile Photo

Satellite Images & Data Science are more common than ever in journalism news stories today I sat down with Krishna Karra from Bloomberg to talk about how the magic happens Watch the full interview: youtu.be/9esybzqRHtk

Andy Pavlo (@andypavlo.bsky.social) (@andy_pavlo) 's Twitter Profile Photo

Buckle up because we're crashing into the new year with my annual database retrospective: License change blowbacks! Databricks vs. SnowflakeDB gangwar! @DuckDB shotgun weddings! Buying a college quarterback with database money for your new lover! cs.cmu.edu/~pavlo/blog/20…

Pyodide (@pyodide) 's Twitter Profile Photo

Pyodide 0.27 has been released 🎉 Release highlights: 🔓 pyodide-build decoupling 🔢 NumPy 2.0 🏎️ Python ⇔ JavaScript FFI performance improvements 📊 New data science and data engineering packages: ApacheArrow (PyArrow), polars data, DuckDB blog.pyodide.org/posts/0.27-rel…

Andrew Lamb (@andrewlamb1111) 's Twitter Profile Photo

The browser based parquet viewer parquet-viewer.xiangpeng.systems is pretty sweet -- let's you explore the file format, including schema and layout, and data with SQL. Natch it is based on ApacheDataFusion

The browser based  parquet viewer  parquet-viewer.xiangpeng.systems is pretty sweet -- let's you explore the file format, including schema and layout, and data with SQL. Natch it is based on <a href="/ApacheDataFusio/">ApacheDataFusion</a>
Kyle Barron kylebarron.dev on bsky (@kylebarron2) 's Twitter Profile Photo

Spatial indexes, and RTrees specifically, are at the core of geospatial software. But ever wondered how an RTree is actually implemented? In this post we’ll dive into the implementation of Flatbush, a blazing-fast, memory-efficient RTree by Volodymyr Agafonkin 🇺🇦 kylebarron.dev/literate-flatb…

Spatial indexes, and RTrees specifically, are at the core of geospatial software.

But ever wondered how an RTree is actually implemented?

In this post we’ll dive into the implementation of Flatbush, a blazing-fast, memory-efficient RTree by <a href="/mourner/">Volodymyr Agafonkin 🇺🇦</a> 

kylebarron.dev/literate-flatb…
Kyle Barron kylebarron.dev on bsky (@kylebarron2) 's Twitter Profile Photo

Really happy for myself and developmentseed to be part of GeoJupyter, an initiative to improve interactive mapping and analysis in Project Jupyter notebooks. geojupyter.org/blog/20250108-…

Kyle Barron kylebarron.dev on bsky (@kylebarron2) 's Twitter Profile Photo

New obstore v0.3 for easy access to S3, GCS, and Azure Storage! - Easy async **streaming** downloads, uploads, and copies across object stores - Streaming list, with no pagination - Easier configuration with improved type hints - Fsspec integration developmentseed.org/obstore/latest/

Kyle Barron kylebarron.dev on bsky (@kylebarron2) 's Twitter Profile Photo

New release of obstore: the simplest, highest-throughput Python interface to S3, GCS & Azure Storage! - Pickle support, to unblock usage in Dask - Easier one-line store creation - Open remote objects as file-like readers or writers - Improved docs developmentseed.org/obstore/latest…

Kyle Barron kylebarron.dev on bsky (@kylebarron2) 's Twitter Profile Photo

Published obstore 0.5, the fastest Python interface to S3, GCS & Azure. - Benchmarks: **2.8x higher throughput** than aioboto3 for many small, concurrent requests - Custom credential providers, automatic token refresh - Improved docs, fsspec integration developmentseed.org/obstore/latest…

Kyle Barron kylebarron.dev on bsky (@kylebarron2) 's Twitter Profile Photo

Published v0.1 of async-tiff, a Rust crate and Python library for low-level, async reading of TIFF and GeoTIFF files. There's high potential for improved performance when opening many TIFF files concurrently, esp in Python server environments github.com/developmentsee…

Kyle Barron kylebarron.dev on bsky (@kylebarron2) 's Twitter Profile Photo

Obstore v0.6 brings simple, painless integration with Microsoft Planetary Computer! - *Automatic token refresh*. No need to manually fetch SAS tokens and never think about token expiration times again. - STAC API integration developmentseed.org/obstore/latest…

Kyle Barron kylebarron.dev on bsky (@kylebarron2) 's Twitter Profile Photo

Introducing Obspec: A Python protocol for interfacing with object storage. Obspec is an alternative to fsspec to read, write, and modify data on object storage while acknowledging that object storage is *not* a filesystem. developmentseed.org/obspec/latest/…

Kyle Barron kylebarron.dev on bsky (@kylebarron2) 's Twitter Profile Photo

Obstore v0.7 is out! The simplest Python cloud storage interface, powered by Rust - Anonymous connections to GCS - Obspec compatibility - Improvements to NASA Earthdata credential provider - Fixed creation of AzureStore from URL - Improved documentation developmentseed.org/obstore/latest…

Kyle Barron kylebarron.dev on bsky (@kylebarron2) 's Twitter Profile Photo

Published v0.4 of the Rust GeoParquet crate: - Read all GeoParquet 1.1 files, including spatial filtering - Easier integration with upstream parquet crate - Support for adding bbox column when writing files - Sync and async for both reading and writing github.com/geoarrow/geoar…