
Ponder
@ponderdata
Run pandas at scale directly in your data warehouse—be it Snowflake, BigQuery or DuckDB—all from the comfort of your favorite IDE or notebook.
ID: 1409999723784671234
http://ponder.io/product 29-06-2021 22:19:53
682 Tweet
2,2K Followers
162 Following

The Python Dataframe Interchange Protocol is a quiet hero 🦸♀️. It makes it easy for libraries to accept many dataframes (Modin, Polars, Ibis, cuDF, Dask). Read our encomium: ponder.io/how-the-python… Thanks to Marco Gorelli & Ralf Gommers for your work! #python #dataframes

.Software Dev Tools saw a workload speedup of 4X with Modin Project (the scalable drop-in replacement for pandas) compared to pandas! Read more from Intel here: intel.com/content/www/us… #python #pandas #datascience


Pulling data from SnowflakeDB to work w/ scikit-learn, LightGBM, XGBoost? 💥Snowpark ML lets you stay in Snowflake but use important ML classes: LGBMClassifier, Lasso, PCA, XGBClassifier, etc. 💥Ponder lets you do your pandas preprocessing in Snowflake ponder.io/using-snowpark…





If you want to automatically parallelize your pandas code, you should check out open-source Modin: github.com/modin-project/… Modin Project uses the pandas API, so all you need to do is change "import pandas as pd" to "import modin.pandas as pd" #pandas #Python #opensource



If you're backed into a dark alley, facing a pack of ravenous NaN dogs, you'll want a sidekick like pandas dropna. Drop rows with n missing values using thresh=n. Drop entirely empty rows with how='all'. Learn more from Matt Harrison: ponder.io/professional-p… #pandas #Python

You can run NumPy 🔢 at scale in your database with Ponder 💥 Through Modin Project, Ponder supports: - Element-wise matrix ops (addition, subtraction, division, power) - Axis-collapsing or reducing ops (min, max, sum, product, mean) & more: ponder.io/numpy-on-snowf… #NumPy #SQL

Great coverage in the Real Python podcast of Mahesh Vashishtha's article: "Why Are There So Many Python Dataframes?" Here's the link to jump straight to that 7-minute portion: realpython.com/podcasts/rpp/1… Link to article: ponder.io/why-are-there-…
