
Shoumik Palkar
@sppalkia
Software engineer @Databricks working on SQL execution. he/him
ID: 167137258
https://shoumik.xyz 15-07-2010 21:10:09
57 Tweet
302 Followers
381 Following





Learned profilers estimate codepath performance dynamically at runtime, enabling lower overhead and more accurate estimates than alternatives like cProfile and statprof: shoumik.xyz/static/papers/… (with Shoumik Palkar, Me, Matei Zaharia at NIPS ML for Systems Workshop)




Nice interview with my PhD student Shoumik Palkar on Weld!

Cool work by my student Shoumik Palkar. Many groups are building compilers for data & ML apps, but this is time-consuming and complex. Shoumik Palkar shows you can get most of the speedup with existing library functions (NumPy, pandas etc) by managing data movement: dawn.cs.stanford.edu/2019/10/22/spl…


thanks for an awesome grad school experience Matei Zaharia!

This is a pretty big deal -- Databricks is launching a new native execution engine for Spark SQL at this #SparkAISummit, which runs existing workloads up to 18x faster. It's optimized for cloud storage and Delta & Parquet formats. Reynold Xin is giving a talk about it on stream now.

I'm getting closer to graduating (hoping by Nov 1), and it's time to figure out what's next! I'd like to continue working on Rust Language and its ecosystem, ideally on open-source libraries and tools, so if you know of a good fit that supports remote work from LA, please reach out!



The CFP for the SOSP Student Research Competition is up: sosp2021.mpi-sws.org/cfsrc.html Excited to chair this with Aurojit Panda and looking forward to the amazing work of undergrad and grad students. This is a great way to increase the visibility of your work and get feedback. Please submit!

