Sujit Pal ๐Ÿ‡บ๐Ÿ‡ธ ๐Ÿ‡ฎ๐Ÿ‡ณ ๐Ÿ‡บ๐Ÿ‡ฆ ๐Ÿ‡ฎ๐Ÿ‡ฑ (@palsujit) 's Twitter Profile
Sujit Pal ๐Ÿ‡บ๐Ÿ‡ธ ๐Ÿ‡ฎ๐Ÿ‡ณ ๐Ÿ‡บ๐Ÿ‡ฆ ๐Ÿ‡ฎ๐Ÿ‡ฑ

@palsujit

@sujitpal.bsky.social

ID: 107592418

linkhttp://sujitpal.blogspot.com calendar_today23-01-2010 02:37:15

735 Tweet

677 Followers

197 Following

Sujit Pal ๐Ÿ‡บ๐Ÿ‡ธ ๐Ÿ‡ฎ๐Ÿ‡ณ ๐Ÿ‡บ๐Ÿ‡ฆ ๐Ÿ‡ฎ๐Ÿ‡ฑ (@palsujit) 's Twitter Profile Photo

Just registered to attend Discovering Complex Causal Structures with Hellixia webinar and learn about Bayesian causality analysis using Hellixia, Bayesia Lab's new subject matter assistant. events.teams.microsoft.com/event/d857e924โ€ฆ

Sujit Pal ๐Ÿ‡บ๐Ÿ‡ธ ๐Ÿ‡ฎ๐Ÿ‡ณ ๐Ÿ‡บ๐Ÿ‡ฆ ๐Ÿ‡ฎ๐Ÿ‡ฑ (@palsujit) 's Twitter Profile Photo

I recently read Probably Overthinking It a book on popular statistics, by Allen Downey and wrote up a small book report with my understanding of the subjects discussed in the book, may be useful as an intro / recap for folks reading it -- sujitpal.blogspot.com/2024/02/book-rโ€ฆ

Sujit Pal ๐Ÿ‡บ๐Ÿ‡ธ ๐Ÿ‡ฎ๐Ÿ‡ณ ๐Ÿ‡บ๐Ÿ‡ฆ ๐Ÿ‡ฎ๐Ÿ‡ฑ (@palsujit) 's Twitter Profile Photo

My blog post "Thoughts on using LangChain LCEL with Claude" discusses some issues (and my solutions) I found when trying to build a Question Generation / Answering / Evaluation pipeline using LCEL (LangChain Expression Language) w/ Anthropic's Claude -- sujitpal.blogspot.com/2024/02/thoughโ€ฆ

Sujit Pal ๐Ÿ‡บ๐Ÿ‡ธ ๐Ÿ‡ฎ๐Ÿ‡ณ ๐Ÿ‡บ๐Ÿ‡ฆ ๐Ÿ‡ฎ๐Ÿ‡ฑ (@palsujit) 's Twitter Profile Photo

I wrote up a blog post about using LlamaIndex ๐Ÿฆ™ to construct hierarchical indexes using Semantic Chunking and RAPTOR (Recursive Abstractive Processing for Tree Organized Retrieval) -- sujitpal.blogspot.com/2024/03/hierarโ€ฆ hope you find it useful

Sujit Pal ๐Ÿ‡บ๐Ÿ‡ธ ๐Ÿ‡ฎ๐Ÿ‡ณ ๐Ÿ‡บ๐Ÿ‡ฆ ๐Ÿ‡ฎ๐Ÿ‡ฑ (@palsujit) 's Twitter Profile Photo

I will be presenting (virtually) about our scalable systems for Named Entity Recognition and Linking that enable our Clinical Knowledge Graph to power our Concept Search platform at the Healthcare and Life Sciences (HCLS) workshop at #KnowledgeGraphConference

I will be presenting (virtually) about our scalable systems for Named Entity Recognition and Linking that enable our Clinical Knowledge Graph to power our Concept Search platform at the Healthcare and Life Sciences (HCLS) workshop at #KnowledgeGraphConference
Sujit Pal ๐Ÿ‡บ๐Ÿ‡ธ ๐Ÿ‡ฎ๐Ÿ‡ณ ๐Ÿ‡บ๐Ÿ‡ฆ ๐Ÿ‡ฎ๐Ÿ‡ฑ (@palsujit) 's Twitter Profile Photo

My trip report of talks I attended at Health Care and Life Sciences (HCLS) workshop at #KGC2024 where I also presented (both virtually) -- sujitpal.blogspot.com/2024/05/kgchclโ€ฆ

Sujit Pal ๐Ÿ‡บ๐Ÿ‡ธ ๐Ÿ‡ฎ๐Ÿ‡ณ ๐Ÿ‡บ๐Ÿ‡ฆ ๐Ÿ‡ฎ๐Ÿ‡ฑ (@palsujit) 's Twitter Profile Photo

I wrote up some findings on vector search performance, using pre-trained vs fine-tuned embeddings, and using float vs byte vs binary vectors on OpenSearch (the first two using Cosine Distance and the last using Hamming Distance), hope you find it useful -- sujitpal.blogspot.com/2024/05/perforโ€ฆ

Sujit Pal ๐Ÿ‡บ๐Ÿ‡ธ ๐Ÿ‡ฎ๐Ÿ‡ณ ๐Ÿ‡บ๐Ÿ‡ฆ ๐Ÿ‡ฎ๐Ÿ‡ฑ (@palsujit) 's Twitter Profile Photo

Write-up of our project submission for the #GoogleAIHackathon, task was to build creative app using #Gemini. We built an LLM based evaluation framework for #RAG systems w/example-driven prompts optimized by #DSPy to generate scores from #RAGAS metrics -- sujitpal.blogspot.com/2024/05/finetuโ€ฆ

Sujit Pal ๐Ÿ‡บ๐Ÿ‡ธ ๐Ÿ‡ฎ๐Ÿ‡ณ ๐Ÿ‡บ๐Ÿ‡ฆ ๐Ÿ‡ฎ๐Ÿ‡ฑ (@palsujit) 's Twitter Profile Photo

My review of manning.com/books/pandas-wโ€ฆ by Reuven M Lerner from Manning Publications -- sujitpal.blogspot.com/2024/06/book-rโ€ฆ hope my review helps if you are looking to improve your Pandas skills as I was.

Sujit Pal ๐Ÿ‡บ๐Ÿ‡ธ ๐Ÿ‡ฎ๐Ÿ‡ณ ๐Ÿ‡บ๐Ÿ‡ฆ ๐Ÿ‡ฎ๐Ÿ‡ฑ (@palsujit) 's Twitter Profile Photo

A colleague and I attended a hackathon to build something cool with multimodal LLMs couple of weeks back, here is what we built -- sujitpal.blogspot.com/2024/06/table-โ€ฆโ€ฆ , and our learnings from it, hope you find it useful.

Sujit Pal ๐Ÿ‡บ๐Ÿ‡ธ ๐Ÿ‡ฎ๐Ÿ‡ณ ๐Ÿ‡บ๐Ÿ‡ฆ ๐Ÿ‡ฎ๐Ÿ‡ฑ (@palsujit) 's Twitter Profile Photo

I did some experiments with Prompt Compression in a RAG (Retrieval Augmented Generation) pipeline using #LLMLingua framework and trained models and evaluated using Answer Relevancy as defined by ragas. My methods and results -- sujitpal.blogspot.com/2024/07/experiโ€ฆ

Elsevier (@elsevierconnect) 's Twitter Profile Photo

๐ŸŒ At Elsevier, we foster an inclusive culture where diverse backgrounds and experiences thrive. Hear from our colleagues and leaders on what inclusion and diversity mean to us: spkl.io/6014f6kMa #ElsevierDiversity #Inclusion #Innovation #WomenInTech #TechJobs

CALL TO ACTIVISM (@calltoactivism) 's Twitter Profile Photo

Holy shit. How can they do this?? Iโ€™m in utter disbelief. Vance just repeated Trumpโ€™s LIE that HE got $35 insulin for seniors. That was 100% Biden and Kamala. RT this to correct the record!!

Sujit Pal ๐Ÿ‡บ๐Ÿ‡ธ ๐Ÿ‡ฎ๐Ÿ‡ณ ๐Ÿ‡บ๐Ÿ‡ฆ ๐Ÿ‡ฎ๐Ÿ‡ฑ (@palsujit) 's Twitter Profile Photo

Description of my implementation of #GraphRAG (subset of the one proposed by Microsoft Research and LlamaIndex ๐Ÿฆ™ based on some components being available already) and the evaluation results of this system against baseline RAG using an LLM judge -- sujitpal.blogspot.com/2024/10/using-โ€ฆ

Description of my implementation of #GraphRAG (subset of the one proposed by <a href="/MSFTResearch/">Microsoft Research</a>  and <a href="/llama_index/">LlamaIndex ๐Ÿฆ™</a> based on some components being available already) and the evaluation results of this system against baseline RAG using an LLM judge -- sujitpal.blogspot.com/2024/10/using-โ€ฆ
Sujit Pal ๐Ÿ‡บ๐Ÿ‡ธ ๐Ÿ‡ฎ๐Ÿ‡ณ ๐Ÿ‡บ๐Ÿ‡ฆ ๐Ÿ‡ฎ๐Ÿ‡ฑ (@palsujit) 's Twitter Profile Photo

I recently applied software engineering best practices to my ML pipelines and wrote about it here. Let me know what you think, interested to hear your thoughts about how this can be improved -- sujitpal.blogspot.com/2024/12/packagโ€ฆ

I recently applied software engineering best practices to my ML pipelines and wrote about it here. Let me know what you think, interested to hear your thoughts about how this can be improved -- sujitpal.blogspot.com/2024/12/packagโ€ฆ
Sujit Pal ๐Ÿ‡บ๐Ÿ‡ธ ๐Ÿ‡ฎ๐Ÿ‡ณ ๐Ÿ‡บ๐Ÿ‡ฆ ๐Ÿ‡ฎ๐Ÿ‡ฑ (@palsujit) 's Twitter Profile Photo

I recently reviewed Essential GraphRAG by Tomaz Bratanic and Oskar Hane and published by Manning Publications . Here is the link to my review -- sujitpal.blogspot.com/2025/06/book-rโ€ฆ , hope you find it useful.