🥳DeepSeek R1 INT4 GGUF model is released by the end of CY 2024: huggingface.co/OPEA/DeepSeek-…, powered by Intel Neural Compressor (github.com/intel/neural-c…) with higher accuracy than llama.cpp. huggingface.co/OPEA/DeepSeek-…

🫡 Sharing #pytorch landscape, a great initiative to promote its ecosystem. Check it out: landscape.pytorch.org 👐Besides the direct upstream to PyTorch, you may want to know more contributions from Intel such as INC: github.com/intel/intel-ex…, and IPEX github.com/intel/neural-c….

🤖Faster Inference of LLMs using FP8 on Intel Gaudi: arxiv.org/pdf/2503.09975

🪜Step by step to generate INT4 DeepSeek-R1 model using Intel's AutoRound tool, while delivering higher accuracy than FP8 or any other open-sourced INT4 model (see #evaluate section in model card) 🤖Tool: github.com/intel/auto-rou… 🎯Model: huggingface.co/OPEA/DeepSeek-…

🔥AutoRound, a leading low-precision library for LLMs/LVMs developed by Intel, officially landed on Hugging Face transformers. Congrats to Wenhua, Weiwei, Heng! Thanks to Ilyas, Marc, Mohamed from HF team! github.com/huggingface/tr… #intel clem 🤗 Julien Chaumond

Congrats Junyang Lin and Qwen team! Really excited to have #intel Neural Compressor (github.com/intel/neural-c…) be part of SW partners for day0 launch! Cheers 🍻

🔥AutoRound supports day0 Qwen3 launch! Check out the sample code from github.com/intel/auto-rou…. Now you can get the best INT4/3 Qwen3 models using AutoRound.

🎯Thrilled to share our blog on "AutoRound", an advanced quantization approach for LLMs 👀Blog: huggingface.co/blog/autoround Thanks to wenhuach Kele Ding & Intel teams and Marc Sun & HF friends!

The land we live on does more than feed us—it helps in cooling our planet by absorbing harmful emissions. Human activities are upsetting this balance, but together we can change the story. Learn more about nature loss and how you can help: unep.org/facts-about-na…

President President Donald J. Trump When you will embrace knowledge and hire people ! That's urgent and important. Neither you are hiring nor you are doing anything ? What do you want ? Information complexity is increasing at rapid pace and there is no hiring.