Prithiv Sakthi's picture

Building on HF

Prithiv Sakthi PRO

prithivMLmods

hugging-science

·

https://linktr.ee/prithivsakthi

AI & ML interests

computer vision, nlp, multimodality - HuggingFace Fellow ML 🤗

Recent Activity

reacted to lbourdois's post with 🔥 about 13 hours ago

New blog post! An introduction to a little-known but highly effective model reduction method: 𝗧𝗿𝗶𝗺𝗺𝗶𝗻𝗴✂️ We show how to reduce model size (we went up to 87.24% reduction) while preserving its performance. We applied this technique to 16 different model families across several modalities to illustrate that it works on any architecture (as long as the embedding layer is the last one of the model) and on any modality involving text. From these 16 families, we generated over 𝟱,𝟱𝟬𝟬 𝗺𝗼𝗻𝗼𝗹𝗶𝗻𝗴𝘂𝗮𝗹 𝗺𝗼𝗱𝗲𝗹𝘀 𝗶𝗻 𝟭𝟮𝟰 𝗱𝗶𝗳𝗳𝗲𝗿𝗲𝗻𝘁 𝗹𝗮𝗻𝗴𝘂𝗮𝗴𝗲𝘀 🌍 Key takeaways from our experiments: 1️⃣ Trimming does not require a GPU. Our models were obtained on a CPU. 2️⃣ This method scales up to at least 4B parameters (we did not test beyond that). 3️⃣ Trimmed model is smaller than the original while preserving its performance. If you observe a slight performance drop, just fine-tuned to recover or even surpass the original performance. 4️⃣ For an equivalent compute budget, it is better to trim then fine-tune rather than fine-tuning the original model. Since the model is smaller, you can run more epochs/show more data and get in fine a better model than the original. 5️⃣ Trimming is a competitive alternative to distillation and quantization. E.g. we obtained our alternative to DistilBERT in 9 minutes on CPU vs. 90 hours of GPU for the latter. 6️⃣ Trimming could generate reasoning traces in the language of the trimmed model. This could be an alternative to generating traces in English and then translating them into the desired language. And many other things (such as how much data are needed, the impact of the database used, the order in which it should be done, etc.) are available in the blogpost! Blogpost: https://huggingface.co/blog/lbourdois/introduction-to-trimming Models: https://huggingface.co/spaces/alphaedge-ai/Trimming_models_search

reacted to lbourdois's post with 🤗 about 13 hours ago

New blog post! An introduction to a little-known but highly effective model reduction method: 𝗧𝗿𝗶𝗺𝗺𝗶𝗻𝗴✂️ We show how to reduce model size (we went up to 87.24% reduction) while preserving its performance. We applied this technique to 16 different model families across several modalities to illustrate that it works on any architecture (as long as the embedding layer is the last one of the model) and on any modality involving text. From these 16 families, we generated over 𝟱,𝟱𝟬𝟬 𝗺𝗼𝗻𝗼𝗹𝗶𝗻𝗴𝘂𝗮𝗹 𝗺𝗼𝗱𝗲𝗹𝘀 𝗶𝗻 𝟭𝟮𝟰 𝗱𝗶𝗳𝗳𝗲𝗿𝗲𝗻𝘁 𝗹𝗮𝗻𝗴𝘂𝗮𝗴𝗲𝘀 🌍 Key takeaways from our experiments: 1️⃣ Trimming does not require a GPU. Our models were obtained on a CPU. 2️⃣ This method scales up to at least 4B parameters (we did not test beyond that). 3️⃣ Trimmed model is smaller than the original while preserving its performance. If you observe a slight performance drop, just fine-tuned to recover or even surpass the original performance. 4️⃣ For an equivalent compute budget, it is better to trim then fine-tune rather than fine-tuning the original model. Since the model is smaller, you can run more epochs/show more data and get in fine a better model than the original. 5️⃣ Trimming is a competitive alternative to distillation and quantization. E.g. we obtained our alternative to DistilBERT in 9 minutes on CPU vs. 90 hours of GPU for the latter. 6️⃣ Trimming could generate reasoning traces in the language of the trimmed model. This could be an alternative to generating traces in English and then translating them into the desired language. And many other things (such as how much data are needed, the impact of the database used, the order in which it should be done, etc.) are available in the blogpost! Blogpost: https://huggingface.co/blog/lbourdois/introduction-to-trimming Models: https://huggingface.co/spaces/alphaedge-ai/Trimming_models_search

updated a collection about 13 hours ago

MTP Qwen 3.5/3.6 Stable

View all activity

Organizations

prithivMLmods 's models 1,233

prithivMLmods/Qwen3.5-0.8B-MTP-GGUF

Image-Text-to-Text • 0.8B • Updated about 14 hours ago • 356 • 1

prithivMLmods/Qwen3.5-2B-MTP-GGUF

Image-Text-to-Text • 2B • Updated about 14 hours ago • 416 • 1

prithivMLmods/Qwen3.5-35B-A3B-MTP-GGUF

Image-Text-to-Text • 36B • Updated about 14 hours ago • 804 • 1

prithivMLmods/Qwen3.6-35B-A3B-MTP-GGUF

Image-Text-to-Text • 36B • Updated about 14 hours ago • 1.38k • 2

prithivMLmods/Qwen3.6-27B-MTP-GGUF

Image-Text-to-Text • 27B • Updated about 14 hours ago • 3.42k • 2

prithivMLmods/Qwen3.5-4B-MTP-GGUF

Image-Text-to-Text • 4B • Updated about 14 hours ago • 2.93k • 3

prithivMLmods/Qwen3.5-9B-MTP-GGUF

Image-Text-to-Text • 9B • Updated about 14 hours ago • 2.73k • 3

prithivMLmods/QIE-FRIE1.1-Deep-Grainy-Polaroid

Image-to-Image • Updated about 14 hours ago • 8 • 1

prithivMLmods/QIE-FRIE1.1-Neutral-Exposure

Image-to-Image • Updated about 14 hours ago • 8 • 2

prithivMLmods/QIE-FRIE1.1-Object-Mover

Image-to-Image • Updated about 14 hours ago • 2 • 1

prithivMLmods/QIE-FRIE1.1-BBox-Object-Remover-v4

Image-to-Image • Updated about 14 hours ago • 6 • 1

prithivMLmods/Q3.5-9B-DS-v4-Flash-DA-GGUF

Image-Text-to-Text • 9B • Updated about 14 hours ago • 2.43k • 2

prithivMLmods/Q3.6-27B-DS-v4-Flash-DA

Image-Text-to-Text • 27B • Updated about 14 hours ago • 59 • 3

prithivMLmods/Q3.5-9B-DS-v4-Flash-DA

Image-Text-to-Text • 9B • Updated about 14 hours ago • 55 • 3

prithivMLmods/Q3.6-27B-DS-v4-Flash-DA-GGUF

Image-Text-to-Text • 27B • Updated about 14 hours ago • 3.28k • 4

prithivMLmods/Q3.6-27B-GLM-5.1-DA-GGUF

Image-Text-to-Text • 27B • Updated about 14 hours ago • 2.65k • 1

prithivMLmods/Q3.5-9B-GLM-5.1-DA-GGUF

Image-Text-to-Text • 9B • Updated about 14 hours ago • 2.35k • 2

prithivMLmods/Q3.5-9B-GLM-5.1-DA

Image-Text-to-Text • 9B • Updated about 14 hours ago • 36 • 1

prithivMLmods/Q3.6-27B-GLM-5.1-DA

Image-Text-to-Text • 27B • Updated about 14 hours ago • 45 • 1

prithivMLmods/Qwen3-VL-8B-Thinking-c_abliterated-v2

Image-Text-to-Text • 9B • Updated about 15 hours ago • 6 • 2

prithivMLmods/Qwen3-VL-8B-Instruct-c_abliterated-v3

Image-Text-to-Text • 9B • Updated about 15 hours ago • 986 • 6

prithivMLmods/Qwen3-VL-4B-Instruct-c_abliterated-v2

Image-Text-to-Text • 4B • Updated about 15 hours ago • 175 • 4

prithivMLmods/Qwen3-VL-8B-Instruct-abliterated-v2

Image-Text-to-Text • 9B • Updated about 15 hours ago • 837 • 30

prithivMLmods/Qwen3-VL-2B-Thinking-abliterated-v1

Image-Text-to-Text • 2B • Updated about 15 hours ago • 18 • 2

prithivMLmods/Qwen3-VL-2B-Instruct-abliterated-v1

Image-Text-to-Text • 2B • Updated about 15 hours ago • 70 • 3

prithivMLmods/Qwen3-VL-8B-Thinking-abliterated-v1

Image-Text-to-Text • 9B • Updated about 15 hours ago • 136 • 7

prithivMLmods/Qwen3-VL-8B-Instruct-abliterated-v1

Image-Text-to-Text • 9B • Updated about 15 hours ago • 339 • 15

prithivMLmods/Qwen3-VL-30B-A3B-Instruct-abliterated-v1

Image-Text-to-Text • 31B • Updated about 15 hours ago • 63 • 3

prithivMLmods/Qwen3-VL-30B-A3B-Thinking-abliterated-v1

Image-Text-to-Text • 31B • Updated about 15 hours ago • 8 • 4

prithivMLmods/Qwen3-VL-32B-Thinking-abliterated-v1

Image-Text-to-Text • 33B • Updated about 15 hours ago • 28 • 6