jaithree/Tini-Cybersec-8B-A1B-mlx-8bit
Text Generation • 8B • Updated • 12
jaithree
jaithree
AI & ML interests
"In the beginning was the word. Then came the **** word processor. Then came the thought processor. Then came the death of literature. And so it goes" -- Hyperion - Dan Simmons
Recent Activity
reacted to FredyRivera-dev's post with ❤️ about 8 hours ago
We wrote a full technical guide on how to train a bilingual (ES/EN) LLM from scratch: TinyQwen.
Covers:
- Hybrid architecture based on Qwen3.5
- Pre-training with 15B tokens
- Cost benchmark between H200 and B200
- Post-training with SFT + LoRA
- Full code and data, open source
With ~$11 of compute on an H200 we ran an initial training run, enough to validate the full architecture and pipeline.
Blog post: https://aquiles-ai.vercel.app/blog/tinyqwen-from-scratch
Technical feedback welcome, especially from anyone looking to replicate the pipeline with more compute. updated a model about 19 hours ago
jaithree/Tini-Cybersec-8B-A1B-mlx-8bit published a model about 19 hours ago
jaithree/Tini-Cybersec-8B-A1B-mlx-8bitOrganizations
None yet
jaithree/grug-v2-9b-mlx-q4
Text Generation • 1B • Updated • 21
jaithree/DarkIdol-Llama-3.1-8B-Instruct-1.0-Uncensored-OptiQ-4bit
Text Generation • 8B • Updated • 282 • 1
jaithree/MN-12B-Mag-Mell-R1-OptiQ-4bit
Text Generation • 12B • Updated • 84 • 1
jaithree/grug-9b-mlx-q4
Text Generation • 1B • Updated • 24