AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
Qwen3.6 27b q5_k_M MTP - 256k context - 5090
https://preview.redd.it/ktg0lr3e0p0h1.png?width=1279&format=png&auto=webp&s=d110580662a5c707038b7e2e…
Stop wasting electricity
Run on my rtx4090 llama.cpp params: llama-server -m ~/Projects/llm/models/Qwen3.6-27B-UD-Q4_K_XL.ggu…
Follow-up to my TranslateGemma-12b benchmark post: human reviewers flagged 71% of the segments automated metrics rated clean
A couple of weeks ago I shared the results of a benchmark here showing TranslateGemma-12b beating fr…
Models and Quants quality test results - the chessboard svg (Qwen3.6 27B/35B-A3B/Zaya1)
According to this. I run several more tests to cover more models and quants. https://www.reddit.com/…
feat: add MiMo v2.5 vision by AesSedai · Pull Request #22883 · ggml-org/llama.cpp
now MiMo can see submitted by /u/jacek2023 [link] [comments]…
converting weights to snn
Hello everyone, I developed the snn architecture from scratch based on the human brain. I had severa…
Gemma 4 E4B is great for short transcriptions
Yes, for material that is an hour long, there is no getting around tools like Whisper - or something…
Llama models: still valuable for finetuning or surpassed by everything new?
Hello there people. So I have noticed that people are pretty much ignoring Llama 3 plus 3.1, 3.2, an…
What model for coding?
I am amazed by the development of locallm in the coding area. Right now im Testing Qwen3.6 27b and i…
Will unsloth release MLX versions of the MTP qwen3.6 and gemma 4 models?
Question in title. Would be awesome to have this on macs, especially q8 or whatever the minimal-loss…
Efficient use of Large system RAM
For example, if I have 128 GB of system RAM but only 16 GB of VRAM, am I still limited to models tha…
Blackwell LLM Toolkit - NVFP4 Config +Wheels + Benchmarks for Blackwell GPUs via TensorRT-LLM - 270 tk/s Nemotron 3 Omni
Was trying to get a good set of models with NVFP4 to leverage the RTX Pro 6000 and was able to get a…