mesa PR with 37-130% llama.cpp pp perf gain for vulkan on Linux on Intel Xe2
submitted by /u/TheBlueMatt [link] [comments]β¦
AI tools, cybersecurity and development news aggregated from top sources β saved permanently with unique URLs.
mesa PR with 37-130% llama.cpp pp perf gain for vulkan on Linux on Intel Xe2
submitted by /u/TheBlueMatt [link] [comments]β¦
Speculative Decoding Implementations: EAGLE-3, Medusa-1, PARD, Draft Models, N-gram and Suffix Decoding from scratch
Iβve been working on an educational implementation repo for speculative decoding: https://github.comβ¦
Confirmed: SWE Bench is now a benchmaxxed benchmark
submitted by /u/rm-rf-rm [link] [comments]β¦
Opencode-power-pack β Claude Code skills ported to OpenCode
I switched from Claude Code to OpenCode a few weeks ago and realized most of Anthropic's official Clβ¦
Are Unsloth models as good as I read?
Has anybody done some comparing between the models that Unsloth offers and their counter part? For eβ¦
Is there any top level hobbyist hardware you guys are waiting to come out this year?
So I've explored buy everything from an RTX 6000 to Mac Studio 512gb M3 ultra to a DGX Spark (I needβ¦
Hardware Choice for 27b to 31b models.
I've come to a point where I find the 27b and 31b models quite impressive. I have a 16 GB AMD Radeoβ¦
Speculative decoding with Gemma-4-31B + Gemma-4-E2B enables 120 - 200 tok/s output speed for specific tasks
So for my project I was using up until now either Gemini 3 / 2.5 Flash or Flash-lite. All my use casβ¦
HauhauCS (of "Uncensored Aggressive" fame) published an abliteration package that plagiarizes Heretic without attribution, and violates its license
HauhauCS (u/hauhau901) publishes uncensored LLM models on HuggingFace with 5M+ combined monthly downβ¦
Iβm starvinβ
submitted by /u/Important_Quote_1180 [link] [comments]β¦
Qwen3.6 35B A3B Heretic (KLD 0.0015!) Incredible model. Best 35B I have found!
Been using this for a few days. It is BY FAR the best uncensored model I have found for Qwen 3.6 35Bβ¦
πPocket LLM v1.5.0 is out: offline Android LLM chat with voice, image input, OCR, and camera capture
Pocket LLM v1.5.0π New in this release: - ποΈ Voice input - πΌοΈ Image input with OCR, Gemma vision, anβ¦