Any LiteRT user's in here on linux ?
if anyone on here is using litert , check out this GUI for ubuntu/debian ... you might like it ! wwwβ¦
AI tools, cybersecurity and development news aggregated from top sources β saved permanently with unique URLs.
Any LiteRT user's in here on linux ?
if anyone on here is using litert , check out this GUI for ubuntu/debian ... you might like it ! wwwβ¦
A quick Gemma4 31B comparison (Q4_k_M, QAT, heretic)
No numbers. Not sure if anybody caresβ¦ Iβve run the UD version of Q4_k_m for a month. I talk to thisβ¦
Github Copilot finally supporting custom endpoints
https://preview.redd.it/082gnmin1l5h1.png?width=1740&format=png&auto=webp&s=2c89f6310c8c654611188183β¦
OpenLumara - A different kind of AI agent, written from scratch, not vibecoded. Extremely token-efficient, super small system prompt, made for local models. Everything is modular.
Hi locallama community! Yes, I know, yet another AI agent announcement post. There are a dime a dozeβ¦
Gemma 4 QAT benchmark results (AMD 7900 XTX): faster, less VRAM, no quality loss
Iβve been doing lots of testing back and forth with this 7900xtx. All of my workloads were relying oβ¦
Running Qwen3.6-35B-A3B on a laptop RTX 4060 (8GB) β what worked, what didn't, and a surprising speculative-decoding result
TL;DR: I spent a long session tuning a 35B MoE on a tiny 8GB laptop GPU. Three things mattered a lotβ¦
dots.tts 2BποΈ SOTA TTS from RedNote
π Blog: https://rednote-hilab.github.io/dots.tts-demo/ π GitHub: https://github.com/rednote-hilab/doβ¦
A 10 year old Xeon is all you need
Thanks to u/demian_west for finding it. submitted by /u/arbv [link] [comments]β¦
Initial testing with llama-bench and 3 different Qwen3 models for my R9700 32GB
In a recent build I did I used dual R9700 32GB cards but I wanted to see how a single R9700 stacked β¦
What exactly is quantization aware training?
First time hearing it. I also heard about the gemma 4 qat quants and if any one of them is good for β¦
Donβt act like yβall ainβt thinking it. Iβm just saying the quiet part out loud. /s
Of course Iβm thankful for all that Qwen has bequeathed us, but deep down in the darkest pit of our β¦
At least one more Gemma 4 model confirmed??
submitted by /u/Sufficient-Bid3874 [link] [comments]β¦