A conversation about local LLMs with a senior government AI leader
I'm a local LLM solutions developer and I've recently had the opportunity to spend an hour talking tβ¦
AI tools, cybersecurity and development news aggregated from top sources β saved permanently with unique URLs.
A conversation about local LLMs with a senior government AI leader
I'm a local LLM solutions developer and I've recently had the opportunity to spend an hour talking tβ¦
Qwen3.6-27B-Q6_K - images
Settings: temperature=0.6, top_p=0.95, top_k=20, min_p=0.0, presence_penalty=0.0, repetition_penaltyβ¦
Where the goblins came from
https://openai.com/index/where-the-goblins-came-from/ Something actually good from OpenAI. submitβ¦
AMD Engineers directly seeking ROCm feedback
Hoping there are folks here with ROCm experience they can share with those guys to improve the ecosyβ¦
DeepSeek V4 isn't beating Opus, but it doesn't need to
DeepSeek V4 is not in the same league as GPT-5.5 or Opus 4.7. Benchmarks put it slightly below both β¦
Qwen3.6-27B 4.256bpw in full VRAM on a 5070 Ti with 50000 q4_0 context - not turbo!
Hugging face link here. Ive been waiting for sokann to drop his Qwen 3.6 GGUF for 16 GB GPUs as his β¦
Larger Gemma-4/Qwen3.6
Qwen3.5-122B-A10B at Q6_K is really good. Do you think we will see a larger MoE Gemma-4 or Qwen3.6 aβ¦
You should probably disable algif kernel module this second if you run linux.
submitted by /u/a_beautiful_rhind [link] [comments]β¦
I got a Qwen sticker lol
submitted by /u/lombwolf [link] [comments]β¦
"What do you guys even use local LLMs for?" Me: A lot
Created separate private API keys for each service within LiteLLM and started logging the usage via β¦
Qwen Models are such good models?
https://preview.redd.it/o1uxb57u47yg1.png?width=862&format=png&auto=webp&s=d38204fe6ccd0d8326dcd98a5β¦
Strip Qwen3.6 dense of its multimodal capabilities
This may be naive but if we stripped a model of its image processing/voice processing capabilities, β¦