Considering two Sparks for local coding
I'm currently running a 4x RTX 3090 system (96GB VRAM, DDR4 2133 RAM) and have tested opencode and pβ¦
AI tools, cybersecurity and development news aggregated from top sources β saved permanently with unique URLs.
Considering two Sparks for local coding
I'm currently running a 4x RTX 3090 system (96GB VRAM, DDR4 2133 RAM) and have tested opencode and pβ¦
Struggling with Qwen3.6 27B / 35B locally (3090) slow responses, breaking code looking for better setup + auto model switching
Hey everyone, Iβve been experimenting with running Qwen models locally on my setup: GPU: RTX 3090 (2β¦
Trying to train tiny LLMs on length constrained reddit posts summarization task using GRPO on 3xMac Minis - updates!
So, here's an update to my GRPO training on length constrained reddit posts summarization on 3x Mac β¦
vibevoice.cpp: Microsoft VibeVoice (TTS + long-form ASR with diarization) ported to ggml/C++, runs on CPU/CUDA/Metal/Vulkan, no Python at inference
A few weeks ago I shipped vibevoice.cpp, a pure-C++ ggml port of Microsoft VibeVoice (the speech-to-β¦
Prompt injection benchmark: delimiter + strict prompt took Gemma 4 from 21% to 100% defense rate (15 models, 6100+ tests)
When dealing with untrusted outside input, I think you should handle it based on the situation. If yβ¦
DeepSeek V4 Pro matches GPT-5.2 on FoodTruck Bench, our agentic benchmark β 10 weeks later, ~17Γ cheaper
Tested DeepSeek V4 Pro on FoodTruck Bench β our 30-day agentic benchmark where models run a food truβ¦
I made a voice controlled Tic-Tac-Toe game as a learning project
Hi, First of all, I know this might be a silly project, but I made it specifically as an educationalβ¦
As MTP prepares to land in llama.cpp, Models that support MTP
DeepSeekv3 OG DeepSeekv3.2/4 Qwen3.5 GLM4.5+ MiniMax2.5+ Step3.5Flash Mimo v2+ Until we get mtp weigβ¦
Qwen3.6 27B FP8 runs with 200k tokens of BF16 KV cache at 80 TPS on a single RTX 5000 PRO 48GB
----START HUMAN TEXT---- Hi all, I've seen a bunch of posts about squeezing 27B onto a 24GB card andβ¦
US GUARD Act: Age Verification for AI Chatbots
There's been a growing number of AI regulation proposals I've been seeing in the US, and this bill iβ¦
qwen 3.6 27B looping problem
Whenever I write here that I use gemma 31B I get answers that qwen 27B is better. I switched in the β¦
Peanut - Text to Image Model (Open Weights coming soon)
A new anonymous model debuts at #8 in the Artificial Analysis Text to Image Arena! Peanutβs weights β¦