AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
Can Opus weight-space-edit Qwen3.8-27B to refuse less? Yes
Everyone's been wondering whether you can take an open model and edit its weights directly to make i…
![[Paper] SpecOPD: Branch-Parallel On-Policy Distillation for Speculative Decoding - By Qwen](https://preview.redd.it/nrft41x6stzh1.jpeg?width=140&height=41&auto=webp&s=a7b04a821389f8cb8f0bd5378b74bfbd81b4e737)
[Paper] SpecOPD: Branch-Parallel On-Policy Distillation for Speculative Decoding - By Qwen
Speculative decoding (SD) accelerates large language model inference by reducing the sequential cost…
[GUIDE] Qwen3.8 Flash-Next on a single RTX 5080 + 64GB RAM: >250 tok/s tg and 5700 tok/s prefill in real agent coding sessions (Basalt + new Unsloth UD-IQ3_XXS + Lamina drafter),+ how it compares to llama.cpp
TL;DR Basalt is the engine and it's doing the heavy lifting. Same model file, same box: about 3.5x …
![[Paper] FireFlash : An Open Recipe for Long-Horizon Agentic RL Achieving the Performance-Cost Pareto Frontier](https://preview.redd.it/orkgrqsqjtzh1.jpeg?width=140&height=117&auto=webp&s=543c65a91791905e11e47c7c94b29d64fdb8179e)
[Paper] FireFlash : An Open Recipe for Long-Horizon Agentic RL Achieving the Performance-Cost Pareto Frontier
We introduce FireFlash, a 300B-scale model tailored for long-horizon agentic tasks. FireFlash excels…
NVIDIA RTX PRO 5500 Blackwell appears at $17,999 MSRP, higher than RTX PRO 6000 at $16,000 MSRP set some months ago by NVIDIA - VideoCardz
submitted by /u/panchovix [link] [comments]…
Getting editable layers out of Qwen-Image 2.1, a model that only edits: what works, what still fails (local, open source) Kokon
I'm the developer of Kokon, a local photo editor around Qwen-Image 2.1 Turbo (on stable-diffusion.cp…
An open-source project just ranked #1 on EnterpriseRAG-Bench, ahead of the listed systems from OpenAI, Google, Microsoft and Amazon
Some of you might remember our post comparing 18 RAG pipelines against our agent loop on FRAMES. The…
My first experience with agentic AI
Strata, Hermes, Kitten TTS with Rosie voice and Whisper on RTX 3060 with 48 gb dram running Qwen3.8-…
Rather Qwen4-27b at 1M ctx than a big MOE at 128k
Larger context just gets more work done rather than having to re-read files ETC id much rather use m…
Quantization livestream with goats of inference
Hey folks, it's Merve from Hugging Face. Title of this post is super self explanatory, we are doing …
Thinking about upgrading ram to 128GB
i have an z690 mainboard, max 128GB RAM (4 slots, dual channel) and r9700 (32gb vram) currently at 4…
Qwen3.8-27B has become unuseable recently
When it came out, I downloaded a Q4 quant of qwen3.8-27b and ran it using llama.cpp on my RTX 4090 a…