AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
Ling-3.1-flash is getting a 1019 update, with open weights to follow
For anyone still downloading the last Flash: there's another checkpoint on the way. Ant Ling's annou…
Llama.cpp PR: How to beat strata decode performance with a R9700
submitted by /u/keyboardhack [link] [comments]…
Carbon-X: the best open DNA language model runs locally with llama.cpp
Hi everyone, we just released Carbon-X, a 14B model that brings DNA and natural language together fo…
Tried LFM2.5-24-A2B. It's crap. Yes. I double confirm it. I wouldn't trust it peeling a peanut correctly
So, yesterday I made an apparently too simplistic post about this shitty model that everyone is chee…
webgpu : add Q2_0 support by teddygood · Pull Request #30914 · ggml-org/llama.cpp
Tested on an RTX 3060 with native Dawn WebGPU. llama-bench -m MODEL -p 512 -n 128 -r 5 -ngl 99 -dev…
How tf Exl3 2.9bpw have this low kl divergence. Is it better than ptq nvfp4?
Is there any negatives that im missing here? Mia-AiLab/DeepSeek-V4.1-Flash-1017-EXL3-EAQ-v1-2.9-bpw …
![[New Model] Sage-A1.5 released based on Qwen3.6-35B MoE with marketed benchmarks: "highly competitive performance against frontier-scale systems such as Kimi-K3, GLM-5.3, and GPT-5.6-sol"](https://external-preview.redd.it/5qD41xp5xVe9is_Ep2AJTpIbrWP4s_zAHdFLcrEwHBE.png?width=640&crop=smart&auto=webp&s=1e3b65c11e75a74bb2a69c96d53f4b14204c6f1a)
[New Model] Sage-A1.5 released based on Qwen3.6-35B MoE with marketed benchmarks: "highly competitive performance against frontier-scale systems such as Kimi-K3, GLM-5.3, and GPT-5.6-sol"
In the process of setting up the model and running local benchmarks on it on the official q4_k_m qua…
what can you do with smaller gpu's?
I mean gpu's with 6/8/12GB vram. All discussion around llm/AI these days is around coding, and this …
Huawei Atlas AI Accelerator Latest Comparison Overview
https://preview.redd.it/hwwhtgar5ywh1.png?width=1688&format=png&auto=webp&s=1aabdbd2bead7b89baece730…
What's your favorite medium to large (~50-150b params) MOE model? Aside from Qwen flash next.
I recently got some more RAM on my desktop, which has opened up running larger MOEs by splitting the…
I have an answer! Qwen Flash Next IQ2 IS better than Q8 of 27B (for me).
I asked a while ago if it would be worth it to try and run qwen flash next at q2 since I can only re…
Open source LLM appreciation post
I just downloaded Raon-1-mini 30B A4B as well as Flint 40B A2.5B and it just blows my mind that we h…