AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
Tensor split mode: CUDA error on latest llama.cpp with Qwen-3.6-27b
Hi guys, I am running into issues when loading the Unsloth UD-Q8_K_XL quant and wanted to check if a…
The Future of Free & Local Models: Training Co-Ops? Professional Orgs? Churches?
I'm relatively new to this forum, so forgive me if this discussion has been had ad nauseam already. …
How much VRAM needed for Qwen 3.6 27B Q8 with 262K context?
trying to figure out my next GPU purchase. currently running IQ4XS and Q4 KV with 262K context and w…
Macbook M5 Pro 24GB or 48GB
Are LLMs for coding (or other genuinely useful workloads) actually viable on 24GB or 48GB Macs? I'm …
Can LLMs Adhere to Strict 2D Spatial Constraints? (Testing with Sokoban)
I recently ran a benchmark to test how well modern Large Language Models (LLMs) handle spatial geome…
Major labs timeshift between the research they publish on Arxiv and implementation in models
Hi guys, just wanted to ask if you know whether if Google Deepmind publishes an interesting paper on…
Calling it now Microsoft is buying Unsloth.
I am going to be honest, I am leery of this new partnership with Unsloth. Microsoft historically hat…
Helvete-nano
Hey everyone, Just released Helvete nano, a compact 2b model for used on unrestricted convo. and cre…
New Microsoft models are not open, right?
Hi. We know their sizes, but I couldn't see any mention of them being open, in any sense of the word…
Holo3.1 35B/9B/4B/0.8B (Qwen 3.5 finetunes)
from Hcompany (which seems to be a French company): Holo3.1: Fast & Local Computer Use Agents Model …
Mellum & Granite Embedding models are ready on llama.cpp
https://github.com/ggml-org/llama.cpp/pull/23966 https://github.com/ggml-org/llama.cpp/pull/22716 Us…
Another shout out to llama.cpp build b9455 2x3090
https://preview.redd.it/xyvtkzwr005h1.png?width=645&format=png&auto=webp&s=aebd5b5ef79255247c9bc91fb…