AI tools, cybersecurity and development news aggregated from top sources β saved permanently with unique URLs.
webui: support video files as input by foldl Β· Pull Request #22830 Β· ggml-org/llama.cpp
now you can talk about videos submitted by /u/jacek2023 [link] [comments]β¦
G4-Meromero-31B-Uncensored-Heretic Is Out Now, a Finetune of Gemma 4 31B It Designed for Creative Tasks, With Kld of 0.0100 and 15/100 Refusals!
Provided in both Safetensors and GGUFs. Safetensors: llmfan46/G4-MeroMero-31B-uncensored-heretic: htβ¦
Ran the same models across Strix Halo, RTX 3090, and RTX 5070 because I wanted my own numbers
I kept seeing inference-speed claims for these models and wanting an apples-to-apples comparison on β¦
Anyone else running one of the pre-release branches of MTP support to maintain the higher speeds?
I cant help myself its ~20% faster for me, I took the highest speed branch(for me), added the visionβ¦
an alternative = similar experience to using windsurf but on local?
so i am not that experienced when it comes to llms, i just have ollama and open webui and occasionalβ¦
Anyone holding out for m5 ultra?
-Faster memory -M5 Ultra, have floating-point (FP) hardware built directly into the silicon at multiβ¦
WSL can't reach Kobold.cpp running on Windows, even though the API works fine in PowerShell, SillyTavern & a Kenshi SentientSands Mod. Does anyone know the solution?
Okay sorry for the slop below but I'm losing my mind with this and I'm hoping someone here has dealtβ¦
Now that MTP is merged... What's the best outputs you're getting on Qwen 3.6 35B on 2x3090s?
We've got great outputs for 27B via club 3090, but what about those of us who love the blazing speedβ¦
Qwen3.5-122B-Q5-MTP - Qwen3.5-122B-Q6-MTP
for anyone who cares... π prompt = spen a 1000 tokens unsloth MTP models strix halo llama.cpp:serverβ¦
I fitted the new Ξ΄-mem research for apple silicon using mlx and openclaw integration! My findings
So Iβve been nerding out hard about memory, and have come to the conclusion that context management β¦
gemma-4-Ortenzya-The-Creative-Wordsmith-31B-it-uncensored-heretic is Out Now, A Writing Finetune that Aims to Improve Gemma 4 31B it Writing Quality with More Natural English and Better Prose, Good for Creative Writings, Translations and RPs!
Provided in both Safetensors and GGUFs. llmfan46/gemma-4-Ortenzya-The-Creative-Wordsmith-31B-it-unceβ¦
Local Qwen 3.6 vs frontier models on a coding primitive: single-file HTML canvas driving animation - results and GIFs
Saw this post comparing Qwen 3.6 variants on coding primitives, so I wanted to see how local quants β¦