AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
Free AI Blog site — I have unused credits expiring soon, feel free to try it
Hi everyone, First of all, I want to clarify that this is not a promotional or advertising post. I h…
how do you decide between q4 and q5 on a 70b when 24gb is the cap?
ran into the q4 vs q5 wall again this morning. 70b model. 24gb card. q4 fits with margin, q5 fits if…
Added direct model downloads right from the UI in Anubis OSS - if anyone would help test that would be great
I developed and maintain Anubis OSS, an Apple Silicon Mac app for benchmarking local LLMs. Mostly bu…
New local model reaching near frontier on PII removal at 9 ms CPU inference
Hi all, I've been working on this model to strip sensitive information from computer use data and wo…
Sharing INT4-W4A16 version of Jackrong/Qwopus3.6-27B-v2 for VLLM/SGLang users
link: https://huggingface.co/JC1DA/Qwopus3.6-27B-v2-INT4-W4A16-Autoround Super surprised how good Ja…
Need Help - What would you build? Air-gapped NL assistant that is integrated with Splunk
So I have a side project with given scope: Fully air-gapped / on-prem - no internet, no outbound ca…
Update on 12x32gb sxm v100 cluster / local AI for legal drafting
Update from the lawyer with the V100 server. A few of you asked what I actually ended up running onc…
Anyone use QwQ-32B? It's over a year old? Has Qwen 3.6 27b basically replaced it?
I seen this one mentioned but it was a source from about 14 months ago. In the age of the Qwen 3.6 a…
ThriftAttention: Selective Mixed Precision for Long-Context FP4 Attention
submitted by /u/miserlou [link] [comments]…
Using Local LLMs for Generating Custom Interactive Recursive Textbooks on the Fly
submitted by /u/Ryoiki-Tokuiten [link] [comments]…
Server build for local inference. 128 gb 3200 or 256 gb 2133mhz RAM?
Hi, I am building a server so that my dual rtx 3090 setup runs at full speed. - asrock romed8 t2 rev…
AI content detector based on Qwen 0.8b fine-tuned on Pangram dataset
I've fine-tuned Qwen 3.5 0.8B on the dataset provided by Pangram with their EditLens paper. It's ava…