AI Tools & Research

Tencent compressed Hy4-preview from 1.5TB to about 200GB GGUF and kept about 98% performance.

submitted by /u/RedditUsr2 [link] [comments]…

Someone tested various Models on the Political Compass test...

submitted by /u/Thrumpwart [link] [comments]…

Exo labs claiming 4.8 tb/s memory bandwidth through m5u Mac Studio clustering

Exo labs making some very exciting and interesting claims. The headline is bandwidth scales linearly…

Nvidia’s AI advantage is moving beyond the GPU

The new generation of data center systems is increasing efficiency with smarter traffic control inst…

Qwen 3.8 27B at 50 tok/s with 100k Context on a 16GB GPU! (beellama.cpp)

I wanted to share my successful setup for running a Qwen 3.8 27B model with a massive context window…

How important is it for Chinese LLMs to reach the Opus 4.8 level?

In mid-August, Ramp published spending data collected from 70,000 U.S. companies: Fable 5 ,the most …

I analyzed 31,352 hourly LLM benchmark scores: within-day variation was 2.8 points, while between-day variation was 8.4 [P]

https://preview.redd.it/42s57e5oqamh1.png?width=1903&format=png&auto=webp&s=69958a72e22276534b3605d1…

If your t/s is low enough, you can see speculative decoding with your own eyes

The other day I was trying out a distillation of DS4 Pro, and it came with MTP. It was slow as hell …

The Cybersecurity Apocalypse Is Coming in ‘Months,’ AI Giants Warn

Plus: Hackers target over 100 US water systems, ICE puts in an order for robot dogs, and you’ll neve…

PhD Internship in smaller lab [D]

How much of a disadvantage is it if your only internship is not at one of the big frontier labs when…

How to Run a Chatbot on Your Own Computer

Installing a large language model on your personal computer gives you a handy digital assistant that…

Build a Local AI App in .NET with Ollama

Learn how to build a real AI-powered application in .NET using Ollama, Llama 3, and Microsoft.Extens…