I made a Windows app for managing llama.cpp in WSL/Ubuntu
Iβm a Windows user, and I have fairly Windows-y expectations for software: I prefer not having to liβ¦
AI tools, cybersecurity and development news aggregated from top sources β saved permanently with unique URLs.
I made a Windows app for managing llama.cpp in WSL/Ubuntu
Iβm a Windows user, and I have fairly Windows-y expectations for software: I prefer not having to liβ¦
Looking for Suggestions β Single 5090 & 64gb DDR5
Hi Reddit, I am planning on running Qwen 3.6 27b NVFP4 via vLLM on my 5090 but was wondering if someβ¦
Turning local agents into self-optimizing agents
I was experimenting with a self-optimizing agentic pipeline to climb the benchmark leaderboard (Termβ¦
Long-context performance at lower quants
I've been using Qwen3.5 122B A10B (Q3_K_XL) a lot lately for coding, and it's been pretty incredibleβ¦
OpenMOSS-Team/MOSS-TTS-v1.5 Β· Hugging Face
MOSS-TTS-v1.5 MOSS-TTS-v1.5 is continued from MOSS-TTS 1.0. It preserves the main 1.0 capabilities, β¦
Feedback Wanted: Building for easier local AI
Just what the post says. Looking to make local AI easier so literally anyone can do βall the thingsββ¦
[OSS] dlmserve - first serving engine for diffusion language models
Spent the last few months building this on a single RTX 5070. Quick context: diffusion language modeβ¦
Small set of local MCP server installers for home Linux users
Hi all, I have published a small open-source MCP server bundle called MCP Basic Servers: https://gitβ¦
Harbor v0.4.19 - vllm/sglang/llama.cpp launch codex/claude/pi/opencode
I'm usually not posting about Harbor releases out of the respect for the community here, but I thinkβ¦
Okay 27B made me a believer
I previously hated on this model, but I have just been impressed by it, and I understand the hype noβ¦
Tencent Hy-MT2 is now under Apache License 2.0
nice update bois submitted by /u/sword-in-stone [link] [comments]β¦
Keye-VL-2.0-30B-A3B -- Introducing DSA attention into multimodality for the first time
Meet Keye-VL-2.0-30B-A3B β the latest 30B-class flagship base model in the Keye series, purpose-builβ¦