Level1Techs - The CUDA hour is Late. Also, Who Made the R9700 this fast?
submitted by /u/Thrumpwart [link] [comments]β¦
AI tools, cybersecurity and development news aggregated from top sources β saved permanently with unique URLs.
Level1Techs - The CUDA hour is Late. Also, Who Made the R9700 this fast?
submitted by /u/Thrumpwart [link] [comments]β¦
Maybe we'll get cheap RAM for Christmas after all!
submitted by /u/keepthepace [link] [comments]β¦
Lawyer with too many GPUs, part 4: DeepSeek-V4.1-Flash on eight V100s from 2018. 200+ tok/s on code, ~110 on legal writing, 2,200 tok/s prefill at 128K, 524K context, every weight in VRAM
fuck you sam altman. i am keeping my spare capacity. Update from the lawyer with the V100 server. Tβ¦
I fixed my tiny TTS by editing the weights directly, no retraining
I'm building Silencio-2, a small finetune of Kyutai's Pocket TTS. It adds inline tags for emotions (β¦
Strata for all Qwen models from little to big
Ran every Qwen GGUF on my disk through RustingStrata and llama.cpp, same PC, same file, back to backβ¦
Appreciation post for OrcaCyber-Nano-1.0
I haven't see anyone post about this gem of a finetune. So I wanted to appreciate the team and bringβ¦
Z.ai chief scientist Jie Tang just revealed the training pipeline behind the upcoming GLM-5.5 (32B, 122B, and 256B)
Smaller GLM models are coming! GLM 5.5 will have a 32B model! submitted by /u/wapswaps [linkβ¦
The Ultimate MoE Training Handbook: training Mixture-of-Experts models with Megatron-LM, setting by setting.
This handbook is for people who have trained a dense model and want to train an MoE next, or who areβ¦
Deepseek fixed my HDMI display show case
I gave Qwen 3.8 flash next 2 times it failed and took long time to conclude the result, DeepSeek tooβ¦
Add support for the xing4_0 by shuxiaoqiong Β· Pull Request #31589 Β· ggml-org/llama.cpp
Xing4.0-29B-A4B is a next-generation large language model in the Xing series (formerly TeleChat), deβ¦
DeepSeek-V4.1-Flash-1017 on one RTX 3090: Big updates to the Delta Inference Engine v0.93. Same 41 tok/s at 192GB/IQ2 at better quality, usable from 64 GB RAM, first token ~40% sooner, new Unsloth quants at full speed, EXL3, basic multi-GPU, public CI and more
Big update to the Delta Inference Engine, you guys asked for more features, more benchmarks and lessβ¦
I added local TTS and STT to apple-llm using what's already on your Mac. 30 minutes of narration renders in under 20 seconds on an M4 Air
I posted apple-llm here a while back: a Node and Python package that calls the LLMs Apple ships withβ¦