All DGX Station GB300 OEM systems side-by-side in one image (roughly actual size)
Except for HP which I had to guesstimate from some Chinese guy's pic at a showcase because the ZGX Fβ¦
AI tools, cybersecurity and development news aggregated from top sources β saved permanently with unique URLs.
All DGX Station GB300 OEM systems side-by-side in one image (roughly actual size)
Except for HP which I had to guesstimate from some Chinese guy's pic at a showcase because the ZGX Fβ¦
Benchmarked inference engines for M1 Max 64gb-results & analysis
I'm a hobbyist on a budget, and am using a M1 Max MacBook Pro for local inference, with Hermes Agentβ¦
How do I try to run Gemma 4 31B at Q8 quantization? Only seeing Q4_K_M on Ollama
Just got my new PC up and running and want to test some local models. I'm a complete noob but I've mβ¦
[PSA] 5060ti 16GB for $300.99. 5070ti 16GB for $699.99. Best Buy in store clearance.
The 5060ti 16GB(SKU 6630626) has been on clearance for a couple of weeks in Best Buy stores for $419β¦
Someone out there likely needs this
submitted by /u/Signal_Ad657 [link] [comments]β¦
Cost Analysis of my $6.4k Local LLM Server
I haven't seen any of these done, so I just wanted to share my experience in case it is useful for aβ¦
Would a MacBook M5 16/24/32GB be an upgrade, complement, or waste next to my RTX 4060 laptop?
Hi everyone, Iβm trying to understand whether buying a future/possible MacBook M5 with 16GB, 24GB, oβ¦
Running Qwen 3.6 35b MoE With Zoo Code On M1 Max is Amazing! Fully local, battery-powered coding powerhouse!
submitted by /u/L064N [link] [comments]β¦
Has anyone experimented with stabilizing low quant models with lower temp and top p?
I was thinking about trying some bigger models out on my 80GB VRAM setup, but everything MoE is too β¦
What features dramatically improved your custom memory system?
Let's talk memory systems. I'm going to provide an overview of my memory system in the comments, butβ¦
For those creating personal assistants locally - how has short/long term memory impacted your experience?
With the release of Qwen 3.5 27B, I created my first truly autonomous agent. That alone completely bβ¦
Parallax: Parameterized Local Linear Attention for Language Modeling
Large Language Models (LLMs) have become the central paradigm in artificial intelligence, yet the coβ¦