Anyone down to test this? Just uploaded a model using rys
Anyone down to test this? Just uploaded a uploaded a model with rys, looks pretty fun. https://huggiβ¦
AI tools, cybersecurity and development news aggregated from top sources β saved permanently with unique URLs.
Anyone down to test this? Just uploaded a model using rys
Anyone down to test this? Just uploaded a uploaded a model with rys, looks pretty fun. https://huggiβ¦
Vision-capable LLMs vs. OCR for long-document (including charts, images, tables, etc.) QA
I benchmarked vision-capable LLMs (the "just attach the PDF and let the model read it" pattern) agaiβ¦
Is there any reason for an uncensored model if you have no interest in roleplaying?
My rag I've been building is much in response to having a LLM that I feel more confident in knowing β¦
Performance When Offloading Large Models to System RAM?
I noticed for people running large models, or those that would be cost prohibitive to have all in GPβ¦
minor speed bump for MTP with Qwen3.6-27B-MTP Q6_K_XL
I'm on Macbook M5 Max with 128GB RAM Running a test in openwebui using llama-server (llama.cpp): unsβ¦
llampart 1.0.0 - I released a standalone local web UI for llama-server with translations, extended settings and a polished conversation sidebar
Hi everyone, Iβve just published the first public release of llampart 1.0.0: https://github.com/mchoβ¦
How to keep up to date on latest models?
How can I keep up to date on the latest models? Is there a website with the latest releases, benchmaβ¦
MLID claims nova lake-ax not cancelled just renamed razor lake-ax
Since these are code names, I find it humorous that a product is not cancelled just that the code naβ¦
Local model doing accounting tasks
So I've been using qwen 3.6 27b for monthly closes, bank recs, payable and receivables. Built a simpβ¦
llama.cpp server have built-in native tools (exec_shell, edit_file, etc.)
https://preview.redd.it/24uvk7o4sy2h1.png?width=1440&format=png&auto=webp&s=542570e3057b6f44c1e7e8d9β¦
For users have have both 6000 PRO MaxQ and Workstation Edition (or Server Edition), how much slower is the MaxQ vs the WS/SV on compute? (Prompt processing, Diffusion, etc)
Hello guys, hoping you are doing fine! I'm torn on the choice of either a RTX 6000 PRO MaxQ (on stocβ¦
Command A+ (218B MoE) running on Apple Silicon β MLX port, PR open
Cohere dropped Command A+ on the 20th (218B total / 25B active, 128 experts top-8, Apache 2.0). Wrotβ¦