terminal
howtonotcode.com

Stories by Tags

Search and filter stories across all digests by tags. Stories must match all selected tags.

Stories with tags: cuda, cuda

Showing 1-2 of 2

LocalAI 3.9.0 adds Agent Jobs and smarter GPU memory management

article Daily Digest calendar_today 2025-12-26 Daily

LocalAI 3.9.0 introduces an Agent Jobs panel and API to schedule background agent tasks (cron, webhooks, MCP) and adds a Smart Memory Reclaimer with LRU model eviction to prevent OOM by auto-unloading unused models. It also adds MLX and CUDA 13 support, improving compatibility across Apple Silicon a...

Unconfirmed report: NVIDIA to buy Groq for $20B — plan for serving portability

article Daily Digest calendar_today 2025-12-26 Daily

A YouTube report claims NVIDIA has acquired Groq for $20B; there is no official confirmation from NVIDIA or Groq at the time of writing. Treat this as a rumor, but use it to stress‑test your hardware and SDK portability for LLM inference. Consolidation could affect roadmaps (CUDA/TensorRT vs Groq LP...