ZFO: Decoupling Direction and Step-Size for Efficient LLM Fine-Tuning
arXiv preprint proposes a lightweight Zero-and-First-Order framework that uses a first-order optimizer for direction and only two extra objective evaluations for…
More freedom.
More control.
New AI releases, creative tools and what you can actually download, change and use.
118 stories
arXiv preprint proposes a lightweight Zero-and-First-Order framework that uses a first-order optimizer for direction and only two extra objective evaluations for…
arXiv preprint introduces TACO, a ternary one-sparse optimizer that follows an operator-norm steepest-descent direction by selecting the sign of the largest-magnitude entry per…
Allen Institute for AI releases AstaBrief 8B, a specialized open-weights model that produces cited scientific reports from queries and literature excerpts. It delivers reports…
Meta's new 30B-parameter multimodal model, distilled from Muse and released under Apache 2.0, targets local deployment for privacy-focused coding, document analysis and…
Meta Superintelligence Labs released its first open model, the 30B-parameter multimodal Muse Glimmer, on August 10 2026. Optimized for local agent workloads with 128K+ context…
NVIDIA's Nemotron 3.5 Lightning, a 30B-parameter Mixture-of-Experts model with 3B active parameters per token, is now available via Ollama for fully local inference. Optimized…
New research quantifies how leading ASR systems reproduce erroneous reference transcripts, recover silenced numbers, and switch orthography to match public benchmarks like…
A publicly shared recipe applies Group Relative Policy Optimization via TRL to LiquidAI's LFM2.5-350M, raising its IFStruct score from 22.6% to 29.7% after 100 steps on roughly…
Jun Kim, the creator and maintainer of oMLX, has joined Hugging Face effective September 2026. The move aims to stabilize oMLX development, accelerate contributions to Apple's…
Hugging Face’s summer ecosystem report separates attention from observed use. For model selection, repository popularity is a starting point, not a verdict.