OpenEnv Released: Hugging Face Turns Claude Code and Codex into RL Environments
Hugging Face released OpenEnv, an open-source capture proxy turning coding harnesses like Claude Code and Codex into RL environments without modifying harness o
#vLLM
TAU-HOME.COM stories tagged vLLM.
Local AI Runtime Benchmarks: Comparing exllamav3, llama.cpp, vLLM, and TensorFold Across 16GB to 256GB Memory Classes
Empirical benchmark results comparing local LLM inference speeds (tok/s) and Time to First Token (TTFT) across RTX 5060 Ti (16GB), RTX 5090 (32GB), and GB10 (12
Decision 2.0 Released: Open-Source Decision AI Family Spanning 0.6B to 27B Parameters
The vllm-sr team has officially open-sourced Decision 2.0, a suite of state-of-the-art decision-focused models ranging from 0.6B to 27B on Hugging Face, deliver
NVIDIA Model Optimizer: A Unified Toolkit for Quantization, Pruning, and Distillation
NVIDIA Model Optimizer (ModelOpt) unifies NVFP4/FP8 quantization, structured pruning, and distillation to accelerate inference across TensorRT-LLM, vLLM, and SG
DiffusionGemma as Jev: Fast Structured Decisions via Direct Slot Probabilities
Run DiffusionGemma 26B-A4B as a Jev-compatible local decision API by reading slot probabilities directly on fixed canvases with patched vLLM instead of generati
vLLM Adds Single-Step Structured Decision Mode Powered by DiffusionGemma
vLLM now supports single-step structured decisions with DiffusionGemma, seeding fixed response templates to extract choices, scores, and confidence in a single
The Infrastructure Behind the AI Boom: 10 Essential Open-Source Repositories
A guide to 10 open-source repositories driving the AI boom, covering high-throughput serving, local execution, unified gateways, vector search, and distributed