Introducing the next generation of AI inference, powered by ll

Google is releasing a new open-source project called llm-d for AI inference. Google is a founding contributor alongside Red Hat, IBM Research, NVIDIA, and CoreWeave. Customers like Snap, Samsung, and BentoML are already seeing great results.