AWS And Microsoft Are Borrowing What Google Already Built

AWS partnered with Cerebras. Microsoft licensed Fireworks. Google built Ironwood. One week of announcements reveals who ...
TheStreet.com

Inference Isn’t A Problem. To Democratize AI, We Need To Cut The Costs Of Data Access

“The rapid release cycle in the AI industry has accelerated to the point where barely a day goes past without a new LLM being announced. But the same cannot be said for the underlying data,” notes ...

The team behind continuous batching says your idle GPUs should be running inference, not sitting dark

FriendliAI — founded by the researcher behind continuous batching, the technique at the core of vLLM — is launching InferenceSense, a platform that fills idle neocloud GPU capacity with paid AI ...
Security Boulevard

Inference protection for LLMs: Keeping sensitive data out of AI workflows

Inference protection is a preventive approach to LLM privacy that stops sensitive data from ever reaching AI models. Learn how de-identification enables secure, compliant AI workflows with ...
Princeton University

Inference in Nonstandard Problems

Paper: "Robust Nonparametric Bias-Corrected Inference in the Regression Discontinuity Design", (joint work with Sebastian Calonico and Rocio Titiunik).

AWS and Cerebras Collaboration Aims to Set a New Standard for AI Inference Speed and Performance in the Cloud

Deployed in AWS data centers and accessed through Amazon Bedrock, AWS Trainium + Cerebras CS-3 solution will accelerate inference speed Key Takeaways Fastest inference coming soon: AWS and Cerebras ...