Nvidia's KV Cache Transform Coding (KVTC) compresses LLM key-value cache by 20x without model changes, cutting GPU memory costs and time-to-first-token by up to 8x for multi-turn AI applications.

A new AI framework called THOR is transforming how scientists calculate the behavior of atoms inside materials. Instead of relying on slow simulations that take weeks of supercomputer time, the system ...

Enterprise AI applications that handle large documents or long-horizon tasks face a severe memory bottleneck. As the context grows longer, so does the KV cache, the area where the model’s working ...

Meta on Wednesday debuted an AI feature called "Dear Algo" that lets Threads users personalize their content-recommendation algorithms. Threads users will be able to tell the Dear Algo tool what kinds ...

These days, there's no shortage of devices and gadgets that can level up your running recovery game. Want to sleep better? Consider a smart ring. Want to better understand how your body is handling ...

[Sketchiest Guy in the World Voice] Hey kid, wanna see the X algorithm? It’s right over here. No really, Elon Musk appears to be partly making good on his promise about a week ago to open up the X ...

In 2023, the website then known as Twitter partially open sourced its algorithm for the first time. In those days, Tesla billionaire Elon Musk had only recently acquired the platform, and he claimed ...

The country’s top internet regulator, the Cyberspace Administration of China (CAC), requires that any company launching an AI tool with “public opinion properties or social mobilization capabilities" ...

Editor’s note: This work is part of AI Watchdog, The Atlantic’s ongoing investigation into the generative-AI industry. On Tuesday, researchers at Stanford and Yale revealed something that AI companies ...

Broadcom's better-than-expected results weren't enough to keep investors from rushing for the exits. The stock sank alongside a decline in shares of Oracle, CoreWeave and other companies tied to AI ...

Social media companies and their respective algorithms have repeatedly been accused of fueling political polarization by promoting divisive content on their platforms. Now, two U.S. Senators have ...