Author: Naveed Ahmad

Serving Giant Language Fashions (LLMs) at scale is a large engineering problem due to Key-Worth (KV) cache administration. As fashions develop in dimension and reasoning functionality, the KV cache footprint will increase and turns into a significant bottleneck for throughput and latency. For contemporary Transformers, this cache can occupy a number of gigabytes. NVIDIA researchers have launched KVTC (KV Cache Remodel Coding). This light-weight remodel coder compresses KV caches for compact on-GPU and off-GPU storage. It achieves as much as 20x compression whereas sustaining reasoning and long-context accuracy. For particular use instances, it might attain 40x or larger. https://arxiv.org/pdf/2511.01815 The…

Czech ice dancers Kateřina Mrázková and Daniel Mrázek made their Olympic debut on Monday, an unfathomable feat that takes a lifetime of dedication and observe. However the sibling duo used AI music of their rhythm dance program, which doesn’t break any official guidelines, however serves as a miserable image of how completely cooked we’re. As Mrázek spun his sister in a loopy cartwheel-lift-sort-of-move that made them look superhuman, one of many NBC commentators talked about in passing, “That is AI generated, this primary half,” referring to the music. One way or the other, that admission is much more baffling than…

Ryan Beiermeister, who served as OpenAI’s vice chairman of product coverage, was fired in January after a male colleague accused her of intercourse discrimination, the Wall Road Journal has reported. “The allegation that I discriminated in opposition to anybody is totally false,” Beiermeister informed the Journal. TechCrunch reached out to OpenAI for remark and likewise contacted an e-mail that seems to be related to Beiermeister; neither had responded on the time of publication. Per the Journal’s report, Beiermeister’s termination got here after she expressed criticism of a deliberate ChatGPT function dubbed “grownup mode.” The brand new mode would introduce erotica…

Monday night time, xAI co-founder Yuhuai (Tony) Wu introduced he was leaving the corporate. “It’s time for my subsequent chapter,” Wu wrote in a late-night post on X. “It’s an period with full prospects: a small crew armed with AIs can transfer mountains and redefine what’s doable.” Lower than a day later, on Tuesday afternoon, xAI co-founder Jimmy Ba, who reported on to Musk, stated that he, too, is bouncing, posting a gracious notice on X on his manner out. “Monumental because of @elonmusk for bringing us collectively on this unimaginable journey. So pleased with what the xAI crew has…

Google Analysis is proposing a brand new method to construct accessible software program with Natively Adaptive Interfaces (NAI), an agentic framework the place a multimodal AI agent turns into the first consumer interface and adapts the appliance in actual time to every consumer’s skills and context. As an alternative of transport a hard and fast UI and including accessibility as a separate layer, NAI pushes accessibility into the core structure. The agent observes, causes, after which modifies the interface itself, transferring from one-size-fits-all design to context-informed selections. What Natively Adaptive Interfaces (NAI) Change within the Stack? NAI begins from a…

The AI trade’s pursuit of licensable content material has been a messy affair, full of lawsuits and accusations of copyright infringement. Now, as tech corporations search for legally protected sources of AI coaching knowledge, Amazon is reportedly contemplating launching a market the place publishers can license their content material on to AI corporations. The Info reported Monday that the e-commerce big has been assembly with publishing executives and alerting them to its plans to launch such a market. Forward of an AWS convention for publishers that occurred Tuesday, Amazon “circulated slides that point out a content material market,” wrote the…

part(“6) pack unpack”) B, Cemb = 2, 128 class_token = torch.randn(B, 1, Cemb, machine=machine) image_tokens = torch.randn(B, 196, Cemb, machine=machine) text_tokens = torch.randn(B, 32, Cemb, machine=machine) show_shape(“class_token”, class_token) show_shape(“image_tokens”, image_tokens) show_shape(“text_tokens”, text_tokens) packed, ps = pack([class_token, image_tokens, text_tokens], “b * c”) show_shape(“packed”, packed) print(“packed_shapes (ps):”, ps) mixer = nn.Sequential( nn.LayerNorm(Cemb), nn.Linear(Cemb, 4 * Cemb), nn.GELU(), nn.Linear(4 * Cemb, Cemb), ).to(machine) blended = mixer(packed) show_shape(“blended”, blended) class_out, image_out, text_out = unpack(blended, ps, “b * c”) show_shape(“class_out”, class_out) show_shape(“image_out”, image_out) show_shape(“text_out”, text_out) assert class_out.form == class_token.form assert image_out.form == image_tokens.form assert text_out.form == text_tokens.form part(“7) layers”) class PatchEmbed(nn.Module): def __init__(self, in_channels=3, emb_dim=192,…

Twenty-five years in the past, Jay Bavisi based EC-Council within the aftermath of 9/11 with a simple premise: if attackers perceive techniques deeply, defenders want to know them simply as effectively. That concept led to Licensed Moral Hacker (CEH), which went on to develop into one of the vital well known credentials in cybersecurity. Bavisi thinks we’re at an analogous inflection level once more—this time with AI. The know-how is transferring quick. The workforce isn’t. And identical to the early days of software program improvement, a lot of the consideration is on what AI can do, not on the way…

A 30-second Tremendous Bowl advert that includes boxing legend Mike Tyson and paid for by the nonprofit MAHA Heart encourages viewers to keep away from processed meals and go to realfood.gov. The federal government web site, which Well being and Human Companies secretary Robert F. Kennedy Jr. is promoting, supplies assets on the administration’s new dietary guidelines, launched in January, and encourages individuals to make use of Elon Musk’s AI chatbot Grok to “get actual solutions about actual meals.”I made a decision to see how Grok’s recommendation aligns with the administration’s suggestions, notably round protein consumption. The brand new pointers…

Fashionable enterprises generate huge quantities of safety knowledge, however legacy instruments like Splunk nonetheless require firms to retailer all of it in a single place earlier than they’ll detect threats — a gradual and dear course of that’s more and more breaking down in cloud environments the place volumes are exploding and knowledge lives in every single place.  AI cybersecurity startup Vega Security needs to flip that method by operating safety the place the information already lives, implementing in cloud providers, knowledge lakes, and current storage methods. And the two-year-old agency simply raised a $120 million Collection B spherical to…