ViewTube

Ready to become a certified watsonx AI Assistant Engineer? Register now and use code IBMTechYT20 for 20% off of your exam ...

Red Hat's Mark Kurtz and Megan Flynn examine speculative decoding, a technique that uses a smaller, faster model—the ...

About the seminar: https://faster-llms.vercel.app Speaker: Hongyang Zhang (Waterloo & Vector Institute) Title: EAGLE and ...

Speculative decoding is one of the most important performance optimizations in modern LLM serving—and most people still don't ...

There is a lot of possibility with Speculative Decoding allowing us normal folks to run larger and larger AI models at home. I hope ...

Speed up your Large Language Model by 2 or 3 times with OpenVINO's speculative decoding. Much faster inference without ...

This is a single lecture from a course. If you you like the material and want more context (e.g., the lectures that came before), check ...

Today, we're joined by Chris Lott, senior director of engineering at Qualcomm AI Research to discuss accelerating large language ...

This video introduces the playlist, explains the Speculative Decoding Algorithm from the paper https://arxiv.org/pdf/2211.17192 in ...

Session covering an overview of speculative decoding and several seminal papers in the space, including Medusa, Eagle 1/2/3, ...

Speculative decoding is a technique used to speed up LLM inference by using a small, fast model to quickly generate text. A big ...

In this video, we're diving deep into Speculative Decoding, an advanced technique that is revolutionizing how AI language ...

AI Gold Nugget #2.1 – Speaker #1: Raphael Vienne Can we go faster…

Speculative decoding is usually discussed as a way to make real time LLM APIs feel faster. But what happens when you apply it to ...

Speculative decoding is one of the most powerful - and misunderstood - techniques for speeding up LLM inference.

arxiv - https://arxiv.org/pdf/2510.19779 Become AI Researcher & Train LLM From Scratch ...

Title: Accelerating LLM Inference with Lossless Speculative Decoding Algorithms for Heterogeneous Vocabularies Authors: ...

What is speculative decoding—at a high level? Why is it used (what problem does it solve)? How does it differ from standard ...

Full Title：Yikai Zhu, Lukec Wang：SpecForge: Open Source Framework for Training Speculative Decoding Models Speculative ...