Research Engineer, Latency & Throughput

Job description preview

From Mistral AI’s original posting

ABOUT MISTRAL Mistral provides full-stack AI solutions: from frontier models to developer tools, applications, and compute. We partner with enterprises tackling the hardest problems across high-stakes industries like finance, manufacturing, defense, healthcare, and the public sector, co-creating customized AI systems that they can run on their terms. We are a dynamic, collaborative team passionate about AI and its potential to transform society. Our diverse workforce thrives in competitive environments and is committed to driving innovation. Our teams are distributed between Europe, North America, Asia and the Middle East. We are creative, low-ego and team-spirited. THE ROLE As a Research Engineer on the Latency & Throughput team, you will push the frontier of LLM inference by researching and prototyping techniques that reduce latency and increase throughput — from speculative decoding and quantization to KV compression and new attention variants. The team sits at the intersection of research and production: you will take ideas from recent literature, form hypotheses, run experiments, and ship the techniques that prove out into our serving stack. This role sits between our…