Zenlayer

Staff Software Engineer, LLM Inference Platform

Remote (United States)Posted 2 days agofulltime
Apply on Zenlayer's career page

CV for this role

Rewrite your CV for what Zenlayer asks for

This job is free to read. A CV tailored to it comes with Weekly and Monthly.

Tailor my CV

Pay comparison

Pay posted by Zenlayer

Market pay for software developers in United States

25th percentileMedian75th percentile

Per year, across all employers in this occupation. This figure is not from Zenlayer.

Source: Text of the Zenlayer job posting; US Bureau of Labor Statistics, Occupational Employment and Wage Statistics, May 2025.

Job description preview

From Zenlayer’s original posting

About Zenlayer Zenlayer is the first massively distributed edge cloud provider, operating 290+ Points of Presence across 70+ countries. With accolades including PTC “Best Networking Innovation”, “Outstanding Cloud, Data Center, or Interconnection Company”, and Inc. 5000, we enable businesses to deploy and run applications at the edge, thus reducing network latency to the end user. Zenlayer focuses on improving connections worldwide, all while nurturing a unique company culture that values service, growth, and trust. As a “Zenplayer”, you’ll be joining a community of success-driven team players that share the dream of powering a better-connected world. About the Role: As the technical lead for inference performance, you will own end-to-end responsibility for the platform's Token Performance. For models ranging from hundreds of billions to trillions of parameters (including MoE), you will continuously reduce cost per million tokens and increase per-GPU Goodput while meeting TTFT/TPOT SLOs, and prove the gain from every optimization with reproducible data. What You Will Work On 1. End-to-End Performance Attribution and Benchmarking • Establish a unified Token Performance metrics…

Open full posting on Zenlayer’s site

Similar roles on Seoulstart

Browse all Global jobs