Upstage
AI Engineer Internship - LLM Inference (정규직 전환형)
Seoul, South KoreaPosted 11 days agointernship
What you'd do
- Design and implement systems optimizing latency, throughput, cost trade-offs for LLM inference.
- Research and apply inference optimization techniques specific to Upstage Solar model architecture.
- Develop CI pipelines automating Solar model benchmarking and evaluation.
What they want
- Deep understanding of latest LLM architectures and serving technologies.
- Experience analyzing and improving model inference system bottlenecks.
- High proficiency in one or more programming languages (Golang, Python, Typescript, Java, C/C++).
Nice to have
- Published ML/NLP papers at international conferences as first or corresponding author.
- Master's degree or higher in relevant field.
- Contributions to open-source LLM frameworks (vLLM, SGLang, TensorRT-LLM, Transformers).