Deep Learning Engineer

Job description preview

From AI21 Labs’s original posting

Description Our team is looking for a Deep Learning Engineer. AI21 is one of the few companies to have trained multi-billion parameter Large Language Models (LLMs). This feat requires top-tier engineering and deep learning algorithmic knowledge. Serving these LLMs efficiently requires cutting-edge technology as well. As a deep learning engineer on the team, you will be responsible for improving and maintaining our training infrastructure, developing/scaling/testing new ideas such as performance improvements and new training methods, adapting our code to run on and best utilize the newest and most advanced hardware accelerators, and running training and evaluation experiments to optimize LLMs on different tasks. Role and Responsibilities • Develop, improve and maintain our training framework and related infrastructure, as part of our applied research projects • Optimize training performance and quality in a variety of aspects, such as adding parallelism methods, improving training SDK, integrating RL environments, optimizing new model architectures, research and development of training methods, etc. • Optimize model serving to support high throughput and low latency in production…