Member of Technical Staff, Training Performance Engineer

Requirements

• Extremely strong software engineering skills
• Proficiency in Python and related ML frameworks such as JAX, Pytorch and XLA/MLIR
• Experience writing kernels for GPUs using CUDA, triton, etc
• Experience using large-scale distributed training strategies
• Familiarity with autoregressive sequence models, such as Transformers
• (Desirable) Bonus: paper at top-tier venues (such as NeurIPS, ICML, ICLR, AIStats, MLSys, JMLR, AAAI, Nature, COLING, ACL, EMNLP)
• If some of the above doesn’t line up perfectly with your experience, we still encourage you to apply!

What the job involves

• As a Performance Engineer in the Pre-Training team you will be responsible for optimizing the performance of our advanced language models and systems
• Their primary focus is on improving key model training metrics, such as training throughput, ensuring high accelerator utilization
• The team combines expertise in software engineering, machine learning, and low-level kernel design and development to design robust systems and enhance model performance
• You will work on identifying and removing performance bottlenecks, develop cutting‑edge training and profiling tools to help Cohere's mission of providing efficient and reliable language understanding and generation capabilities and drive innovation in the field of natural language processing
• Design and write high-performant and scalable software for training
• Understand architectural modifications and design choices and their effects on training throughput and quality
• Write low-level CUDA, triton kernels to squeeze every last bit of performance from our accelerators
• Research, implement, and experiment with ideas on our supercompute and data infrastructure
• Learn from and work with the best researchers in the field

#J-18808-Ljbffr