Research Engineer, Pretraining

• Join the Pretraining team responsible for developing the next generation of large language models at Anthropic, working at the intersection of cutting-edge research and practical engineering. • Conduct research and implement solutions in areas such as model architecture, algorithms, data processing, and optimiser development. • Contribute to the development of safe, steerable, and trustworthy AI systems across the entire stack from low-level optimisations to high-level model design.

• Hold an advanced degree (MS or PhD) in Computer Science, Machine Learning, or a related field. • Have strong software engineering skills with a proven track record of building complex systems. • Have expertise in Python and experience with deep learning frameworks, with PyTorch preferred. • Have familiarity with large-scale machine learning, particularly in the context of language models. • Be able to balance research goals with practical engineering constraints. • Have strong problem-solving skills and a results-oriented mindset. • Have excellent communication skills and the ability to work in a collaborative environment. • Care about the societal impacts of your work.

• Have experience working on high-performance, large-scale ML systems. • Have familiarity with GPUs, Kubernetes, and OS internals. • Have experience with language modelling using transformer architectures. • Have knowledge of reinforcement learning techniques. • Have a background in large-scale ETL processes.

• Conduct research and implement solutions in areas such as model architecture, algorithms, data processing, and optimiser development. • Independently lead small research projects while collaborating with team members on larger initiatives. • Design, run, and analyse scientific experiments to advance understanding of large language models. • Optimise and scale training infrastructure to improve efficiency and reliability. • Develop and improve dev tooling to enhance team productivity. • Contribute to the entire stack from low-level optimisations to high-level model design. • Scale distributed training jobs to thousands of GPUs. • Design fault tolerance strategies for training infrastructure.

• Receive an annual salary of £260k–£630k GBP. • Work from the London office with a hybrid policy requiring at least 25% office time. • Receive visa sponsorship with every reasonable effort made and an immigration lawyer retained to help. • Receive competitive compensation and benefits with optional equity donation matching. • Receive generous vacation and parental leave. • Enjoy flexible working hours.

Anthropic's mission is to create reliable, interpretable, and steerable AI systems that are safe and beneficial for users and society. The company is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. Anthropic is a public benefit corporation headquartered in San Francisco with offices in London.