Staff Research Engineer (LLM Pre-Training)

<p data-pos="0">At JetBrains, code is our passion. Ever since we started back in 2000, we have been striving to make the world’s most robust and effective developer tools. By automating routine checks and corrections, our tools speed up production, freeing developers to grow, discover, and create.</p> <p data-pos="284">We are working on an ambitious new platform that provides AI capabilities to all JetBrains products. Our platform is based on models developed in-house for writing and coding assistance, as well as integration with our strategic partners.</p> <p data-pos="524">We are looking for a Research Engineer who can contribute to training foundation models for coding tasks. You’ll be working on developing Large Language Models from scratch and deploying them into production environments where they will be accessible by end users across the globe.</p> <h3 id="we-value-engineers-who" data-pos="811"><strong data-pos="813">We value engineers who:</strong>&nbsp;</h3> <ul data-pos="840"> <li data-pos="840">Can plan projects and make decisions independently, consulting with others if needed.</li> <li data-pos="928">Identify customer needs and prioritize their tasks accordingly.</li> <li data-pos="994">Start with the simplest solutions and gradually add complexity as needed.</li> <li data-pos="1070">Take sole responsibility for an entire subsystem.</li> <li data-pos="1122">Have a passion for learning and a desire to stay up to date with the latest developments in the LLM field.</li> </ul> <h3 id="in-this-role-you-will" data-pos="1236"><strong data-pos="1238">In this role, you will:</strong>&nbsp;</h3> <ul data-pos="1265"> <li data-pos="1265">Work with stakeholders to convert business requirements into technical specifications.</li> <li data-pos="1354">Train LLMs from scratch on a large GPU cluster.</li> <li data-pos="1404">Collect and process pre-training and fine-tuning datasets.</li> <li data-pos="1465">Support and improve existing subsystems.</li> </ul> <h3 id="well-be-happy-to-have-you-on-our-team-if-you-have" data-pos="1513"><strong data-pos="1515">We’ll be happy to have you on our team if you have:</strong>&nbsp;</h3> <ul data-pos="1570"> <li data-pos="1570">Experience in design, deployment, and support of production ML systems.</li> <li data-pos="1644">A strong theoretical background in NLP and transformer-based approaches.</li> <li data-pos="1719">Proficiency with modern deep learning framework