Member of Technical Staff - Evaluation Infrastructure

Palo Alto, CA·Posted today
aiinfrastructuremlllm
<div class="content-intro"><p><span style="font-family: arial, helvetica, sans-serif;">SpaceXAI’s mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge.&nbsp;</span><span style="font-family: arial, helvetica, sans-serif;">Our team is small, highly motivated, and focused on engineering excellence. This organization is for individuals who appreciate challenging themselves and thrive on curiosity. </span><span style="font-family: arial, helvetica, sans-serif;">We operate with a flat organizational structure. All employees are expected to be hands-on and to contribute directly to the company’s mission. Leadership is given to those who show initiative and consistently deliver excellence. Work ethic and strong prioritization skills are important. </span><span style="font-family: arial, helvetica, sans-serif;">All employees are expected to have strong communication skills. They should be able to concisely and accurately share knowledge with their teammates.</span></p></div><h3><strong>ABOUT THE ROLE:</strong></h3> <p>The RL infrastructure team is looking for an engineer to help develop our evaluation infrastructure.</p> <p><strong>RESPONSIBILITIES:</strong></p> <ul> <li>Build highly reliable, efficient, and easy to use infrastructure that runs all our evaluations at scale</li> <li>Collaborate closely with modeling &amp; evaluation teams on developing new evals, maintaining evaluation signal quality, and building internal tooling to support training our next-generation of models</li> <li>Identify and resolve performance bottlenecks in all layers of the eval infrastructure stack, including inference, capacity fleet management, asynchronous eval orchestration, and more</li> </ul> <h3><strong>BASIC QUALIFICATIONS:</strong></h3> <ul> <li>Experience in building, debugging, and optimizing efficiency of large-scale distributed systems</li> <li>Willingness to dive deep and solve hard problems at all levels of the stack</li> </ul> <h3><strong>PREFERRED SKILLS AND EXPERIENCE:</strong></h3> <ul> <li>Experience in LLM inference</li> <li>Experience in GPU compute management, workload scheduling, and dynamic resource optimization</li> <li>Experience in developing interfaces for comparing models and evals</li> </ul> <h3><strong style="font-family: arial, helvetica, sans-serif;">COMPENSATION AND BENEFITS:</strong></h3> <p><span style="font-family: arial, helvetica, sans-serif;">$180,000 - $440,000 USD</span></p> <p><span style="font-family: arial, helvetica, sans-serif;">Base salary is just one part of our total rewards package at SpaceXAI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short &amp; long-term disability insurance, life insurance, and various other discounts and perks.</span></p><div class="content-conclusion"><p><em>SpaceXAI is an equal opportunity employer. For details on data processing, view our </em><em><a href="https://x.ai/legal/recruitment-privacy-notice" target="_blank">Recruitment Privacy Notice</a>.</em></p></div>