Staff Triage & RCA Engineer

Hybrid- Fremont, CA·Posted yesterday

infrastructureairoboticspythonaws

<div class="content-intro">Agility’s commercially deployed humanoids operate alongside teams in warehouses, manufacturing facilities, and distribution centers—tackling physically demanding and repetitive tasks while enabling workers to focus on higher-value work. With industry-leading safety standards and years of proven deployment data, we're pioneering a new era of automation that enhances human potential.</div><h2>About the Role</h2> Agility Robotics is at the forefront of humanoid robotics, redefining how robots interact with and navigate the human world. Our robots rely on a complex intersection of hardware and advanced software to perform tasks in dynamic environments. We are seeking a Staff Triage & RCA Engineer to provide technical leadership for software issue triage and root cause analysis across our robotic systems. In addition to leading complex investigations, this role will define the processes, tooling, and technical systems used to diagnose and resolve failures at scale. You will serve as a technical authority for ambiguous hardware-software failures, establish standards and methodologies for triage and RCA, and drive the development of diagnostic tools and infrastructure that improve the efficiency and effectiveness of the broader engineering organization. You will also mentor engineers and help set technical direction for the discipline. About the Work <h2>Issue Triage</h2> <ul> <li style="font-size: 10pt;">Serve as a technical lead for complex software, firmware, and system-level failure triage.</li> <li style="font-size: 10pt;">Define and improve standardized triage processes, workflows, and disposition criteria.</li> <li style="font-size: 10pt;">Lead prioritization and escalation of critical software-related failures, ensuring engineering teams receive clear, actionable investigations.</li> <li style="font-size: 10pt;">Identify systemic failure trends across the fleet and drive appropriate corrective actions.</li> </ul> <h2>Root Cause Analysis</h2> <ul> <li style="font-size: 10pt;">Lead end-to-end investigations of novel and ambiguous failures at the hardware-software interface.</li> <li style="font-size: 10pt;">Use logs, telemetry, video, and system behavior to identify definitive root causes and contributing factors.</li> <li style="font-size: 10pt;">Establish and promote rigorous RCA methodologies and standards across the organization.</li> <li style="font-size: 10pt;">Author high-quality RCA reports and troubleshooting guidance that enable broader engineering teams to independently investigate failures.</li> </ul> <h2>Tooling & Continuous Improvement</h2> <ul> <li style="font-size: 10pt;">Define the technical direction and roadmap for triage, diagnostics, and RCA tooling.</li> <li style="font-size: 10pt;">Develop scalable diagnostic scripts, automation, and data analysis frameworks to accelerate investigations.</li> <li style="font-size: 10pt;">Drive improvements to system observability, telemetry, logging, and diagnosability.</li> <li style="font-size: 10pt;">Identify opportunities to automate recurring investigations and improve the overall engineering feedback loop.</li> </ul> <h2>Technical Leadership & Mentorship</h2> <ul> <li style="font-size: 10pt;">Serve as a technical subject matter expert and mentor for engineers performing triage and RCA.</li> <li style="font-size: 10pt;">Establish technical standards and best practices for failure investigation and documentation.</li> <li style="font-size: 10pt;">Influence Software, Hardware, Controls, and Systems teams on approaches to fault isolation, diagnosability, and system reliability.</li> <li style="font-size: 10pt;">Provide technical direction for initiatives that improve the organization's ability to detect, diagnose, and resolve failures.</li> </ul> <h2>About You</h2> <h3>Experience:</h3> <ul> <li style="font-size: 10pt;">10+ years of experience in Systems Integration, Software-Hardware interface, R&D, or similar roles involving complex mechatronic or autonomous systems.</li> <li style="font-size: 10pt;">Proven track record of leading complex, ambiguous technical investigations and defining scalable engineering processes or tooling.</li> <li style="font-size: 10pt;">Experience with monitoring and observability platforms (e.g., Datadog, Splunk, or New Relic).</li> <li style="font-size: 10pt;">Experience working with cloud storage and databases (e.g., AWS S3, SQL, or NoSQL) to retrieve and analyze large-scale telemetry and video datasets.</li> <li style="font-size: 10pt;">Experience influencing cross-functional engineering teams and mentoring technical contributors.</li> <li style="font-size: 10pt;">Preferred: Experience with HW/SW integration and design on HiL.</li> </ul> <h3>Technical Expertise:</h3> <ul> <li style="font-size: 10pt;">Mastery of log parsing and proficiency with Python or similar scripting languages for data analysis and automation.</li> <li style="font-size: 10pt;">Strong understanding of robotics software stacks and communication protocols such as EtherCAT and CAN.</li> <li style="font-size: 10pt;">Experience correlating video and/or hardware symptoms with system telemetry to identify software and system failures.</li> <li style="font-size: 10pt;">Experience developing diagnostic, observability, or automation tooling for complex systems.</li> <li style="font-size: 10pt;">Preferred: Experience troubleshooting HW/SW interactions involving cameras, encoders, IMUs, or other sensors.</li> </ul> <h3>Skills:</h3> <ul> <li style="font-size: 10pt;">Ability to define technical direction and solve ambiguous, unprecedented problems with scalable solutions.</li> <li style="font-size: 10pt;">Ability to balance hands-on technical investigation with longer-term process, tooling, and systems development.</li> <li style="font-size: 10pt;">Exceptional ability to synthesize complex data into clear, actionable insights.</li> <li style="font-size: 10pt;">Strong technical leadership, communication, and mentoring skills.</li> </ul> <h2>Education:</h2> Bachelor’s or Master’s degree in Computer Science, Robotics, Electrical Engineering, or a related field.   <hr> Location  <ul> <li style="font-size: 10pt;">This is a hybrid position based out of our Fremont office.</li> </ul> The final salary offered to a successful candidate will be dependent on several factors that may include but are not limited to: job-related knowledge, skills, and experience. Agility Robotics is a multi-state employer and this salary range may not reflect positions who work in other locations. These ranges may be modified in the future.<div class="content-pay-transparency"><div class="pay-input"><div class="title">Anticipated Base Salary Range</div><div class="pay-range">$191,000—$249,000 USD</div></div></div><div class="content-conclusion">In addition to base pay, our competitive total rewards package consists of the following for full-time employees: <ul> <li>401(k) Plan: Includes a 6% company match.</li> <li>Equity: Company stock options.</li> <li>Insurance Coverage: 100% company-paid medical, dental, vision, and short/long-term disability insurance for employees.</li> <li>Benefit Start Date: Eligible for benefits on your first day of employment.</li> <li>Well-Being Support: Employee Assistance Program (EAP).</li> <li>Time Off: <ul> <li>Exempt Employees: Flexible, unlimited PTO and 12 company holidays, including a winter shutdown.</li> <li>Non-Exempt Employees: 10 vacation days, paid sick leave, and 12 company holidays, including a winter shutdown, annually.</li> </ul> </li> <li>On-Site Perks: Catered lunches four times a week and a variety of healthy snacks and refreshments at our Salem and Pittsburgh locations.</li> <li>Parental Leave: Generous paid parental leave programs.</li> <li>Work Environment: A culture that supports flexible work arrangements.</li> <li>Growth Opportunities: Professional development and tuition reimbursement programs.</li> <li>Relocation Assistance: Provided for eligible roles.</li> <li>Annual Discretionary Bonus: Provided for eligible roles.</li> </ul> All of our roles are U.S.-based. Applicants must have current authorization to work in the United States. Agility Robotics is committed to a work environment in which all individuals are treated with respect and dignity. Each individual has the right to work in a professional atmosphere that promotes equal employment opportunities and prohibits unlawful discriminatory practices, including harassment. Therefore, it is the policy of Agility Robotics to ensure equal employment opportunity without discrimination or harassment on the basis of race, color, religion, sex, sexual orientation, gender identity or expression, age, disability, marital status, citizenship, national origin, genetic information, or any other characteristic protected by law. Agility Robotics prohibits any such discrimination or harassment.   Agility Robotics does not accept unsolicited referrals from third-party recruiting agencies.  We prioritize direct applicants and encourage all qualified candidates to apply directly through our careers page.  If you are represented by a third party, your application may not be considered.  To ensure full consideration, please apply directly.  </div>

Apply for this role