Senior Software Engineer, ML Data Services

Mission Summary

We are seeking a Senior Engineer to join our ML Data Services team and help us build and improve data infrastructure for Autonomy ML teams. As a Senior Engineer, you will be responsible for building scalable microservices, APIs, and tooling to support Autonomy labeling needs. You will also help architect and implement scalable pipelines to process terabytes of data and deliver datasets for ML training, Simulation, and evaluation.

What you’ll be doing:

• Design and implement Restful APIs and microservices for data labeling and annotations
• Architect, build and maintain scalable data processing pipelines with cloud ETL technology to deliver datasets for Autonomy teams
• Design and implement a data linter framework to monitor and improve data quality
• Work closely with leadership and stakeholders to define objectives, align timelines, agree on key deliverables, and build the execution plan
• Design and develop monitoring and observability services for the MLOps data service pipelines
• Mentor and teach junior engineers in the team to develop good SDLC skills and better quality code with pairing sessions

What we’re looking for:

• 5+ years of software development experience with Python preferred. Relevant experience with Java or C++ 
• 5+ years of web backend development experience with REST APIs and microservices  
• 3+ years of AWS cloud experience (e.g., DynamoDB, API Gateway, EKS, Lambda, OpenSearch, Redshift, S3)
• 3+ years of data engineering experience with Airflow, Argo or AWS Step Functions
• Strong written and oral communication skills
• Experience working in cross-functional development teams, including quarterly road map design
• Ability to mentor junior engineers
• BS or MS in Computer Science or related field

Bonus points (not required):

• Hands-on experience with using Ray, Beam, Spark, or related big data processing in a large-scale environment
• Experience in Docker Containerization
• Autonomous driving industry experience