Technical Lead - Data Processing Infrastructure / Data Platform

Top Echelon Software, LLC; Austin (TX); In loco; USD 180.000 - 220.000; Tempo pieno

Vantaggi offerti da questo lavoro

Healthcare benefits

Pre-tax commuter benefits

FSA

Disability and life insurance

401(k) retirement plan

Generous PTO

Lunch provided

Descrizione del lavoro

Top Echelon Software, LLC in Austin, TX is seeking a Technical Lead to define and build a scalable compute platform for Simulation and ML teams (Perception, Prediction, Planner). You will shape the data processing infrastructure vision with robust, scalable solutions and provide clear documentation to accelerate adoption.

You will prototype and write code, lead infrastructure engineering efforts, and mentor teams.

Competenze

• Strong Python proficiency; C++ desired.
• Experience with distributed compute frameworks.
• Proven leadership in data processing infrastructures.
• Excellent communication and collaboration.

Mansioni

• Define and build a scalable compute platform for Simulation and ML teams.
• Collaborate with ML teams to understand requirements and use cases.
• Prototype and refine solutions; lead architecture decisions.
• Mentor teams and document technical guidance for adoption.
• Evaluate open-source tools and integrate into the platform.

Conoscenze

Leadership

Communication

Collaboration

Formazione

Bachelor's degree in CS or related field

Strumenti

Python

C++

Apache Spark

Ray

Apache Beam

Apache Airflow

Argo Workflows

Kubernetes

Descrizione del lavoro

Job Title:Technical Lead - Data Processing Infrastructure / Data Platform
Location:Austin, TX
Salary Range: $200,000 Per Year
Job Type:Direct Hire

Sponsorship:Yes, Company provides visa sponsorship

Job Overview

A leading autonomous mobility company seeks a Technical Lead to define and build a scalable, user-friendly compute platform for Simulation and ML teams (Perception, Prediction, Planner). You will set the strategic vision for data processing infrastructure, ensuring its scalability, robustness, and alignment with team requirements. You'll make key decisions, prototype solutions, write code, improve frameworks, and provide clear documentation and examples to support adoption.

Key Responsibilities

• Collaborate closely with Simulation and ML teams to understand requirements and use cases.

• Evaluate, integrate, and enhance open-source tools like Apache Spark, Ray, Apache Beam, and Argo.

• Prototype, develop, and refine scalable compute solutions through hands-on coding and validation.

• Lead and coordinate infrastructure engineering teams.

• Define and communicate technical vision with mentorship, documentation, and examples for adoption.

Requirements

• Strong proficiency in Python; C++ experience highly desirable.

• Hands‑on experience with distributed computing frameworks like Apache Spark, Ray, Apache Beam, Apache Airflow, Argo Workflows, and Kubernetes.

• Proven leadership in architecture design and development of data processing infrastructures.

• Excellent communication and collaboration skills.

Preferred Qualifications

• Understanding of ML/AI and experience building ML pipelines.

• Experience with sensor data from cameras, lidars, and radars in autonomous vehicles or robotics.

• Experience optimizing costs and performance of distributed computing systems.

Benefits

• Employer-subsidized healthcare (medical, dental, vision)

• Pre‑tax commuter benefits

• Flexible Spending Account (FSA)

• Employer‑covered disability and life insurance

• 401(k) retirement plan

• Generous PTO

• Covered lunches and more