ML & Cloud Infastructure Engineer

OpenArc, LLC.; Belmont (CA); On-site; USD 120,000 - 150,000; Full time

Job summary

OpenArc, LLC. in the United States is seeking an experienced ML & Cloud Infrastructure Engineer to join our client’s organization. You will architect scalable cloud infrastructure for AI and data pipelines, and own deployment pipelines in a fast-paced startup environment.

You should have a track record delivering high-performance ML pipelines in production, with Python and familiarity with C++/Go, plus hands-on experience with AWS/GCP/Azure, Docker, Kubernetes and Airflow.

Qualifications

• Proven experience deploying high-performance ML pipelines in production.
• Strong Python skills; comfortable with C++/Go.
• Hands-on experience with cloud platforms (AWS, GCP, Azure).
• Familiarity with ML frameworks such as PyTorch.
• Experience with data-loading workflows and formats (Parquet, HDF5, TFRecord).
• Experience with containerization and orchestration tools (Docker, Kubernetes, Airflow).
• Ability to take ownership with light supervision; strong problem-solving skills.

Responsibilities

• Develop and deploy scalable ML training and validation pipelines in the cloud.
• Spin up distributed data ingestion, training and evaluation pipelines.
• Deploy monitoring and CI/CD pipelines.
• Enable large-scale evaluation of AI models via cloud-based metrics.
• Support simulations in the cloud for autonomy software evaluation.
• Optimize performance, I/O and GPU utilization.
• Build tooling and dashboards for experimentation, orchestration and visualization.
• Collaborate with multiple teams to integrate cloud tooling into workflows.

Skills

Python

C++/Go

PyTorch

Cloud platforms (AWS/GCP/Azure)

Data loading formats (Parquet/HDF5/TFR

Tools

Docker

Kubernetes

Airflow

Job description

OpenArc - Empowering Your Career. As a leading IT staffing firm, we are dedicated to connecting talented professionals with your ideal opportunities. We are currently seeking a qualified ML & Cloud Infastructure Engineer to join our client’s organization and contribute to their ongoing success.

Job summary

We’re looking for an experienced ML & Cloud Infrastructure Engineer to join our team. As an early member, you will play a pivotal role in architecting scalable cloud infrastructure for our AI and data pipelines. You'll need to thrive in a fast-paced startup environment where you'll wear multiple hats and have a direct impact on our product's evolution. Ideally, you have a proven track record of developing and deploying high-performance ML and cloud pipelines in production, and you're passionate about pushing the boundaries of what's possible in robotics with AI.

Responsibilities:

• Develop and deploy scalable AI training and validation pipelines in the cloud.
• Spin up distributed pipelines for data ingestion, pre-processing, training and evaluation.
• Deploy monitoring and CI/CD pipelines.
• Enable large-scale evaluation of AI models via cloud-based metrics.
• Enable large-scale evaluation of autonomy software and models via simulations in the cloud.
• Optimize performance, I/O and GPU utilization.
• Build tooling and dashboards for rapid experimentation, orchestration and visualization.
• Work with other teams to integrate cloud tooling into workflows.

Requirements:

• Experience deploying high-performance ML pipelines in production.
• Proficient in Python and comfortable with C++/Go.
• Experience with ML frameworks like PyTorch.
• Experience with IO and data-loading workflows, including formats like Parquet, HDF5, TFRecord etc.
• Experience with deploying on cloud platforms like AWS, GCP or Azure.
• Experience with tooling like Docker, Kubernetes, and Airflow.
• Should be comfortable taking ownership of tasks with light supervision.
• Must have excellent problem-solving skills.

At OpenArc, we prioritize your career success and strive to build exceptional technical teams for our clients. By understanding your experience and aspirations, we ensure to present you with rewarding and fulfilling opportunities.

As an employee of OpenArc and our clients, you will be eligible to participate in a comprehensive benefits package.

OpenArc is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.