Senior Data Platform Engineer

TechStarsGroup; Los Angeles (CA); On-site; USD 140,000 - 210,000; Full time

Job summary

A leading tech organization based in Los Angeles is seeking a passionate Senior Data Platform Engineer to join their team. This pivotal role focuses on architecting, developing, and managing advanced AI/ML platforms. Candidates should have a Bachelor's degree in a related field, along with at least 5 years of experience in the domain. Key skills include Kubernetes, MLFlow, and Spark. The position offers competitive compensation and the opportunity to make a significant impact on healthcare through technology.

Qualifications

• 5+ years of experience managing AI/ML platforms.
• Strong expertise in Kubernetes, MLFlow, Kubeflow, Ray, and Spark.
• Deep understanding of algorithms and data modeling.

Responsibilities

• Architect and build an advanced AI/ML platform.
• Construct efficient ML training and inference pipelines.
• Collaborate with teams to deliver innovative features.
• Collaborate with cross-functional teams to design new features.
• Evaluate and adopt new technologies to boost productivity.

Skills

AI/ML platform architecture

Kubernetes

MLFlow

Kubeflow

Ray

Spark

Machine learning algorithms

Cloud services (GCP, AWS, Azure)

Education

Bachelor's degree in Computer Science, Statistics, Mathematics, or related discipline

Tools

Apache Kafka

Tableau

Power BI

Spark

Kubernetes

Job description

About the job Senior Data Platform Engineer

Our client is on a mission to transform healthcare using the power of artificial intelligence. We are dedicated to leveraging AI to make a significant impact on healthcare, aiming to enhance patient care by making every patient’s journey a cornerstone for healthcare decisions. Our goal is to improve treatment outcomes and accelerate drug discovery by analyzing patient health records to provide accurate and timely care. If you are passionate about advancing healthcare through innovative technology, we invite you to join us in pioneering the future.

Position Overview

We are on the lookout for a seasoned Senior Data Platform Engineer to enhance our vibrant team. The successful applicant will possess a profound expertise in architecting, developing, and managing AI/ML platforms, focusing on scalability and robustness.

Key Responsibilities

• Architect, build, and sustain an advanced AI/ML platform to facilitate the development of LLM, Bert, and other cutting‑edge models.
• Construct and maintain efficient ML training and inference pipelines utilizing tools such as MLFlow, Kubeflow, Ray, and Spark.
• Guarantee model performance, quality, and responsiveness.
• Work in tandem with diverse teams to conceptualize, design, and deliver innovative features.
• Proactively seek out, assess, and integrate new technologies to enhance development productivity.

Qualifications

• A Bachelors degree in Computer Science, Statistics, Mathematics, or a related discipline, with a preference for advanced degrees.
• At least 5 years of experience in crafting and managing AI/ML platforms with proficiency in Kubernetes, MLFlow, Kubeflow, Ray, and Spark.
• In-depth understanding of machine learning frameworks, libraries, data structures, data modeling, and software design principles.
• Solid grasp of machine learning algorithms, methodologies, tools, and platforms.
• Familiarity with cloud services (GCP, AWS, Azure), with experience in cloud‑agnostic deployments being a significant plus.
• Exceptional problem‑solving capabilities and a collaborative team spirit.

Desirable Skills

• Prior experience in startup settings and familiarity with agile development practices.
• Effective communication skills, with the knack for demystifying technical concepts for non‑technical stakeholders.
• Knowledge of data streaming technologies like Apache Kafka.
• Proficiency in data visualization tools such as Tableau or Power BI.
• Certifications in relevant data engineering technologies.

Role Impact

In this pivotal role, you will be instrumental in sculpting our data infrastructure to ensure data availability, reliability, and analysis‑readiness. Your contributions will be crucial to our organization’s data‑centric strategic decisions and overarching success.

Compensation

[Details on compensation, including salary, benefits, and other perks, to be provided based on the application process and discussions.]