Remote Senior Data Platform Engineer — ML Ops & Cloud

Ellipsis Health; United States; Remote; USD 150,000 - 170,000; Full time

Benefits offered by this job

401(k) matching

Health, vision, dental insurance

Flexible paid time off

Job summary

Ellipsis Health is seeking an experienced Senior Data Platform Engineer to design, build, and scale a modern data platform across AWS and GCP, supporting analytics, ML Ops, and BI. You will partner with Data Science, ML, Applications and DevOps teams to deliver end-to-end pipelines and secure data infrastructure.

You will architect data warehousing with Databricks, dbt, and Spark, develop ETL pipelines, and optimize costs and performance while ensuring governance and privacy compliance.

Qualifications

• Bachelor's or Master's degree in Computer Science or equivalent experience.
• 5+ years of industry experience in designing and building large-scale data platforms.
• Strong expertise in SQL, Data Modeling, and Data Warehousing (Databricks, Snowflake, Redshift, BigQuery, etc).
• Proficiency in writing Advanced SQLs and performance tuning.
• Strong proficiency in Python for building, optimizing, automating and maintaining data pipelines and services.
• Deep experience with Apache Spark and distributed data processing frameworks.
• Hands-on experience with modern ETL/Orchestration frameworks such as Airflow, dbt, and others.
• Knowledge of BI tools such as Sigma, Metabase, Tableau, and Looker.
• Strong familiarity with cloud-based infrastructure and managed data services in GCP and AWS.
• Experience with CI/CD pipelines to automate testing, deployment and release of data engineering and analytics workflows.
• Experience with tools like Kubernetes, Terraform, Pubsub, Debezium.
• Exposure building data quality frameworks and automation.
• Understanding of data governance, privacy, and regulatory frameworks (HIPAA, SOC-2, HITRUST)

Responsibilities

• Lead the design, development, and operation of a scalable data platform for analytics, ML Ops, and BI.
• Collaborate with Data Science, ML, Applications and DevOps teams to implement ML Ops pipelines.
• Architect and manage data warehousing solutions using Databricks, dbt, and Spark.
• Develop and maintain ETL/data pipelines across diverse sources.
• Optimize data storage and processing for cost-efficiency and performance in GCP/AWS.
• Build dashboards and analytics using Sigma, Metabase, and other BI tools.
• Ensure compliance with data governance, security, and privacy requirements (HIPAA, SOC-2, etc).
• Design and implement scalable infra for LLM operations, including training and inference workflows.
• Collaborate with AI/ML teams to optimize LLM serving platforms for real-time and batch processing.
• Develop monitoring/observability for LLMs, ensuring performance and cost-efficiency.
• Evaluate and integrate state-of-the-art LLM tech to enhance analytics and decision-making.

Skills

SQL

Python

Apache Spark

Data Modeling

Data Warehousing

Education

Bachelor's or Master's in Computer Science or equivalent

Tools

Databricks

dbt

Airflow

Kubernetes

Terraform

Job description

Ellipsis Health is seeking an experienced Senior Data Platform Engineer to design, build, and scale a modern data platform across AWS and GCP, supporting analytics, ML Ops, and BI. You will partner with Data Science, ML, Applications and DevOps teams to deliver end-to-end pipelines and secure data infrastructure.

You will architect data warehousing with Databricks, dbt, and Spark, develop ETL pipelines, and optimize costs and performance while ensuring governance and privacy compliance.