Senior Data Engineer: Healthcare AI Platform

Cohort AI Inc.

Naperville (IL)

On-site

USD 120,000 - 160,000

Full time

8 days ago

Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Job summary

Cohort AI Inc. is seeking a Senior Data Engineer to design, build, and scale data infrastructure for our platform.

You will work with large healthcare datasets, develop production-grade pipelines, and collaborate with Data Science, Clinical Informatics, Product, Infrastructure, and Commercial teams to translate requirements into robust data solutions. You will build reliable ETL/ELT workflows using SQL, Python, PySpark, and Apache Spark, while focusing on data quality, monitoring, and

Qualifications

5+ years of professional Data Engineering experience required.
Strong SQL skills and experience with large datasets.
Hands-on experience in Python and PySpark.
Experience with Apache Spark and distributed data processing.
Experience with modern data platforms like Databricks, Snowflake, BigQuery, Redshift.
Experience designing and operating production-grade ETL/ELT pipelines.

Responsibilities

Design, build, and maintain scalable, reliable data pipelines.
Develop high-performance ETL/ELT workflows using SQL, Python, PySpark, and Apache Spark.
Work with complex healthcare datasets including clinical and claims data.
Build ingestion and transformation workflows that are reliable and scalable.
Develop data quality, monitoring, and observability solutions.
Troubleshoot production data pipeline issues using Linux and shell tools.
Optimize data processing and cloud infrastructure costs.
Contribute to data modeling and data warehousing decisions.
Collaborate with Data Science, Clinical Informatics, Product, Infrastructure, and Commercial teams to translate requirements into data solutions.
Support customer onboarding and complex data integration initiatives.