Senior Data Engineer — Healthcare ML & GCP Pipelines

Remote; San Francisco (CA); On-site; USD 140,000 - 180,000; Full time

Benefits offered by this job

Health insurance

Retirement plans

Professional development opportunities

Job summary

Egen is seeking a Senior Data Engineer to design, build, and deploy robust data solutions that enable data-driven decision-making and improved patient outcomes. You will collaborate across teams to deliver end-to-end GCP data pipelines and maintain documentation of information assets.

The role emphasizes hands-on data engineering, MLOps awareness, and advances in BigQuery SQL optimization, with daily standups and cross-functional planning.

Qualifications

• 5+ years of hands-on experience as a Data Engineer or Data Architect.
• Proven track record leading technical projects and teams.
• Expert proficiency in Google Cloud Platform (GCP) tools, including: GCS, BigQuery, Cloud Composer/Airflow, Dataproc/Spark.
• Strong data analysis and problem-solving skills.
• Proficiency in a Business Intelligence (BI) tool.
• Advanced SQL skills, including writing, tuning, and interpreting complex SQL queries.
• Experience writing and maintaining Unix/Linux shell scripts.
• Solid understanding of Data Build Tool (DBT).
• Experience with CI/CD pipelines.
• Machine Learning experience.
• Proficiency in developing Python-based ELT data pipelines.
• Expertise in optimizing GCP BigQuery SQL queries and scripts.

Responsibilities

• Design, architect, develop, support GCP data pipelines to extract, load, and transform data.
• Maintain a holistic view of information assets by creating and maintaining artifacts that illustrate how information is stored, processed, and supported (i.e. documentation).
• Work with the project team, estimate and plan the work effort.
• Attend daily team standups.
• Work with business analysts and project management to review business requirements and produce technical design specs that will meet the requirements.

Skills

Data engineering

GCP

BigQuery

Airflow

SQL

Unix/Linux scripting

DBT

CI/CD

Python

Machine Learning

ELT pipelines

BI tools

Data analysis

Tools

Google Cloud Storage (GCS)

BigQuery

Cloud Composer/Airflow

Dataproc/Spark

Job description

Egen is seeking a Senior Data Engineer to design, build, and deploy robust data solutions that enable data-driven decision-making and improved patient outcomes. You will collaborate across teams to deliver end-to-end GCP data pipelines and maintain documentation of information assets.

The role emphasizes hands-on data engineering, MLOps awareness, and advances in BigQuery SQL optimization, with daily standups and cross-functional planning.