Senior Data Engineer: Scalable Healthcare Data

Abridge; San Francisco (CA); On-site; USD 210,800 - 248,000; Full time

Benefits offered by this job

Generous time off

Health plans

HSA contributions

Parental leave

Equity

Job summary

Abridge is seeking a Data Engineer to join our US-based Data Engineering team in San Francisco. You will build and optimize large-scale data infrastructure to drive business decisions and ML research.

You will work with frontend and backend engineers, product managers, and analysts to improve data throughput, latency, and reliability, while designing data quality frameworks and integrations.

Qualifications

• 8+ years of experience in Data Engineering or Backend Engineering with a focus on data systems.
• Proficient in Python/Java/Scala and SQL.
• Proficiency with at least one cloud provider (GCP, AWS, Azure) and accompanying data services.
• Experience in ingesting, transforming, and managing structured and unstructured data.
• Deep knowledge of modern data infrastructure best practices.
• Experience with distributed systems and processing frameworks.
• Experience with Terraform, Kubernetes, and containerization.
• Familiarity deploying ML models at scale is a bonus.
• Experience building well-modeled, documented data products.
• Ability to prioritize amidst changing priorities in a fast-moving environment.

Responsibilities

• Build and maintain scalable data services, pipelines and storage for ML training data and evaluation.
• Build and manage OLAP databases, ELTs and data tooling for analytics and product features.
• Collaborate with frontend/backend engineers, product managers, and analysts.
• Optimize data infrastructure for throughput, latency and reliability.
• Investigate and resolve issues from data operations monitors and reports.
• Design data integrations and data quality framework.

Skills

Python/Java/Scala

SQL

Cloud platforms

Data pipelines

Distributed systems

Terraform

Kubernetes

Docker

ML deployment

Data modeling

Tools

Terraform

Kubernetes

Docker

Job description

Abridge is seeking a Data Engineer to join our US-based Data Engineering team in San Francisco. You will build and optimize large-scale data infrastructure to drive business decisions and ML research.

You will work with frontend and backend engineers, product managers, and analysts to improve data throughput, latency, and reliability, while designing data quality frameworks and integrations.