Senior Data Engineer - Healthcare AI Pipelines

Engg; San Francisco (CA); Hybrid; USD 150,000 - 210,000; Full time

Benefits offered by this job

Medical Insurance

Dental Insurance

Vision Insurance

Life Insurance

HSA with employer match

401(k)

Job summary

Rad AI in San Francisco is seeking a Senior Data Engineer to design and maintain scalable data platforms, pipelines, and management tools. You will work with Airflow, AWS Glue, Spark, and other big data technologies, collaborating with researchers and stakeholders to meet data needs.

This role focuses on building robust data infrastructure, ensuring quality, security, and scalability in a healthcare AI context.

Qualifications

• 5+ years of experience in data engineering.
• Experience designing distributed data pipelines on large-scale data sets.
• Hands-on experience building scalable data infra in complex environments.
• Experience with SQL and NoSQL databases (DynamoDB, Elasticsearch, PostgreSQL).
• Infrastructure as Code with Terraform.
• Software engineering background is a plus.

Responsibilities

• Design data architecture for scalable, efficient pipelines.
• Establish internal standards for style, maintenance, and best practices for a high-scale data platform.
• Collaborate with researchers and stakeholders to understand data needs and develop solutions.
• Take ownership of data engineering projects and design, develop, and maintain high-quality data solutions.
• Ensure data quality, integrity, and security with validation, monitoring, and access controls.
• Evaluate and recommend data technologies to improve efficiency and effectiveness.

Skills

Data Engineering

Distributed Pipelines

Big Data

Data Quality

Security

Tools

Apache Airflow

AWS Glue

Spark

Terraform

DynamoDB

Elasticsearch

PostgreSQL

Job description

Rad AI in San Francisco is seeking a Senior Data Engineer to design and maintain scalable data platforms, pipelines, and management tools. You will work with Airflow, AWS Glue, Spark, and other big data technologies, collaborating with researchers and stakeholders to meet data needs.

This role focuses on building robust data infrastructure, ensuring quality, security, and scalability in a healthcare AI context.