Data Engineer

Storm3; United States; Remote; USD 130,000 - 160,000; Full time

Job summary

A leading biotechnology company seeks a Data Engineer to enhance their internal platform by developing tools for building data pipelines and collaborating with scientists. The role emphasizes innovative practices in a supportive environment, suited for someone passionate about data engineering and cloud technologies.

Benefits

Medical insurance

Vision insurance

401(k)

Pension plan

Child care support

Paid maternity leave

Paid paternity leave

Disability insurance

Qualifications

• 4+ years of professional experience in Python and data pipelines.
• Experience building tools for data engineering.
• Familiar with cloud platforms and distributed system principles.

Responsibilities

• Build tools for improving data engineering workflows.
• Collaborate with scientists and engineers on data tasks.
• Implement observability and instrumentation for applications.

Skills

Python

SQL

Data pipelines

Distributed systems

Git

Tools

AWS

Apache Spark

Job description

Get AI-powered advice on this job and more exclusive features.

This range is provided by Storm3. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$130,000.00/yr - $160,000.00/yr

Direct message the job poster from Storm3

AI for Science - Connecting Tech talent into innovative Healthtechs and Biotechs

Remote within the US or San Diego

Working with a clinical-stage biotechnology company that leverages human genetics to transform therapeutic discovery. They utilize its platform to analyze extensive biological datasets, aiming to identify and develop novel medicines that mimic naturally occurring genetic variants with beneficial health effects.

You will work closely with a team of engineers and scientists to build and extend the internal data platform, which include cloud-based systems, services, and web applications that help our scientists discover drug targets from some of the largest biological datasets in the world. An ideal candidate is curious, detail-oriented, and enjoys working in collaborative environments with teammates coming from diverse backgrounds and skill sets.

• Building tools for internal use that improve the ability of data engineers and analysts to build pipelines and integrate with cloud compute platforms
• Collaborate with a team of scientists and engineers to build reusable components that solve common problems during pipeline development
• Be a champion of data engineering best practices, enabling others through the creation of tools and frameworks that enforce and simplify their implementation
• Implement observability and instrumentation for real-time tracking and alerting of application and data metrics
• Build tools to integrate and abstract integration with cloud vendors and external services
• Create documentation and trainings to enable pipeline developers to use internal and external tools
• Take ownership of the code and subsystems that you work on
• Strong experience with Python (4 years professional experience minimum)
• Comfortable with SQL
• Significant experience building data pipelines (4 years professional experience minimum)
• Strong experience with distributed transformation frameworks such as Spark
• Strong understanding of distributed systems
• Experience building internal tools and automation, and improving developer workflows
• Experience implementing data observability tooling
• Proficiency with git / GitHub
• Experience with a CI / CD solution such as Github Actions, CircleCI, Travis, Code*, etc.
• Experience building documentation for internal APIs and tools
• Experience administering and building on AWS, including exposure to most of the following: EC2, ECS, VPC, Lambda, RDS, IAM, Athena
• Proven ability to self-manage all aspects of SDLC for a given project, including requirements gathering, specifications, implementation, and ongoing maintenance
• Experience working in a complex scientific domain
• Experience with a workflow orchestration tool (Dagster, Airflow, Prefect, etc.)
• Experience using or implementing a data catalog
• Knowledgeable about data governance and organizational best practices
• Exposure to data warehousing techniques such as star / snowflake schemas, medallion architecture
• Experience building backend applications and REST / GraphQL / GRPC services
• Apache Spark tuning and administration experience
• Experience deploying software with complex dependencies
• Experience with next-gen ETL frameworks such as Polars, Daft, Duckdb
• Experience with Ray as a user or administrator
• Experience building tools or services that handle and manage large (>100TB) datasets
• Experience building tools on top of Databricks
• Significant experience with next-gen table formats such as Delta, Iceberg, Hudi, etc.
• Working knowledge of relational databases such as Postgres, MySQL, MariaDB, etc.
• Working knowledge of log aggregation / monitoring tools (we use Datadog)
• Exposure to Scala / Java

Interested in applying? Please click on the ‘Easy Apply’ button

Storm3 is a HealthTech recruitment firm with clients across London, Europe and North America. To discuss open opportunities or career options, please visit our website www.storm3.com and follow the Storm3 Linked In page for the latest jobs and intel.

Seniority level

• Seniority level

  Not Applicable

Employment type

• Employment type

  Full-time

Job function

• Job function

  Engineering and Information Technology

• Industries

  Biotechnology Research and Technology, Information and Media

Referrals increase your chances of interviewing at Storm3 by 2x

Inferred from the description for this job

Medical insurance

Vision insurance

401(k)

Pension plan

Child care support

Paid maternity leave

Paid paternity leave

Disability insurance

Get notified when a new job is posted.

Sign in to set job alerts for “Data Engineer” roles.

Software Engineer - Fullstack, Multiple Locations

United States $81,900.00-$174,600.00 6 days ago

United States $170,000.00-$720,000.00 5 days ago

Santa Clara, CA $100,000.00-$500,000.00 6 days ago

Full-Stack Software Engineer (New graduates: United States)

United States $70,000.00-$100,000.00 1 week ago

New York, NY $140,000.00-$185,000.00 3 days ago

United States $120,000.00-$170,000.00 2 weeks ago

United States $130,000.00-$180,000.00 5 days ago

New York, United States $142,600.00-$196,200.00 3 days ago

Software Engineer L4/L5, Model Serving Systems, Machine Learning Platform

United States $100,000.00-$720,000.00 1 week ago

Software Engineer (L5) - Ads Identity & Privacy

United States $100,000.00-$720,000.00 1 week ago

United States $140,000.00-$170,000.00 1 month ago

Software Engineer Intern/Co-op (Fall 2025)

New York, NY $145,000.00-$260,000.00 7 months ago

United States $90,000.00-$170,000.00 9 months ago

Software Engineer (L5) - Open Connect Platform

United States $100,000.00-$720,000.00 20 hours ago

Software Engineer - AI/ML, Multiple Locations

Redmond, WA $81,900.00-$174,600.00 1 week ago

Software Engineer - AI/ML, Multiple Locations

United States $81,900.00-$174,600.00 6 days ago

United States $164,200.00-$229,900.00 5 days ago

United States $126,500.00-$187,400.00 3 days ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.