Senior Data Engineer — Hybrid Cloud Data Pipelines

Curium Pharma; Maryland Heights (MO); Hybride; USD 110 000 - 190 000; Plein temps

Résumé du poste

Curium is seeking a Senior Data Engineer to design, build, and maintain scalable data pipelines, platforms, and analytics products. You will collaborate with data architects, data scientists, analysts, and business stakeholders to deliver trusted data for analytics, reporting, ML, and operations.

The role emphasizes cloud platforms like Databricks, Snowflake, Fabric, and Azure, with a hybrid schedule (4 days onsite, 1 day remote).

Qualifications

• Bachelor's degree in CS/Engineering/Info Systems or equivalent experience.
• 5+ years of professional data engineering experience.
• Strong SQL and database development skills.
• Experience developing production-grade ETL/ELT pipelines.
• Proficiency in Python, Scala, Java, or similar language.
• Experience with cloud data platforms and cloud storage.
• Strong understanding of data modeling, data warehouses, data lakes, and/or lakehouses.
• Experience with Git, CI/CD, testing, and deployment practices.

Responsabilités

• Design, build, and maintain scalable batch and real-time data pipelines.
• Develop ETL/ELT processes for structured, semi-structured, and unstructured data.
• Integrate data from databases, APIs, SaaS apps, files, and streams.
• Build and maintain cloud-based data lake, lakehouse, and warehouse solutions.
• Collaborate with architects, data scientists, analysts, and stakeholders.
• Mentor junior engineers and promote engineering best practices.
• Ensure compliance with regulatory guidelines (FDA, DEA, EU, etc.).
• Translate business requirements into scalable technical solutions.
• Create technical documentation and runbooks.

Connaissances

SQL

ETL/ELT pipelines

Python

Scala

Java

Cloud platforms

Data modeling

Data warehouses

Data lakes

Lakehouses

Git

CI/CD

Testing

Deployment

Databricks

Snowflake

Microsoft Fabric

Spark

PySpark

Azure

AWS

Google Cloud

Kafka

Event Hubs

Kinesis

Azure Data Factory

Airflow

Delta Lake

Apache Iceberg

Data mesh

Data catalog

Data lineage

Governance

Observability

AI/ML data

Formation

Bachelor's degree in CS/Engineering/Information Systems

Outils

Databricks

Snowflake

Microsoft Fabric

Azure Data Factory

Description du poste

Curium is seeking a Senior Data Engineer to design, build, and maintain scalable data pipelines, platforms, and analytics products. You will collaborate with data architects, data scientists, analysts, and business stakeholders to deliver trusted data for analytics, reporting, ML, and operations.

The role emphasizes cloud platforms like Databricks, Snowflake, Fabric, and Azure, with a hybrid schedule (4 days onsite, 1 day remote).