Senior Data Engineer - Snowflake & Airflow

Quantori; United States; Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

Competitive compensation

Excellent tech team

Job summary

Quantori is seeking a hands-on Senior Data Engineer to design, build, and maintain modern data platforms and production pipelines using Snowflake, Apache Airflow, Python, and AWS. You will work across the full data engineering lifecycle - from data ingestion and modeling to transformation, testing, deployment, monitoring, and production support.

You’ll collaborate with cross-functional teams to turn complex data requirements into reliable, scalable, and well-governed data solutions.

Qualifications

• 5+ years of experience in Data Engineering
• 3+ years working with production data platforms
• Advanced SQL skills and complex transformations
• Strong Python skills for ETL and automation
• Production experience with Airflow and DAGs
• Experience with relational databases, object storage, APIs, and file-based sources
• Knowledge of modern data architectures and modeling concepts
• Experience with Git, PRs, and CI/CD for data pipelines

Responsibilities

• Design, develop, and maintain production data pipelines using Python, Airflow, Snowflake, and S3
• Build scalable data architectures with Bronze/Silver/Gold data layers
• Develop data models and implement incremental loading, historization, and transformations
• Write and optimize complex SQL transformations, views, procedures, and dynamic tables
• Integrate data from databases, APIs, object storage, and files
• Implement data quality checks, lineage, monitoring, and error handling
• Manage Snowflake access controls, roles, and deployment across environments
• Maintain CI/CD pipelines for Snowflake objects, Airflow DAGs, and Python code
• Monitor and troubleshoot production pipelines and improve reliability
• Collaborate with cross-functional teams to translate requirements into data products
• Create technical docs and specifications according to standards

Skills

Problem solving

Independent work

Team collaboration

Tools

Snowflake

Apache Airflow

Python

SQL

Git

CI/CD

AWS

S3

Job description

We are looking for a hands-on Senior Data Engineer to design, build, and maintain modern data platforms and production data pipelines using Snowflake, Apache Airflow, Python, and AWS. You will work across the full data engineering lifecycle - from data ingestion and modeling to transformation, testing, deployment, monitoring, and production support. You’ll collaborate with cross-functional teams to turn complex data requirements into reliable, scalable, and well-governed data solutions.

Location:

Quantori is an international team: we have colleagues who work not only from office but also remotely from all over the world.

Responsibilities:

• Design, develop, and maintain production data pipelines using Python, Apache Airflow, Snowflake, and Amazon S3
• Design and evolve scalable data architectures, including Bronze, Silver, and Gold data layers
• Develop data models and implement incremental loading, historization, versioning, and reusable transformation patterns
• Write and optimize complex SQL transformations, views, stored procedures, dynamic tables, streams, tasks, and scheduled jobs
• Integrate data from relational databases, APIs, object storage, and file-based sources
• Implement data-quality checks, validation, reconciliation, lineage, monitoring, and robust error-handling processes
• Manage Snowflake access controls, roles, permissions, service accounts, and deployment across development, staging, and production environments
• Maintain CI/CD pipelines for Snowflake objects, Airflow DAGs, and Python code using Git and automated testing
• Monitor and troubleshoot production pipelines and proactively improve reliability and performance
• Collaborate with data, analytics, engineering, and other technical teams to translate business and technical requirements into reliable data products
• Create technical documentation and specifications following established quality and compliance standards

What we expect:

• 5+ years of experience in Data Engineering, including at least 3 years working with production data platforms
• Strong hands-on experience with Snowflake, including Data modeling, RBAC and access management, Warehouse management, Query profiling and performance optimization, Stored procedures
• Advanced SQL skills, including complex joins, CTEs, window functions, incremental processing, and query optimization
• Strong Python skills for ETL, database integration, automation, error handling, and testing
• Production experience with Apache Airflow, including DAG development, dependencies, sensors, task groups, retries, backfills, and operational support
• Experience working with relational databases, object storage, APIs, and file-based data sources
• Strong understanding of modern data architectures, including medallion and dimensional modeling, slowly changing dimensions, natural and surrogate keys, and historization
• Experience with Git, pull requests, automated testing, and CI/CD for data pipelines and database code
• Strong problem-solving skills and the ability to work independently in a production environment
• Snowflake and Apache Airflow are core requirements for this role; experience only with alternative data warehouses or orchestration tools would not be sufficient

Nice to have:

• Experience working in regulated or validated environments
• Background in life sciences, healthcare, clinical, laboratory, genomic, or bioinformatics data
• Experience working with LIMS or other scientific/clinical data systems
• Familiarity with OMOP or other standardized clinical data models
• Experience with data-consumption and visualization tools such as Tableau or Streamlit
• Familiarity with scientific or computational workflows and tools such as Nextflow or similar workflow orchestration platforms
• Experience with AWS Managed Workflows for Apache Airflow (MWAA)

We offer:

• Competitive compensation
• A team with excellent tech expertise