Snowflake python ETL engineer

Quantum Technologies. LLC; Boston (MA); Hybrid; USD 120,000 - 180,000; Full time

Job summary

QUANTUM TECHNOLOGIES LLC in Boston is seeking a Snowflake Python ETL Engineer to design, develop, and maintain scalable data pipelines that feed Snowflake Data Cloud. You will collaborate with data engineers, analysts, and business stakeholders to ensure reliable, secure data processing using Python-based ETL frameworks and cloud-native tech.

Responsibilities include building ETL/ELT pipelines, managing transformations with Snowflake SQL and Snowpark, and ingesting data from multiple sources.

Qualifications

• Strong experience with Snowflake Data Cloud.
• Proficient in Python for ETL development (Pandas, PySpark, Snowpark).
• Strong SQL skills, especially in Snowflake.
• Experience with ETL/ELT tools and orchestration frameworks.
• Knowledge of cloud platforms (AWS, Azure, or Google Cloud).
• Experience with data modeling (star/snowflake schemas).
• Familiarity with CI/CD, Git, and DevOps practices.
• Understanding of data security, governance, and compliance.

Responsibilities

• Design, develop, and optimize ETL/ELT pipelines using Python to load data into Snowflake.
• Build and manage data transformations using Snowflake SQL, Python, and Snowpark.
• Ingest data from databases, APIs, flat files, and cloud storage (S3, Azure Blob, GCS).
• Implement data validation, data quality checks, and reconciliation processes.
• Optimize Snowflake performance using clustering, partitioning, caching, and warehouse sizing.
• Develop reusable Python modules and frameworks for ETL automation.
• Orchestrate workflows using Airflow, Azure Data Factory, dbt, or Control-M.
• Implement CI/CD pipelines for data workflows and manage deployments across environments.
• Monitor ETL jobs, troubleshoot failures, ensure SLA compliance.
• Ensure data security and governance with RBAC, masking policies, and encryption.
• Collaborate with analytics, BI, and data science teams for reporting and analytics.

Skills

Snowflake Data Cloud

Python ETL

Snowflake SQL

ETL/ELT tools

Cloud platforms

Data modeling

CI/CD & Git

Data security & governance

Tools

Airflow

Azure Data Factory

dbt

Control-M

Snowpark

Job description

Job Title: Snowflake Python ETL Engineer

Location: Boston, MA (Hybrid 3 days onsite 2 days remote per week

Duration: Long Term Contract

Job Description:

Job Summary:

• The Snowflake Python ETL Engineer is responsible for designing, developing, and maintaining scalable data pipelines that ingest, transform, and load data into Snowflake Data Cloud.
• This role involves working closely with data engineers, analysts, and business stakeholders to ensure reliable, performant, and secure data processing using Python-based ETL frameworks and cloud-native technologies.

Key Responsibilities:

• Design, develop, and optimize ETL/ELT pipelines using Python to load data into Snowflake
• Build and manage data transformations using Snowflake SQL, Python, and Snowpark
• Ingest data from multiple sources such as databases, APIs, flat files, and cloud storage (S3, Azure Blob, GCS)
• Implement data validation, data quality checks, and reconciliation processes
• Optimize Snowflake performance using clustering, partitioning, caching, and warehouse sizing
• Develop reusable Python modules and frameworks for ETL automation
• Orchestrate workflows using tools such as Airflow, Azure Data Factory, dbt, or Control-M
• Implement CI/CD pipelines for data workflows and manage deployments across environments
• Monitor ETL jobs, troubleshoot failures, and ensure SLA compliance
• Ensure data security and governance using RBAC, masking policies, and encryption
• Collaborate with analytics, BI, and data science teams to support reporting and advanced analytics

Required Skills & Qualifications:

• Strong experience with Snowflake Data Cloud
• Proficient in Python for ETL development (Pandas, PySpark, Snowpark)
• Strong SQL skills, especially in Snowflake
• Experience with ETL/ELT tools and orchestration frameworks
• Knowledge of cloud platforms (AWS, Azure, or Google Cloud Platform)
• Experience with data modeling, star/snowflake schemas
• Familiarity with CI/CD, Git, and DevOps practices
• Understanding of data security, governance, and compliance

QUANTUM TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. QUANTUM TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will QUANTUM TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract