Snowflake python ETL engineer

Valiant Technologies LLC; Boston (MA); Hybrid; USD 83,000 - 138,000; Full time

Job summary

VALIANT TECHNOLOGIES LLC in Boston, MA is seeking a Snowflake Python ETL Engineer to design, build, and maintain scalable data pipelines that load data into Snowflake Data Cloud. You will work with data engineers, analysts, and business stakeholders to ensure reliable, secure data processing using Python-based ETL frameworks and cloud-native technologies.

Key activities include developing ETL/ELT pipelines with Python, Snowpark, and Snowflake SQL; orchestrating with Airflow, Azure Data Factory,

Qualifications

• Experience designing and maintaining Snowflake-based ETL pipelines.
• Strong Python skills with Pandas, PySpark, or Snowpark.
• Proficiency in Snowflake SQL and data modeling.
• Experience with orchestration tools (Airflow, ADF, dbt, Control-M).
• Familiarity with cloud platforms (AWS/Azure/GCP) and security practices.

Responsibilities

• Design, develop, and optimize ETL/ELT pipelines using Python to load data into Snowflake.
• Build and manage data transformations using Snowflake SQL, Python, and Snowpark.
• Ingest data from sources like databases, APIs, flat files, and cloud storage (S3, Azure, GCS).
• Implement data validation, data quality checks, and reconciliation processes.
• Optimize Snowflake performance with clustering, partitioning, caching, and warehouse sizing.
• Develop reusable Python modules and frameworks for ETL automation.
• Orchestrate workflows using Airflow, Azure Data Factory, dbt, or Control-M.
• Implement CI/CD pipelines for data workflows and deployments across environments.
• Monitor ETL jobs, troubleshoot failures, and ensure SLA compliance.
• Ensure data security and governance using RBAC, masking policies, and encryption.
• Collaborate with analytics, BI, and data science teams.

Skills

Snowflake Data Cloud

Python ETL

Snowpark

Snowflake SQL

ETL/ELT tools

Cloud platforms

CI/CD & DevOps

Data security

Tools

Airflow

Azure Data Factory

dbt

Control-M

Job description

Job Title: Snowflake Python ETL Engineer

Location: Boston, MA (Hybrid 3 days onsite 2 days remote per week

Duration: Long Term Contract

Job Description:

Job Summary:

• The Snowflake Python ETL Engineer is responsible for designing, developing, and maintaining scalable data pipelines that ingest, transform, and load data into Snowflake Data Cloud.
• This role involves working closely with data engineers, analysts, and business stakeholders to ensure reliable, performant, and secure data processing using Python-based ETL frameworks and cloud-native technologies.

Key Responsibilities:

• Design, develop, and optimize ETL/ELT pipelines using Python to load data into Snowflake
• Build and manage data transformations using Snowflake SQL, Python, and Snowpark
• Ingest data from multiple sources such as databases, APIs, flat files, and cloud storage (S3, Azure Blob, GCS)
• Implement data validation, data quality checks, and reconciliation processes
• Optimize Snowflake performance using clustering, partitioning, caching, and warehouse sizing
• Develop reusable Python modules and frameworks for ETL automation
• Orchestrate workflows using tools such as Airflow, Azure Data Factory, dbt, or Control-M
• Implement CI/CD pipelines for data workflows and manage deployments across environments
• Monitor ETL jobs, troubleshoot failures, and ensure SLA compliance
• Ensure data security and governance using RBAC, masking policies, and encryption
• Collaborate with analytics, BI, and data science teams to support reporting and advanced analytics

Required Skills & Qualifications:

• Strong experience with Snowflake Data Cloud
• Proficient in Python for ETL development (Pandas, PySpark, Snowpark)
• Strong SQL skills, especially in Snowflake
• Experience with ETL/ELT tools and orchestration frameworks
• Knowledge of cloud platforms (AWS, Azure, or Google Cloud Platform)
• Experience with data modeling, star/snowflake schemas
• Familiarity with CI/CD, Git, and DevOps practices
• Understanding of data security, governance, and compliance

VALIANT TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. VALIANT TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will VALIANT TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract