Hybrid Snowflake Python ETL Engineer | Data Pipelines

Valiant Technologies LLC; Boston (MA); Hybride; USD 83 000 - 138 000; Plein temps

Résumé du poste

VALIANT TECHNOLOGIES LLC in Boston, MA is seeking a Snowflake Python ETL Engineer to design, build, and maintain scalable data pipelines that load data into Snowflake Data Cloud. You will work with data engineers, analysts, and business stakeholders to ensure reliable, secure data processing using Python-based ETL frameworks and cloud-native technologies.

Key activities include developing ETL/ELT pipelines with Python, Snowpark, and Snowflake SQL; orchestrating with Airflow, Azure Data Factory,

Qualifications

• Experience designing and maintaining Snowflake-based ETL pipelines.
• Strong Python skills with Pandas, PySpark, or Snowpark.
• Proficiency in Snowflake SQL and data modeling.
• Experience with orchestration tools (Airflow, ADF, dbt, Control-M).
• Familiarity with cloud platforms (AWS/Azure/GCP) and security practices.

Responsabilités

• Design, develop, and optimize ETL/ELT pipelines using Python to load data into Snowflake.
• Build and manage data transformations using Snowflake SQL, Python, and Snowpark.
• Ingest data from sources like databases, APIs, flat files, and cloud storage (S3, Azure, GCS).
• Implement data validation, data quality checks, and reconciliation processes.
• Optimize Snowflake performance with clustering, partitioning, caching, and warehouse sizing.
• Develop reusable Python modules and frameworks for ETL automation.
• Orchestrate workflows using Airflow, Azure Data Factory, dbt, or Control-M.
• Implement CI/CD pipelines for data workflows and deployments across environments.
• Monitor ETL jobs, troubleshoot failures, and ensure SLA compliance.
• Ensure data security and governance using RBAC, masking policies, and encryption.
• Collaborate with analytics, BI, and data science teams.

Connaissances

Snowflake Data Cloud

Python ETL

Snowpark

Snowflake SQL

ETL/ELT tools

Cloud platforms

CI/CD & DevOps

Data security

Outils

Airflow

Azure Data Factory

dbt

Control-M

Description du poste

VALIANT TECHNOLOGIES LLC in Boston, MA is seeking a Snowflake Python ETL Engineer to design, build, and maintain scalable data pipelines that load data into Snowflake Data Cloud. You will work with data engineers, analysts, and business stakeholders to ensure reliable, secure data processing using Python-based ETL frameworks and cloud-native technologies.

Key activities include developing ETL/ELT pipelines with Python, Snowpark, and Snowflake SQL; orchestrating with Airflow, Azure Data Factory,