Senior Data Engineer

TechDigital Group; St. Louis (MO); On-site; USD 100,000 - 130,000; Full time

Job summary

A tech solutions provider in St. Louis is seeking a Data Engineer to design and maintain data warehouses within Snowflake. You will build robust ETL/ELT pipelines, optimize data integration workflows, and implement data governance policies. The role requires a Bachelor's or Master's degree in a related field, with a minimum of 7 years of experience in data engineering, particularly in Azure and Snowflake. Ideal candidates will have strong SQL skills and expertise in various Azure data services.

Qualifications

• 7+ years of professional experience in data engineering.
• Deep expertise in Snowflake, familiar with SnowSQL and Snowpipe.
• Hands-on experience with Azure Data Factory for building ETL/ELT pipelines.

Responsibilities

• Design and maintain scalable data models within Snowflake.
• Build and optimize robust ETL/ELT pipelines.
• Implement data quality checks and governance policies.

Skills

Data modeling

ETL pipeline development

Azure Data Factory

SQL proficiency

Snowflake expertise

Education

Bachelor's or Master's degree in Computer Science or related field

Tools

Azure Data Factory

Snowflake

Job description

Responsibilities

• Data Warehouse Design and Development (Snowflake): Design, develop, and maintain scalable and efficient data models and data warehouses within the Snowflake environment.
• ETL/ELT Pipeline Development: Design, build, and optimize robust ETL/ELT pipelines using various tools and technologies to ingest, transform, and load data from diverse sources into Snowflake and other data stores.
• Azure Data Services: Utilize and integrate various Azure data services, including but not limited to Azure Data Factory, Azure Synapse Analytics (SQL Data Warehouse, Data Lake), Azure Databricks, Azure Blob Storage, Azure SQL Database, and Azure Data Lake Storage (ADLS).
• Data Integration: Develop and implement data integration solutions to connect various internal and external data sources.
• Performance Optimization: Identify and resolve performance bottlenecks in data pipelines and Snowflake queries.
• Data Quality and Governance: Implement and enforce data quality checks, data governance policies, and data security measures.
• Monitoring and Alerting: Design and implement monitoring and alerting systems for data pipelines and data infrastructure to ensure reliability and timely issue resolution.

Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, Information Technology, or a related field.
• Minimum of 7 years of professional experience in data engineering.
• Deep expertise in Snowflake data warehousing:
  • Experience with Snowflake utilities and tools (e.g., SnowSQL, Snowpipe, Tasks).
• Strong experience with Microsoft Azure data services:
  • Hands‑on experience with Azure Data Factory for building ETL/ELT pipelines.
  • Familiarity with other Azure data services such as Azure Synapse Analytics, Azure Databricks, Azure Data Lake Storage, and Azure SQL Database.
• Extensive experience with ETL/ELT tools and techniques:
  • Proven ability to design, develop, and maintain complex ETL/ELT workflows.
  • Experience with various data integration patterns and technologies.
• Strong proficiency in SQL and experience working with different database systems.