Senior Data Engineer

Datatobiz; United States; Remote; USD 120,000 - 160,000; Full time

Job summary

Datatobiz is seeking a data engineer to design and maintain large-scale data pipelines using Azure Data Factory and Snowflake, enabling reliable data delivery across teams. You will optimize SQL queries, collaborate with cross-functional partners, and implement automated testing for ETL jobs, supporting batch and streaming data workloads in a cloud-first environment.

The ideal candidate has 5-8 years of experience, strong problem-solving skills, and a track record of delivering scalable data

Qualifications

• 5-8 years of data engineering experience with ADF, ETL, Snowflake, and Azure Databricks.
• Knowledge of cloud platforms such as AWS or GCP is a plus.
• Strong SQL skills for large datasets and big-data processing (batch/streaming).

Responsibilities

• Design, develop, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Snowflake.
• Collaborate with cross-functional teams to gather requirements for ETL processes and ensure seamless integration with existing systems.
• Develop complex SQL queries to optimize database performance and troubleshoot issues in Snowflake.
• Implement automated testing frameworks to ensure high-quality delivery of ETL jobs.

Skills

ADF

ETL

Snowflake

Azure Databricks

SQL

Cloud platforms (AWS/GCP)

Big data processing

Tools

Azure Data Factory (ADF)

Job description

Roles and Responsibilities

• Design, develop, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Snowflake.


• Collaborate with cross-functional teams to gather requirements for ETL processes and ensure seamless integration with existing systems.


• Develop complex SQL queries to optimize database performance and troubleshoot issues in Snowflake.


• Implement automated testing frameworks to ensure high-quality delivery of ETL jobs.

Desired Candidate Profile

• 5-8 years of experience in Data Engineering with expertise in ADF, ETL, Snowflake, and Azure Databricks.


• Strong understanding of cloud-based technologies such as AWS or GCP is an added advantage.


• Proficiency in writing efficient SQL queries for querying large datasets.


• Experience working on big-data processing tasks including batch/streaming data ingestion.