Data Engineer

Programmers.io; United States; On-site; USD 90,000 - 130,000; Full time

Job summary

Programmers.io is seeking a data engineer to join our team in the United States. The role focuses on designing and implementing scalable data pipelines in Azure, leveraging Azure Data Factory (ADF), Azure SQL Database, and Snowflake to deliver reliable data assets for analytics and applications.

You will collaborate with cross-functional teams to optimize data architectures, establish best practices in DevOps and CI/CD (GitHub Copilot awareness), and ensure data quality, security, and governance

Qualifications

• Proficiency in building data pipelines in Azure cloud environments.
• Experience designing and optimizing ETL pipelines using ADF and SQL.
• Snowflake experience is a plus; knowledge of DevOps and GitHub Copilot desired.

Responsibilities

• Design, develop, and optimize data pipelines and data stores in cloud platforms.
• Collaborate with vendors and internal teams to align architecture with business needs.
• Support analytics and applications built on top of data assets.
• Ensure data quality, security, and scalable solutions.

Skills

Azure Data Factory

SQL

Data pipelines

Azure Cloud

Azure SQL Database

Snowflake

DevOps

GitHub Copilot

Microsoft 365 Copilot

Tools

Snowflake

GitHub Copilot

Microsoft 365 Copilot

Azure DevOps

Job description

requirement JD : Azure Data Factory (ADF) mandatory, Strong SQL and data pipeline development experience, Azure cloud, Azure SQL Database, SNOWFLAKE, DevOps Knowledge and GitHub Copilot, Microsoft 365 Copilot.

Solid background in developing Data pipelines in Azure cloud or another cloud technology needed.

Experience in Snowflake would be a plus.

Functions may include database architecture, engineering, design, optimization, security, and administration; as well as data modelling, big data development, Extract, Transform, and Load (ETL) development, storage engineering, data warehousing, data provisioning, and other similar roles.

Responsibilities may include Platform-as-a-Service and Cloud solution with a focus on data stores and associated eco systems.

Duties may include management of design services, providing sizing and configuration assistance, ensuring strict data quality, and performing needs assessments.

Analyses current business practices, processes and procedures as well as identifying future business opportunities for leveraging data storage and retrieval system capabilities. Manages relationships with software and hardware vendors to understand the potential architectural impact of different vendor strategies and data acquisition.

May design schemas, write SQL, or other data markup scripting and helps to support development of Analytics and Applications that build on top of data.