Data Engineering Consultant – Azure Data Factory

Optum; Gurugram District; On-site; INR 1,200,000 - 1,800,000; Full time

Benefits offered by this job

Cloud platform exposure

Growth opportunities

Competitive compensation

Collaborative team

Job summary

Optum is seeking a Data Engineer to design, build, and maintain scalable data pipelines and platforms. You will work with Azure Data Factory and Snowflake, partnering with analytics and reporting teams to deliver reliable data solutions.

Responsibilities include developing ELT/ETL workflows, optimizing Snowflake performance, and ensuring data quality and security across pipelines. Collaboration with Power BI teams and adherence to company policies are expected.

Qualifications

• Solid hands-on experience with Azure Data Factory and Snowflake.
• Design, develop, and maintain scalable data pipelines.
• Knowledge of ELT/ETL workflows and data modeling concepts.
• Experience with data governance, security, and cost optimization.
• Strong SQL skills and dimensional modeling understanding.

Responsibilities

• Design, develop, and maintain end-to-end data pipelines using Azure Data Factory.
• Build and optimize Data Models and transformations in Snowflake.
• Develop ELT/ETL workflows to ingest data from multiple sources.
• Ensure data quality, consistency, and reliability across pipelines.
• Collaborate with Power BI/reporting teams to enable analytics-ready datasets.

Skills

SQL

Data warehousing

ELT/ETL architectures

Dimensional modeling

Problem solving

Communication

Teamwork

Tools

Azure Data Factory

Snowflake

Power BI

Azure DevOps

Git

Python

Spark

Job description

Description: We are looking for a Data Engineer to join our data engineering team and help design, build, and maintain scalable data pipelines and data platforms. The ideal candidate will have solid hands-on experience with Azure Data Factory and Snowflake, and will work closely with business, analytics, and downstream reporting teams to deliver reliable, high quality data solutions.

Responsibilities

• Design, develop, and maintain end-to-end data pipelines using Azure Data Factory (ADF)
• Build and optimize data models and transformations in Snowflake
• Develop ELT/ETL workflows to ingest data from multiple sources (databases, APIs, files, cloud storage)
• Ensure data quality, consistency, and reliability across pipelines
• Implement incremental loads, CDC, and error handling mechanisms
• Optimize Snowflake performance through clustering, warehouse sizing, partitioning, and query tuning
• Implement monitoring, logging, and alerting for data pipelines
• Work closely with Power BI / reporting teams to enable analytics-ready datasets
• Follow best practices for security, data governance, and cost optimization
• Participate in code reviews, design discussions, and documentation
• Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so

Technical Skills

• Solid hands-on experience with Azure Data Factory
• Pipelines, triggers, datasets, linked services
• Parameterized pipelines and dynamic mapping
• Solid experience with SnowflakeSQL, views, stored procedures
• Performance tuning and cost optimization
• Experience with data warehousing concepts (fact/dimension tables, star schema)
• Experience working with cloud data sources (Azure Blob Storage, ADLS, S3, APIs, RDBMS)
• Understanding of ETL/ELT architectures
• Solid SQL skills and understanding of dimensional modeling

Preferred Qualifications

• Experience with Power BI or other BI tools
• Experience with CI/CD for data pipelines
• Experience with data governance and security models
• Knowledge of Azure DevOps / Git
• Exposure to Python or Spark

Soft Skills

• Solid problem-solving and analytical skills
• Ability to work independently and within a team
• Good communication skills to work with technical and non-technical stakeholders
• Attention to detail and ownership mindset

What We Offer

• Opportunity to work on modern cloud data platforms
• Exposure to enterprise-scale data systems
• Collaborative and learning-focused team environment
• Clear growth path toward Senior / Techno-Functional roles
• Competitive compensation and benefits