ADF Databricks/Snowflake Consultant

Infosys; Bengaluru; On-site; INR 900,000 - 1,300,000; Full time

Job summary

Infosys in Bengaluru is seeking a skilled Data Engineer to design, develop, and maintain scalable data pipelines using Azure Data Factory, Azure Databricks, and Snowflake. The role focuses on integrating data from multiple sources to enable enterprise analytics and reporting.

You will work with PySpark and SQL, ensure data quality, governance, and performance tuning, and collaborate with stakeholders in an Agile environment while supporting production data platforms.

Qualifications

• Experience with Azure Data Factory, Databricks, and Snowflake in building data pipelines.
• Strong SQL and PySpark development skills for data transformation.
• Experience implementing data quality checks, monitoring, and performance tuning.
• Ability to ingest and process structured and unstructured data from multiple sources.
• Collaborate with stakeholders and cross-functional teams to deliver data solutions.

Responsibilities

• Build and optimize data ingestion and transformation workflows in Snowflake.
• Develop scalable solutions using PySpark and SQL.
• Implement data quality checks, monitoring, and performance tuning.
• Work with structured and unstructured data from multiple sources.
• Collaborate with business stakeholders, architects, and cross-functional teams to deliver data solutions.
• Troubleshoot production issues and provide ongoing support for data platforms.
• Ensure adherence to data governance, security, and best practices.

Skills

ADF

Azure Databricks

Snowflake

PySpark

SQL

ADLS

Azure ecosystem

Data warehousing concepts

Education

MBA

MCA

ME

MSc

MTech

BE/BTech

BCA

BSc

Tools

Snowflake

Databricks

PySpark

ADF

SQL

Azure

Azure Data Lake Storage (ADLS)

Job description

Job Summary

We are looking for a highly skilled Data Engineer with hands-on experience in Azure Data Factory (ADF), Azure Databricks, or Snowflake. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and data integration solutions to support enterprise analytics and reporting requirements. Relevant experience with ADF, Databricks, or Snowflake is consistently highlighted in similar internal Data Engineer requirements.

Roles & Responsibilities

• Build and optimize data ingestion and transformation workflows in Snowflake.
• Develop scalable solutions using PySpark and SQL.
• Implement data quality checks, monitoring, and performance tuning.
• Work with structured and unstructured data from multiple sources.
• Collaborate with business stakeholders, architects, and cross-functional teams to deliver data solutions.
• Troubleshoot production issues and provide ongoing support for data platforms.
• Ensure adherence to data governance, security, and best practices.

Technical Requirements

• Strong experience in Azure Data Factory (ADF).
• Hands-on experience with Azure Databricks and PySpark.
• Strong Snowflake development experience.
• Advanced SQL skills.
• Experience with ADLS and Azure ecosystem.
• Understanding of data warehousing concepts and dimensional modeling.

Additional Responsibilities

• Strong analytical and problem-solving skills.
• Experience working in Agile environments.
• Excellent communication and stakeholder management skills.
• Ability to work independently and deliver high-quality solutions.

Educational Requirement

• MBA, MCA, ME, MSc, MTech, Bachelor of Engineering, BCA, BSc, BTech

Preferred Skills

• Technology -> Cloud Integration -> Azure Data Factory (ADF)
• Technology -> Data Engineering -> Databricks
• Technology -> Data on Cloud-DataStore -> Snowflake

Service Line

• Data & Analytics Unit