Azure Databricks Engineer

Coforge; Dadri, Greater Noida, Pune District; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Coforge is seeking a Senior Data Engineer in India to design, build, and optimize cloud-based data pipelines and architectures. You will leverage Azure Data Factory, Snowflake, and Azure Databricks to enable scalable data processing and analytics, collaborating with cross-functional teams to translate requirements into robust technical specifications.

The role emphasizes CI/CD with Azure DevOps, data quality, and documentation to ensure compliant, reliable data solutions while staying current

Qualifications

• 5–7 years of experience in data engineering or analytics.
• Senior-level data engineering role focusing on cloud-based data architectures.
• Experience with building scalable data pipelines and data platforms.

Responsibilities

• Design, develop, and implement data pipelines using Azure Data Factory and Snowflake.
• Utilize Azure Databricks for data processing and analytics at scale.
• Collaborate with cross-functional teams to gather requirements and translate into specs.
• Monitor and optimize data workflows for efficiency and reliability.
• Implement CI/CD practices with Azure DevOps for deployments.
• Ensure data quality and integrity through testing and validation.
• Document data architecture, processes, and workflows for compliance.
• Stay updated with industry trends to continuously improve data solutions.

Skills

Azure DevOps

Snowflake

Azure Data Factory

Azure Databricks

Job description

Job Description-

Years of Experience: 5-7 years

Job Summary:

We are seeking a highly skilled Senior Data Engineer with a strong background in cloud-based data solutions. The ideal candidate will have extensive experience with Azure DevOps, Snowflake, and Azure Data Factory, and must possess expertise in Azure Databricks. This role involves designing, developing, and maintaining data pipelines and architectures to support our data-driven initiatives.

Responsibilities:

Design, develop, and implement data pipelines using Azure Data Factory and Snowflake.

Utilize Azure Databricks for data processing and analytics, ensuring high performance and scalability.

Collaborate with cross-functional teams to gather requirements and translate them into technical specifications.

Monitor and optimize data workflows and processes for efficiency and reliability.

Implement CI/CD practices using Azure DevOps to streamline deployment processes.

Ensure data quality and integrity through rigorous testing and validation processes.

Document data architecture, processes, and workflows for future reference and compliance.

Stay updated with the latest industry trends and technologies to continuously improve data solutions.

Mandatory Skills:

• Azure DevOps
• Snowflake
• Azure Data Factory
• Azure Databricks (Deal Breaker Skill)