Azure Databricks Developer

Infosys; Bengaluru; On-site; INR 800,000 - 1,200,000; Full time

Job summary

Infosys is seeking a skilled Data Engineer to design and optimize data pipelines in Bengaluru, India. The ideal candidate should have strong knowledge of Azure Databricks and at least 2 years of experience in data engineering. Responsibilities include collaborating with teams to deliver scalable solutions and ensuring data integrity across sources.

The role requires a Bachelor's degree in a related field, along with expertise in PySpark and cloud technologies. Infosys offers a dynamic work environment focused on data analytics.

Qualifications

• Minimum of 2 years' experience in data engineering.
• Strong understanding of data processing frameworks.
• Proven experience with Azure Databricks.

Responsibilities

• Design, develop, and optimize data pipelines using Azure Databricks.
• Collaborate with cross-functional teams to meet data requirements.
• Ensure data quality and integrity across data sources.

Skills

Azure Databricks

Data Engineering

PySpark

Python

Education

Bachelor's degree in Computer Science, Information Technology, or related field

Job description

Educational Requirements

Bachelor of Engineering, BCom, BBA

Service Line

Data Analytics Unit

Responsibilities

Design, develop, and optimize data pipelines using Azure Databricks. Collaborate with cross-functional teams to understand data requirements and deliver scalable solutions. Implement data transformation and processing tasks using PySpark. Ensure data quality and integrity across various data sources. Provide technical guidance and mentorship to junior team members.

Additional Responsibilities

• Minimum Qualifications: Bachelor's degree in Computer Science, Information Technology, or a related field
• Proven experience with Azure Databricks, with a minimum of 2 years in data engineering
• Strong understanding of data processing frameworks and cloud technologies
• Preferred Qualifications: Experience with PySpark and its application in big data environments
• Azure Databricks certification
• Track record of successfully delivering data solutions in a consulting environment
• Familiarity with data governance and security best practices
• Excellent problem-solving skills and ability to work independently

Technical and Professional Requirements

Databricks, PySpark, Python

Preferred Skills

Technology → Data Engineering → Databricks