Azure Databricks-Data Engineer (Female Hiring)

Infosys; Hyderabad, Pune District, Bengaluru; On-site; INR 1,500,000 - 2,300,000; Full time

Job summary

Infosys is hiring a Data Bricks-Data Engineer in Hyderabad with 2–5 years of experience. The role focuses on designing and maintaining scalable data pipelines using Databricks, Spark/PySpark, and Delta Lake.

You will implement Lakehouse architecture, manage data models, and ensure data governance and security while collaborating with data scientists and BI teams. The position is full-time and based in Hyderabad, offering opportunities to work on cloud migrations and data modernization

Qualifications

• 2–5 years of experience in data engineering or a related field.
• Proficient in Databricks, Spark and PySpark.
• Strong experience with ETL/ELT pipelines for large-scale data ingestion and transformation.
• Knowledge of Lakehouse architecture and Delta Lake.
• Experience with data governance, security, and access controls.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Databricks.
• Build and optimize ETL/ELT processes for large-scale data ingestion and transformation.
• Develop Spark and PySpark applications for batch and real-time processing.
• Implement Lakehouse architecture using Delta Lake.
• Create and maintain data models, tables, and data warehouses.

Skills

Databricks

Spark/PySpark

ETL/ELT

Data pipelines

Tools

Delta Lake

Unity Catalog

Terraform

Job description

Position: Data Bricks-Data Engineer

Experience: 2 to 5 years

Location: Hyderabad

Employment Type: Full-Time

Roles & Responsibilities

• Design, develop, and maintain scalable data pipelines using Databricks.
• Build and optimize ETL/ELT processes for large-scale data ingestion and transformation.
• Develop Spark and PySpark applications for batch and real-time processing.
• Implement Lakehouse architecture using Delta Lake.
• Create and maintain data models, tables, and data warehouses.
• Optimize Databricks jobs, Spark performance, and query execution.
• Integrate data from multiple cloud and on-premises sources.
• Ensure data quality, governance, and security standards.
• Work with Unity Catalog for data governance and access management.
• Automate deployments using CI/CD and Infrastructure as Code (Terraform).
• Monitor and troubleshoot production data pipelines.
• Collaborate with Data Scientists, BI Developers, and Business Stakeholders.
• Support cloud migration and data modernization initiatives.