Azure Databricks Data Engineer (Power BI & Informatica)

Tata Consultancy Services; Bengaluru; On-site; INR 1,500,000 - 2,100,000; Full time

Job summary

Tata Consultancy Services in Bengaluru is seeking an experienced Azure Databricks Data Engineer to design, develop, and support enterprise-grade ETL solutions and data pipelines within the Azure ecosystem.

You will build Power BI dashboards, collaborate with data teams, and optimize SQL/T-SQL, PySpark, and Informatica workloads across large data marts and reporting environments.

Qualifications

• 6-8 years of experience in data engineering and ETL development.
• Hands-on expertise with Azure Databricks and Power BI development.
• Proficiency in Azure Data Factory, SQL/T-SQL, and PySpark.
• Experience with Informatica and enterprise data marts is preferred.

Responsibilities

• Design, develop, and maintain ETL/ELT solutions using Azure Databricks and ADF.
• Build scalable data pipelines across ADLS, Synapse, and Databricks.
• Develop data transformations using Python and PySpark.
• Create and maintain Power BI dashboards and reports.
• Optimize SQL/T-SQL queries and manage data warehouse objects.
• Collaborate with stakeholders and analytics teams to deliver data solutions.
• Support testing, deployment, and production operations.

Skills

Azure Databricks

Power BI

Azure Data Factory

Informatica

SQL

PySpark

ETL

Data pipelines

Tools

Azure Synapse Analytics

ADLS

Databricks

Power BI

Job description

We are looking for an experienced Azure Databricks Data Engineer with strong expertise in Azure Databricks, Power BI, Azure Data Factory, Informatica, SQL, and PySpark. The ideal candidate will be responsible for designing, developing, and supporting enterprise-grade ETL solutions, data pipelines, reporting platforms, and large-scale data marts within the Azure ecosystem.

Key Responsibilities

• Design, develop, and maintain ETL/ELT solutions using Azure Databricks, Azure Data Factory, and related Azure services.
• Build scalable data pipelines and integrations across Azure platforms including ADLS, ADF, Synapse Analytics, and Databricks.
• Develop data transformation processes using Python and PySpark.
• Create and maintain Power BI dashboards, reports, and analytical solutions.
• Work with Informatica and other enterprise ETL tools to support data integration requirements.
• Design and optimize SQL and T-SQL queries, stored procedures, and database objects.
• Develop and support large-scale data marts and reporting environments.
• Implement data quality controls, validation frameworks, and performance optimization strategies.
• Troubleshoot database, ETL, reporting, and data pipeline issues.
• Manage database security, user access, backup, archiving, capacity planning, and performance tuning activities.
• Collaborate with business stakeholders, architects, and analytics teams to deliver data solutions.
• Participate in testing, deployment, and production support activities.

Required Skills

• 6-8 years of experience in Data Engineering and ETL development.
• Strong hands-on experience with Azure Databricks.
• Strong Power BI development experience.
• Expertise in Azure Data Factory (ADF).
• Strong Python and PySpark development skills.
• Experience with SQL and T-SQL programming.
• Good understanding of Informatica.
• Experience working with large enterprise data marts and data warehouse solutions.
• Experience with cloud data connectivity across Azure services.
• Strong database troubleshooting and performance tuning experience.

Preferred Skills

• Azure Synapse Analytics.
• Azure Data Lake Storage (ADLS).
• Banking or Financial Services domain experience.
• Data Modelling and Data Warehouse concepts.
• Azure Analytics and reporting solutions.
• Cloud-based ETL modernization programs.

Desired Candidate Profile

• Strong analytical and problem-solving skills.
• Excellent verbal and written communication abilities.
• Flexible and proactive mindset with strong ownership.
• Ability to manage large, complex datasets and data platforms.
• Experience working in Agile environments and cross-functional teams.