Lead Data Engineer - R01568425

Brillio; Bengaluru; On-site; INR 3,500,000 - 6,000,000; Full time

Job summary

Brillio in Bengaluru seeks a Lead Data Engineer to architect and implement robust ETL pipelines and scalable data warehouse solutions. You will collaborate with cross‑functional teams to translate business requirements into architecture and ensure data quality across enterprise systems.

The role requires 4–6 years in ETL, Informatica MDM expertise, and strong SQL/PLSQL skills. You will optimise performance, mentor juniors, and drive data platform modernization in a fast-paced environment.

Qualifications

• Experience in designing and implementing robust ETL pipelines using Informatica MDM
• Develop, optimize, and maintain complex SQL, PLSQL, and T-SQL stored procedures
• Lead data modelling initiatives for scalable data warehouse solutions
• Collaborate with cross-functional teams to gather requirements and deliver insights via advanced data engineering
• Troubleshoot and resolve data-related issues ensuring high availability and performance of ETL workflows
• Automate data ingestion and transformation tasks using Python
• Monitor and improve ETL performance and throughput
• Adhere to data governance policies and maintain data integrity and security

Responsibilities

• Design and implement robust ETL pipelines using Informatica MDM to ensure accurate data integration and management across enterprise systems
• Develop, optimise, and maintain complex SQL, PLSQL, and T-SQL stored procedures for efficient data processing and transformation
• Lead data modelling initiatives, translating business requirements into scalable data warehouse solutions and modern data platform architectures
• Collaborate with cross‑functional teams to gather requirements, validate data quality, and deliver actionable insights through advanced data engineering practices
• Troubleshoot and resolve data‑related issues, ensuring high availability, reliability, and performance of ETL workflows
• Automate data ingestion and transformation tasks using Python, enhancing operational efficiency and reducing manual intervention
• Monitor and improve ETL performance, proactively identifying bottlenecks and implementing enhancements to achieve optimal throughput
• Ensure adherence to data governance policies and best practices, maintaining data integrity and security throughout the lifecycle

Skills

ETL Fundamentals

SQL

SQL (Basic + Advanced)

Python

Data Warehousing

Modern Data Platform Fundamentals

Data Modelling Fundamentals

PLSQL

T-SQL

Stored Procedures

Informatica MDM

ETL pipeline development with Informat

Advanced SQL programming

Python for data engineering

Enterprise data warehousing

Data modelling for large-scale systems

Data governance

Stored procedures development

Education

Bachelor’s degree in Computer Science, Information Technology, or a related field

Job description

Lead Data Engineer

Primary Skills

• ETL Fundamentals, SQL, SQL (Basic + Advanced), Python, Data Warehousing, Modern Data Platform Fundamentals, Data Modelling Fundamentals, PLSQL, T-SQL, Stored Procedures

Specialization

• ETL Specialization: Data Engineer

Job requirements

• Experience Range: 4 to 6 years of experience, including hands‑on expertise in ETL and Informatica MDM solutions
• Key Responsibilities:
• 1. Design and implement robust ETL pipelines using Informatica MDM to ensure accurate data integration and management across enterprise systems
• 2. Develop, optimise, and maintain complex SQL, PLSQL, and T-SQL stored procedures for efficient data processing and transformation
• 3. Lead data modelling initiatives, translating business requirements into scalable data warehouse solutions and modern data platform architectures
• 4. Collaborate with cross‑functional teams to gather requirements, validate data quality, and deliver actionable insights through advanced data engineering practices
• 5. Troubleshoot and resolve data‑related issues, ensuring high availability, reliability, and performance of ETL workflows
• 6. Automate data ingestion and transformation tasks using Python, enhancing operational efficiency and reducing manual intervention
• 7. Monitor and improve ETL performance, proactively identifying bottlenecks and implementing enhancements to achieve optimal throughput
• 8. Ensure adherence to data governance policies and best practices, maintaining data integrity and security throughout the lifecycle
• Required Skills:
• 1. Informatica MDM
• 2. ETL pipeline development with Informatica
• 3. Advanced SQL programming
• 4. Python for data engineering
• 5. Enterprise data warehousing
• 6. Data modelling for large‑scale systems
• 7. PLSQL
• 8. T-SQL
• 9. Stored procedures development
• Preferred Skills:
• 1. Experience with cloud‑based ETL tools such as Azure Data Factory or AWS Glue
• 2. Expertise in master data management platforms beyond Informatica
• 3. Knowledge of big data technologies such as Spark or Hadoop
• 4. Familiarity with data governance frameworks
• 5. Proficiency in performance tuning and optimisation of ETL processes
• Desired Qualifications:
• 1. Bachelor’s degree in Computer Science, Information Technology, or a related field
• 2. Relevant certifications in Informatica MDM or ETL technologies
• Additional Information: Informatica MDM skills are required as a core competency for this role.