Data Engineering Lead

Brace Infotech Private Limited

Hyderabad

On-site

INR 4,200,000 - 6,400,000

Full time

5 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Brace Infotech Private Limited is seeking a Data Engineering Lead in Hyderabad to design, build, and manage enterprise-scale data integration and analytics initiatives. You will guide end-to-end pipelines using Microsoft Fabric, SSIS, PySpark, and Python, while driving modernization of the data platform.

The role emphasizes data migration from legacy systems, governance, and collaboration with cross-functional teams to deliver scalable solutions.

Qualifications

  • 6-8 years of IT experience in data engineering.
  • Hands-on in Microsoft Fabric and Fabric Data Engineering components.
  • Strong exposure to SSIS and SSAS.
  • Extensive ETL/ELT design and development experience.
  • Experience in large-scale data migration projects.
  • Proficient in Python and PySpark for data processing.
  • Familiarity with CI/CD pipelines using Azure DevOps.
  • Experience with cloud migration and modernization projects.
  • Git-based source control and branching.
  • Strong SQL and performance tuning.
  • Experience with data warehousing concepts.
  • Agile/Scrum environments.

Responsibilities

  • Lead the design, development, and implementation of end-to-end data engineering solutions.
  • Develop and maintain scalable ETL/ELT pipelines using SSIS, Microsoft Fabric, PySpark, and Python.
  • Drive data migration initiatives from legacy systems to modern cloud-based data platforms.
  • Design and implement data ingestion, transformation, cleansing, and validation processes.
  • Build and optimize data warehouses, data marts, and lakehouse architectures.
  • Collaborate with business stakeholders, architects, and cross-functional teams to understand data requirements and translate them into technical solutions.
  • Ensure data quality, reliability, security, and governance standards are met.
  • Monitor and optimize data pipeline performance, scalability, and cost efficiency.
  • Lead code reviews, technical design discussions, and best practice adoption across the team.
  • Provide technical guidance and mentoring to junior and mid-level data engineers.
  • Participate in effort estimation, sprint planning, and release management activities.

Skills

Data Engineering
Microsoft Fabric
SSIS
PySpark
Python
ETL/ELT
Data Migration
SQL
Azure DevOps
Data Warehousing

Tools

Azure DevOps
Azure Data Factory
Databricks

Job description

Please find the detailed Job Description for the Data Engineering Lead position. Kindly prioritize candidates with strong hands-on experience in Microsoft Fabric, SSIS, ETL/ELT, Python, PySpark, and Data Migration.

Looking forward to your support in closing this requirement at the earliest.

Position:

Data Engineering Lead

Experience:

6-8 Years

Location:

Hyderabad, Telangana

Mode:

C2H / Permanent

About The Role

We are seeking an experienced Data Engineering Lead to design, develop, and lead enterprise-scale data integration, migration, and analytics initiatives. The ideal candidate will have strong expertise in Microsoft Fabric, SSIS, ETL development, Data Engineering, and Data Migration, along with hands-on experience in Python/PySpark. The candidate will be responsible for driving data platform modernization efforts, mentoring team members, and ensuring the delivery of high-quality, scalable data solutions.

Key Responsibilities
  • Lead the design, development, and implementation of end-to-end data engineering solutions.
  • Develop and maintain scalable ETL/ELT pipelines using SSIS, Microsoft Fabric, PySpark, and Python.
  • Drive data migration initiatives from legacy systems to modern cloud-based data platforms.
  • Design and implement data ingestion, transformation, cleansing, and validation processes.
  • Build and optimize data warehouses, data marts, and lakehouse architectures.
  • Collaborate with business stakeholders, architects, and cross-functional teams to understand data requirements and translate them into technical solutions.
  • Ensure data quality, reliability, security, and governance standards are met.
  • Monitor and optimize data pipeline performance, scalability, and cost efficiency.
  • Lead code reviews, technical design discussions, and best practice adoption across the team.
  • Provide technical guidance and mentoring to junior and mid-level data engineers.
  • Participate in effort estimation, sprint planning, and release management activities.
Mandatory Skills
  • Strong experience in Data Engineering with 6-8 years of overall IT experience.
  • Hands-on expertise in Microsoft Fabric and Fabric Data Engineering components.
  • Strong exposure to SSIS (SQL Server Integration Services), SSAS (SQL Server Analytical Services).
  • Extensive experience in designing and developing ETL/ELT pipelines.
  • Experience in large-scale Data Migration projects.
  • Proficiency in Python and PySpark for data processing and transformation.
  • Familiarity with CI/CD pipelines using Azure DevOps.
  • Experience in cloud migration and modernization projects.
  • Familiarity with Git-based source control and branching strategies.
  • Strong SQL skills with experience in performance tuning and query optimization.
  • Experience working with large datasets and complex data transformation frameworks.
  • Understanding of data warehousing concepts, dimensional modeling, and data architecture principles.
  • Experience working in Agile/Scrum environments.
Good-to-Have Skills
  • Experience with Azure Data Factory (ADF).
  • Exposure to Azure Synapse Analytics.
  • Experience with Microsoft Fabric Lakehouse, Dataflows Gen2, and Notebooks.
  • Knowledge of Delta Lake, Apache Spark, and Databricks.
  • Experience with Power BI reporting and semantic models.
  • Knowledge of data governance and data quality frameworks.
  • Exposure to real-time data processing and streaming technologies.
  • Certifications in Microsoft Azure Data Engineering or Microsoft Fabric.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer
Senior Data Engineer

SOTIIND SOTI India Private Ltd. • Ernakulam

On-site
INR 1,500,000 - 2,000,000
Data Engineer – Microsoft Fabric / Azure
Data Engineer – Microsoft Fabric / Azure

VMC Soft Technologies • Bengaluru

On-site
INR 1,400,000 - 2,100,000
Data Engineer Lead
Data Engineer Lead

Sonata Software • Hyderabad, Bengaluru

On-site
INR 3,500,000 - 6,000,000
Data Engineer Lead
Data Engineer Lead

Sonata Software (SonataOne) • Bengaluru

On-site
INR 1,000,000 - 1,800,000
Data Engineer
Data Engineer

Omni Recruit Private Limited • Pune District

On-site
INR 1,800,000 - 3,200,000
Lead Data Engineer - Fabric
Lead Data Engineer - Fabric

iLink Digital • Pune District

On-site
INR 1,500,000 - 2,500,000
Sr. Data Engineer
Sr. Data Engineer

Zepto • Hyderabad

On-site
INR 2,600,000 - 4,200,000
Lead Data Architect - Microsoft Fabric
Lead Data Architect - Microsoft Fabric

TigerHire • India

Remote
INR 2,000,000 - 6,000,000
Lead Data Architect (Fabric)
Lead Data Architect (Fabric)

Weekday (YC W21) • India

Remote
INR 4,000,000 - 7,000,000
Senior Fabric Lead Data Engineer - R01572945
Senior Fabric Lead Data Engineer - R01572945

Brillio • Bengaluru

On-site
INR 1,400,000 - 2,200,000