Data Engineer

Latinum HR Solutions

Bengaluru

Vor Ort

INR 3.200.000 - 4.800.000

Vollzeit

vor 20 Stunden
Sei unter den ersten Bewerbenden

Eine vollständige Bewerbung in einer Minute

Maßgeschneiderter Lebenslauf und Anschreiben – versandbereit.

Schaffe es an den ATS-Filtern vorbei

Zusammenfassung

Latinum HR Solutions is seeking an experienced Data Engineer for a client in Bengaluru. The role focuses on building scalable ETL/ELT pipelines using Azure Data Factory and Azure Synapse, with strong SQL and Power BI capabilities.

The ideal candidate will design data solutions from scratch, emphasize clean architecture and performance, and collaborate with analysts to translate business needs into technical outcomes. Familiarity with AI-assisted development tools is a plus.

Qualifikationen

  • 8+ years of hands-on Data Engineering experience.
  • Strong expertise in Azure Data Factory (ADF) and Azure Synapse Analytics.
  • Excellent SQL skills with complex data transformations.
  • Strong understanding of ETL/ELT patterns and data warehousing concepts.
  • Practical experience with Azure DevOps and Git-based CI/CD.

Aufgaben

  • Design, develop, and maintain end-to-end ETL/ELT pipelines using Azure Data Factory and Azure Synapse Analytics.
  • Manage pipeline orchestration, scheduling, dependency management, error handling, monitoring, and performance optimisation.
  • Integrate data from multiple enterprise sources, including Oracle, Salesforce, and other business applications.
  • Develop and manage ADF pipelines using Git-based version control and Azure DevOps.
  • Implement CI/CD practices, including repository management, branching strategies, pull requests, and code reviews.
  • Onboard new source systems by defining extraction strategies, incremental and daily loading mechanisms, and connectivity standards.
  • Build and maintain Power BI semantic models, datasets, reports, and dashboards.
  • Develop and support data transformations using Databricks wherever required.
  • Create and maintain technical documentation, including data mapping documents, pipeline specifications, and data model documentation.
  • Collaborate with business analysts and stakeholders to understand requirements, identify gaps, and translate business needs into technical solutions.
  • Participate in testing, deployment, troubleshooting, and post-deployment validation.
  • Leverage AI coding assistants such as ChatGPT and Claude for development support, documentation, and initial code reviews.
  • Review and validate AI-assisted or agent-generated code and pull requests, ensuring adherence to engineering standards and production quality.

Kenntnisse

Azure Data Factory
Azure Synapse Analytics
SQL
Power BI
CI/CD
Azure DevOps
Databricks

Tools

Azure Databricks
Git
PySpark
Scala

Jobbeschreibung

Experience: 8+ Years
About the Role

Latinum is hiring for a client seeking an experienced Data Engineer with strong hands‑on expertise in Azure Data Factory (ADF), Azure Synapse Analytics, SQL, and Power BI.

The ideal candidate will have extensive experience designing, developing, and maintaining scalable ETL/ELT pipelines across multiple enterprise data sources. Strong expertise in ADF pipeline orchestration, Azure DevOps‑based CI/CD, and Power BI semantic modelling is essential.

The role involves building data solutions from the ground up, with a strong focus on clean architecture, scalability, maintainability, and performance. Familiarity with AI‑assisted development tools such as ChatGPT and Claude will be valuable, as the team is progressively adopting AI‑augmented and agent‑assisted engineering workflows.

Key Responsibilities
  • Design, develop, and maintain end‑to‑end ETL/ELT pipelines using Azure Data Factory and Azure Synapse Analytics.
  • Manage pipeline orchestration, scheduling, dependency management, error handling, monitoring, and performance optimisation.
  • Integrate data from multiple enterprise sources, including Oracle, Salesforce, and other business applications.
  • Develop and manage ADF pipelines using Git‑based version control and Azure DevOps.
  • Implement CI/CD practices, including repository management, branching strategies, pull requests, and code reviews.
  • Onboard new source systems by defining extraction strategies, incremental and daily loading mechanisms, and connectivity standards.
  • Build and maintain Power BI semantic models, datasets, reports, and dashboards.
  • Develop and support data transformations using Databricks wherever required.
  • Create and maintain technical documentation, including data mapping documents, pipeline specifications, and data model documentation.
  • Collaborate with business analysts and stakeholders to understand requirements, identify gaps, and translate business needs into technical solutions.
  • Participate in testing, deployment, troubleshooting, and post‑deployment validation.
  • Leverage AI coding assistants such as ChatGPT and Claude for development support, documentation, and initial code reviews.
  • Review and validate AI‑assisted or agent‑generated code and pull requests, ensuring adherence to engineering standards and production quality.
Required Skills & Experience
  • 8+ years of hands‑on Data Engineering experience.
  • Strong, hands‑on expertise in Azure Data Factory (ADF) and Azure Synapse Analytics.
  • Excellent SQL skills and experience working with complex data transformations.
  • Strong understanding of ADF pipeline architecture, orchestration, scheduling, monitoring, error handling, and performance optimisation.
  • Practical experience with Azure DevOps and Git‑based CI/CD, including repositories, branching, pull requests, and code management.
  • Hands‑on experience with Power BI, particularly semantic modelling, datasets, and DAX.
  • Experience integrating Salesforce data through REST/Bulk APIs, SOQL, or connector‑based approaches.
  • Experience integrating data across multiple enterprise source systems, including Oracle and other business applications.
  • Strong understanding of ETL/ELT patterns, data warehousing concepts, and enterprise data architecture.
  • Ability to independently develop scalable, maintainable data pipelines and solutions from scratch.
  • Experience using AI‑assisted coding tools as part of a professional software development workflow.
  • Strong technical documentation, analytical, troubleshooting, and problem‑solving skills.
Good to Have
  • Working knowledge of Azure Databricks, including PySpark or Scala.
  • Experience integrating additional enterprise platforms such as SAP, ServiceNow, Workday, or similar systems.
  • Exposure to AI‑assisted development tools, coding agents, and automated code review workflows.
  • Experience working in engineering teams transitioning towards automated and agent‑driven pipeline development.
Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.

oder ziehe deine Datei hierhin.

Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

Senior Data Engineer
Senior Data Engineer

Kanini Software Solutions • Pune District, Chennai, Bengaluru

Hybrid
INR 3.500.000 - 7.000.000
Azure Data Engineer
Azure Data Engineer

Getege EdTech Pvt. Ltd. • Dadri

Vor Ort
INR 1.200.000 - 1.800.000
Azure Data Engineer
Azure Data Engineer

Einfochips • Indore District, Ahmedabad District

Vor Ort
INR 2.000.000 - 4.000.000
Azure Data Engineer
Azure Data Engineer

Getege EdTech Pvt. Ltd. • Bhopal

Vor Ort
INR 1.200.000 - 1.600.000
Data Engineer
Data Engineer

Intact India • Gurugram District

Vor Ort
INR 1.200.000 - 2.400.000
Azure Data Engineer
Azure Data Engineer

Saisystems Technology • Pune District, Mumbai, Gurugram District

Hybrid
INR 2.400.000 - 4.200.000
Data Engineer
Data Engineer

Botmet • Indien

Remote
INR 3.000.000 - 3.500.000
Lead I - Azure Data Engineer FS
Lead I - Azure Data Engineer FS

UST • Maharashtra

Vor Ort
INR 1.500.000 - 2.500.000
Data Engineer
Data Engineer

Techcarrot • Chennai

Vor Ort
INR 1.500.000 - 2.100.000
Data Engineer
Data Engineer

Tibil Solutions • Bengaluru

Vor Ort
INR 900.000 - 1.500.000