Data Engineer -Azure

OnPoint Insights LLC.; Mumbai; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

OnPoint Insights LLC. is seeking a Data Engineer with ~2 years of experience to build and maintain scalable data pipelines on Azure. You will implement CI/CD to support reliable deployments and collaborate with BI teams to deliver clean datasets.

Responsibilities include designing ETL/ELT pipelines with ADF or SQL-based tools, optimizing queries for performance and cost, and applying GenAI tools to automate data workflows. Proficiency in Python and PySpark is required.

Qualifications

• ~2 years of experience as a Data Engineer.
• Strong hands-on experience with Azure data services (ADF, Synapse, Azure SQL, or similar).
• Proficiency in SQL and solid understanding of relational database concepts.
• Working knowledge of CI/CD concepts and tools — Azure DevOps required; GitHub Actions, Jenkins, or GitLab CI experience a plus.
• Hands-on experience developing and maintaining CI/CD pipelines for development environments using Azure DevOps (ADO).
• Experience with Git-based version control and branching workflows.
• Ability to write clean, modular, well-documented pipeline code.
• Python for scripting; Proficiency in PySpark and Spark SQL.

Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines using Azure Data Factory and/or SQL-based tools
• Work with SQL Server / Azure SQL for ingestion, transformation, and storage across staging/curated/reporting layers
• Optimize pipelines and queries for performance and cost efficiency
• Collaborate with BI/analytics teams to deliver clean, reliable datasets for reporting
• Implement and maintain CI/CD pipelines using Azure DevOps
• Write clean, modular, well-documented code following Git-based version control practices
• Monitor pipeline health, troubleshoot failures, and ensure data quality
• Explore opportunities to apply AI/GenAI tools for pipeline automation, data quality checks, or documentation
• Participate in code reviews and contribute to engineering best practices

Skills

Azure Data Factory

Azure Synapse

Azure SQL

SQL

CI/CD pipelines

Azure DevOps

Git version control

Python

PySpark

Spark SQL

Tools

GitHub Actions

Jenkins

GitLab CI

Databricks

Job description

We're looking for a Data Engineer with ~2 years of experience building and maintaining data pipelines on Azure, along with working knowledge of CI/CD practices to support automated, reliable deployments.

Key Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines using Azure Data Factory and/or SQL-based tools
• Work with SQL Server / Azure SQL for ingestion, transformation, and storage across staging/curated/reporting layers
• Optimize pipelines and queries for performance and cost efficiency
• Collaborate with BI/analytics teams to deliver clean, reliable datasets for reporting
• Implement and maintain CI/CD pipelines using Azure DevOps
• Write clean, modular, well-documented code following Git-based version control practices
• Monitor pipeline health, troubleshoot failures, and ensure data quality
• Explore opportunities to apply AI/GenAI tools for pipeline automation, data quality checks, or documentation
• Participate in code reviews and contribute to engineering best practices

Required Skills & Qualifications

• ~2 years of experience as a Data Engineer
• Strong hands-on experience with Azure data services (ADF, Synapse, Azure SQL, or similar)
• Proficiency in SQL and solid understanding of relational database concepts
• Working knowledge of CI/CD concepts and tools — Azure DevOps required; GitHub Actions, Jenkins, or GitLab CI experience a plus
• Hands-on experience developing and maintaining CI/CD pipelines for development environments using Azure DevOps (ADO)
• Experience with Git-based version control and branching workflows
• Ability to write clean, modular, well-documented pipeline code
• Python for scripting
• Proficiency in PySpark and Spark SQL

Good to Have

• Exposure to Databricks (PySpark / Spark SQL), Delta Lake concepts
• Familiarity with AI-assisted development tools (GitHub Copilot, Azure OpenAI, Claude Code or similar)
• Basic exposure to GenAI/LLM-based data workflows
• Basic understanding of data warehousing / dimensional modeling
• Bash/PowerShell scripting/testing
• Familiarity with Power BI or other BI tools
• Azure certifications (DP-700 Fabric Data Engineer Associate, AZ-900, etc.)