Data Engineer -Azure

OnPoint Insights LLC.; Mumbai; On-site; INR 1,500,000 - 2,500,000; Full time

Job summary

OnPoint Insights LLC. is seeking a Data Engineer with about 2 years of experience to design and maintain data pipelines on Azure, ensuring reliable deployments with CI/CD practices.

You will work with Azure Data Factory, Synapse, and Azure SQL to ingest, transform, and store data across layers, while optimizing performance and costs. Proficiency in SQL, Python, and PySpark is required.

Qualifications

• ~2 years of experience as a Data Engineer.
• Hands-on experience with Azure data services (ADF, Synapse, Azure SQL, or similar).
• Proficiency in SQL and relational database concepts.
• Working knowledge of CI/CD concepts and tools (Azure DevOps required; GitHub Actions/Jenkins/GitLab CI is a plus).
• Hands-on experience developing and maintaining CI/CD pipelines for development environments using Azure DevOps (ADO).
• Experience with Git-based version control and branching workflows.
• Ability to write clean, modular, well-documented pipeline code.
• Python for scripting.
• Proficiency in PySpark and Spark SQL.

Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines using Azure Data Factory and/or SQL-based tools.
• Work with SQL Server / Azure SQL for ingestion, transformation, and storage across staging/curated/reporting layers.
• Optimize pipelines and queries for performance and cost efficiency.
• Collaborate with BI/analytics teams to deliver clean, reliable datasets for reporting.
• Implement and maintain CI/CD pipelines using Azure DevOps.
• Write clean, modular, well-documented code following Git-based version control practices.
• Monitor pipeline health, troubleshoot failures, and ensure data quality.
• Explore opportunities to apply AI/GenAI tools for pipeline automation, data quality checks, or documentation.
• Participate in code reviews and contribute to engineering best practices.

Skills

Azure Data Services

SQL

CI/CD

Python

PySpark

Spark SQL

Git-based version control

Azure DevOps

Azure Data Factory

Synapse

Tools

Azure DevOps

GitHub Actions

Jenkins

GitLab CI

Databricks

Job description

We're looking for a Data Engineer with ~2 years of experience building and maintaining data pipelines on Azure, along with working knowledge of CI/CD practices to support automated, reliable deployments.

Key Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines using Azure Data Factory and/or SQL-based tools
• Work with SQL Server / Azure SQL for ingestion, transformation, and storage across staging/curated/reporting layers
• Optimize pipelines and queries for performance and cost efficiency
• Collaborate with BI/analytics teams to deliver clean, reliable datasets for reporting
• Implement and maintain CI/CD pipelines using Azure DevOps
• Write clean, modular, well-documented code following Git-based version control practices
• Monitor pipeline health, troubleshoot failures, and ensure data quality
• Explore opportunities to apply AI/GenAI tools for pipeline automation, data quality checks, or documentation
• Participate in code reviews and contribute to engineering best practices

Required Skills & Qualifications

• ~2 years of experience as a Data Engineer
• Strong hands-on experience with Azure data services (ADF, Synapse, Azure SQL, or similar)
• Proficiency in SQL and solid understanding of relational database concepts
• Working knowledge of CI/CD concepts and tools — Azure DevOps required; GitHub Actions, Jenkins, or GitLab CI experience a plus
• Hands-on experience developing and maintaining CI/CD pipelines for development environments using Azure DevOps (ADO)
• Experience with Git-based version control and branching workflows
• Ability to write clean, modular, well-documented pipeline code
• Python for scripting
• Proficiency in PySpark and Spark SQL

Good to Have

• Exposure to Databricks (PySpark / Spark SQL), Delta Lake concepts
• Familiarity with AI-assisted development tools (GitHub Copilot, Azure OpenAI, Claude Code or similar)
• Basic exposure to GenAI/LLM-based data workflows
• Basic understanding of data warehousing / dimensional modeling
• Bash/PowerShell scripting/testing
• Familiarity with Power BI or other BI tools
• Azure certifications (DP-700 Fabric Data Engineer Associate, AZ-900, etc.)