Data Engineer

OnPoint Insights; Mumbai Suburban; Presencial; INR 1.200.000 - 1.800.000; Jornada completa

Descripción de la vacante

OnPoint Insights LLC. is seeking a Data Engineer with about 2 years of experience to design and maintain scalable data pipelines on Azure.

The role focuses on SQL-based ingestion, transformation, and storage across staging, curated, and reporting layers, with strong emphasis on performance, cost efficiency, and data quality. The candidate will implement CI/CD pipelines using Azure DevOps, collaborate with BI teams, write clean pipeline code, and explore GenAI tools for automation and

Formación

• ~2 years of experience as a Data Engineer.
• Strong hands-on experience with Azure data services (ADF, Synapse, Azure SQL, or similar).
• Proficiency in SQL and solid understanding of relational database concepts.
• Working knowledge of CI/CD concepts and tools - Azure DevOps required; GitHub Actions, Jenkins, or GitLab CI experience a plus.
• Hands-on experience developing and maintaining CI/CD pipelines for development environments using Azure DevOps (ADO).
• Experience with Git-based version control and branching workflows.
• Ability to write clean, modular, well-documented pipeline code.
• Python for scripting.
• Proficiency in PySpark and Spark SQL.

Responsabilidades

• Design, build, and maintain scalable ETL/ELT pipelines using Azure Data Factory and/or SQL-based tools.
• Work with SQL Server / Azure SQL for ingestion, transformation, and storage across staging/curated/reporting layers.
• Optimize pipelines and queries for performance and cost efficiency.
• Collaborate with BI/analytics teams to deliver clean, reliable datasets for reporting.
• Implement and maintain CI/CD pipelines using Azure DevOps.
• Write clean, modular, well-documented code following Git-based version control practices.
• Monitor pipeline health, troubleshoot failures, and ensure data quality.
• Explore opportunities to apply AI/GenAI tools for pipeline automation, data quality checks, or documentation.
• Participate in code reviews and contribute to engineering best practices.

Herramientas

Azure Data Factory

Azure Synapse

Azure SQL

CI/CD (Azure DevOps)

GitHub Actions

Jenkins

GitLab CI

Python

PySpark

Spark SQL

Descripción del empleo

We're looking for a Data Engineer with ~2 years of experience building and maintaining data pipelines on Azure, along with working knowledge of CI/CD practices to support automated, reliable deployments.

Key Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines using Azure Data Factory and/or SQL-based tools
• Work with SQL Server / Azure SQL for ingestion, transformation, and storage across staging/curated/reporting layers
• Optimize pipelines and queries for performance and cost efficiency
• Collaborate with BI/analytics teams to deliver clean, reliable datasets for reporting
• Implement and maintain CI/CD pipelines using Azure DevOps
• Write clean, modular, well-documented code following Git-based version control practices
• Monitor pipeline health, troubleshoot failures, and ensure data quality
• Explore opportunities to apply AI/GenAI tools for pipeline automation, data quality checks, or documentation
• Participate in code reviews and contribute to engineering best practices

Required Skills & Qualifications

• ~2 years of experience as a Data Engineer
• Strong hands-on experience with Azure data services (ADF, Synapse, Azure SQL, or similar)
• Proficiency in SQL and solid understanding of relational database concepts
• Working knowledge of CI/CD concepts and tools - Azure DevOps required; GitHub Actions, Jenkins, or GitLab CI experience a plus
• Hands-on experience developing and maintaining CI/CD pipelines for development environments using Azure DevOps (ADO)
• Experience with Git-based version control and branching workflows
• Ability to write clean, modular, well-documented pipeline code
• Python for scripting
• Proficiency in PySpark and Spark SQL

Good to Have

• Exposure to Databricks (PySpark / Spark SQL), Delta Lake concepts
• Familiarity with AI-assisted development tools (GitHub Copilot, Azure OpenAI, Claude Code or similar)
• Basic exposure to GenAI/LLM-based data workflows
• Basic understanding of data warehousing / dimensional modeling
• Bash/PowerShell scripting/testing
• Familiarity with Power BI or other BI tools
• Azure certifications (DP-700 Fabric Data Engineer Associate, AZ-900, etc.)