Senior Data Engineer

InvoLead; Gurugram District; On-site; INR 1,800,000 - 2,800,000; Full time

Job summary

InvoLead is seeking a Data Engineer Consultant to work on large, complex datasets and build scalable data pipelines across AWS/Azure/GCP. You will design, deploy, and optimize end-to-end analytics solutions while collaborating with multi-functional teams in a consulting setup.

The role requires 3–6 years of experience, strong Python/PySpark skills, and hands-on data warehousing and BI experience. Full-time/Consultant engagement in Gurgaon/Delhi with a focus on delivering client-ready data

Qualifications

• Strong hands-on experience with Python / PySpark / Spark.
• Proficiency in SQL and data warehousing concepts.
• Experience with cloud platforms AWS / Azure / GCP.
• Knowledge of CI/CD pipelines, IaC and DevOps practices; DataOps, MLOps, MLflow.
• Experience with Hadoop ecosystem is preferred.
• Power BI experience is required.

Responsibilities

• Work with large datasets and present insights to stakeholders.
• Design data pipelines using Python / PySpark / Spark.
• Contribute to end-to-end analytics and data projects from requirements to deployment.
• Design and optimize cloud-based data solutions across AWS / Azure / GCP.
• Build and maintain ETL pipelines and automate data processing.
• Develop modular, optimized code for speed.
• Create CI/CD pipelines for data workflows and MLflow tasks.
• Implement DevOps / DevSecOps practices, including release management.
• Support DataOps / MLOps for reliability and scalability.
• Design data warehouses / OLAP solutions.
• Develop BI dashboards using Power BI.
• Collaborate with team and stakeholders across functions.

Skills

Python / PySpark / Spark

SQL

Cloud platforms (AWS / Azure / GCP)

CI/CD / IaC / DevOps

DataOps / MLOps / MLflow

Hadoop ecosystem

Education

B.Tech / M.Tech from a reputed engineering institute

Masters degree in CS or related field preferred

Tools

Power BI

Job description

Job Title: Data Engineer Consultant

Experience: 3-6 Years

Location: Gurgaon / Delhi

Department: Data Engineering

Employment Type: Full-time / Consultant

Key Responsibilities

• Work with large and complex datasets and present insights to key client stakeholders
• Design and implement data engineering pipelines using Python / PySpark / Spark
• Contribute to end-to-end analytics and data engineering projects, from requirement understanding to deployment
• Design and optimize cloud-based data solutions across AWS / Azure / GCP
• Build and maintain ETL pipelines and automate recurring data processing tasks
• Develop modular, reusable, and optimized code to improve processing speed
• Create and maintain CI/CD pipelines for data workflows, ETL jobs, and MLflow tasks
• Implement DevOps / DevSecOps best practices, including branching strategies and release management
• Support DataOps and MLOps processes to ensure reliability and scalability
• Design and implement data warehouses / OLAP solutions
• Develop interactive BI dashboards using Power BI (Power Query, Power BI Desktop, Power Apps, Power Pivot, etc.)
• Collaborate closely with team members and cross-functional stakeholders

Required Technical Skills

• Strong hands-on experience with Python / PySpark / Spark
• Proficiency in SQL and data warehouse concepts
• Experience working with cloud platforms AWS / Azure / GCP
• Knowledge of CI/CD pipelines, Infrastructure-as-Code, and DevOps practices Understanding of DataOps, MLOps, and MLflow
• Experience with Hadoop ecosystem (preferred)

• Strong experience in Power BI (Power Query, Power BI Desktop, Power Apps, Power Pivot)

Qualifications

• B. Tech / M. Tech from a reputed engineering institute
• Masters degree in computer science or related field preferred

Preferred Experience

• 3-6 years of experience in consulting or analytics roles
• Prior experience building end-to-end data engineering solutions
• Exposure to multi-client or multi-environment deployments