Lead Data Engineer 4C

Jobgether; India; Remote; INR 1,800,000 - 3,000,000; Full time

Benefits offered by this job

Fully remote within India

Mentorship & professional development

Exposure to advanced Big Data tech

Job summary

Jobgether is seeking a Lead Data Engineer to lead a team of data engineers in designing scalable Big Data solutions from India. You will oversee robust ETL processes, ensure data quality and security, and translate business requirements into effective architectures.

This remote, full-time role emphasizes mentorship, standardization, and continuous improvement across the data ecosystem. You will drive performance optimization, data integration, and collaboration with stakeholders while following

Qualifications

• Experience designing and implementing enterprise-scale Big Data solutions.
• Experience leading data engineering teams and mentoring staff.
• Proficiency with Spark, Kafka, and Airflow.
• Experience with Databricks and Snowflake platforms.
• CI/CD practices, Git, and infrastructure automation using Terraform.
• Strong SQL with performance tuning and monitoring.

Responsibilities

• Lead and coordinate a team to design, develop, and implement Big Data solutions.
• Design, build, and maintain scalable data pipelines and ETL processes.
• Ensure data quality, integrity, and security across data platforms.
• Collaborate with stakeholders to translate requirements into data engineering solutions.
• Provide technical direction and mentorship to junior engineers.
• Monitor, analyze, and troubleshoot data systems to improve efficiency and scalability.
• Oversee data integration and data modeling activities in line with architecture.
• Promote secure coding practices and CI/CD for data workflows.
• Develop and maintain documentation for data processes and infrastructure.
• Stay informed about emerging Big Data technologies and trends.

Skills

Team leadership

Data engineering

English proficiency

Analytical skills

Troubleshooting

Stakeholder collaboration

Education

Bachelor's degree in CS/DS/Statistics

Master's degree in Data Science

Tools

Apache Spark

Apache Kafka

Apache Airflow

Databricks

Snowflake

AWS Data Pipeline

Terraform

Git

Job description

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Lead Data Engineer 4C based in India.

In this role, you will lead a team of data engineers in designing and delivering scalable, reliable Big Data solutions. You will oversee the development of robust data pipelines and ETL processes, ensuring that data systems meet high standards of quality, integrity, and security. Working closely with business stakeholders, you will translate complex requirements into effective technical architectures and engineering solutions. You will also drive performance optimization, data integration, and continuous improvement across the data ecosystem. Beyond hands-on technical leadership, you will mentor engineers, promote best practices, and support a culture of knowledge sharing. This is a full-time, remote opportunity in a global, technology-driven environment.

Accountabilities

• Lead and coordinate a team of data engineers in the design, development, and implementation of Big Data solutions.

• Design, build, and maintain scalable, reliable data pipelines and ETL processes to support business and analytical requirements.

• Ensure data quality, integrity, consistency, and security across data platforms and systems.

• Collaborate with business stakeholders and technical teams to understand requirements and translate them into effective data engineering solutions.

• Provide technical direction, guidance, and mentorship to junior data engineers, encouraging best practices and continuous development.

• Monitor, analyze, and troubleshoot data systems to identify performance issues and improve efficiency, reliability, and scalability.

• Oversee data integration and data modeling activities, ensuring solutions are aligned with architectural and business needs.

• Promote secure coding practices and contribute to CI/CD processes for data engineering workflows.

• Develop, maintain, and update technical documentation covering data processes, systems, pipelines, and infrastructure.

• Stay informed about emerging Big Data technologies, tools, and industry trends, identifying opportunities to improve engineering practices and solutions.

Requirements

• Bachelor's degree in Computer Science, Data Science, Statistics, or a related discipline; a master's degree in Data Science is also relevant.

• Strong professional experience in data engineering, including designing and implementing enterprise-scale Big Data solutions.

• Demonstrated experience leading or guiding data engineering teams and providing technical mentorship.

• Proficiency with Apache Spark, Apache Kafka, and Apache Airflow.

• Experience designing and managing data ETL processes, data pipelines, and integration workflows.

• Knowledge of data modeling, data quality management, and secure data engineering practices.

• Experience with Databricks and Snowflake platforms.

• Familiarity with AWS Data Pipeline and API integration.

• Strong SQL skills and experience with performance tuning and system performance monitoring.

• Experience with CI/CD practices, Git, and infrastructure automation using Terraform.

• Ability to translate business requirements into scalable technical solutions and collaborate effectively with stakeholders.

• Strong analytical, troubleshooting, communication, and leadership skills.

• Proficiency in English at C2 level.

Relevant Certifications

• Certified Data Management Professional.

• Databricks Certified Associate Developer for Apache Spark 3.0.

• Databricks Certified Associate Developer for Apache Spark.

• Microsoft Certified: Azure Data Engineer Associate.

• Oracle Database 12c Certified Implementation Specialist.

Benefits

• Fully remote work arrangement within India.

• Full-time, regular employment.

• Opportunity to lead data engineering initiatives supporting global enterprise transformation.

• Exposure to advanced Big Data technologies and AI-driven innovation.

• Mentorship and professional development opportunities.

• Access to learning resources and opportunities to expand technical expertise.

• Collaborative environment with experienced technology professionals.

• Inclusive, values-driven workplace focused on integrity, innovation, and continuous learning.