Lead Data Engineer

Forward Eye Technologies; Dadri; On-site; INR 1,500,000 - 2,600,000; Full time

Job summary

Forward Eye Technologies in Dadri, Uttar Pradesh, India, is seeking an experienced Data Engineering Lead to guide a team of data engineers and transform raw data into reliable analytics. You will architect pipelines, ensure data quality, and align projects with business goals.

The role emphasizes hands-on coding in Spark, Hive, Scala, SQL and Python, building scalable ETL processes, and collaborating with data scientists and analysts to deliver actionable insights.

Qualifications

• Experience leading a data engineering team and projects.
• Strong expertise in designing scalable data pipelines and ETL processes.
• Ability to collaborate with data scientists and business stakeholders.

Responsibilities

• Lead and mentor a team of data engineers and oversee data projects.
• Design and maintain scalable data pipelines and data models.
• Collaborate with data scientists and analysts to deliver data solutions.
• Communicate complex concepts to non-technical stakeholders.

Skills

Spark

Hive

Scala

SQL

Python scripting

Data visualization

Job description

Spark, Hive, Scala, SQL ,Python scripting ,data visualization

Key Responsibilities:

• Leadership and Team Management:
• Lead and mentor a team of data engineers, fostering a culture of collaboration and continuous improvement.
• Oversee the planning and execution of data projects, ensuring alignment with business objectives and timelines.
• Provide technical guidance and expertise to the team, promoting best practices in data engineering.

Data Architecture and Development:

• Design, develop, and maintain scalable data pipelines and ETL processes to ingest, process, and store large volumes of data.
• Architect and implement robust data models and schemas to support analytics and business intelligence needs.
• Ensure data quality, integrity, and security across all data assets.

Collaboration and Communication:

• Work closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions that meet their needs.
• Communicate complex technical concepts to non-technical stakeholders in a clear and concise manner.
• Collaborate with other engineering teams to integrate data solutions with various applications and systems.

Technology and Innovation:

• Stay up-to-date with emerging technologies and trends in data engineering and big data.
• Evaluate and implement new tools and technologies to improve data processing, storage, and analysis capabilities.
• Drive innovation and continuous improvement in data engineering practices.