Data Engineer 3

Allegis Group; Gurugram District; On-site; INR 1,800,000 - 3,000,000; Full time

Job summary

Allegis Group is seeking a Data Engineer 3 in Gurugram, India. This role focuses on building and operating large-scale data extraction, ingestion, and processing pipelines using Spark, Scala, SQL, AWS and Kafka.

The ideal candidate brings 5-7 years of software development experience in enterprise settings and 5+ years of hands-on big data engineering, delivering BI/AI projects. Strong leadership and mentoring experience are expected.

Qualifications

• 5-7 years software development experience in an enterprise level environment.
• 5+ years hands-on big data engineering experience delivering BI and AI projects.
• Experience architecting, developing, and delivering complex, large-scale systems.
• Fluent in one or more of the following languages: Python, Java, Scala and AWS or equivalent cloud technology.
• Worked in at least 2 multi-quarter data engineering projects.
• Worked in decentralized teams and projects.
• Formally mentored at least 3 individual contributors.
• Built high-performance scalable data products.
• Drove technical design end to end of at least 3 data engineering projects.

Responsibilities

• Partners with the business to have a clear understanding of how own technology stack is tied to business outcomes and our bottom line.
• Successfully conducts day-to-day work and solves complex issues in own specific technical engineering area.
• Advocates efforts to remove tech roadblocks for their team for long term success.
• Possesses knowledge of features and facilities for integration, communication among applications, databases and technology platforms to bring together different components and form a fully functional solution to a business problem.
• Has proven ability, experience and advanced knowledge of building and operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets.
• Creatively tests and maintains software applications and related programs and procedures by using a variety of software development tools following design requirements of customer.
• Justifies technology choices to both technical and non-technical observers.

Skills

Big data engineering

Distributed systems

Technical leadership

Mentoring

Problem solving

Tools

Spark

Scala

SQL

AWS

Kafka

Job description

Tech stack requirements : Spark, Scala, SQL, AWS, Kafka

Job Description

Data Engineer 3

What you'll do:

• Partners with the business to have a clear understanding of how own technology stack is tied to business outcomes and our bottom line.
• Successfully conducts day-to-day work and solves complex issues in own specific technical engineering area.
• Advocates efforts to remove tech roadblocks for their team for long term success.
• Possesses knowledge of features and facilities for integration, communication among applications, databases and technology platforms to bring together different components and form a fully functional solution to a business problem.
• Has proven ability, experience and advanced knowledge of building and operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets.
• Creatively tests and maintains software applications and related programs and procedures by using a variety of software development tools following design requirements of customer.
• Justifies technology choices to both technical and non-technical observers.

Who you are:

5-7 years software development experience in an enterprise level engineering environment demonstrating increasing levels of technical leadership

5+ years hands-on big data engineering experience with excellent understanding of delivering BI and AI projects

Experience architecting, developing, and successfully delivering complex, large-scale systems

Fluent in one or more of the following languages: Python, Java, Scala and AWS or equivalent cloud technology

Worked in at least in 2 multi-quarter data engineering projects.

Worked in decentralized teams and projects.

Formally mentored at least 3 individual contributors.

Built high-performance scalable data products.

Drove technical design end to end of at least 3 data engineering projects.