Data Engineering Lead / Architect

Aspire Talent Innovations; Chandigarh, Bengaluru; On-site; INR 3,000,000 - 6,000,000; Full time

Job summary

Aspire Talent Innovations is seeking a Data Engineering Lead/Architect with 5–10 years of experience in data engineering and architecture to design and implement scalable data pipelines for large-scale data initiatives.

The role involves mentoring engineers, collaborating with cross-functional teams to define requirements, and maintaining comprehensive documentation on data systems and architectures.

Qualifications

• Experience with data modeling and data warehousing concepts.
• Proficient with big data technologies such as Hadoop, Spark, and NoSQL databases.
• Strong programming skills in Java, Python, or Scala.

Responsibilities

• Design and implement scalable and efficient data pipelines and architectures.
• Collaborate with cross-functional teams to identify business requirements and develop solutions.
• Develop and maintain technical documentation for data systems and architectures.
• Ensure data quality and integrity by implementing data validation and testing procedures.
• Mentor junior engineers and provide guidance on best practices and design patterns.
• Participate in code reviews and ensure adherence to coding standards.

Skills

Data modeling

Problem-solving

Communication

Adaptability

Tools

Hadoop

Spark

NoSQL

Java

Python

Scala

Job description

We are looking for a skilled Data Engineering Lead / Architect with 5 to 10 years of experience in data engineering and architecture. The ideal candidate will have a strong background in designing and implementing large-scale data systems.

Roles and Responsibility

• Design and implement scalable and efficient data pipelines and architectures.
• Collaborate with cross-functional teams to identify business requirements and develop solutions.
• Develop and maintain technical documentation for data systems and architectures.
• Ensure data quality and integrity by implementing data validation and testing procedures.
• Mentor junior engineers and provide guidance on best practices and design patterns.
• Participate in code reviews and ensure adherence to coding standards.

Job Requirements

• Strong understanding of data modeling, database design, and data warehousing concepts.
• Experience with big data technologies such as Hadoop, Spark, and NoSQL databases.
• Proficiency in programming languages such as Java, Python, or Scala.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills.
• Ability to work in a fast-paced environment and adapt to changing priorities.