Data Engineer

Anlage Infotech; Hyderabad, Pune District, Bengaluru; Hybrid; INR 1,500,000 - 2,100,000; Full time

Job summary

Anlage Infotech is seeking a Data Engineer for PAN INDIA operations. The role requires 8+ years of experience in design and development with big data technologies, focusing on building robust data pipelines.

You will work with Python, PySpark and cloud platforms (Azure, AWS, GCP), develop tests, and contribute to CI/CD pipelines while collaborating with stakeholders in a dynamic environment.

Qualifications

• 8+ years of design and development experience with big data technologies.
• Proficient in Python, PySpark and cloud platforms (Azure, AWS, GCP).
• Experience writing unit and integration tests for ingestion pipelines.
• Experience building CI/CD pipelines and using code quality tools.
• Strong communication, problem-solving and leadership skills.

Responsibilities

• Design and develop scalable data pipelines and data processing solutions.
• Ensure data quality, reliability, and timely data delivery across systems.
• Collaborate with cross-functional teams and stakeholders to translate business needs into technical solutions.
• Lead and mentor junior engineers and help drive best practices in a fast-paced environment.

Skills

Python

PySpark

Cloud platforms

Data querying

Testing

CI/CD

Leadership

Tools

Azure

AWS

GCP

Kubernetes

Terraform

Job description

Role: Data Engineer

Location: PAN INDIA

Experience: 8+ years

Notice period: Immediate to 30days

8+ years of design & development experience with big data technologies

• Proficient in Python, PySpark, Azure Data Brickes/AWS, Kubernetes and Terraform
• 2+ years of development experience in cloud technologies like Azure, AWS or GCP
• Proficient in querying and manipulating data from various DB (relational and big data).
• Experience of writing effective and maintainable unit and integration tests for ingestion pipelines.
• Experience of using static analysis and code quality tools and building CI/CD pipelines.
• Excellent communication, problem-solving, and leadership skills, and be able to work well in a fast-paced, dynamic environment.
• Experience of working on high-traffic and large-scale Software Products

Role Key Performance Indicators:

• Data Pipeline reliability & resiliency
• Data processing efficiency & Release quality
• Defect Analysis & Data Quality maintained with the development done
• Time to market & resource utilisation
• Business & Stakeholder satisfaction