Data Engineer

xtsworld; Pune District; On-site; INR 1,500,000 - 2,000,000; Full time

Benefits offered by this job

Free meals

Collaborative work culture

Health benefits

Job summary

A leading technology company located in India is seeking a skilled Senior Data Engineer to lead the design and implementation of advanced data infrastructure. The role involves crafting high-performance ETL pipelines, managing scalable data models, and fostering real-time data processing solutions. Ideal candidates will have a Bachelor's or Master's degree in Computer Science and 4-6 years of experience in data engineering. The position offers opportunities for leadership and mentorship within a collaborative work environment.

Qualifications

• 4-6+ years of experience in data engineering with a strong track record.
• Deep expertise in relational and NoSQL database systems.
• Strong skills in containerization and orchestration.

Responsibilities

• Design and maintain high-performance ETL/ELT pipelines.
• Architect and optimize data models across multiple databases.
• Lead real-time data processing and streaming solutions.

Skills

Data modeling

API development

Cloud-native development

ETL pipelines

Kafka

Education

Bachelor’s or Master’s degree in Computer Science

Tools

Apache Airflow

Docker

Kubernetes

PostgreSQL

MongoDB

AWS

Job description

About the Role:

We are looking for a skilled and experienced SeniorDataEngineerto lead the design and implementation of scalable, high-performancedatainfrastructure. You will play a critical role in building robust ETL pipelines, architectingdatamodels, and enabling real-timedataprocessing systems across our platform. If you're passionate about bigdata, cloud-native development, andengineering best practices, this role is for you.

Key Responsibilities

• Design, develop, and maintain high-performance ETL/ELT pipelines using Python, Apache Airflow, and DBT.
• Architect and optimizedatamodels across relational (PostgreSQL), NoSQL (MongoDB), and cloud-baseddatawarehouses like Redshift and Clickhouse.
• Build and maintain APIs fordataaccess and integration using FastAPI.
• Lead real-timedataprocessing and streaming solutions using Kafka or RabbitMQ.
• Design and implement scalable Spark-baseddataprocessing pipelines and caching solutions with Redis.
• Implement and manage search and analytics capabilities using Elasticsearch.
• Containerize and orchestratedataservices using Docker and Kubernetes.
• Leverage AWS cloud services (S3, Lambda, Glue, ECS/EKS, RDS) to ensure secure and efficientdatainfrastructure.
• Establish and enforcedataquality, governance, and security standards.
• Mentor juniordataengineers and contribute to architectural decision-making and technical leadership.

Required Skills & Qualifications

• Bachelor’s or Master’s degree in Computer Science,Engineering, or related field.
• 4-6+ years of experience indataengineering, with a strong track record of building and scalingdatainfrastructure.
• Extensive experience with workflow orchestration tools like Apache Airflow.
• Deep expertise in relational (PostgreSQL) and NoSQL (MongoDB)database systems.
• Proficiency in designingdatalakes anddatawarehouses with Clickhouse and Amazon Redshift.
• Practical experience with streaming frameworks such as Kafka or RabbitMQ.
• Solid hands-on experience with Spark, Redis, and Elasticsearch.
• Strong skills in containerization (Docker) and orchestration (Kubernetes).
• Cloud-native development experience using AWS services.
• Strong understanding ofdatamodeling,dataarchitecture, and performance optimization.

Preferred Skills

• Experience with infrastructure as code (e.g., Terraform, CloudFormation).
• Knowledge of CI/CD pipelines and DevOps practices.
• Familiarity withdatasecurity, compliance (GDPR, HIPAA), and governance.
• Leadership experience in cross-functional teams or agile environments.

What We Offer

• Free meals to all our employees over & above the CTC
• A collaborative, innovation-driven work culture
• Great learning curve
• Opportunities for leadership and technical mentorship
• Exposure to cutting-edge technologies and scalable product development
• Health benefits

Technical stack

Python, Fast API, Postgres SQL, Mongo DB,ETL pipelines,Docker, Kubernetes, Cloud (preferred AWS).

Expected Joining

Within a month.