Data Engineer - Python / Big Data

Darwinbox Digital Solutions Pvt. Ltd.; Bengaluru; On-site; INR 1,800,000 - 2,400,000; Full time

Job summary

Darwinbox Digital Solutions Pvt. Ltd. in Bengaluru invites a Mid-Level Data Engineer to design, build and optimize scalable data systems in cloud environments. You will create robust pipelines, data lakes, and warehouses to empower analytics across product and business teams.

You’ll collaborate with data scientists, analysts, and engineers, applying Python/SQL, ETL/ELT, and distributed processing tools to deliver high-quality data products.

Qualifications

• 3+ years of data engineering experience in cloud/big data environments.
• Strong Python and SQL (MySQL preferred).
• Hands-on with ETL/ELT pipelines and data modeling.

Responsibilities

• Design, develop, and maintain scalable data products including data warehouses, data lakes, and databases
• Build and optimize ETL/ELT pipelines for batch and real-time data processing
• Develop robust and reusable data models to support analytics and reporting needs
• Build and maintain automated, scalable data pipelines
• Monitor, troubleshoot, and optimize pipeline performance for latency, cost, and reliability
• Ensure high availability and data integrity across systems
• Work with AWS services including EC2, S3, Lambda, Redshift, Glue, EMR, and DynamoDB
• Implement distributed data processing solutions using Spark, Flink, or Kafka
• Design cloud-native data architectures for scalability and efficiency

Skills

Python

SQL

ETL/ELT

Data modeling

Distributed systems

AWS

Spark

Kafka

Flink

Git

CI/CD

Debugging

Education

BE / BTech in CS or related field

MCA graduates also eligible

Tools

Airflow

Git

Airflow or similar

Job description

About the Role

We arelooking for a skilled Data Engineer – Python / Big Data to design, build, andoptimize scalable, high-performance data systems in cloud environments. In thisrole, you will be responsible for developing robust data pipelines, managingdata infrastructure, and enabling reliable, high-quality data availability foranalytics, product, and business teams.

You willwork closely with cross-functional teams to build scalable data productssuchas data lakes, data warehouses, and real-time data systems that power criticalbusiness decisions.

What You’ll Do

• Design, develop, and maintain scalable data productsincluding data warehouses, data lakes, and databases
• Build and optimize ETL/ELT pipelines for batch and real-timedata processing
• Develop robust and reusable data models to support analyticsand reporting needs
• Build and maintain automated, scalable data pipelines
• Monitor, troubleshoot, and optimize pipeline performance forlatency, cost, and reliability
• Ensure high availability and data integrity across systems
• Work with AWS services including EC2, S3, Lambda, Redshift,Glue, EMR, and DynamoDB
• Implement distributed data processing solutions using Spark,Flink, or Kafka
• Design cloud-native data architectures for scalability andefficiency

Technical Leadership &Collaboration

• Provide technical guidance on data architecture andengineering best practices
• Collaborate with data scientists, analysts, and engineeringteams to deliver data-driven solutions
• Contribute to CI/CD processes and engineering automation

Data Quality & Governance

• Ensure accuracy, consistency, and reliability of data systems
• Implement data validation and monitoring frameworks
• Support secure and compliant data handling practices

What We’re Looking For

Technical Expertise

• 3+ years of experience in data engineering, preferably incloud and big data environments
• Strong proficiency in Python and SQL (MySQL preferred)
• Hands-on experience with ETL/ELT pipelines and data modeling
• Strong understanding of scalable data architectures anddistributed systems
• Experience with AWS cloud services (EC2, S3, Lambda,Redshift, Glue, EMR, DynamoDB)
• Hands-on experience with Spark, Kafka, Flink, or similardistributed processing tools
• Familiarity with real-time and batch data processing systems
• Experience with Git-based version control systems
• Understanding of CI/CD pipelines and deployment automation
• Strong debugging and performance optimization skills

Education

• BE / BTech in Computer Science or related field
• MCA graduates also eligible

Soft Skills

• Strong analytical and problem-solving mindset
• Excellent communication and collaboration skills
• Ability to manage multiple priorities in a fast-pacedenvironment
• Strong attention to detail and quality-focused approach

Nice to Have

• Experience in fintech or high-scale consumer platforms
• Exposure to data governance or data quality frameworks
• Familiarity with orchestration tools like Airflow or similar
• Experience working in startup or product-based environments

Why You’ll Love Working With Us

• Opportunity to build large-scale, high-impact data systems
• Work on modern cloud and big data technologies
• Fast-paced and collaborative engineering culture
• Strong ownership and learning opportunities
• Exposure to real-time, high-volume data platforms

Position: DataEngineer - Python / Big Data
Employment Type: Full-Time
Experience Level: Mid-Level
Location: Bengaluru, India (Onsite)

By applying for this position, you acknowledge and agree that any personal data you provide may be used for recruitment and employment purposes. The data collected will be stored and processed in accordance with our privacy policy and applicable data protection laws. Your information will only be shared with relevant internal stakeholders and will not be disclosed to third parties without your consent, unless required by law.