Senior Data Engineer - AWS & Big Data | Hybrid, Bangalore

Berkadia; Hinoba-an; Hybrid; PHP 1,971,000 - 4,600,000; Full time

Benefits offered by this job

Leaves policy

Free transportation

Medical insurance

Learn while you Earn

Wellness program

Job summary

Berkadia Services India Pvt Ltd in Bangalore is seeking a Senior Data Engineer to join the Data Pipeline team. You will design and build data projects that integrate data warehousing concepts with modern big data technologies, while ensuring data security and integrity.

The role requires 7+ years in data engineering, expertise in SQL, Python, PySpark, Airflow, and AWS, plus mentoring capabilities. This is a full-time hybrid position aligned with Berkadia policy.

Qualifications

• Bachelor’s degree in information technology, Computer Science, Data Engineering, Information Systems, or a closely related technology field; or equivalent practical experience.
• Preferably Post Graduate degree in CS, ML, Data Engineering or Data Science.
• 7+ years of professional experience in data engineering or related field.
• 5-7 years of hands-on data engineering with end-to-end ownership of ingestion & transformation data flows.
• Proven experience building ETL/ELT pipelines using PostgreSQL, Docker, Airflow, AWS Step Functions, or similar.
• 5+ years of experience building high-performance algorithms in Scala, Python and R.
• Strong SQL (complex queries, performance tuning) & Python (PySpark).
• Experience with cloud computing in AWS (EMR, AirFlow, Spark, S3).
• Experience with modern data warehousing and/or lakehouse architectures.
• CI/CD, Git, and agile development practices.
• Experience managing large scale products with a focus on quality/efficiency.

Responsibilities

• Research new technology and share knowledge with team and peers.
• Design, implement and release data applications in AWS using big data technologies.
• Coordinate development efforts across the organization.
• Influence team in development standards and processes.
• Mentor peers and conduct code reviews.
• Perform other duties as assigned.

Skills

SQL

Python

PySpark

Analytical thinking

CI/CD

Agile development

Mentoring

Education

Bachelor's degree in IT/CS/Data Eng

Postgraduate degree in CS/ML/Data Science

Tools

Docker

PostgreSQL

Apache Airflow

AWS Step Functions

AWS EMR

Spark

S3

Job description

Berkadia Services India Pvt Ltd in Bangalore is seeking a Senior Data Engineer to join the Data Pipeline team. You will design and build data projects that integrate data warehousing concepts with modern big data technologies, while ensuring data security and integrity.

The role requires 7+ years in data engineering, expertise in SQL, Python, PySpark, Airflow, and AWS, plus mentoring capabilities. This is a full-time hybrid position aligned with Berkadia policy.