Data Engineer -AWS, PySpark, SQL (8+ yrs)

Banking Tech MNC; Bengaluru; On-site; INR 800,000 - 1,200,000; Full time

Job summary

Banking Tech MNC is looking for a Data Engineer in Bengaluru. The ideal candidate will have strong experience in data processing, ETL, and cloud technologies such as AWS. You will translate business stakeholder needs into technical solutions and ensure compliance with security and scalability principles.

The role requires proficiency in Python, strong communication skills, and familiarity with CI/CD processes.

Qualifications

• Experience in ETL, data processing, data warehousing, and data engineering.
• Proficient in at least one Python programming language.
• Hands-on experience with IaC tools like AWS CloudFormation and Terraform.
• Good understanding of cloud security best practices.

Responsibilities

• Translate business stakeholder needs into technical solutions.
• Scale up solutions aligned with the tech tooling strategy.
• Incorporate security principles into designs and deliverables.
• Test end-to-end data pipelines ensuring compliance.

Skills

ETL

Data processing

Data warehousing

RDBMS

PySpark

AWS cloud development

Python

AWS CloudFormation

Terraform

CI/CD tools

Monitoring tools

Git

Job description

Data Engineer – Bengaluru

To be a successful Data Engineer, you should have experience with:

Responsibilities

• Translate business stakeholder needs into technical solutions and align with solution architecture.


• Scale up solutions and align to BUK CDAO tech tooling strategy, e.g., EDP capabilities, Databricks.


• Incorporate security principles into designs and deliverables.


• Ensure compliance with standards (CSO, CDO, CDA, etc.) and execute/test end‑to‑end data pipelines.


• Meet non‑functional requirements such as scalability, security, and resilience.


• Follow data product principles and the CDA team's best practices for data modeling, compliance, and security.

Qualifications

• Experience in ETL, data processing, data warehousing, data engineering, RDBMS, PySpark.


• Experience in data processing and ETL in on‑prem and cloud‑based systems.


• Preferred AWS cloud development and strong understanding of AWS services (EC2, S3, Lambda, RDS, DynamoDB, etc.).


• Proficient in at least one Python programming language.


• Hands‑on experience with IaC tools like AWS CloudFormation, Terraform, etc.


• Experience with CI/CD tools and pipelines (Jenkins, GitLab CI, etc.) for automation and deployment.


• Good understanding of cloud security best practices and experience with IAM, VPC, security groups, and encryption mechanisms.


• Good knowledge of monitoring, logging, and troubleshooting tools (e.g., CloudWatch, CloudTrail).


• Experience with version control systems (Git, GitHub, Bitbucket).


• Strong communication skills and ability to work in a collaborative team environment.


• Experience with cloud‑based services and integrations, exposure to Databricks, Agile development practices, and familiarity with databases (SQL/NoSQL), release management.


• Highly valued: experience with cloud based services and integrations, exposure to Databricks, agile development practices, familiarity with SQL/NoSQL databases, release management.

Location

Bengaluru, India.