Cloud Data Engineer - Data Pipeline and Quality (India)

Thakral One; Bengaluru Urban; On-site; INR 2,400,000 - 4,000,000; Full time

Job summary

Thakral One seeks a Cloud Data Engineer to design and optimise data warehouses, data lakes, and data marts for large financial institutions. You will work with business and tech leads to build scalable data solutions across on-prem and AWS environments using Snowflake and Starburst.

You will translate business specs into technical designs, develop data pipelines, validate data quality, and collaborate on SIT/UAT, ensuring high performance and reliable BI integrations.

Qualifications

• Bachelor’s degree in IT/CS or related field.
• 5+ years as a Data Engineer, with data pipelines and large datasets.
• Experience with data lakes, data warehouses, and distributed computing systems.
• Financial services or banking experience preferred.

Responsibilities

• Design, build, and optimise data warehouses, data lakes, and data marts for large financial institutions.
• Translate specifications into technical designs for implementation and deployment.
• Extract, transform, and load large volumes of structured and unstructured data into AWS data lakes or data warehouses.
• Collaborate with cross-functional teams to develop prototypes, artifacts, components, support SIT and UAT testing, triage issues, and perform bug fixing.
• Optimise and fine-tune data pipeline jobs for performance and scalability.
• Implement data quality and validation processes to ensure data accuracy and integrity.
• Provide problem-solving expertise and perform complex analysis to design BI integrations.
• Convert data integration models into source code and ensure system performance.

Skills

Data pipeline design

Analytical problem-solving

Cross-functional collaboration

Cloud data architectures

ETL/ELT best practices

Performance tuning

Education

Bachelor's degree in IT/CS or related field

Tools

AWS Glue

Redshift

EMR

RDS

Kinesis

S3

Athena

DynamoDB

Step Functions

Lambda

Snowflake

Starburst

Denodo

HiveQL

Python

Spark

Scala

Job description

Cloud Data Engineer, you will design, build, and optimise data warehouses, data lakes, and data marts for large financial institutions. You will work closely with technology and business leads to enhance critical enterprise applications across on-prem environments and AWS, leveraging the Modern Data Stack including Snowflake and Starburst to deliver scalable, high-quality data solutions.

What You’ll Do and How You’ll Succeed

• Manage data analysis and integration across disparate systems.
• Translate functional specifications from business users into technical designs for implementation and deployment.
• Extract, transform, and load large volumes of structured and unstructured data into AWS data lakes or data warehouses.
• Work with cross-functional teams to develop prototypes, produce design artefacts, develop components, support SIT and UAT testing, triage issues, and perform bug fixing.
• Optimise and fine-tune data pipeline jobs for performance and scalability.
• Implement data quality and validation processes to ensure data accuracy and integrity.
• Provide problem-solving expertise and perform complex analysis to design business intelligence integrations.
• Convert physical data integration models and design specifications into source code.
• Ensure high performance and quality of data integration systems to meet business requirements.

We’d Love to Hear From You If…

Experience

• You have a bachelor’s degree in IT, Information Systems, Computer Science, Software Engineering, or a related field.
• You have 5+ years of experience as a Data Engineer, with strong experience building data pipelines and processing large datasets.
• You have experience working with data lakes, data warehouses, and distributed computing systems.
• You have experience in the financial services or banking industry (preferred).

Technical Expertise

• You have 5+ years of strong proficiency in AWS services such as AWS Glue, Redshift, EMR, RDS, Kinesis, S3, Athena, DynamoDB, Step Functions, and Lambda.
• You have 3+ years of experience with Informatica for building data pipelines.
• You have 2+ years of experience with Snowflake Data Platform (highly desirable).
• You have exposure to data virtualisation platforms such as Starburst or Denodo.
• You are skilled in HiveQL, Python, Spark, Scala, and big data processing.
• You understand data modelling, database design, and ETL principles.
• You are familiar with data governance, data security, and cloud compliance practices.
• You can optimise and fine-tune Spark jobs and data pipelines for performance.
• AWS data-related certifications are a plus.

Ways of Working

• You communicate effectively and collaborate well within cross-functional teams.
• You are committed to high-quality delivery, continuous improvement, and elegant solution design.
• You approach problem-solving with analytical depth and technical rigour.

---

Who We Are

Thakral One is a consulting and technology services company headquartered in Singapore, with a pan-Asian presence. We focus primarily around technology-driven consulting, adoption of value-added bespoke solutions, enabling enhanced decision support through data analytics, and embracing possibilities in the cloud. We are heavily inclined towards building capabilities collaboratively with clients and believe strongly in improving grounded and practical outcomes.

This approach is possible through our partnership with leading global technology providers and internal R&D teams. Our clients come from Financial Services, Banking, Telco, Government, Healthcare, and Consumer-oriented organisations.