Data Engineer

Capgemini; Kuala Lumpur; Hybrid; MYR 60,000 - 80,000; Full time

Job summary

A leading technology services firm based in Kuala Lumpur is seeking a Data Engineer (Cloud) to enhance data-driven decision-making processes. This role involves creating scalable data pipelines and optimizing cloud-based data solutions. Candidates should possess proficiency in cloud platforms like AWS, Azure, or GCP, as well as strong programming skills in Python, Java, Scala, or SQL. A Bachelor's degree in a related field is required. This position blends in-office, client site, and remote work environments.

Benefits

Diverse work environment

Opportunities for skill development

Contributing to meaningful projects

Qualifications

• Proven ability to dissect complex problems and provide actionable insights in a timely manner.
• Strong programming skills in Python, Java, Scala, or SQL.
• Proficiency with ETL processes and data transformation techniques.

Responsibilities

• Design, develop, and maintain scalable ETL pipelines using cloud-native tools.
• Optimize cloud infrastructure for cost, performance, and security.
• Implement monitoring, logging, and alerting solutions for data pipelines.

Skills

Analytical Thinking & Problem Solving

Proficiency with AWS

Strong programming skills in Python

Experience with big data tools

Education

Bachelor's degree in data science, Analytics, Business, or related field

Tools

Apache Airflow

AWS

Azure

GCP

Job description

Capgemini Global Insights & Data business line is a market leader in the data, platform, and analytics across all regions and across many sectors (including financial services, consumer products, manufacturing & life sciences). Our offerings include end-2-end data integration to cloud platform, complete suite of AI engineering capabilities and a category of sector-based advanced analytics / AI solutions.

The places that you work from day to day will vary according to your role, your needs, and those of the business; it will be a blend of Company offices, client sites, and your home; noting that you will be unable to work at home 100% of the time.

Your Role

We are seeking an experienced and visionary Data Engineer (Cloud) to lead our data-driven decision-making processes. This role requires someone with a balance of analytical skills, strategic foresight, and the ability to collaborate effectively across diverse teams. The Data Engineer will be instrumental in creating scalable data pipelines, optimizing data architectures, and ensuring the overall security and reliability of cloud-based data solutions. The ideal candidate will have a strong background in data architecture, ETL pipelines, cloud platforms (AWS, Azure, GCP), and big data technologies.

• Design, develop, and maintain scalable ETL (Extract, Transform, Load) pipelines using cloud-native tools.
• Implement best practices for data ingestion, transformation, and loading processes across multiple sources.
• Automate workflows and develop data pipelines using tools such as Apache Airflow, Glue, Databricks, or Dataflow.
• Architect, build, and maintain cloud-based data solutions using AWS, Azure, or Google Cloud Platform (GCP).
• Optimize cloud infrastructure for cost, performance, and security.
• Implement monitoring, logging, and alerting solutions for data pipelines and cloud infrastructure.
• Bachelor's degree in data science, Analytics, Business, or related field. Advanced degrees or certifications are a plus.

Your Skills and Experience

• Analytical Thinking & Problem Solving: Proven ability to dissect complex problems and provide actionable insights in a timely manner.
• Proficiency with cloud platforms such as AWS (S3, EC2, EMR, Glue, Lambda), Azure (Data Factory, Blob Storage, HDInsight), or GCP (Big Query, Dataflow, Pub/Sub).
• Strong programming skills in Python, Java, Scala, or SQL.
• Experience with big data tools (Hadoop, Spark, Kafka, etc.).
• Proficiency with ETL processes and data transformation techniques.
• Knowledge of relational and different databases (PostgreSQL, MongoDB, Cassandra).

Why you should consider Capgemini

Growing clients’ businesses while building a more sustainable, more inclusive future is a tough ask. When you join Capgemini, you’ll join a thriving company and become part of a diverse collective of free-thinkers, entrepreneurs and industry experts. We find new ways technology can help us reimagine what’s possible. It’s why, together, we seek out opportunities that will transform the world’s leading businesses, and it’s how you’ll gain the experiences and connections you need to shape your future. By learning from each other every day, sharing knowledge, and always pushing yourself to do better, you’ll build the skills you want. You’ll use your skills to help our clients leverage technology to innovate and grow their business. So, it might not always be easy, but making the world a better place rarely is.

About Capgemini

Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, cloud and data, combined with its deep industry expertise and partner ecosystem. The Group reported 2023 global revenues of €22.5 billion.