Big Data Developer

Capgemini Singapore Pte Ltd; Singapore; On-site; SGD 60,000 - 90,000; Full time

Job summary

Capgemini Singapore Pte Ltd is seeking a Data Scientist to join our Big Data team. You will design and implement robust data pipelines, leverage Spark and Hadoop to process large datasets, and translate business needs into scalable analytics solutions.

The role emphasizes collaboration with cross-functional teams, mentoring junior engineers, and driving performance improvements while ensuring data security and governance in a fast-paced environment.

Qualifications

• Experience in designing and maintaining automated data pipelines.
• Strong knowledge of big data technologies and data warehousing concepts.
• Familiarity with cloud platforms and containerization is a plus.

Responsibilities

• Design and develop robust data pipelines and ETL processes to ensure data quality and accessibility.
• Leverage Apache Spark, Hadoop, and Kafka to process large datasets efficiently.
• Develop scalable data warehouse structures and indexing strategies.
• Build scalable software architectures to handle increasing user loads.
• Collaborate with security teams to ensure data privacy and regulatory compliance.
• Mentor junior engineers and collaborate with cross-functional teams.
• Automate data flow and monitoring for optimal performance.

Job description

Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and build a more sustainable, more inclusive world.

YOUR ROLE

Are you passionate about crafting innovative data solutions that drive impactful business decisions Join our team as a Data Scientist in Big Data and contribute to building cutting-edge platforms that process and analyze vast datasets with efficiency and scalability.

In this role, you will play a key role in:

• Design and Development: Architect and implement robust data pipelines and ETL processes to ensure data quality, accuracy, and integrity.
• Big Data Expertise: Leverage technologies like Apache Spark, Hadoop, and Kafka to process large datasets, optimize pipelines, and deliver high-performance solutions.
• Data Infrastructure: Develop and maintain scalable data warehouse structures, including schema design and indexing strategies, to support evolving business requirements.
• System Scalability: Design and implement highly scalable software architectures that accommodate increasing user loads while ensuring system reliability.
• Data Security: Collaborate with security teams to implement data security measures, ensuring compliance with regulatory standards and maintaining privacy protocols.
• Collaboration and Leadership: Work with cross-functional teams to translate business needs into technical requirements and mentor junior engineers to foster team growth and innovation.
• Automation: Streamline data flow across systems by building automated scheduling and monitoring mechanisms for optimal performance.

YOUR PROFILE

• • 1–3 years of hands-on experience in:
• Ø Big Data Technologies: Apache Spark, Hadoop, Kafka.
• Ø Programming Languages: Python, Scala, Java, SQL, and Shell ing.
• Ø Cloud Technologies: AWS and Kubernetes.
• Ø Data Warehousing: Hive, Impala, Sqoop.
• • Proven experience designing and maintaining automated, large-scale data pipelines.
• • Demonstrated success in system troubleshooting, performance tuning, and distributed system optimization.

Preferred Skills

• • Experience with containerization tools like Docker.
• • Familiarity with version control systems (e.g., Git) and frameworks like Spring Boot.
• • Knowledge of cloud-native solutions and cloud migration best practices.

Core Competencies

• • Data Architecture & ETL Development: Expertise in creating efficient data solutions.
• • Big Data Leadership: Strong skills in distributed systems and performance tuning.
• • Collaboration: Ability to work effectively with diverse teams to deliver business value.
• • Continuous Learning: Commitment to staying current with industry trends and innovations.

WHAT YOU'LL LOVE ABOUT WORKING HERE

• • We promote Diversity & Inclusion as we believe diversity of thought fuels excellence and innovation.
• • In Capgemini, you are the architect of your career growth. We equip people in maximizing their full potential by providing wide array of career growth programs that empower them to get the future they want.
• • Capgemini fosters impactful experiences for its people that would aid in bringing out the best in them for them, for the company, and for their clients.

Disclaimer:

Capgemini is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law.

This is a general de ion of the Duties, Responsibilities, Qualifications required for this position. Physical, mental, sensory, or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Whenever necessary to provide individuals with disabilities an equal employment opportunity. Capgemini will consider reasonable accommodations that might involve varying job requirements and/or changing the way this job is performed, provided that such accommodations do not pose an undue hardship. Capgemini is committed to providing reasonable accommodations during our recruitment process. If you need assistance or accommodation, please reach out to your recruiting contact.