Scala Spark Developer

Capgemini; Hyderabad, Chennai, Bengaluru; Presencial; INR 1.200.000 - 1.800.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Career paths

Wellness benefits

Belonging culture

Challenging projects

Descripción de la vacante

Capgemini is seeking an experienced Scala Developer to build Spark-based data pipelines and manage big data workflows in HDFS. You will engage in advanced data engineering tasks and contribute to Agile development cycles.

Ideal candidates have strong Scala/Spark expertise, DB2 SQL skills, and hands-on experience with formats like JSON, Parquet, AVRO, ORC, and XML, along with data profiling and lineage capabilities.

Formación

• Hands on Scala/Spark developer.
• Hands on SQL writing skills on DB2 databases.
• Experience with file formats JSON, Parquet, AVRO, ORC and XML.
• Must have worked in an HDFS platform development project.
• Proficiency in data analysis, profiling, and lineage.
• Strong oral and written communication skills.
• Experience working in Agile projects.

Responsabilidades

• Build Spark-based data pipelines.
• Manage big data workflows in HDFS.
• Contribute to Agile development processes.

Conocimientos

Scala

Spark

SQL on DB2

Agile

Data analysis

Herramientas

DB2

HDFS

JSON

Parquet

AVRO

ORC

XML

Descripción del empleo

Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way youd like, where youll be supported and inspired bya collaborative community of colleagues around the world, and where youll be able to reimagine whats possible. Join us and help the worlds leading organizationsunlock the value of technology and build a more sustainable, more inclusive world.

Your Role

A experienced Scala Developer responsible for building Spark-based data pipelines, performing advanced data engineering tasks, managing big data workflows in HDFS, and contributing to Agile development processes.

• Hands-on expertise in Scala and Spark, strong SQL skills on DB2, and proficiency in handling diverse file formats including JSON, Parquet, AVRO, ORC, and XML.
• Proven experience in HDFS platform development, data analysis, profiling, and lineage. Effective communicator with a solid background in Agile project environments
• This position offers an exciting opportunity to contribute to high-impact data engineering projects within a dynamic and innovative environment.

Your Profile

As a senior software engineer with Capgemini, you will be having experience in Scala with strong project track record.

• Hands On experience in Scala/Spark developer
• Hands on SQL writing skills on RDBMS (DB2) databases
• Experience in working with different file formats like JSON, Parquet, AVRO, ORC and XML.
• Must have worked in a HDFS platform development project.
• Proficiency in data analysis, data profiling, and data lineage
• Strong oral and written communication skills
• Experience working in Agile projects.

What You will Love About Capgemini

• You can shape your with us. We offer a range of career paths and internal opportunities within Capgemini group. You will also get personalized career guidance from our leaders.
• You will get comprehensive wellness benefits including health checks, telemedicine, insurance with top-ups, elder care, partner coverage or new parent support via flexible work.
• We're committed to ensure that people of all backgrounds feel encouraged and have a sense of belonging at Capgemini. You are valued for who you are, and you can .
• At Capgemini, you can work on in tech and engineering with industry leaders or create to overcome societal and environmental challenges.

About Capgemini

Capgemini is an AI-powered global business and technology transformation partner, delivering tangible business value. We imagine the future of organizations and make it real with AI, technology and people. With our strong heritage of nearly 60 years, we are a responsible and diverse group of 420,000 team members in more than 50 countries. We deliver end-to-end services and solutions with our deep industry expertise and strong partner ecosystem, leveraging our capabilities across strategy, technology, design, engineering and business operations. The Group reported 2024 global revenues of 22.1 billion. Capgemini in India comprises nearly 235,000 team members working across 13 locations: Bangalore, Bhubaneswar, Chennai, Coimbatore, Gandhinagar, Gurugram, Hyderabad, Kolkata, Mumbai, Noida, Pune, Salem, and Tiruchirappalli. Make it real |