Big Data Developer

Dassault Systèmes; Pune District; On-site; INR 1,400,000 - 2,000,000; Full time

Benefits offered by this job

Global leader in Europe

Collaborative culture

Career progression

Multinational team

Job summary

Dassault Systèmes in Pune, India invites a Big Data Developer to design and maintain ETL pipelines using Spark, Kafka, and Python. You will build data lakes, data marts, and data warehouses to support BI, reporting, and ML.

Collaboration with analysts, data scientists, and stakeholders is essential to deliver scalable data solutions. The role emphasizes data governance, real-time processing, and optimization of workflows for large datasets, with documentation to support collaboration and

Qualifications

• Bachelor's degree in Computer Science, Engineering or related field.
• 2–5 years of data engineering experience with ETL pipelines.

Responsibilities

• Design, develop, and maintain ETL pipelines for batch and real-time data.
• Build scalable data architectures: data lakes, marts, warehouses.
• Ensure data reliability, governance, and quality for decision making.
• Collaborate with data analysts, scientists, and stakeholders to gather requirements.
• Develop efficient workflows for large-scale datasets and performance.
• Create detailed documentation for data processes and architecture.
• Introduce new tools and best practices to improve data processes.

Skills

Python

PySpark

Spark SQL

Kafka

Hadoop

HDFS

Hive

Iceberg

SQL/NoSQL

Cloud & On-Prem

Education

Bachelor's degree in CS/Engineering

Job description

Unlock your potential with Dassault Systèmes, a global leader in Scientific Software Engineering as a

Big Data Developer in Pune, India!

Role Description & Responsibilities:

• Data Pipeline Development: Design, develop, and maintain robust ETL pipelines for batch and real-time data ingestion, processing, and transformation using Spark, Kafka, and Python.
• Data Architecture: Build and optimize scalable data architectures, including data lakes, data marts, and data warehouses, to support business intelligence, reporting, and machine learning.
• Data Governance: Ensure data reliability, integrity, and governance by enabling accurate, consistent, and trustworthy data for decision-making.
• Collaboration: Work closely with data analysts, data scientists, and business stakeholders to gather requirements, identify inefficiencies, and deliver scalable and impactful data solutions.
• Optimization: Develop efficient workflows to handle large-scale datasets, improving performance and minimizing downtime.
• Documentation: Create detailed documentation for data processes, pipelines, and architecture to support seamless collaboration and knowledge sharing.
• Innovation: Contribute to a thriving data engineering culture by introducing new tools, frameworks, and best practices to improve data processes across the organization.

Qualifications:

• Educational Background: Bachelor's degree in Computer Science, Engineering, or a related field.
• Professional Experience: 2–5 years of experience in data engineering, with expertise in designing and managing complex ETL pipelines.

Technical Skills:

• Proficiency in Python, PySpark, and Spark SQL for distributed and real-time data processing.
• Deep understanding of real-time streaming systems using Kafka.
• Experience with data lake and data warehousing technologies (Hadoop, HDFS, Hive, Iceberg, Apache Spark).
• Strong knowledge of relational and non-relational databases (SQL, NoSQL).
• Experience in cloud and on-premises environments for building and managing data pipelines.
• Analytical and Problem-Solving Skills: Ability to translate complex business requirements into scalable and efficient technical solutions.
• Collaboration and Communication: Strong communication skills and the ability to work with cross-functional teams, including analysts, scientists, and stakeholders.

What is in it for you?

• Work for the one of the biggest software companies in Europe
• Work in a culture of collaboration and innovation
• Opportunities for personal development and career progression
• Chance to collaborate with a multinational and multidisciplinary team

Inclusion statement

As a game-changer in sustainable technology and innovation, Dassault Systèmes is striving to build more inclusive and diverse teams across the globe. We believe that our people are our number one asset and we want all employees to feel empowered to bring their whole selves to work every day. It is our goal that our people feel a sense of pride and a passion for belonging. As a company leading change, it’s our responsibility to foster opportunities for all people to participate in a harmonized Workforce of the Future.