Senior Data Engineer: Big Data Pipelines & Real-Time

Sapient Corporation; Boston (MA); On-site; USD 135,000 - 165,000; Full time

Benefits offered by this job

Inclusive workplace

Learning opportunities

Competitive compensation

Flexible work-life balance

Health benefits

Paid leave & holidays

Wellness program

Job summary

Publicis Sapient is seeking a Senior Associate Data Engineer to design and maintain scalable Big Data solutions. You will work with large datasets, real-time processing frameworks, and cloud platforms to enable data-driven decision-making for clients.

Responsibilities include building pipelines with Hadoop, Spark, Kafka, and Flink, transforming data for analytics and ML, and ensuring data quality, security, and compliance while collaborating with data scientists and stakeholders.

Qualifications

• 5+ years of experience in Big Data engineering and analytics.
• Proficiency in Hadoop, Spark, Kafka, Flink, and Hive.
• Experience with cloud platforms such as AWS, GCP, or Azure.
• Proficiency in Java, Scala, or Python for data processing.
• Hands-on experience with ETL, data modeling, and data warehousing.
• Strong understanding of distributed computing, data streaming, and real-time processing.
• Knowledge of data governance, security, and compliance best practices.
• Strong problem-solving and analytical skills with a focus on high-quality data solutions.

Responsibilities

• Design, develop, and maintain Big Data pipelines with Hadoop, Spark, Kafka, and Flink.
• Implement data processing and transformation workflows to support analytics and ML.
• Optimize data storage and processing for performance and scalability.
• Collaborate with data scientists, analysts, and stakeholders to understand data requirements.
• Ensure data quality, security, and compliance with industry standards.
• Automate data workflows and monitoring to improve efficiency and reliability.
• Stay updated with emerging Big Data technologies and best practices.

Skills

Big Data Eng

Spark

Kafka

Flink

Hive

Python

Java

Tools

Hadoop

Kafka

Spark

Flink

Hive

Docker

Kubernetes

SQL

Job description

Publicis Sapient is seeking a Senior Associate Data Engineer to design and maintain scalable Big Data solutions. You will work with large datasets, real-time processing frameworks, and cloud platforms to enable data-driven decision-making for clients.

Responsibilities include building pipelines with Hadoop, Spark, Kafka, and Flink, transforming data for analytics and ML, and ensuring data quality, security, and compliance while collaborating with data scientists and stakeholders.