Senior Data Engineer: Scalable Big Data Pipelines

Publicis Sapient; Chicago (IL); On-site; USD 135,000 - 165,000; Full time

Benefits offered by this job

Competitive compensation and benefits

Flexible work options

Health benefits for you and yourfamily

Generous paid leave and holidays

Wellness program and employee support

Learning and development opportunities

Job summary

Publicis Sapient in Chicago is seeking a Senior Associate Data Engineer to design, develop, and maintain scalable Big Data solutions across on-prem and cloud platforms. You will work with large datasets, real-time processing, and orchestration tools to enable data-driven decision-making for clients.

The role requires 5+ years in Big Data engineering with Hadoop, Spark, Kafka, Flink, and Hive, plus experience on AWS, GCP, or Azure.

Qualifications

• 5+ years of experience in Big Data engineering, data processing, and analytics.
• Strong proficiency in Big Data technologies such as Hadoop, Spark, Kafka, Flink, and Hive.
• Experience with cloud-based data platforms such as AWS, GCP, or Azure.
• Proficiency in programming languages such as Java, Scala, or Python for data processing and analytics.
• Hands-on experience with data modeling, ETL processes, and data warehousing.
• Strong understanding of distributed computing, data streaming, and real-time processing.
• Experience with SQL, NoSQL databases, and data lakes.
• Knowledge of data governance, security, and compliance best practices.
• Strong problem-solving and analytical skills with a focus on delivering high-quality data solutions.

Responsibilities

• Design, develop, and maintain Big Data pipelines using Hadoop, Spark, Kafka, and Flink.
• Implement data processing and transformation workflows to support analytics, reporting, and ML applications.
• Optimize data storage, retrieval, and processing for performance and scalability.
• Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver solutions.
• Ensure data quality, security, and compliance with industry standards and best practices.
• Automate data workflows and monitoring processes to improve efficiency and reliability.
• Stay updated with emerging Big Data technologies and best practices to drive innovation.

Skills

Big Data engineering

Hadoop

Spark

Kafka

Flink

Hive

Cloud platforms

AWS

GCP

Azure

Java

Scala

Python

ETL

Data warehousing

SQL

NoSQL

Data lakes

Data governance

Security

Compliance

Tools

Docker

Kubernetes

Job description

Publicis Sapient in Chicago is seeking a Senior Associate Data Engineer to design, develop, and maintain scalable Big Data solutions across on-prem and cloud platforms. You will work with large datasets, real-time processing, and orchestration tools to enable data-driven decision-making for clients.

The role requires 5+ years in Big Data engineering with Hadoop, Spark, Kafka, Flink, and Hive, plus experience on AWS, GCP, or Azure.