Senior Data Engineer: Real-Time Big Data Pipelines Leader

Publicis Groupe; Northern (KY); Hybrid; USD 135,000 - 165,000; Full time

Benefits offered by this job

Inclusive workplace

Learning opportunities

Competitive compensation

Flexible work options

Job summary

Publicis Sapient is seeking a Senior Associate Data Engineer to design, develop, and maintain scalable Big Data solutions. You will work with large datasets, real-time processing frameworks, and cloud-based data platforms to enable data-driven decision-making for our clients.

You will build pipelines with Hadoop, Spark, Kafka, and Flink; transform data for analytics and ML; ensure data quality, security, and compliance; collaborate with data scientists and analysts; automate workflows and stay

Qualifications

• 5+ years of experience in Big Data engineering, data processing, and analytics.
• Strong proficiency in Big Data technologies such as Hadoop, Spark, Kafka, Flink, and Hive.
• Experience with cloud-based data platforms such as AWS, GCP, or Azure.
• Proficiency in programming languages such as Java, Scala, or Python for data processing and analytics.

Responsibilities

• Design, develop, and maintain Big Data pipelines using Hadoop, Spark, Kafka, and Flink.
• Implement data processing and transformation workflows to support analytics, reporting, and machine learning applications.
• Optimize data storage, retrieval, and processing for performance and scalability.
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver high-quality solutions.
• Ensure data quality, security, and compliance with industry standards and best practices.
• Automate data workflows and monitoring processes to improve efficiency and reliability.
• Stay updated with emerging Big Data technologies and best practices to drive innovation.

Skills

Big Data technologies

Hadoop

Spark

Kafka

Flink

Hive

AWS

GCP

Azure

Java

Scala

Python

ETL

Data warehousing

SQL

NoSQL

Data governance

Security & compliance

Tools

Docker

Kubernetes

Job description

Publicis Sapient is seeking a Senior Associate Data Engineer to design, develop, and maintain scalable Big Data solutions. You will work with large datasets, real-time processing frameworks, and cloud-based data platforms to enable data-driven decision-making for our clients.

You will build pipelines with Hadoop, Spark, Kafka, and Flink; transform data for analytics and ML; ensure data quality, security, and compliance; collaborate with data scientists and analysts; automate workflows and stay