Data Engineer (AWS & Big Data Pipelines)

Publicis Groupe; Atlanta (GA); On-site; USD 91,000 - 119,000; Full time

Job summary

Publicis Sapient is seeking an Associate Data Engineer to design, develop, and maintain scalable Big Data solutions for clients. You will work with large datasets, real-time processing frameworks, and cloud-based data platforms to enable data-driven decision-making.

You will collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver high-quality solutions, while ensuring data quality and security.

Qualifications

• 5+ years of experience in Big Data engineering, data processing, and analytics.
• Experience with Hadoop, Spark, Kafka, Flink, and Hive.
• Experience with AWS, GCP, or Azure.
• Proficiency in Java, Scala, or Python for data processing and analytics.
• Hands-on experience with data modeling, ETL, and data warehousing.
• Strong understanding of distributed computing, data streaming, and real-time processing.
• Experience with SQL, NoSQL and data lakes.
• Knowledge of data governance, security, and compliance best practices.
• Strong problem-solving and analytical skills.

Responsibilities

• Design, develop, and maintain Big Data pipelines using technologies such as Hadoop, Spark, Kafka, and Flink.
• Implement data processing and transformation workflows to support analytics, reporting, and machine learning applications.
• Optimize data storage, retrieval, and processing for performance and scalability.
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver high-quality solutions.
• Ensure data quality, security, and compliance with industry standards and best practices.
• Automate data workflows and monitoring processes to improve efficiency and reliability.
• Stay updated with emerging Big Data technologies and best practices to drive innovation.

Skills

Big Data engineering

Data processing

Analytics

SQL/NoSQL

Java/Scala/Python

Data modeling

ETL

Data warehousing

Distributed computing

Data governance

Tools

Hadoop

Spark

Kafka

Flink

Hive

AWS

GCP

Azure

Docker

Kubernetes

Job description

Publicis Sapient is seeking an Associate Data Engineer to design, develop, and maintain scalable Big Data solutions for clients. You will work with large datasets, real-time processing frameworks, and cloud-based data platforms to enable data-driven decision-making.

You will collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver high-quality solutions, while ensuring data quality and security.