Associate Data Engineer - AWS & Big Data Pipelines

Publicis Groupe ANZ; Atlanta (GA); On-site; USD 91,000 - 119,000; Full time

Benefits offered by this job

Health benefits

Paid time off

Work-life balance

Family health coverage

Holidays

Wellness program

Job summary

Publicis Sapient in Atlanta is seeking an Associate Data Engineer to design, develop, and maintain scalable Big Data solutions across large datasets and cloud platforms. You will enable data-driven decision-making by building pipelines with Hadoop, Spark, Kafka, and Flink.

The role requires 5+ years in Big Data engineering, experience with AWS/GCP/Azure, and programming in Java, Scala, or Python for data processing.

Qualifications

• 5+ years of experience in Big Data engineering, data processing, and analytics.
• Strong proficiency in Hadoop, Spark, Kafka, Flink, and Hive.
• Experience with cloud-based data platforms such as AWS, GCP, or Azure.
• Proficiency in Java, Scala, or Python for data processing and analytics.
• Hands-on experience with data modeling, ETL processes, and data warehousing.
• Strong understanding of distributed computing, data streaming, and real-time processing.
• Experience with SQL, NoSQL databases, and data lakes.
• Knowledge of data governance, security, and compliance best practices.

Responsibilities

• Design, develop, and maintain Big Data pipelines for analytics and ML applications.
• Implement data processing workflows across real-time and batch processing.
• Optimize storage and processing for performance and scalability.
• Collaborate with data scientists, analysts, and stakeholders to define data requirements.
• Ensure data quality, security, and regulatory compliance.
• Automate data workflows and monitoring to improve reliability.
• Stay current with emerging Big Data technologies to drive innovation.

Skills

Hadoop

Spark

Kafka

Flink

Hive

AWS/GCP/Azure

Java/Scala/Python

ETL

Data warehousing

SQL/NoSQL

Data governance

Tools

Docker

Kubernetes

Job description

Publicis Sapient in Atlanta is seeking an Associate Data Engineer to design, develop, and maintain scalable Big Data solutions across large datasets and cloud platforms. You will enable data-driven decision-making by building pipelines with Hadoop, Spark, Kafka, and Flink.

The role requires 5+ years in Big Data engineering, experience with AWS/GCP/Azure, and programming in Java, Scala, or Python for data processing.