Senior Data Engineer: Build Scalable Big Data Pipelines

Publicis Sapient; Atlanta (GA); On-site; USD 135,000 - 165,000; Full time

Benefits offered by this job

Competitive compensation

Health benefits for you and family

Paid leave and holidays

Learning & development opportunities

Job summary

Publicis Sapient is seeking a Senior Associate Data Engineer to design, develop, and maintain scalable Big Data solutions across cloud-based platforms. You will work with large datasets and real-time processing frameworks to enable data-driven decision-making for clients.

You will collaborate with data scientists, analysts, and stakeholders to deliver high-quality data pipelines and ensure data governance and security in a fast-paced consulting environment.

Qualifications

• 5+ years of experience in Big Data engineering and analytics.
• Proficient with Hadoop, Spark, Kafka, Flink, Hive.
• Experience with cloud platforms: AWS, GCP, or Azure.
• Proficient in Java, Scala, or Python for data processing.
• Experience with data modeling, ETL, and data warehousing.
• Strong knowledge of distributed computing and real-time processing.
• SQL, NoSQL, and data lakes experience.
• Data governance, security, and compliance basics.

Responsibilities

• Design, develop, and maintain Big Data pipelines using Hadoop, Spark, Kafka, and Flink.
• Implement data processing and transformation workflows for analytics, reporting, and ML applications.
• Optimize data storage, retrieval, and processing for performance and scalability.
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements.
• Ensure data quality, security, and compliance with industry standards and best practices.
• Automate data workflows and monitoring processes to improve efficiency and reliability.
• Stay updated with emerging Big Data technologies and best practices to drive innovation.

Skills

Big Data

Spark

Kafka

Flink

Hive

AWS

GCP

Azure

Java

Scala

Python

ETL

Data warehousing

Tools

Docker

Kubernetes

Job description

Publicis Sapient is seeking a Senior Associate Data Engineer to design, develop, and maintain scalable Big Data solutions across cloud-based platforms. You will work with large datasets and real-time processing frameworks to enable data-driven decision-making for clients.

You will collaborate with data scientists, analysts, and stakeholders to deliver high-quality data pipelines and ensure data governance and security in a fast-paced consulting environment.