Senior Big Data Engineer: Real-Time Pipelines on AWS

Princeton IT Services, Inc; Mount Laurel Township (NJ); On-site; USD 120,000 - 150,000; Full time

Job summary

A technology services company in Mt. Laurel, NJ is seeking a skilled Big Data Engineer with over 10 years of experience. The role involves designing and optimizing data pipelines using frameworks like Spark and Flink, with a strong emphasis on AWS cloud services. The ideal candidate will possess strong programming skills in Java, Python, and Scala, and have expertise in real-time data streaming technologies like Kafka. This position offers the opportunity to work in a collaborative Agile environment.

Qualifications

• 10+ years of experience as a Data Engineer or Big Data Engineer.
• Hands-on expertise in cloud platforms, preferably AWS.
• Strong experience with Big Data tools including Flink and Hadoop.

Responsibilities

• Design, develop, and optimize scalable data pipelines.
• Work with streaming frameworks to handle large event-driven data flows.
• Implement data lake and data warehouse solutions on AWS.

Skills

Spark (PySpark, Spark SQL, Spark Streaming)

Java

Python

Scala

Kafka

AWS

CI/CD tools (Jenkins, Git, Bitbucket, Terraform, Docker, Kubernetes)

SQL

NoSQL databases

Data quality and governance

Education

Bachelor's degree in Computer Science, Engineering, or related field

Job description

A technology services company in Mt. Laurel, NJ is seeking a skilled Big Data Engineer with over 10 years of experience. The role involves designing and optimizing data pipelines using frameworks like Spark and Flink, with a strong emphasis on AWS cloud services. The ideal candidate will possess strong programming skills in Java, Python, and Scala, and have expertise in real-time data streaming technologies like Kafka. This position offers the opportunity to work in a collaborative Agile environment.