Senior Data Engineer - Real-Time Cloud Data Pipelines

TechDigital Group; New Jersey; Hybrid; USD 100,000 - 130,000; Full time

Job summary

A leading technology company in New Jersey is looking for an experienced Data Engineer to build and maintain scalable data pipelines. Candidates should possess extensive experience in Python and AWS, with a strong understanding of big data technologies. The role involves collaboration with cross-functional teams and mentoring junior staff. Excellent communication skills and the ability to thrive in a fast-paced environment are essential. Competitive salary and opportunities for growth await the ideal candidate.

Qualifications

• 7+ years of experience in data solutions and 3+ years coding in Python or Scala.
• Experience with AWS Cloud for data pipeline development and big data technologies.
• Demonstrated ability to work collaboratively in an Agile environment.

Responsibilities

• Build, deploy, and maintain scalable data pipelines for large, complex data sets.
• Collaborate with SMEs and other team members to develop real-time data solutions.
• Mentor junior engineers and create documentation and run-books.

Skills

Python

AWS Cloud Platform

Data ingestion

Kafka

MPP databases

Agile methodologies

Communication skills

Education

Bachelor's degree in Computer Science or equivalent

Tools

Snowflake

AWS Glue

EMR

Spark

Job description

A leading technology company in New Jersey is looking for an experienced Data Engineer to build and maintain scalable data pipelines. Candidates should possess extensive experience in Python and AWS, with a strong understanding of big data technologies. The role involves collaboration with cross-functional teams and mentoring junior staff. Excellent communication skills and the ability to thrive in a fast-paced environment are essential. Competitive salary and opportunities for growth await the ideal candidate.