Senior Data Engineer – High-Scale, Privacy-Preserving Pipelines

Success Tech Solutions Inc.; Town of Florida (NY); On-site; USD 120,000 - 150,000; Full time

Job summary

A leading technology company in New York is seeking an experienced Data Engineer to drive the development of privacy-preserving solutions. The ideal candidate should have over 7 years of experience, expertise in building large-scale data pipelines, and familiarity with cloud technologies like AWS, Spark, and Airflow. Applicants from an AdTech background are highly desirable. This role offers exciting challenges and opportunities for growth in a collaborative environment.

Qualifications

• Minimum 7 years professional experience in data engineering.
• Experience with distributed systems like Cassandra or Kubernetes.
• Worked in CI/CD environments.

Responsibilities

• Build reliable and performant pipelines for large-scale data processing.
• Optimize analytic workloads by recognizing usage patterns.
• Design and implement testing strategies for data products.

Skills

Building data pipelines

Experience with AWS

Experience with Spark

Cloud environment familiarity

Strong programming skills (SQL, Python)

Education

BS/MS in Computer Science or related field

Tools

AWS EMR

Airflow

Kafka

Docker

Trino

Job description

A leading technology company in New York is seeking an experienced Data Engineer to drive the development of privacy-preserving solutions. The ideal candidate should have over 7 years of experience, expertise in building large-scale data pipelines, and familiarity with cloud technologies like AWS, Spark, and Airflow. Applicants from an AdTech background are highly desirable. This role offers exciting challenges and opportunities for growth in a collaborative environment.