Principal Data Engineer - Fraud AI Platform Lead

Appgate, Inc.; New York (NY); On-site; USD 180,000 - 270,000; Full time

Job summary

Appgate, Inc. is looking for a Staff or Principal Data Engineer to manage the data platform and data lake crucial for fraud detection across 360 Fraud Protection. This hands-on role requires collaboration with engineers and data scientists, overseeing data flow and integrity.

Ideal candidates will have extensive experience with large-scale data systems, particularly with tools like Apache Spark and Kubernetes. Compensation ranges from $180 to $270, with a potential 15% bonus.

Qualifications

• Extensive experience building and operating large-scale data platforms.
• Hands-on expertise with Apache Spark and Flink.
• Strong production engineering skills with Kubernetes and CI/CD tooling.

Responsibilities

• Design, build, and operate the data lake and ingestion platform.
• Build low-latency pipelines for data ingestion from multiple sources.
• Establish data quality and observability for the platform.

Skills

Apache Spark

Apache Flink

Kubernetes

CI/CD

Data pipeline best practices

Gen AI and embedding models

Job description

Appgate, Inc. is looking for a Staff or Principal Data Engineer to manage the data platform and data lake crucial for fraud detection across 360 Fraud Protection. This hands-on role requires collaboration with engineers and data scientists, overseeing data flow and integrity.

Ideal candidates will have extensive experience with large-scale data systems, particularly with tools like Apache Spark and Kubernetes. Compensation ranges from $180 to $270, with a potential 15% bonus.