Remote Senior AWS Data Engineer: Data Pipelines & Spark

Cyber Sphere LLC; New York (NY); On-site; USD 140,000 - 210,000; Full time

Job summary

CYBER SPHERE LLC in New York City offers a Sr AWS Data Engineer role with remote capabilities. The position focuses on building and optimizing cloud-based data pipelines using AWS services and Iceberg technology.

You will work on large-scale data processing and design resilient data architectures. Ideal candidates have hands-on AWS experience, strong knowledge of Apache Iceberg and Polaris, and a track record of delivering scalable data solutions in a hybrid environment.

Qualifications

• Strong hands-on experience with AWS services including S3, Glue, Spark, Iceberg, IAM and networking.
• Experience designing and implementing cloud-based data pipelines and large-scale data-processing solutions.
• Strong understanding of Apache architecture, Iceberg table maintenance and optimization.
• Experience configuring Apache Polaris and Iceberg with data stored in Amazon S3.

Responsibilities

• Design and implement cloud-based data pipelines on AWS.
• Optimize Iceberg tables and maintain data Lakehouse architectures.

Skills

AWS S3

AWS Glue

Apache Spark

Apache Iceberg

IAM

AWS Networking

Tools

Apache Polaris

Apache Iceberg

Job description

CYBER SPHERE LLC in New York City offers a Sr AWS Data Engineer role with remote capabilities. The position focuses on building and optimizing cloud-based data pipelines using AWS services and Iceberg technology.

You will work on large-scale data processing and design resilient data architectures. Ideal candidates have hands-on AWS experience, strong knowledge of Apache Iceberg and Polaris, and a track record of delivering scalable data solutions in a hybrid environment.