Remote Data Engineer: Scalable AWS Pipelines

Eliassen Group; Bismarck (ND); Remote; USD 69,000 - 79,000; Part time

Job summary

Eliassen Group is seeking a Data Engineer for a remote contract role. You will design and implement high-performance data pipelines at scale, focusing on ingestion, transformation, and data quality across AWS services.

Responsibilities include ensuring data lineage, building resilient pipelines, and collaborating with teams. Ideal candidates have expert Python and PySpark skills and real-time processing with Kinesis or Kafka.

Qualifications

• Expert-level proficiency in Python and PySpark.
• Deep hands-on experience with AWS Glue and Amazon EMR.
• Proven track record building scalable pipelines for large-scale data, preferably at terabyte scale.
• Experience implementing frameworks for data lineage and data quality.
• Strong experience with S3-based data lakes and relational databases such as RDS, PostgreSQL, or MySQL.
• Experience in Financial Services is a plus.
• Experience with real-time processing using Kinesis or Kafka.
• Familiarity with CI/CD for data pipelines and Infrastructure as Code.

Responsibilities

• Design and implement high-performance data pipelines that handle large volumes of data.
• Ensure data integrity through advanced quality checks and lineage tracking.

Skills

Python

PySpark

Data pipelines

Data quality

Data lineage

Tools

AWS Glue

Amazon EMR

S3

RDS

PostgreSQL

MySQL

Kinesis

Kafka

Job description

Eliassen Group is seeking a Data Engineer for a remote contract role. You will design and implement high-performance data pipelines at scale, focusing on ingestion, transformation, and data quality across AWS services.

Responsibilities include ensuring data lineage, building resilient pipelines, and collaborating with teams. Ideal candidates have expert Python and PySpark skills and real-time processing with Kinesis or Kafka.