Senior AWS Data Platform Engineer: Production Pipelines

United States Digital Space LLC; United States; Remote; USD 140,000 - 190,000; Full time

Job summary

United States Digital Space LLC is seeking a senior Data Platform Engineer to consolidate and migrate customer data infrastructure on AWS. You will own target architecture, data models, and pipeline design, delivering production systems on tight schedules.

You will build with PySpark/SQL on EMR or Glue, model for Redshift/Snowflake/Athena/Presto, and orchestrate with Airflow, reaching production rather than dashboards.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or related field.
• 3+ years of experience working with PySpark and SQL.
• 2+ years of experience building and maintaining data pipelines using Amazon EMR or Amazon Glue.
• 2+ years of experience with data modeling and end-user querying using Amazon Redshift or Snowflake, Amazon Athena, and Presto.
• 1+ years of experience building and maintaining pipeline orchestration using Airflow.
• Strong problem-solving and troubleshooting skills.
• Excellent communication and collaboration skills.
• Ability to work independently and within a team environment.

Responsibilities

• Build and maintain data pipelines on Amazon EMR or Amazon Glue that run in production.
• Design data models and end-user querying on Amazon Redshift or Snowflake, Amazon Athena, and Presto.
• Build and maintain pipeline orchestration with Airflow.
• Work with customer and internal teams to understand data needs and design the solutions that meet them.
• Troubleshoot and optimize pipelines and data models until they hold up under real load.
• Write and maintain PySpark and SQL scripts to extract, transform, and load data.
• Document and communicate technical decisions to technical and non-technical audiences — customers sign off on what we ship.
• Track new AWS data technologies and judge their impact on the systems we run.

Skills

PySpark

SQL

Airflow

Data modeling

Amazon EMR

Amazon Glue

Redshift

Snowflake

Athena

Presto

Education

Bachelor's degree in Computer Science or related field

Job description

United States Digital Space LLC is seeking a senior Data Platform Engineer to consolidate and migrate customer data infrastructure on AWS. You will own target architecture, data models, and pipeline design, delivering production systems on tight schedules.

You will build with PySpark/SQL on EMR or Glue, model for Redshift/Snowflake/Athena/Presto, and orchestrate with Airflow, reaching production rather than dashboards.