Remote Data Platform Engineer – Big Data Pipelines

United States Digital Space LLC; United States; Remote; USD 110,000 - 165,000; Full time

Job summary

United States Digital Space LLC is seeking a Data Engineer to join the ADE team within Data Science & AI Platform. You will build large, scalable analytics pipelines using Spark, SQL, and modern data technologies, starting from the ground up and avoiding heavy technical debt.

Collaborate with engineers, product managers, and data scientists to shape data architecture for major projects, design data models, and optimize pipelines for reliability and performance across multiple products.

Qualifications

• 5+ years of Spark, Python, Java, C++, or Scala development.
• 5+ years of SQL experience.
• 5+ years of experience with schema design, dimensional data modeling, and medallion architectures.
• Experience with the Databricks platform and data lake architectures for large-scale data processing and analytics.
• BS degree in Computer Science or related technical field involved coding.

Responsibilities

• Define data assets (data model) and SPARK/SQL jobs to populate data models.
• Design data integrations, data quality frameworks and evaluate tools for data lineage.
• Collaborate with business units and engineering teams to develop long-term Data Platform architecture.
• Own data architecture for multiple large-scale projects, evaluating design and cost-benefit tradeoffs.
• Collaborate with engineers, product managers, and data scientists to translate data needs into insights.
• Design, build, and launch data models and visualizations that support multiple use cases across products.
• Optimize pipelines, dashboards, frameworks, and systems for easier development of data artifacts.

Skills

Spark

Python

Java

C++

Scala

SQL

Data modeling

Medallion architectures

Databricks

Data lake

Education

BS degree in Computer Science or related field

Tools

Airflow

Databricks

MonteCarlo

Job description

United States Digital Space LLC is seeking a Data Engineer to join the ADE team within Data Science & AI Platform. You will build large, scalable analytics pipelines using Spark, SQL, and modern data technologies, starting from the ground up and avoiding heavy technical debt.

Collaborate with engineers, product managers, and data scientists to shape data architecture for major projects, design data models, and optimize pipelines for reliability and performance across multiple products.