Azure Data Platform Engineer — Pipelines & Delta Lake

United States Digital Space LLC; United States; Hybrid; USD 90,000 - 130,000; Full time

Benefits offered by this job

Flexible work hours

Hybrid/Remote options

Training & mentoring

Impact on product roadmap

Diversity & inclusion

Job summary

United States Digital Space LLC is seeking a Professional Data Platform Engineer to design and operate robust batch and streaming data pipelines on Azure, Delta Lake, and Databricks. You will implement data governance, quality, and security practices while collaborating with data scientists and product teams to deliver scalable solutions.

The role offers hybrid work options with flexible hours and opportunities for continuous learning, training, and mentoring in a tech-forward environment.

Qualifications

• 2–5 years of experience in data engineering, preferably with Azure Data Services
• Strong SQL and Python skills; experience with Delta Lake, streaming, and data modeling
• Knowledge of CI/CD and DevOps processes, cloud security and governance
• Excellent communication skills and willingness to learn new things
• Very good German and good English skills

Responsibilities

• Plan, develop, and maintain robust batch and streaming pipelines with Azure Data Factory, MS Fabric and Databricks.
• Integrate new Azure features such as mirroring (zero ETL), Delta Live Tables, and Unity Catalog for governance.
• Automate deployments and testing using CI/CD (Azure DevOps or GitHub Actions) and infrastructure as code (Bicep/Terraform).
• Ensure data quality, lineage, and security—using Microsoft Purview and RBAC.
• Collaborate with data scientists, product owners, and customers to translate requirements into scalable data solutions.
• Evaluate new services such as Lakeflow or Microsoft Fabric for productive use.

Skills

SQL

Python

Data modeling

Communication

German language

English language

CI/CD

Cloud governance

Tools

Azure Data Factory

Databricks

MS Fabric

Delta Lake

Unity Catalog

Purview

Azure DevOps

GitHub Actions

Bicep

Terraform

Kafka

Event Hubs

Job description

United States Digital Space LLC is seeking a Professional Data Platform Engineer to design and operate robust batch and streaming data pipelines on Azure, Delta Lake, and Databricks. You will implement data governance, quality, and security practices while collaborating with data scientists and product teams to deliver scalable solutions.

The role offers hybrid work options with flexible hours and opportunities for continuous learning, training, and mentoring in a tech-forward environment.