Senior Data Engineer

MARGO

United States

Remote

USD 110,000 - 170,000

Full time

10 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

MARGO is seeking a Senior Data Engineer to evolve our Azure-based Data Platform and Lakehouse architecture. You will build pipelines in Azure Data Factory, create DAGs in Airflow, and transform business needs into reliable Data Products in Databricks.

You will work with POs and architects to refine requirements, optimize performance, and ensure operational readiness of data solutions in a fast-paced environment.

Qualifications

  • Build scalable data pipelines using Azure Data Factory and Airflow.
  • Develop data transformations in Azure Databricks (PySpark/SQL) to create business-ready data products.
  • Optimize performance, cost, and reliability of data workloads.

Responsibilities

  • Implement scalable and reusable data pipelines with ADF and Airflow.
  • Develop and refine data products following medallion-style architecture.
  • Collaborate with architects and product owners on data maturity and requirements.
  • Provide run and operations support for production data pipelines.

Skills

Data product development
Stakeholder collaboration
Problem solving

Tools

Azure Data Factory
Apache Airflow
Azure Databricks
PySpark/SQL

Job description

We are looking for a Senior Data Engineer to help drive the evolution of our Azure-based Data Platform and Lakehouse architecture. This role is focused on Data Products development. The successful candidate will build pipelines in ADF, DAGs in Airflow and work closely with POs to refine business requirements and transform business needs into reliable Data Products in Databricks.

Key Responsibilites
  • Implement scalable, reliable and reusable data pipelines using Azure Data Factory and Apache Airflow.
  • Develop data transformations in Azure Databricks (PySpark / SQL) to create/extend data products following the Medallion Architecture layers: Bronze (raw ingestion) Silver (cleansed & conformed) Gold (business-ready data products).
  • Optimize performance, cost, and reliability of data workloads.
  • Raise important questions during business maturation in order to detect risks before development stage.
Technical Leadership
  • Participate in architecture reviews and technical decision-making.
  • Promote engineering excellence through code reviews and design reviews.
  • Collaborate with Architects, Product Owners in data product technical maturation.
Support & Operations (Run Team Collaboration)
  • Provide support to the Run/Operations team for production pipelines and data products for complex topics.
  • Troubleshoot and resolve data incidents, failures, and performance issues
  • Participate in incident management, root cause analysis, and post-mortems.
  • Ensure proper handover, documentation, and operational readiness of developed solutions.
  • Contribute to improving runbooks, monitoring, and operational processes.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer - CR 12/11/26
Senior Data Engineer - CR 12/11/26

Margo Group • United States

Remote
USD 120,000 - 170,000
Senior Data Platform Engineer CR 12/11/26
Senior Data Platform Engineer CR 12/11/26

Margo Group • United States

Remote
USD 150,000 - 210,000
Senior Data Software Engineer with Azure Databricks
Senior Data Software Engineer with Azure Databricks

EPAM Systems • United States

Remote
USD 140,000 - 170,000
Senior Data Engineer
Senior Data Engineer

9nexus • United States

Remote
USD 120,000 - 190,000
Azure Data Engineer
Azure Data Engineer

Envision • Indianapolis (IN)

On-site
USD 140,000 - 190,000
Senior Azure Data Engineer
Senior Azure Data Engineer

xebiacee • United States

Remote
USD 140,000 - 180,000
Senior Data Engineer
Senior Data Engineer

Topcoder • California

On-site
USD 120,000 - 170,000
Senior Databricks & Azure Data Platform Engineer
Senior Databricks & Azure Data Platform Engineer

Kestra Financial, Inc. • Tempe (AZ)

On-site
USD 120,000 - 160,000
Competitive pay and benefits
401(k)
Health insurance
+1
Senior Databricks & Azure Data Platform Engineer
Senior Databricks & Azure Data Platform Engineer

Kestra Holdings • Tempe (AZ)

On-site
USD 120,000 - 150,000
Competitive pay and benefits
401(k) and health insurance
Opportunities for training and development
Senior Data Engineer, Azure Databricks
Senior Data Engineer, Azure Databricks

Nextech Solutions • United States

Remote
USD 130,000 - 170,000