Remote Senior Data Engineer - Databricks & Lakehouse

SFE; United States; Remote; USD 120,000 - 180,000; Part time

Job summary

SFE is seeking a Sr Data Engineer for a remote contract role. You will design and optimize Azure Databricks-based batch pipelines, building bronze/silver/gold data layers and delivering reliable data products for analytics.

The role requires 10+ years of experience with at least 3 years in Databricks development, strong SQL and PySpark skills, and expertise in data governance, CI/CD, and scalable data architectures. Remote work option with enterprise data platforms.

Qualifications

• Strong hands-on experience with Azure Databricks and production-grade batch pipelines.
• Proficient in PySpark/Spark SQL, transformations, window functions, and performance tuning.
• Deep knowledge of Delta Lake, schema evolution, upsert patterns, and data quality controls.

Responsibilities

• Design scalable batch pipelines in Azure Databricks using PySpark and Spark SQL.
• Build bronze, silver, and gold data layers with certified fact/dimension products.
• Implement data quality checks, lineage, and documentation; enable CI/CD deployment.

Skills

Azure Databricks

PySpark

Delta Lake

Medallion Architecture

Data Modeling

Data Quality & Testing

SQL

DevOps

Security/Governance

Azure Data Lake

Job description

SFE is seeking a Sr Data Engineer for a remote contract role. You will design and optimize Azure Databricks-based batch pipelines, building bronze/silver/gold data layers and delivering reliable data products for analytics.

The role requires 10+ years of experience with at least 3 years in Databricks development, strong SQL and PySpark skills, and expertise in data governance, CI/CD, and scalable data architectures. Remote work option with enterprise data platforms.