Remote Data Engineer - Databricks on Azure ETL

Apex Systems; Pleasanton (CA); On-site; USD 68,880 - 79,900; Part time

Job summary

Apex Systems is seeking a Data Engineer with Databricks experience for a large healthcare client. This fully remote role in the United States focuses on migrating Oracle PL/SQL ETL processes to Databricks on Microsoft Azure and designing scalable data pipelines.

You will validate data with business users, implement Delta Lake, and participate in CI/CD and production support. 4–6 years of ETL and SQL development are required.

Qualifications

• Bachelor's degree in computer science, information systems, engineering, or related field.
• 4–6 years of ETL, database development, or data engineering.
• 4+ years of advanced SQL development and query optimization.
• 3+ years of Oracle PL/SQL development.
• 3+ years of Databricks data pipelines on Microsoft Azure.

Responsibilities

• Migrate Oracle PL/SQL ETL processes to Databricks data pipelines.
• Design, develop, test, deploy, and maintain scalable data pipelines on Azure Databricks.
• Validate migrated data with business users and subject matter experts.
• Implement incremental data processing with Databricks and Delta Lake.
• Monitor, troubleshoot, and optimize production ETL pipelines.

Skills

Spark SQL

PySpark

Delta Lake

Azure Data Lake Storage

Git

CI/CD

Power BI

Tableau

Python

Machine learning awareness

Education

Bachelor's degree in Computer Science or related field

Tools

Databricks

Azure Data Factory

Git

CI/CD tooling

Job description

Apex Systems is seeking a Data Engineer with Databricks experience for a large healthcare client. This fully remote role in the United States focuses on migrating Oracle PL/SQL ETL processes to Databricks on Microsoft Azure and designing scalable data pipelines.

You will validate data with business users, implement Delta Lake, and participate in CI/CD and production support. 4–6 years of ETL and SQL development are required.