Databricks Engineer

Randstad USA; Dallas (TX); Remote; USD 67,000 - 69,000; Part time

Job summary

Randstad Digital is seeking an experienced Databricks Data Engineer to join its AI & Data team supporting Health & Life Sciences initiatives. This remote contract role will design, build, and optimize scalable ETL/ELT pipelines and curated data products across large-volume datasets.

Location: Telecommute • Salary: $48.66–$50.00 per hour • Work hours: 8am–5pm • Education: Bachelors. Previous experience with Databricks, PySpark, SQL, Delta Lake, and cloud platforms is required.

Qualifications

• Minimum Bachelors of Engineering Degree.
• 5+ years of experience with Databricks, PySpark, SQL, Delta Lake, ETL/ELT, and large-scale data processing.
• 5+ years of experience with Unity Catalog, Azure/AWS, ADF, Databricks Workflows, CI/CD, and Performance Optimization.
• 4 - 6 years of overall Data Engineering experience.
• Must be located in the United States (Remote).

Responsibilities

• Design, build and maintain scalable ETL/ELT pipelines using Databricks, PySpark and SQL.
• Develop data ingestion and transformation frameworks supporting large-volume structured and semi-structured datasets.
• Implement Delta Lake patterns, data-quality validations, exception handling and reconciliation processes.
• Optimize Spark workloads and SQL queries for performance and cost efficiency.
• Collaborate with analysts, architects and source-system teams to deliver reliable curated data products.

Skills

Databricks

PySpark

SQL

Delta Lake

ETL/ELT

Unity Catalog

Azure

AWS

ADF

CI/CD

Databricks Workflows

Performance Optimization

Spark

Data Ingestion

Cost Optimization

Education

Bachelor's degree

Tools

Databricks

Delta Lake

Azure

AWS

ADF

CI/CD

Job description

Job Summary

We are seeking an experienced Databricks Data Engineer to join our AI & Data team supporting Health & Life Sciences initiatives. In this remote role, you will design, build, and optimize scalable ETL/ELT pipelines and curated data products across large-volume structured and semi-structured datasets.
Location: Telecommute
Job type: Contract
Salary: $48.66 - 50.00 per hour
Work hours: 8am to 5pm
Education: Bachelors

Responsibilities

• Design, build and maintain scalable ETL/ELT pipelines using Databricks, PySpark and SQL.
• Develop data ingestion and transformation frameworks supporting large-volume structured and semi-structured datasets.
• Implement Delta Lake patterns, data-quality validations, exception handling and reconciliation processes.
• Optimize Spark workloads and SQL queries for performance and cost efficiency.
• Collaborate with analysts, architects and source-system teams to deliver reliable curated data products.

Qualifications

Required Qualifications

• Minimum Bachelors of Engineering Degree.
• 5+ years of experience with Databricks, PySpark, SQL, Delta Lake, ETL/ELT, and large-scale data processing.
• 5+ years of experience with Unity Catalog, Azure/AWS, ADF, Databricks Workflows, CI/CD, and Performance Optimization.
• 4 - 6 years of overall Data Engineering experience.
• Must be located in the United States (Remote).

Preferred Qualifications

• Prior industry experience working on Health Payer projects.

Skills

• AWS
• Spark
• AI
• large-scale data processing
• CI/CD
• data ingestion
• Delta Lake
• ELT pipelines
• Databricks
• ETL
• Data Engineering
• Azure
• Performance Optimization
• PySpark
• SQL
• SQL queries
• reconciliation processes
• data products
• Managed Services
• exception handling
• cost efficiency
• Workflows

Equal Opportunity Employer

Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

Accommodation

At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact [e-mail].

Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including:

• medical
• prescription
• dental
• vision
• AD&D
• life insurance offerings
• short-term disability
• 401K plan

(all benefits are based on eligibility)

Posting Duration

This posting is open for thirty (30) days.

Legal Information

It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.