Databricks Data Engineer (GCP)

Randstad Digital Americas; Phoenix (AZ); On-site; USD 41,000 - 69,000; Part time

Job summary

Randstad Digital Americas in Phoenix, AZ is seeking an experienced Databricks Data Engineer to design and deploy Lakehouse solutions on Google Cloud Platform. You will build batch and real-time data pipelines and implement data governance with Unity Catalog to enable enterprise analytics.

This contract role requires strong PySpark, SQL, and data modeling skills, plus hands-on experience with BigQuery, GCS, Pub/Sub, and Cloud Composer.

Qualifications

• 4+ years of hands-on data engineering experience building enterprise data pipelines with Databricks and PySpark.
• Strong experience with GCP cloud architecture and native services (GCS, BigQuery, Pub/Sub, Cloud Composer).
• Proven capability in data modeling, complex SQL development, and pipeline performance optimization.

Responsibilities

• Design, build, and maintain scalable batch and real-time data pipelines using Databricks, PySpark, and SQL.
• Integrate Databricks with GCP services: GCS, BigQuery, Pub/Sub, and Cloud Composer.
• Implement metadata-driven ingestion, incremental loads, and structured data models.

Skills

Databricks

PySpark

SQL

Scala

Airflow

BigQuery

GCP

DataOps

CI/CD

Data governance

Data modeling

Unity Catalog

Pub/Sub

Education

Bachelor's degree

Tools

Databricks

Unity Catalog

Airflow

Cloud Composer

BigQuery

GCS

Pub/Sub

Cloud Storage

CI/CD

Job description

Job Summary

We are seeking an experienced Databricks Data Engineer to join our high-performing Data & AI practice in Phoenix, AZ. In this role, you will be responsible for designing and deploying enterprise-grade Lakehouse solutions on Google Cloud Platform (GCP). You will build robust batch and real-time data pipelines, optimize ETL/ELT processes, and implement data governance using Unity Catalog to power advanced analytics across the enterprise.

Job Summary

We are seeking an experienced Databricks Data Engineer to join our high-performing Data & AI practice in Phoenix, AZ. In this role, you will be responsible for designing and deploying enterprise-grade Lakehouse solutions on Google Cloud Platform (GCP). You will build robust batch and real-time data pipelines, optimize ETL/ELT processes, and implement data governance using Unity Catalog to power advanced analytics across the enterprise.

location: Phoenix, Arizona

job type: Contract

salary: $40 - 50 per hour

work hours: 8am to 5pm

education: Bachelors

Responsibilities

• Design, build, and maintain scalable batch and real-time data engineering pipelines using Databricks, PySpark, and SQL.
• Integrate Databricks seamlessly with GCP services including Google Cloud Storage (GCS), BigQuery, Pub/Sub, and Cloud Composer.
• Implement metadata-driven ingestion frameworks, incremental load patterns, and structured data models.
• Configure and manage Databricks Unity Catalog to enforce fine-grained access controls, security, and data lineage.
• Implement automated orchestrations using Cloud Composer/Apache Airflow and drive CI/CD DataOps best practices.

Qualifications

4+ years of hands-on data engineering experience building enterprise data pipelines with Databricks and PySpark.Strong experience with GCP cloud architecture and native services (GCS, BigQuery, Pub/Sub, Cloud Composer).Proven capability in data modeling, complex SQL development, and pipeline performance optimization.Practical experience configuring Databricks Unity Catalog, Delta Live Tables, and Auto Loader.Solid understanding of CI/CD deployment and DevOps workflows in cloud data environments.

Preferred Qualifications

Proficiency in Scala for Spark processing.Formal GCP or Databricks certifications (e.g., Databricks Certified Data Engineer Professional, GCP Professional Data Engineer).Experience with automated testing and DataOps frameworks.

Skills

Cloud Composer,Apache Airflow,BigQuery,Cloud Integration,cloud environments,cloud services,Cloud Storage,CI/CD,Lakehouse architecture,data governance,enterprise data governance,lineage tracking,real-time data pipelines,Pipeline Development,Streaming,DataOps,Data Bricks,Databricks,DevOps practices,distributed data,ETL,Google Cloud Platform (GCP),Google Cloud Platform,metadata,PySpark,real-time data,SQL,Scala,integrating,detail-oriented,self-driven,access controls,Access Control,automation,data modeling,data quality,Governance,Pub/Sub,security,deployment practices,workflows

Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact [e-mail].

Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility).

This posting is open for thirty (30) days.