Databricks Data Engineer - GenAI Pipelines (Remote)

Primoris Services Corporation; United States; Remote; USD 115,000 - 120,000; Full time

Benefits offered by this job

401k w/employer match

Health/Dental/Vision insurance plans

Paid time off

10 paid holidays

Stock purchase plan

Job summary

Primoris Services Corporation is seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines on the Databricks Lakehouse Platform. The role focuses on producing production-grade ELT workloads and relies on Python, PySpark, and SQL within a medallion architecture.

You will work with global teams, contribute to CI/CD automation, and help evolve the data platform toward GenAI and intelligent orchestration, while ensuring data quality, governance, and clear documentation.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related field.
• 3+ years of hands‑on data engineering experience delivering production workloads.
• Strong experience with Databricks, Python, PySpark, and SQL.
• Experience troubleshooting and debugging Terraform deployments, state management, module configurations, and cloud infrastructure issues.
• Solid understanding of Delta Lake and medallion architecture design principles.
• Experience using Azure DevOps or GitHub for version control and CI/CD automation.
• Proven ability to support or lead offshore engineering teams while maintaining delivery accountability.
• Experience with Azure-based data platforms preferred.
• Databricks certification (Associate Data Engineer or higher) preferred.
• Palantir platform knowledge or experience is a plus.
• Interest in or exposure to GenAI, agent tooling, and modern orchestration or ML workflows.
• Strong written and verbal communication skills.

Responsibilities

• Design, build, and maintain ELT pipelines on Databricks using Python, PySpark, and SQL, following medallion architecture patterns.
• Package, version, and deploy reusable pipeline components using Databricks Asset Bundles (DABs).
• Implement and manage CI/CD workflows across environments using Azure DevOps or GitHub.
• Perform code reviews and provide delivery oversight for offshore data engineering teams, ensuring quality, consistency, and adherence to standards.
• Participate in sprint planning, technical design reviews, and architecture discussions.
• Proactively identify, troubleshoot, and resolve data quality, performance, and reliability issues.
• Evaluate and adopt emerging tools and approaches, including LLMs, GenAI, and agent-based workflows, to modernize and automate data delivery.
• Support data modeling, lineage, and governance practices using Unity Catalog and related tooling.
• Maintain clear technical documentation and communicate effectively with both technical and business stakeholders.

Skills

Python

PySpark

SQL

Databricks

Delta Lake

Azure DevOps

GitHub

Medallion architecture

Terraform

Communication

Education

Bachelor’s degree in Computer Science, Engineering, or related field

Tools

Databricks

Terraform

Azure DevOps

Job description

Primoris Services Corporation is seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines on the Databricks Lakehouse Platform. The role focuses on producing production-grade ELT workloads and relies on Python, PySpark, and SQL within a medallion architecture.

You will work with global teams, contribute to CI/CD automation, and help evolve the data platform toward GenAI and intelligent orchestration, while ensuring data quality, governance, and clear documentation.