Senior Data Engineer: PySpark/Databricks, Hybrid Houston

RJC Group; Houston (TX); Hybrid; USD 150,000 - 190,000; Full time

Job summary

RJC Group in Houston is seeking a hands-on Senior Data Engineer to build and optimize production data pipelines using PySpark and Databricks. You should have 7+ years of data engineering experience, with 3+ years in PySpark/Databricks, and strong Python, ETL/ELT and CI/CD capabilities.

This role is hybrid in Houston with 3 days onsite. You will troubleshoot production pipelines and drive Spark performance optimisations within a structured enterprise data platform team.

Qualifications

• 7+ years of data engineering experience.
• 3+ years of strong PySpark and Databricks experience.
• Production pipeline troubleshooting and Spark performance optimisation.
• Strong Python, ETL/ELT and CI/CD experience.
• AWS or Azure cloud experience.
• Experience working in a structured enterprise data platform team.

Responsibilities

• Build and optimise production data pipelines using PySpark and Databricks.
• Debug and improve Spark performance across pipelines.
• Collaborate with the enterprise data platform team to ensure reliability and scalability.
• Implement CI/CD processes for data engineering workflows.

Skills

PySpark

Databricks

Python

ETL/ELT

CI/CD

AWS/Azure

Tools

Databricks

Spark

CI/CD tooling

AWS

Azure

Job description

RJC Group in Houston is seeking a hands-on Senior Data Engineer to build and optimize production data pipelines using PySpark and Databricks. You should have 7+ years of data engineering experience, with 3+ years in PySpark/Databricks, and strong Python, ETL/ELT and CI/CD capabilities.

This role is hybrid in Houston with 3 days onsite. You will troubleshoot production pipelines and drive Spark performance optimisations within a structured enterprise data platform team.