Databricks Data Engineer: AI‑Ready Lakehouse Pipelines

Recru, LLC.; Sugar Land (TX); On-site; USD 120,000 - 150,000; Full time

Job summary

Recru, LLC. is seeking a data engineer to design, build, and support data pipelines in a Databricks lakehouse. You will govern data, create AI-ready datasets, and collaborate with business users to build semantic models, dashboards, and reports.

The role requires 5+ years in data engineering and strong Python/PySpark skills, with experience in data quality, governance, and lakehouse architectures. On-site in Sugar Land, TX, with collaboration across teams.

Qualifications

• Minimum 5 years IT/technology experience spanning data analysis, data engineering, and/or data integration.
• At least 3 years writing SQL/NoSQL queries with MS SQL Server, Oracle, and/or Postgres.
• Hands-on experience with modern cloud data platforms/lake houses (Databricks, Microsoft Fabric, Snowflake, or comparable).
• Experience landing data from diverse sources into a lake/lake house and curating it through a medallion architecture.
• Strong Python skills for data engineering, including PySpark.
• Knowledge of data quality, governance, and monitoring practices across pipelines.
• Experience designing simple data models for integrations, analytics, and reporting.

Responsibilities

• Land data from source systems into the Databricks lake house and curate via medallion architecture into analytics-ready datasets.
• Produce and maintain AI-ready data products as foundation for AI/ML initiatives.
• Implement data quality, governance, and monitoring controls across pipelines.
• Develop and maintain reporting and analytics solutions—semantic models, dashboards, and reports.
• Gather requirements and design new data integrations or enhancements to existing code.
• Partner with business users on requirements gathering, testing, and supporting integrations, analytics, and reporting.
• Create and maintain documentation and process flows for integration solutions.

Skills

SQL/NoSQL

Python

PySpark

Databricks

Medallion architecture

Data governance

REST/Web APIs

Education

Bachelor's degree in Information Systems / IT

Tools

Databricks

SQL Server

PostgreSQL

Job description

Recru, LLC. is seeking a data engineer to design, build, and support data pipelines in a Databricks lakehouse. You will govern data, create AI-ready datasets, and collaborate with business users to build semantic models, dashboards, and reports.

The role requires 5+ years in data engineering and strong Python/PySpark skills, with experience in data quality, governance, and lakehouse architectures. On-site in Sugar Land, TX, with collaboration across teams.