Senior Data Engineer - Lakehouse & ML Systems Lead

Raag Solutions LLC.; Cary (NC); On-site; USD 120,000 - 180,000; Full time

Job summary

Raag Solutions LLC is seeking a data engineer to design and deliver scalable data pipelines using Python, Scala, and PySpark. You will work with Databricks Delta Lake, Unity Catalog, and Azure Data Factory to build robust lakehouse solutions in production.

The role emphasizes governance, reproducibility, and performance tuning. You will contribute to data architecture, implement security controls, and participate in IaC and CI/CD practices to ensure reliable, scalable data platforms for

Qualifications

• Expert in Python, Scala, and PySpark for production-grade, modular solutions.
• Strong SQL and data modelling (dimensional/normalised).
• Databricks: Delta Lake, Unity Catalog, Jobs & Workflows.
• Azure data stack: ADLS Gen2, Azure Data Factory, Event Hubs.
• Azure security and governance: Entra ID, RBAC, Key Vault.
• CI/CD and IaC: Azure DevOps, Terraform.
• Clear technical writing and design presentations.

Skills

Python

Scala

PySpark

SQL

Data modelling

Databricks

Azure Data stack

Spark

Delta Lake

Tools

Databricks

Unity Catalog

Jobs & Workflows

Cluster & Pool mgmt

Performance tuning

Model Serving

Job description

Raag Solutions LLC is seeking a data engineer to design and deliver scalable data pipelines using Python, Scala, and PySpark. You will work with Databricks Delta Lake, Unity Catalog, and Azure Data Factory to build robust lakehouse solutions in production.

The role emphasizes governance, reproducibility, and performance tuning. You will contribute to data architecture, implement security controls, and participate in IaC and CI/CD practices to ensure reliable, scalable data platforms for