Senior Databricks Data Engineer – Lakehouse & AI Pipelines

CSS Staffing; Moncks Corner (SC); Hybrid; USD 117,000 - 143,000; Full time

Benefits offered by this job

Comprehensive medical, dental, andvis

Retirement program

Paid time off

Tuition reimbursement and professional

Tuition reimbursement and professional

Job summary

CSS Staffing is seeking a Senior Data Engineer for a hybrid role across South Carolina or North Carolina. You will design scalable ETL/ELT pipelines with Databricks, build Lakehouse solutions, and support AI and analytics initiatives.

You’ll collaborate with data scientists and analytics teams, implement streaming and batch processing, and ensure data quality, governance, and performance across the enterprise.

Qualifications

• 7+ years of enterprise data engineering experience.
• 2+ years of hands-on Databricks experience building and supporting production data pipelines.
• Advanced SQL and Python programming skills.
• Experience cloud-native data solutions in Azure or GCP; AWS also considered.
• Experience developing both streaming and batch processing solutions.
• Strong understanding of dimensional modeling and Lakehouse architecture.

Responsibilities

• Design, develop, and optimize scalable ETL/ELT pipelines using Databricks and cloud tech.
• Build and support Lakehouse solutions with Medallion Architecture, Delta Lake, and Star Schema.
• Develop both streaming and batch data pipelines for analytics.
• Engineer reliable data assets for reporting, analytics, AI, and ML initiatives.
• Partner with data scientists and analytics teams to prepare production-ready datasets and support ML models and API integrations.
• Improve data quality, governance, monitoring, and platform performance.
• Collaborate with business stakeholders, analysts, architects, and software engineers.
• Communicate technical concepts effectively to both technical and non-technical audiences.
• Represent the data organization in cross-functional meetings and initiatives.

Skills

SQL

Python

Cloud data platforms

Streaming & batch processing

Data modeling

ETL/ELT design

Stakeholder communication

Tools

Databricks

Informatica

Azure Data Factory

Delta Lake

Spark

Job description

CSS Staffing is seeking a Senior Data Engineer for a hybrid role across South Carolina or North Carolina. You will design scalable ETL/ELT pipelines with Databricks, build Lakehouse solutions, and support AI and analytics initiatives.

You’ll collaborate with data scientists and analytics teams, implement streaming and batch processing, and ensure data quality, governance, and performance across the enterprise.