Senior Databricks Lakehouse Engineer - Azure Hybrid Chicago

Bilink Corp

Chicago (IL)

Hybrid

USD 110,000 - 160,000

Full time

6 days ago

Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

401(k) with match

Health and dental insurance

Paid time off

Job summary

Bilink Corp in Chicago seeks a Senior Databricks Data Engineer / Lakehouse Architect to design, build, and run a production Databricks lakehouse on Azure, using SAP as a data source.

This hybrid role collaborates with analytics and IT, focusing on governance, security (Unity Catalog), and performance tuning.

You will own architecture end to end, mentor engineers, and ensure data quality and scalable platform capabilities.

Qualifications

7+ years of data engineering experience
4+ years hands-on experience with Databricks on production projects
Azure strongly preferred; AWS or GCP considered
Strong Python and SQL skills with data modeling and warehousing experience
Clear communication with technical and non-technical stakeholders
Must reside in Chicago area and be able to work from River North office 3 days a week
Authorized to work in the US; visa sponsorship considered for exceptional candidates
No corp-to-corp; direct W2 employment with Bilink

Responsibilities

Build ETL/ELT pipelines on Databricks using Spark and PySpark
Implement Delta Lake and medallion architecture
Support incremental loads and CDC using MERGE
Set up governance and security with Unity Catalog
Tune for performance and cost while maintaining data quality

Skills

Databricks

Spark

PySpark

Delta Lake

Unity Catalog

MERGE

Python

SQL

Data modeling

Data warehousing

Communication

Education

Bachelor’s or Master’s in Computer Science or Engineering or related field

Tools

Azure