Staff / Principal Data Engineer (Databricks Architect)

The Judge Group; Chicago (IL); Hybrid; USD 150,000 - 230,000; Full time

Benefits offered by this job

Equity

Wellness stipends

Mental health support

Flexible time off

Catered team events

Job summary

The Judge Group is seeking a Staff/Principal Data Engineer to shape a next-gen data platform, setting the technical roadmap, best-practice lakehouse patterns, and guiding a high-performing team. You will own enterprise data architecture, drive modern data stack decisions, and mentor engineers in a fast-paced environment.

Ideal candidates combine hands-on Databricks expertise with strategic leadership, strong cloud know-how, and a passion for scalable, reliable data systems across multiple

Qualifications

• Deep distributed data systems experience with cloud lakehouse patterns.
• Strong Python and SQL development skills.
• Experience with Databricks and Azure PaaS.
• Proven leadership in engineering teams and Agile practices.

Responsibilities

• Architect and scale enterprise data platforms in the cloud.
• Define SDLC, CI/CD, and Agile standards.
• Lead and mentor the engineering team.
• Collaborate with Product and executives to align roadmaps.

Skills

Databricks

Medallion Lakehouse

Distributed systems

Leadership

Python

SQL

Azure ecosystem

CI/CD

Mentorship

YBIYRI

Tools

Databricks

Azure

Job description

To maintain strong team cohesion and operational continuity, candidates must be based in the Greater Chicago Area and commit to a hybrid schedule (2-3 days/week on-site). All applicants must possess unrestricted work authorization in the United States.

Shape Next-Gen Data Infrastructure

Imagine architecting the foundational data platform that powers a high-growth, technology-driven enterprise. As a Staff / Principal Data Engineer for our client, you won’t just write code—you’ll define the overall technical roadmap, establish modern Medallion Lakehouse standards, and mentor an elite team of engineers in a fast-paced environment. If you are a visionary Databricks architect who thrives at the intersection of hands‑on technical excellence, agile execution, and team mentorship, your next career defining role starts here.

At-a-Glance Snapshot

• Location: Flexible Hybrid Model (10+ days/month in‑office for \"moments that matter\")


• Compensation & Equity: Top-tier competitive salary + performance bonuses + company equity package


• Culture: High-autonomy startup energy with the backing of experienced industry leadership

Why Join Our Client?

Our client combines the agility and speed of a high-growth startup with the stability of a deeply experienced executive team. You will be entering an environment that heavily invests in engineering culture, professional growth, and modern technology choices.

• High-Impact Leadership: Direct ownership over the platform architecture, tech stack selection, and engineering excellence across the organization.


• Modern Databricks Stack: Deep dive into distributed systems, Medallion Lakehouse patterns, and multi-cloud streaming/batch automation.


• Premier Benefits & Equity: Enjoy industry-leading total rewards including equity, generous wellness stipends, mental health support, flexible time off, and catered team events.

Your Impact (The \"Power\" Bullets)

In this principal-level technical leadership role, you will:

• Architect Enterprise Data Platforms: Design, build, and scale a resilient cloud lakehouse platform serving all core portfolio applications.


• Elevate Engineering Standards: Establish best-in-class SDLC, CI/CD, and Agile practices while driving a true \"You Build It, You Run It\" (YBIYRI) operational culture.


• Master Medallion & ETL Automation: Lead the evolution of automated data pipelines, data movement, and semantic layers across Databricks and Azure PaaS.


• Coach & Scale Engineers: Act as a primary technical mentor, conducting code reviews, technical design evaluations, and skill development for team members.


• Bridge Business & Tech: Partner directly with Product Managers, Solution Leads, and executive stakeholders to translate business goals into scalable technical roadmaps.

What You Bring

We are seeking an established technical authority with deep distributed systems knowledge and a passions for people development.

• Architectural Expertise: Proven track record designing and maintaining complex distributed data systems, specifically utilizing Databricks and Medallion Lakehouse architectures.


• Technical Stack: Advanced proficiency in Python, SQL, and experience across Microsoft or Azure ecosystems (Azure PaaS, C#/.NET, SQL Server, PostgreSQL).


• Leadership Acumen: Demonstrated capability leading engineering teams, guiding technical direction, and driving Agile methodologies.


• Hands-on Mindset: Willingness to balance high-level architectural strategy with deep‑dive code reviews and technical execution.


• Bonus Exposure: Experience with AWS Data Services, Databricks Unity Catalog, Qlik, Zoho Analytics, SSRS, or Izenda is a plus.

Ready to Drive Technical Direction?