Databricks Engineer

Apex Systems; Cleveland (OH); On-site; USD 100,000 - 150,000; Full time

Benefits offered by this job

Medical, dental, vision, life, and disability insurance

401K with company match

Employee Assistance Program

Professional development opportunities

Disability insurance

ESPP

Job summary

A leading technology consulting firm is seeking mid-to-senior level engineers for a Databricks implementation in Cleveland, Ohio. The ideal candidate will guide best practices, establish governance, and shape a modern data ecosystem focusing on AI capabilities. Candidates should possess strong SQL/PySpark skills and hands-on experience with Databricks components. An adaptable mindset is essential in this greenfield environment, along with a relevant degree or equivalent professional experience. The company offers comprehensive benefits and professional development opportunities.

Qualifications

• Hands-on experience with Databricks platform components and Unity Catalog governance.
• Experience designing ingestion and transformation pipelines.
• Practical knowledge of catalog structures and permission models.

Responsibilities

• Lead Databricks platform build-out, defining foundational structures.
• Advise on ingestion, modeling, and orchestration patterns.
• Explore and prototype Databricks AI capabilities.
• Collaborate with cross-platform teams to ensure integration.
• Create playbooks and knowledge artifacts.

Skills

Databricks expertise

Strong SQL/PySpark skills

Knowledge of CI/CD and orchestration tools

Adaptability

Education

Bachelor’s degree in Data Science, Statistics, Mathematics, Business Analytics, or equivalent

Job description

Overview

Our client is implementing Databricks from the ground up and seeking mid‑to senior‑level engineers who can guide best practices, platform adoption, and governance. This is a greenfield environment, ideal for consultants who want to shape architecture and standards from day one. You will collaborate with Palantir teams and help establish a modern data ecosystem that includes Unity Catalog and emerging AI capabilities.

Job # 3017540

Job Description

Our client is implementing Databricks from the ground up and seeking mid‑to senior‑level engineers who can guide best practices, platform adoption, and governance. This is a greenfield environment, ideal for consultants who want to shape architecture and standards from day one. You will collaborate with Palantir teams and help establish a modern data ecosystem that includes Unity Catalog and emerging AI capabilities.

What you’ll do

• Lead Databricks platform build‑out. Define and implement foundational structures for catalogs, schemas, and data assets; set up permissions and governance in Unity Catalog.
• Establish best practices. Advise on ingestion, modeling, and orchestration patterns for practical applications in a new Databricks environment.
• Enable AI features. Explore and prototype Databricks AI capabilities (Mosaic AI, AI/BI Genie, DBRX, foundation models) to inform future adoption.
• Collaborate cross‑platform. Work with Palantir engineers and Snowflake teams to ensure seamless integration and governance alignment.
• Document and coach. Create playbooks, standards, and knowledge artifacts to accelerate internal adoption.

Required qualifications

• Databricks expertise: Hands‑on experience with Databricks platform components (Workspaces, Clusters, Jobs, SQL Warehouses) and Unity Catalog governance.
• Data Engineering: Strong SQL/PySpark skills; experience designing ingestion and transformation pipelines; familiarity with CI/CD and orchestration tools.
• Governance: Practical knowledge of catalog structures, asset registration, and permission models; prior involvement in a Unity Catalog implementation is highly preferred.
• Adaptability: Comfort working in a greenfield environment with evolving requirements; ability to set direction amid uncertainty.
• Bachelor’s degree in Data Science, Statistics, Mathematics, Business Analytics, or a related field, or equivalent professional experience.

Certifications

• Databricks certifications (Lakehouse Fundamentals, Data Engineer Associate/Professional) are a strong plus; willingness to obtain certification post‑hire is expected.

Apex Benefits Overview

Apex offers a range of supplemental benefits, including medical, dental, vision, life, disability, and other insurance plans that offer an optional layer of financial protection. We offer an ESPP and a 401K program which allows you to contribute typically within 30 days of starting, with a company match after 12 months of tenure. Apex also offers a HSA, the SupportLinc Employee Assistance Program with up to 8 free counseling sessions, a corporate discount savings program and other discounts. In addition, professional development opportunities include an on‑demand training program, access to certification prep, and a library of technical and leadership courses once you have 6+ months of tenure.

Apex is an equal opportunity employer. We do not discriminate or allow discrimination on the basis of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Apex will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation in using our website for a search or application, please contact our Benefits Department at [email protected] or 804‑523‑8228. (Do not submit resumes or solicit consultants to this email address). UnitedHealthcare creates and publishes the Transparency in Coverage Machine-Readable Files on behalf of Apex Systems.