AI Architect (Generative AI & Databricks)

Entrada

Poland

Remote

PLN 420,000 - 640,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Apple MacBook Air M4 15
Referral bonus
Certification support
Industry leadership opportunities
Personal branding opportunities
Expert mentorship

Job summary

Entrada AI is seeking an experienced AI Architect (GenAI & Databricks) to lead the design and implementation of an enterprise GenAI platform for a marquee client. You will architect ingestion pipelines, anti-hallucination architecture, and HITL review cockpit built on Databricks Apps.

You will bridge LLM orchestration with production Lakehouse patterns, enabling high-throughput parsing, strict schema validation, and secure data governance across the project.

Qualifications

  • 7+ years in data engineering, data architecture, or applied ML systems.
  • 4+ years designing on the Databricks Lakehouse Platform (Unity Catalog, Delta Lake, Model Serving).
  • Experience building structured extraction pipelines using Python, PySpark, and guardrail/citation systems.
  • Experience parsing unstructured documents with PyMuPDF, pdfplumber, OpenPyXL, BeautifulSoup4.
  • Hands-on with Streamlit or Dash for interactive data apps; Databricks Apps deployment.
  • Knowledge of Microsoft Graph API, OAuth 2.0, Azure AD, and Databricks Secret Scopes.
  • Excellent communication and client-facing skills.

Responsibilities

  • Design end-to-end GenAI Lakehouse architecture on Databricks.
  • Build secure ingestion pipelines via Microsoft Graph API and PySpark.
  • Develop deterministic extraction workflows with Model Serving and Pydantic.
  • Implement three-layer anti-hallucination verification.
  • Create HITL review app on Databricks Apps (Streamlit/Dash) with HITL workflow.
  • Model pricing staging tables and ERP data feeds via SQL Warehouses and REST APIs.
  • Establish Unity Catalog governance, data lineage, and security practices.
  • Document architecture and mentor client teams.

Skills

Data engineering
Data architecture
Applied ML systems
LLMOps
Python
API integrations
Client communication

Education

Bachelor's degree in Computer Science, AI, Data Engineering, or related field
Master's degree in related field

Tools

Databricks Lakehouse
Unity Catalog
Delta Lake
Databricks Model Serving
PySpark
Python
Streamlit
Dash
BeautifulSoup4
pdfplumber
OpenPyXL
PyMuPDF
Microsoft Graph API

Job description

About Entrada AI

Entrada AI is a specialized consulting partner and a strategic portfolio company of Databricks Ventures. We were recently named the Genie Partner of the Year (2026) for our work deploying Databricks Genie at enterprise scale—bridging the gap between AI ambition and the trusted, governed data required for accurate responses. With over 150 Databricks projects delivered, we unlock self-service analytics for Fortune 500 leaders. Databricks invested in us because of our technical excellence, placing us in the “inner circle” of the ecosystem. For our engineers, this means direct access to product roadmaps, private previews, and the teams building the platform. You will join a team of industry veterans who value clean architecture over quick fixes. We don't just maintain pipelines; we solve complex architectural challenges.

About The Role

Entrada AI, Inc. is seeking an experienced AI Architect (Generative AI & Databricks) to join our growing team of consultants to lead the design and implementation of an enterprise GenAI platform for a marquee client. In this role, you will architect an intelligent ingestion pipeline and an Anti-Hallucination & Zero-Inference Architecture designed to automate the triage, parameter extraction, and staging of incoming customer commercial pricing requests. You will bridge advanced LLM orchestration with production Lakehouse patterns, replacing manual data re-keying with high-throughput unstructured parsing, automated guardrail verification, an interactive Human-in-the-Loop (HITL) review cockpit built on Databricks Apps.

Key Responsibilities
  • Design and oversee the end-to-end GenAI Lakehouse architecture on Databricks, transforming unstructured email threads and complex attachments into fully verified, ERP-ready tabular data.
  • Architect secure, incremental ingestion pipelines via Microsoft Graph API and PySpark parsing engines to process multi-page PDFs, Excel workbooks, and HTML bodies directly into Unity Catalog Volumes and Bronze Delta tables.
  • Lead the development of deterministic extraction workflows on Databricks Model Serving (Claude/GPT), enforcing strict Pydantic schemas to accurately extract commercial attributes without arbitrary prose.
  • Implement a 3-layer anti-hallucination verification engine combining strict schema constraints, mandatory source citations, and PySpark string-assertion to ensure zero hallucinated data reaches production.
  • Architect and deploy an interactive Human-in-the-Loop (HITL) review application natively on Databricks Apps (Streamlit/Dash) featuring side-by-side reconciliation, manual override capabilities, and secure SSO/OBO authentication.
  • Model Gold-layer pricing staging tables and design automated batch feeds for downstream ERP consumption via Databricks SQL Warehouses and REST APIs.
  • Establish best practices for Unity Catalog governance, data lineage, error-quarantine routing, and system security across client engineering teams.
  • Create and maintain comprehensive architectural documentation, data models, and interface specifications while mentoring client teams.
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Data Engineering, or a related field.
  • 7+ years of experience in data engineering, data architecture, or applied machine learning systems.
  • 4+ years of hands‑on experience designing and deploying solutions on the Databricks Lakehouse Platform (Unity Catalog, Delta Lake, Databricks Model Serving, and Databricks SQL).
  • Demonstrated experience as an Applied GenAI / LLMOps Engineer/Architect, specifically building structured extraction pipelines using function calling, Pydantic validation, and custom guardrail/citation-verification systems.
  • Proven track record parsing dirty, semi-structured, and unstructured business documents using Python and PySpark libraries (PyMuPDF, pdfplumber, OpenPyXL, BeautifulSoup4).
  • Hands‑on experience developing and deploying interactive data applications using Streamlit or Dash, with specific experience deploying containerized apps natively inside Databricks Apps.
  • Strong understanding of enterprise identity and API integrations, including Microsoft Graph API, OAuth 2.0 client credential flows, Microsoft Entra ID (Azure AD), and Databricks Secret Scopes.
  • Solid background in data modeling, governance, and auditability inside Unity Catalog (handling Volumes, Delta Tables, ACLs, and row/column‑level security).
  • Experience or working familiarity with downstream enterprise ERP integration patterns.
  • Strong problem‑solving and analytical skills, with the ability to design resilient, production‑ready systems that prevent hallucinated data from touching financial systems of record.
  • Excellent communication, consulting, and client‑facing skills, with the ability to articulate complex GenAI concepts clearly to both technical teams and executive business stakeholders.
The Offer
Cooperation Models
  • Poland: Available via Employment Contract (UoP) or B2B.
  • Romania/ Greece: Available via B2B only.
  • 100% Remote: Full flexibility to work from anywhere in Poland/ Romania / Greece
  • High-End Tech: Apple MacBook Air M4 15\" provided to all engineers.
  • Referral Bonus: Bonus for bringing other top-tier engineers to the team.
  • Professional Growth:
    • Certification Support: Coverage for all Databricks technical certifications.
    • Industry Leadership: Support in reaching the highest tiers of Databricks expertise (such as the Champion program) tailored to your specific career track.
    • Personal Branding: Opportunities to present at global industry conferences and contribute to technical thought leadership.
    • Expert Mentorship: Direct collaboration with Databricks MVPs and core product teams, giving you a front-row seat to the platform's evolution.
Recruitment Process
  • Introductory Call (20 min): Short conversation with our Recruiter to discuss your background and expectations.
  • Technical Interview (60 min): Deep dive into your technical skills with our engineering team.
  • Optional Client Interview: Required only in specific cases.
  • Decision & Offer: We aim to close the process and provide feedback efficiently.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Architect (Generative AI & Databricks)
AI Architect (Generative AI & Databricks)

Dover • Poland

Remote
PLN 240,000 - 360,000
100% Remote
High-End Tech
Referral Bonus
+2
Remote Databricks Data Architect — Scale & Govern Data
Remote Databricks Data Architect — Scale & Govern Data

Entrada AI • Kraków

Remote
PLN 180,000 - 320,000
Remote work
Databricks certification support
Mentorship with Databricks MVPs
+2
Data Architect
Data Architect

Entrada AI • Kraków

Remote
PLN 180,000 - 320,000
Remote work
Databricks certification support
Mentorship with Databricks MVPs
+2
AI Engineer
AI Engineer

Randstad Polska Sp. z oo • Warszawa

Hybrid
PLN 240,000 - 320,000
Senior Technical Recruiter
Senior Technical Recruiter

af • Wrocław

Hybrid
PLN 120,000 - 180,000
Apple MacBook Air M4 15
Bonus for bringing other top-tier is a
Data Engineer (Databricks)
Data Engineer (Databricks)

Addepto • Poland

Hybrid
PLN 80,000 - 100,000
Flexible work arrangements
20 fully paid days off
Medical and sports packages
+1
Senior Technical Recruiter
Senior Technical Recruiter

Entrada • Polska

Remote
PLN 150,000 - 210,000
Data Engineer (GCP, Snowflake, dbt)
Data Engineer (GCP, Snowflake, dbt)

Addepto • Poland

Hybrid
PLN 180,000 - 240,000
Remote work
Career paths
Training & conferences
+1
Data Platform Architect (Azure, AWS)
Data Platform Architect (Azure, AWS)

Grid Dynamics • Województwo mazowieckie

On-site
PLN 300,000 - 520,000
Medical insurance
Sports benefits
Corporate events
+1
Data Software Engineer (Upskilling position for Python Developers)
Data Software Engineer (Upskilling position for Python Developers)

EPAM Systems Inc • Polska

Hybrid
PLN 180,000 - 260,000
Hybrid work model
Remote work within Poland
Work abroad up to 60 days annually
+4
Top locations