Staff Data Engineer (Databricks specialist)

Opinov8; United States; Remote; USD 150,000 - 210,000; Full time

Benefits offered by this job

Remote work with flexible conditions

Globally distributed team

Continuous learning and development

Job summary

Opinov8 is seeking a remote Lead Data Platform Architect to guide enterprise data platforms across ingestion, storage and serving. You will shape master data governance, create AI-enabled workflows, and establish scalable data services for analytics teams.

The role emphasizes leadership across teams and cloud-based design. The ideal candidate has deep experience in data engineering, MDM, data governance, and ML infrastructure, with strong mentorship and collaboration with product leaders.

Qualifications

• Experience leading cross-team data engineering initiatives.
• Expertise building and operating cloud-based data platforms.
• Strong mastery of enterprise master data management and data governance.
• Experience with AI/ML data infrastructure and language-model workflows.
• Proficient software engineering for data services and APIs.
• Ability to mentor engineers and align with product leadership.

Responsibilities

• Design cloud-based data platforms and scalable pipelines across ingestion, transformation, storage and serving.
• Lead master data management, including entity resolution and stewardship.
• Integrate AI workflows such as retrieval-augmented generation into data systems.
• Build foundations for ML, feature stores, embeddings, and model ops pipelines.
• Create data services and APIs for applications and analytics teams.
• Set data quality, testing, observability, governance and deployment practices; review designs and mentor engineers.

Skills

Data engineering leadership

Distributed data platforms

Master data management

Data governance

AI/ML data infrastructure

APIs and data services

Mentoring engineers

Job description

Role overview

Lead the architecture and delivery of enterprise data platforms for a global commercial property business. The role spans data pipelines, master data management, governance, machine learning foundations and AI-enabled workflows, with responsibility for guiding technical direction across teams.

Responsibilities

• Design cloud-based data platforms and scalable pipelines across ingestion, transformation, storage and serving.
• Lead master data management, including entity resolution, trusted records, reference data and stewardship.
• Integrate AI and language-model workflows, such as retrieval-augmented generation and autonomous agents, into data systems.
• Build foundations for ML and AI, including feature and vector stores, embeddings, and model operations pipelines.
• Create data services and APIs that make curated information available to applications, analytics and reporting teams.
• Set practices for data quality, testing, observability, governance and deployment; review designs, resolve systemic issues and mentor engineers.

Requirements

• Experience leading complex, cross-team data engineering initiatives and shaping platform architecture.
• Ability to build and operate distributed data platforms in a major cloud environment.
• Expertise in enterprise master data management and data governance.
• Experience with AI or ML data infrastructure, including language-model workflows.
• Strong software engineering skills for data services, APIs and production systems.
• Ability to guide engineering standards, collaborate with product and technical leaders, and mentor other engineers.

Nice to have

• Experience in commercial real estate, fintech, or operational and transaction systems.
• Public technical writing, speaking or open-source contributions, particularly in data or applied AI.

Benefits and work setup

• Remote work with flexible working conditions and a globally distributed team.
• Continuous learning and development opportunities.