Data Engineer, AI-Driven Finance Platform (Equity)

Minority Professional Network, Inc.; San Diego (CA); On-site; USD 97,000 - 140,000; Full time

Benefits offered by this job

Bonus

Equity

Benefits

Job summary

Shield AI seeks a Data Engineer to build a governed data foundation for Finance's analytics and AI-enabled apps. You will work on the Databricks platform to create reusable data integrations, semantic-layer infrastructure, and production data services.

The role blends engineering rigor with AI-assisted development to improve delivery speed, reliability, and cost efficiency. You will own end-to-end pipelines, observability, data quality, and security, partnering with analytics engineers and

Qualifications

• Production data engineering experience with SQL and Python or PySpark.
• Experience with cloud data platforms, orchestration, data modeling, and governed serving patterns.
• Design for observability, recoverability, security, and maintainability.
• Proficiency with AI coding assistants and independent validation of generated work.
• Experience enabling AI capabilities on enterprise data, ideally in Databricks; Snowflake Cortex or similar welcomed.
• Strong cross-functional collaboration and production ownership.

Responsibilities

• Build and operate scalable pipelines and integrations connecting enterprise data to Finance products.
• Develop semantic-layer infrastructure and governed data access for analytics and AI applications.
• Establish end-to-end pipeline observability and data-quality controls.
• Engineer services behind Databricks Genie and other AI-enabled Finance workflows.
• Use AI coding assistants to accelerate development while ensuring correctness and security.
• Apply FinOps to manage platform spend and optimize cost without compromising quality.
• Partner with analytics engineers and enterprise teams on architecture and data contracts.

Skills

SQL

Python / PySpark

Data engineering

Cross-functional collaboration

Observability & security

Tools

Databricks

Delta Lake

Snowflake Cortex

Job description

Shield AI seeks a Data Engineer to build a governed data foundation for Finance's analytics and AI-enabled apps. You will work on the Databricks platform to create reusable data integrations, semantic-layer infrastructure, and production data services.

The role blends engineering rigor with AI-assisted development to improve delivery speed, reliability, and cost efficiency. You will own end-to-end pipelines, observability, data quality, and security, partnering with analytics engineers and