Data Engineer - AI-Driven Finance & Databricks Platform

Speedrun Talent Network; San Diego (CA); On-site; USD 130,000 - 170,000; Full time

Benefits offered by this job

Bonus

Benefits

Equity

Job summary

Shield AI seeks a Data Engineer to build the reliable, governed data foundation for Finance's planning and decision support. Working on our Databricks platform, you will own reusable integrations, semantic-layer infrastructure, and production data services that support analytics and AI-enabled applications.

You will apply FinOps practices to manage platform spend, ensure observability, security, and collaborate with analytics engineers and enterprise teams on architecture, data contracts, and

Qualifications

• Hands-on production data engineering experience with SQL and Python or PySpark.
• Experience with cloud data platforms, orchestration, data modeling, and governed serving patterns.
• Ability to design for observability, recoverability, security, and maintainability.
• Proficiency with AI coding assistants and independent validation of generated work.
• Practical experience enabling AI capabilities on enterprise data, ideally in Databricks; adjacent Snowflake Cortex or comparable experience is welcome.
• Strong cross-functional collaboration and production ownership.

Responsibilities

• Build and operate scalable pipelines and integrations connecting enterprise data to Finance products.
• Develop semantic-layer infrastructure and governed data access for analytics, planning, and AI applications.
• Establish end-to-end pipeline observability, data-quality controls, and resilient operations.
• Engineer the services and integrations behind Databricks Genie and other AI-enabled Finance workflows.
• Use AI coding assistants to accelerate development while validating correctness, security, and performance.
• Apply FinOps practices to manage platform spend and optimize cost without compromising service quality.
• Partner with analytics engineers and enterprise teams on architecture, data contracts, and sustainable ownership.

Skills

SQL

Python/PySpark

Cloud data platforms

Observability

AI coding assistants

Tools

Databricks

Snowflake Cortex

Job description

Shield AI seeks a Data Engineer to build the reliable, governed data foundation for Finance's planning and decision support. Working on our Databricks platform, you will own reusable integrations, semantic-layer infrastructure, and production data services that support analytics and AI-enabled applications.

You will apply FinOps practices to manage platform spend, ensure observability, security, and collaborate with analytics engineers and enterprise teams on architecture, data contracts, and