Tech Lead Databricks Data Engineer

Mitre Media; United States; Remote; USD 150,000 - 185,000; Full time

Job summary

A leading FinTech firm is seeking a Tech Lead Data Engineer to design and maintain the data infrastructure essential for delivering insights to millions of investors. The ideal candidate will have expertise in Python, SQL, and Databricks, along with the ability to enhance ETL processes. This role offers flexibility to work remotely within ±3 hours of Eastern Time and comes with a competitive salary range of $150k – $185k CAD/USD along with benefits.

Benefits

Competitive Compensation

Remote Flexibility

Growth Opportunities

Qualifications

• Expert in Python programming, with knowledge of Scala or Java.
• Hands-on experience in Databricks for building and optimizing ETL workflows.
• Strong analytical SQL skills for data transformation and model design.

Responsibilities

• Design and implement large-scale ETL workflows in Databricks.
• Own data quality and implement monitoring for critical data pipelines.
• Collaborate in a hybrid culture and contribute to team mentorship.

Skills

Expert in Python

Working knowledge of Scala or Java

Strong analytical SQL

Production experience on AWS or GCP data services

Solid grasp of EL(T) patterns

Dimensional and schema-on-read designs

Tools

Databricks

Apache Spark

SQL

DBT

Job description

About Mitre Media

Mitre Media is redefining FinTech with AI-driven tools that empower millions of investors. Our portfolio, including Dividend.com and MutualFunds.com, leverages LLMs to deliver novel data insights and visually rich user experiences. For over a decade, we’ve served individual investors, financial advisors, and top asset managers like BlackRock and Vanguard through our premium data, tools, and advertising solutions. If you’re excited by the intersection of big data, AI, and investing, join our lean, entrepreneurial team from anywhere within ±3 hours of Eastern Time.

About the Role

As Tech Lead Data Engineer, you’ll architect and maintain the data backbone powering every feature across our product suite. Reporting to the CTO, you will design Databricks-based ETL pipelines, model complex investment data, and surface low-latency, high-quality datasets for both user-facing features and internal AI/analytics workloads. You’ll collaborate in a remote-first hybrid culture that values in-person “bursts” of collaboration, follow ShapeUp for project planning, and ship pragmatic solutions that favor de-scoping over delays.

Responsibilities

• Design, implement, and optimize large-scale ETL workflows in Databricks (Apache Spark, Delta Lake, DBT).
• Develop algorithms that transform raw market data into actionable insights.
• Own data quality and lineage, instituting tests, monitoring, and alerting for mission-critical pipelines.
• Evolve our cloud data platform (AWS & GCP) for scale, performance, and cost efficiency.
• Mentor engineers, championing best practices in code reviews, documentation, and DevOps for data.

Required Technical Skills

• Programming: Expert in Python plus working knowledge of Scala or Java.
• Databricks & Spark: Hands-on with cluster tuning, job orchestration, and Delta Tables.
• SQL & DBT: Strong analytical SQL, modular data-model design, and CI/CD for transformations.
• Cloud: Production experience on AWS or GCP data services (e.g., S3/GCS, EMR/Dataproc, Glue/Dataflow).
• ETL & Orchestration: Solid grasp of EL(T) patterns, workflow scheduling, and incremental processing.
• Data Modeling: Dimensional and schema-on-read designs for analytics and AI.

AI & Analytics Enablement

• Building feature stores or inference-ready tables for ML/LLM workflows.
• Familiarity with vector databases or embedding pipelines.

Nice-to-Have Technical Skills

• Apache Airflow, Luigi, or Dagster for DAG orchestration.
• Experience with Looker, Tableau, or Stripe’s Vizier-style visualization stacks.
• Financial-markets domain knowledge (equities, ETFs, mutual funds).
• Machine-learning engineering or statistical-analysis background.

Required Soft Skills

• Entrepreneurial mindset with a passion for AI and FinTech innovation.
• Self-starter who diagnoses problems, proposes trade-offs, and delivers.
• Clear communicator who thrives in distributed, cross-functional teams.
• Mentorship attitude—uplifts peers through code reviews and knowledge-sharing.
• Detail-oriented and disciplined about data accuracy and documentation.

Why Join Us?

• Impactful Work – Your pipelines feed every insight we deliver to millions of investors.
• Cutting-Edge Tech – Databricks, Delta Lake, LLMs, Hotwire, and xAI’s API, all in a modern microservices stack.
• Autonomy & Influence – Work directly with the CEO & CTO to shape our data and AI strategy.
• Competitive Compensation – $150k – $185k CAD/USD plus benefits and performance bonuses.
• Remote Flexibility – Remote-first within ±3 hrs ET; optional collaboration hubs in Toronto and NYC.
• Growth Opportunities – Budget for conferences (e.g., Data+AI Summit, NeurIPS) and continuous learning.

About Mitre Media’s AI-Driven Platform

Mitre Media powers premium financial brands like Dividend.com and MutualFunds.com with the Mitre Platform. This platform integrates traditional content management, financial data, first-party data, ad revenue, and subscription tools, all enhanced by LLMs for rich, user-focused experiences. Our data-derived insights delight users, while our advertising solutions deliver unmatched performance for partners like BlackRock and Vanguard, leveraging advanced targeting and first-party data.

How to Apply

Submit your resume, GitHub profile, and a brief note on why you’re excited about building AI-driven FinTech to [e-mail].