Senior Data Engineer, AI-Ready Data Platforms

Autodesk; Vancouver; On-site; CAD 120,000 - 176,000; Full time

Job summary

Autodesk Vancouver seeks a Principal Data Engineer to design AI-ready data products powering analytics, ML, and agentic experiences. You’ll drive data structuring, governance and cross-functional leadership across product, engineering, data science and research teams, influencing standards and architecture.

You will partner with AI/ML squads to operationalize feature stores, RAG pipelines, and scalable ETL/ELT workflows, while ensuring data quality and observability for reliable AI decisions.

Qualifications

• 10+ years of experience in data engineering and large-scale production data systems.
• Hands-on with Python, Spark, PySpark, SQL and scripting.
• Experience with LLM ecosystems, embeddings, vector databases and RAG.
• Experience with streaming tech: Kafka, Flink, Spark Streaming.
• Knowledge of analytics engineering and semantic layer tools (dbt, metrics stores).
• Experience with data governance, lineage, and cataloging systems.
• Exposure to product analytics and experimentation frameworks.
• Designing and operating reliable ETL/ELT pipelines across batch/streaming workloads.

Responsibilities

• Architect and implement scale batch and streaming pipelines for large-scale telemetry.
• Collaborate with AI/ML teams to operationalize feature stores and RAG pipelines.
• Ensure data quality, observability and governance for AI-driven decisions.
• Guide build vs. buy decisions for data tooling and platforms.
• Enable analysts with trusted, well-modeled datasets for self-service analytics.
• Translate product questions into measurable data signals.
• Improve instrumentation for high-quality behavioral data.
• Support analytics exploration and cross-functional collaboration.

Skills

Python

Spark

PySpark

SQL

Scripting

LLM ecosystems

Embeddings

Vector databases

Kafka

Flink

Spark Streaming

dbt

Metrics stores

Data governance

Orchestration

Airflow

AWS (EMR, Glue, S3)

Snowflake

Redshift

Iceberg

Hive

Tools

Airflow

dbt

Fivetran

Iceberg

Hive

Snowflake

Redshift

Athena

AWS EMR

Glue

S3

IAM

Lambda

Step Functions

Spark

Kafka

Job description

Autodesk Vancouver seeks a Principal Data Engineer to design AI-ready data products powering analytics, ML, and agentic experiences. You’ll drive data structuring, governance and cross-functional leadership across product, engineering, data science and research teams, influencing standards and architecture.

You will partner with AI/ML squads to operationalize feature stores, RAG pipelines, and scalable ETL/ELT workflows, while ensuring data quality and observability for reliable AI decisions.