Senior Data Pipeline & API Engineer

Autodesk, Inc.; Montreal (administrative region); On-site; CAD 107,000 - 157,000; Full time

Job summary

Autodesk, Inc. is seeking a Sr. Software Developer for the Reporting Team to build scalable ETL pipelines and RESTful APIs. You will collaborate with product managers, infrastructure, and QA to ensure data is accessible, reliable, and well structured for reporting.

The role requires strong experience with big data technologies, cloud platforms, and a focus on data quality, security, and performance across data pipelines and services.

Qualifications

• 7+ years of software development experience in multiple capacities.
• 2+ years in big data technologies (Airflow, EMR/Spark, Snowflake, Hadoop/Hive).
• Experience with data streaming (Kinesis/Kafka).
• Proficiency in Python and Java/Scala.
• Experience building RESTful APIs and microservices.
• Experience with relational databases (MySQL, PostgreSQL).
• Background on cloud technologies (AWS, S3/EBS, Lambda, EKS, CloudWatch).
• Familiarity with observability platforms (Splunk, Datadog).
• Knowledge of design patterns and methodologies across multiple platforms.
• Knowledge of Agile and Open-Source development practices.
• Excellent debugging skills.

Responsibilities

• Data Pipeline Development: develop data pipelines to extract, transform, and load (ETL) data from multiple sources into a centralized data repository. Improve and refine data pipelines for efficiency, reliability, and scalability.
• API Development: develop RESTful APIs & microservices to support multiple operations. Follow best practices for security, scaling, cost effectiveness and testing. Create unit and integration tests.
• Problem Solving: resolve technical issues and bugs in applications. Identify performance bottlenecks and improve code and databases.
• Team Collaboration: collaborate with engineers, analysts, cross-functional teams and partners to understand data requirements and deliver relevant insights.
• Performance Optimization: improve data processing and query performance for data retrieval and analytics.
• Code Review and Documentation: perform code review and provide constructive feedback within ethical boundaries.
• Test and Quality Assurance: stay up to date with the latest data engineering technologies, and best practices. Recommend new technologies for data engineering improvements.
• Security and Compliance: ensure data security by implementing access controls, encryption, and comply with data privacy regulations.

Skills

Python

Java/Scala

RESTful APIs

Microservices

Data streaming

Debugging

Design patterns

Agile methodologies

Open-source practices

Education

Bachelor's degree in Computer Science or equivalent

AWS Certified Developer - Associate

Tools

Airflow

EMR/Spark

Snowflake

Hadoop/Hive

Kinesis/Kafka

MySQL

PostgreSQL

AWS

S3/EBS

Lambda

EKS

CloudWatch

Splunk

Datadog

Job description

Autodesk, Inc. is seeking a Sr. Software Developer for the Reporting Team to build scalable ETL pipelines and RESTful APIs. You will collaborate with product managers, infrastructure, and QA to ensure data is accessible, reliable, and well structured for reporting.

The role requires strong experience with big data technologies, cloud platforms, and a focus on data quality, security, and performance across data pipelines and services.