Senior Software Developer, Big Data

Job Requisition ID #

Position Overview

Autodesk is seeking a Senior Software Developer with experience building software solutions in support of data platforms to join the Enterprise Data Engineering & Visualization (EDEV) team. Our team is chartered with building data solutions that enable our users to seamlessly interact with the Autodesk data platform to enable ML and analytic use cases that unlock business insights. These solutions serve as the building blocks for all data engineers, data scientists, and data analysts throughout the organization. In addition, this team establishes and promotes data engineering best practices across Autodesk, leading efforts to make data an integral part of decision-making.

This role collaborates with Product Managers, Program/Project Managers, Architects, Operations, and the Engineering Team to ensure data solutions leverage modern, scalable, and reliable methods. Communication skills are critical, and you must be comfortable distilling complex technical information to both non-technical audiences and technical leaders.

You will report to the Senior Software Development Manager based in the US. This role is based in Toronto, in a hybrid mode. Autodesk supports the FLEX working model.

Responsibilities

1. Design, architect, and implement secure and scalable data solutions enabling data scientists and analysts.
2. Develop Micro-front ends and APIs that interact with each other to provide automation of complex processes.
3. Leverage programming languages for data manipulation, including SQL, Python, Spark, PySpark, Spark SQL, Java.
4. Apply CI/CD processes to orchestrate automated batch and streaming pipelines running PySpark and Flink.
5. Design, develop, execute, and document software solutions to address complex data collection, processing, transformation, testing, and publishing.
6. Collaborate with peer organizations, DevOps, and Support to troubleshoot technical issues and help resolve code-level problems and performance issues.
7. Recommend architectural standards, best practices, and quality assurance processes for data-related systems and applications.
8. Build data quality and durability tracking mechanisms to provide visibility into and address changes in data ingestion, processing, and storage.
9. Lead and/or help design data schemas to ensure common protocols and storage mechanisms are used across all data services.
10. Partner with data and software architects to design data models, APIs, or other architectural elements.
11. Develop, refine, and educate the data community on coding standards and best practices.
12. Automate data transformations sourced from various systems including desktop, web, and mobile product usage logs and business systems data.

Minimum Qualifications:

1. At least 5 years of experience in cloud ETL, ELT, and near-real-time data collection, transport, and processing technologies.
2. 3+ years of experience with data modeling, including schema design optimized for data retrieval.
3. 5+ years of programming experience with SQL, Python, Spark, PySpark, Spark SQL, Java, Jinja, dbt, and related technologies.
4. 3+ years of experience working with big data environments including Hadoop, Hive, Spark, and Presto.
5. Experience architecting and implementing data testing solutions.
6. Experience with workflow management tools like Airflow and Temporal.
7. Proven expertise with algorithms, distributed systems design, and the software development lifecycle.
8. Experience designing and implementing RESTful APIs in Python, preferably with Flask.
9. Experience deploying and maintaining cloud infrastructure, preferably on AWS.
10. Experience with Infrastructure as Code frameworks, preferably Terraform.
11. Experience developing CI/CD pipelines, preferably with Jenkins or Spinnaker.
12. Familiarity with data governance frameworks, SDLC, and Agile methodology.
13. Strong technical skills and an interest in learning best-in-class technologies around data warehousing, data wrangling, data quality, data governance, and data ethics.

Learn More

About Autodesk

Welcome to Autodesk! Amazing things are created every day with our software – from green buildings and clean cars to smart factories and hit movies. We help innovators turn ideas into reality, transforming how things are made and what can be made.

We pride ourselves on our culture, guided by our Culture Code, which helps our people thrive and realize their potential, leading to better outcomes for our customers.

As an Autodesker, you can be your whole, authentic self and do meaningful work that helps build a better future. Ready to shape the world and your future? Join us!

Salary Transparency

Salary is part of Autodesk’s competitive compensation package, based on experience and location. It includes base salary, discretionary bonuses, commissions for sales roles, stock or long-term incentives, and comprehensive benefits.

Diversity & Belonging

We cultivate a culture of belonging and an equitable workplace. Learn more: https://www.autodesk.com/company/diversity-and-belonging

Existing Contractors or Consultants

If you are an existing contractor or consultant with Autodesk, please search for open jobs and apply internally.