Senior Data Engineer

INSPYR; Lake Buena Vista (FL); Remote; USD 120,000 - 170,000; Full time

Job summary

INSPYR Solutions is recruiting a Data Engineer to join the Disney Decision Science and Integration (DDSI) team. You will design and sustain data pipelines, enabling analytics and AI-based solutions across The Walt Disney Company.

Work with business, science, and technology groups to deliver scalable ETL/ELT workflows, leverage GenAI tools, and participate in production rollout, testing, and sustainment across Disney’s entertainment, parks, and studios ecosystem.

Qualifications

• 5+ years of technology experience.
• ELT/ETL data pipeline development and maintenance.
• Proven expertise using Python and SQL.
• Strong understanding of database and data warehouse design, and proficiency utilizing various data platforms (PostgreSQL, Snowflake).
• Solid understanding of GenAI concepts and tools (LLMs, embeddings, prompt engineering).
• Experience with GenAI APIs/frameworks (OpenAI, LangChain, AWS Bedrock).
• Experience with DevOps practices and code deployment using GitLab/GitHub.
• Hands-on knowledge of Apache Airflow.
• Ability to gather data requirements and design data solutions across business domains.

Responsibilities

• Design, develop, and maintain data pipelines for analytics and AI models.
• Collaborate with business, science, and technology teams to define scope and requirements.
• Implement data aggregation and transformation for usability by science models and visualizations.
• Leverage GenAI tools to deliver AI-based data solutions and automate processes.
• Participate in planning, testing, deployment, and sustainment of data systems.
• Communicate progress to project leadership and work across multiple teams.

Skills

ETL pipelines

Python

SQL

Data warehousing

PostgreSQL

Snowflake

GenAI concepts

Vector databases

OpenAI APIs

Airflow

Git/GitHub

DevOps

Cross-team work

Communication

Education

Bachelor's degree (CS/Math/SE)

Tools

Databricks

Kubernetes

Docker

AWS

Snowflake

Job description

The Disney Decision Science and Integration (DDSI) team leverages advanced technologies, data analytics, and scientific approaches such as optimization, and statistical modeling to build innovative tools that shape business decisions across The Walt Disney Company. We support Disney Entertainment (ABC, The Walt Disney Studios, Disney+, Hulu), ESPN, Disney Experiences (Theme Parks, Cruise Line, Consumer Products, DVC), and Corporate Finance with strategic applications that enable data-driven decision-making.

What You Will Do

The Data Engineering team is responsible for development and sustainment projects, ad-hoc requests, prototyping and research initiatives by providing data pipeline and data engineering services. You will work with business, science, and technology teams to understand scope and requirements, business needs, and data from across the Disney company in order to design and deliver the data pipelines necessary for our solutions. You will have tasks to design, develop, enhance, and implement systems for advanced analytic data solutions. This includes data aggregation and manipulation to make the data usable by science models, visualizations, and applications. You will be expected to leverage GenAI tools to be efficient in your work, and you will be delivering AI-based solutions. You will also support the exploration and integration of GenAI tools and techniques into data engineering processes to enhance automation and analytical capabilities. Other activities could include planning, estimating, design, development, testing, production rollout, and sustainment activities. In addition to technical capabilities, the role is responsible for developing an understanding the business domain and processes, then applying that knowledge to the assigned deliverables.

Responsibilities of the Role

Work assignments may cover activities such as participation in data requirements gathering, source-to-target mapping, data validation scripting and review, developing and monitoring ETL/ELT data pipelines, and producing datasets as input to science models and visualizations. As part of a data engineering team, this role will be included in technical reviews of the team to ensure quality deliverables. In addition to technical capabilities, the role is responsible for developing an understanding of the business domain and processes, then applying that knowledge to the assigned deliverables. This role communicates data engineering progress to the project leadership team and actively participates in meetings and discussions.

Basic Qualifications

• 5+ years of technology experience
• Strong experience with ELT/ETL data pipeline development and maintenance
• Proven expertise using Python and SQL
• Strong understanding of database and data warehouse design, and proficiency utilizing various data platforms, such as PostgreSQL, Snowflake, etc.
• Solid understanding of GenAI concepts and tools (e.g., LLMs, embeddings, prompt engineering)
• Understanding of vector databases or RAG (Retrieval-Augmented Generation) architectures
• Experience working with GenAI APIs or frameworks (e.g., OpenAI, LangChain, AWS Bedrock)
• Experience with developing in a multi environment (Dev, QA, Prod, etc.) and DevOps procedures for code deployment/promotion using a source control product such as GitLab or GitHub.
• Hands-on knowledge of job orchestration software like Apache Airflow
• Experience and understanding of one or more business domains to assist in gathering/refining data requirements and data design solutions
• Experience managing and deploying code using a source control product such as GitLab/GitHub
• Able to effectively formulate solutions and communicate complex technical concepts to non-technical team members
• Proven ability to work collaboratively in a multi-team environment

Desired Qualifications

• Experience with analytic systems
• Experience with infrastructure as Code, Docker and containerization and elastic scaling with Kubernetes or a similar framework and with AWS
• Experience working with large datasets and big data technologies such as Snowflake, Databricks, or similar
• Demonstrated proficiency with API development
• Knowledgeable on cloud architecture and product offerings, preferably AWS

Education

• Bachelor's degree (Computer Science, Mathematics, Software Engineering or related field)

INSPYR Solutions provides Equal Employment Opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, genetics, or any other protected status. INSPYR Solutions complies with all applicable laws governing nondiscrimination in employment in every location in which the company has facilities.

Applicants requiring reasonable accommodation during the application or interview process should contact [e-mail] for assistance.

Information collected and processed through your application with INSPYR Solutions (including any job applications you choose to submit) is subject to INSPYR Solutions' Privacy Policy and INSPYR Solutions' AI and Automated Employment Decision Tool Policy: https://www.inspyrsolutions.com/policies/. By submitting an application, you are consenting to being contacted by INSPYR Solutions through phone, email, or text.