Senior Data Engineer: Scalable Pipelines & AI Solutions

Washington Wizards; Washington (District of Columbia); On-site; USD 150,000 - 190,000; Full time

Benefits offered by this job

Health benefits

Job summary

Monumental Sports & Entertainment is hiring a data engineering leader to architect scalable data infrastructure, build robust pipelines, and ensure data quality across engineering initiatives.

You will work with cross-functional teams to design and implement data solutions, leverage Prefect/DBT, and use cloud services (AWS, GCP, Azure) to handle large datasets in a fast-paced environment.

Qualifications

• 5+ years of professional software development experience.
• Strong proficiency with a variety of transactional (OLTP) and analytical (OLAP) databases.
• Sophisticated knowledge of Python and SQL.
• Experience with data engineering frameworks such as Prefect, DBT, etc.
• Experience with open-source backend frameworks such as Rails, Django, Next.js, etc.
• Diverse set of infrastructure experience with PaaS and IaaS and budgeting.
• Experience with Docker.
• Experience working with large datasets.
• Familiarity with Agile development frameworks.

Responsibilities

• Architect the data engineering infrastructure to be performant, reliable, and scalable.
• Lead data engineering efforts, including decisions on technologies, providers, database design, partitioning and indexing strategies, and software patterns.
• Create and maintain data pipelines to ingest, validate, and organize critical data using orchestration tools (e.g. Prefect).
• Optimize pipelines and data storage to handle large datasets.
• Build thorough data validation procedures to ensure data quality.
• Implement medallion architectures to organize data structure and provide data lineage.
• Collaborate with cross-department team members to build products, implement feedback, and fix bugs.
• Stay aware of emerging technologies like generative AI and how to apply them.
• Other duties as assigned.

Skills

5+ years software development

Databases (OLTP/OLAP)

Python

SQL

Agile development

Tools

Prefect

DBT

Rails

Django

Next.js

Docker

AWS

GCP

Azure

Job description

Monumental Sports & Entertainment is hiring a data engineering leader to architect scalable data infrastructure, build robust pipelines, and ensure data quality across engineering initiatives.

You will work with cross-functional teams to design and implement data solutions, leverage Prefect/DBT, and use cloud services (AWS, GCP, Azure) to handle large datasets in a fast-paced environment.