Data Engineer

sportygroup; United States; Remote; USD 110,000 - 160,000; Full time

Job summary

sportygroup is seeking a Data Engineer to design and maintain data infrastructure powering ML and analytics for a fast-growing digital business. The role focuses on scalable pipelines, data quality, and architecture to handle high daily changes.

You will collaborate with data scientists, MLOps, product owners, and BI analysts to translate business processes into robust data systems and features.

Qualifications

• Bachelor's degree or equivalent in a technical field
• 3+ years of data engineering or related experience
• Hands-on with data pipelines, warehouses, and data integration
• Production experience with relational and NoSQL databases and data modelling

Responsibilities

• Design, develop, and maintain scalable batch ETL and near-real-time data pipelines across diverse, high-velocity sources
• Ensure data quality, accuracy, and consistency across the platform
• Identify and implement internal process improvements to optimize data delivery and re-architect infrastructure for scalability
• Build new API integrations to support growing data volume and complexity

Skills

SQL

Python

Apache Airflow

Apache Spark

AWS

Data modelling

Event-driven architectures

Education

Bachelor's degree or equivalent

Tools

Apache Airflow

Apache Spark

AWS Redshift

AWS S3

AWS Athena

EC2

Lambda

Job description

Role overview

A Data Engineer is needed to design and maintain the data infrastructure that powers machine learning and analytics initiatives across a fast-growing digital business. The role focuses on building scalable pipelines and architectures that handle very high volumes of daily changes while ensuring data quality across the platform.

Responsibilities

• Design, develop, and maintain scalable batch ETL and near-real-time data pipelines across diverse, high-velocity data sources
• Ensure delivered data meets strict standards for quality, accuracy, and consistency
• Identify and implement internal process improvements to optimize data delivery and re-architect infrastructure for better scalability
• Build new API integrations to support growing data volume and complexity
• Collaborate with data scientists, MLOps engineers, product owners, and BI analysts to understand business processes and system architecture for specific product features

Requirements

• Bachelor's degree or equivalent experience in Computer Science, Engineering, Mathematics, or a related technical field
• Three or more years of experience in data engineering, data platforms, BI, or a closely related domain
• Hands-on experience delivering data-centric projects including operational data stores, data warehouses, and data integration work
• Production experience with large-scale relational and NoSQL databases and data modelling
• Working knowledge of data architectures and event-driven architectures
• Proficiency in SQL, familiarity with at least one scripting language (preferably Python), and experience with Apache Airflow and Apache Spark
• Solid understanding of cloud data services, including AWS offerings such as S3, Athena, EC2, Redshift, EMR, EKS, RDS, and Lambda

Nice to have

• Understanding of machine learning models
• Familiarity with containerisation and orchestration technologies such as Docker or Kubernetes
• Relevant knowledge or experience in the gaming industry

Benefits and work setup

• Remote-first organisation with sustainability goals
• Competitive salary plus quarterly individual performance bonuses
• 28 days of paid annual leave
• Core working hours of 10am-3pm in the local time zone, with flexibility outside that window
• Referral and other flash bonuses
• Top-of-the-line equipment provided
• Annual company retreats for internal networking
• Interview process includes a remote video screening, an offline take-home assignment, and a 90-minute remote video interview with team members