Data Engineer

Yankalatam; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

SportsEngine is seeking a Data Engineer to design, build, and maintain scalable data systems powering analytics and operations. You will develop data pipelines, implement ETL/ELT processes, ingest data from internal systems, APIs, third-party providers, and real-time streams, and shape data models for data lakes and warehouses.

You will collaborate with product and engineering teams to translate business needs into robust data solutions, ensure data quality, and participate in Agile ceremonies

Qualifications

• Strong experience designing and building data pipelines.
• Expertise in ETL/ELT processes and data ingestion.
• Experience with data lake architectures and modern data platforms.

Responsibilities

• Design, build, and maintain scalable data pipelines and data processing systems.
• Develop and optimize ETL/ELT processes for batch and real-time data ingestion.
• Ingest and process data from internal systems, APIs, third-party platforms, and streaming sources.
• Design and maintain data models, data lakes, and data warehouse structures.
• Write clean, efficient, and reusable code for large-scale data processing.
• Collaborate with product managers, data teams, and engineering teams to translate business needs into data solutions.
• Ensure data quality, integrity, and availability across systems.
• Monitor, troubleshoot, and resolve production issues related to data pipelines and workflows.
• Contribute to improving code quality, system reliability, and best engineering practices.
• Actively participate in Agile ceremonies (standups, sprint planning, retrospectives)

Skills

Python

SQL

PySpark

Airflow

AWS ecosystem

ETL/ELT pipelines

Data lakes

API integration

CI/CD / TDD (basic)

Tools

Terraform

Talend

Job description

Summary

We are looking for a new GIGAnte to join our team as a Data Engineer.In this role, you will be responsible for designing, building, and maintaining robust data systems that power SportsEngine’s analytics and operational platforms. You will work closely with cross-functional teams to develop scalable data pipelines and data platforms, enabling reliable data ingestion, transformation, and delivery from multiple sources, including internal systems, third-party providers, and real-time streams.This is a key role for driving data-driven decision-making and ensuring high-quality, accessible, and scalable data infrastructure across the organization.

What You’ll Do

• Design, build, and maintain scalable and reliable data pipelines and data processing systems
• Develop and optimize ETL/ELT processes for batch and real-time data ingestion
• Ingest and process data from internal systems, APIs, third-party platforms, and streaming sources
• Design and maintain data models, data lakes, and data warehouse structures
• Write clean, efficient, and reusable code for large-scale data processing
• Collaborate with product managers, data teams, and engineering teams to understand business needs and translate them into data solutions
• Ensure data quality, integrity, and availability across systems
• Monitor, troubleshoot, and resolve production issues related to data pipelines and workflows
• Contribute to improving code quality, system reliability, and best engineering practices
• Actively participate in Agile ceremonies (standups, sprint planning, retrospectives)

What We’re Looking For

Technical Skills

• Strong experience with Python and SQL
• Advanced English (written and spoken)
• Hands-on experience with PySpark or distributed data processing frameworks
• Experience building and orchestrating pipelines using Apache Airflow or Amazon MWAA Solid experience with AWS ecosystem, including:S3, Redshift, DynamoDBAthena, EMR, AWS Lambda
• Experience with data lake architectures and modern data platforms
• Strong knowledge of ETL/ELT pipelines, APIs, and real-time data ingestion
• Experience with Terraform or infrastructure as code (nice to have)
• Knowledge of Talend or similar ETL tools (nice to have)
• Familiarity with CI/CD pipelines and Test-Driven Development (TDD) (nice to have)