Data Engineer

Nextera; United States; Remote; USD 110,000 - 150,000; Full time

Job summary

Некстера в США ищет опытного Data Engineer для разработки и поддержки масштабируемых конвейеров данных. Основная область охватывает Bronze и Silver слои платформы данных.

Обязанности включают проектирование пакетной и потоковой обработки, сбор данных, развитие моделей data lake/warehouse, работу с Spark, Delta, Parquet, S3 и Kafka, а также внедрение мониторинга и контроля качества данных. Команда сотрудничает с аналитиками и backend.

Qualifications

• Сильные навыки SQL и Python.
• Опыт создания ETL/ELT пайплайнов в продакшн.
• Практический опыт Spark/PySpark, особенно в потоковой обработке.
• Опыт работы с Delta/Parquet и S3.
• Опыт с инструментами оркестрации, такими как Airflow.
• Опыт работы с Kafka и потоковыми пайплайнами.
• Опыт поддержки и улучшения продакшн-конвейеров данных.

Responsibilities

• Design and develop batch and streaming data pipelines
• Build and maintain data ingestion from internal and external sources
• Develop and evolve data lake / data warehouse models
• Optimize performance of Spark-based data processing jobs
• Develop and maintain dbt models and data contracts
• Implement and support monitoring, observability, and data quality checks
• Work with Kafka-based streaming pipelines
• Collaborate with analytics, marketing, platform, and backend teams

Skills

SQL

Python

ETL/ELT pipelines

Spark/PySpark

Delta tables

Parquet

S3

Kafka

Data warehousing

Observability

Data quality

Tools

Airflow

Job description

Описание:

We are seeking a Data Engineer with 5+ years of experience. You will be responsible for designing, building, and maintaining scalable data pipelines, as well as supporting and refactoring existing solutions. The primary ownership area will be the Bronze and Silver layers of our data platform.

Задачи:

• Design and develop batch and streaming data pipelines
• Build and maintain data ingestion from internal and external sources
• Develop and evolve data lake / data warehouse models
• Optimize performance of Spark-based data processing jobs
• Develop and maintain dbt models and data contracts
• Implement and support monitoring, observability, and data quality checks
• Work with Kafka-based streaming pipelines
• Collaborate with analytics, marketing, platform, and backend teams

Требования:

What we're looking for;

• Strong SQL and Python skills
• Solid production experience building ETL / ELT pipelines
• Hands-on experience with Spark / PySpark, especially in streaming scenarios
• Understanding of distributed data processing and storage systems
• Experience working with data lake / data warehouse architectures
• Practical experience with Delta tables, Parquet, and S3
• Experience with orchestration tools such as Airflow or similar
• Experience working with Kafka and streaming pipelines
• Experience maintaining and improving production-grade data pipelines
• Experience with observability, monitoring, and data quality practices

Условия:

• Healthcare; Medical care program (including dental service) or medical care compensation are available for you wherever you wish to work. The medical care program (basic package) is also available for your family members if you choose to work from our official locations – Cyprus, Armenia, and Kazakhstan;
• Work, life, and balance; We offer a fair amount of paid vacation days and sick leave. You can work at one of our comfortable offices in official locations or from home;
• Sports; You can choose various sports activities like yoga, football, and volleyball in our official locations;
• Relocation support; A relocation package is available for you if you decide to join us in one of our official locations;
• Skills improvement; Let's learn languages: you can visit online English language courses. Greek and Armenian language lessons are available for everyone who works in Cyprus or Armenia. Our company encourages people of Nexters to take part in game jams, hackathons, and relevant conferences and meetups as expert speakers;
• Community & ESG; We are proud of our local communities and support employees’ social initiatives. Dream big, act big: Nexters contribute to gaming’s positive impact on the world, hold a sustainability strategy, and take part in charity projects all over the world.