Data engineer in cloud

Social Discovery Group; United States; Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

Remote work

Referral bonuses up to $5000

Training stipend 50%

English lessons discount

Health benefits

Home office reimbursement up to $1000

Equipment provided

Wellness/leave allowances

Job summary

Social Discovery Group (SDG) ищет инженера по данным для миграции дата- продуктов и аналитических нагрузок в облачную платформу. Вы будете анализировать устаревшие SQL-выражения, ETL-процессы и бизнес-логику, чтобы спроектировать их под целевую архитектуру.

Будет строиться масштабируемая конвейерная обработка данных и аналитические модели; вы будете валидировать мигрированные данные, работать с аналитиками и бизнес-обладателями требований, улучшать устойчивость платформы и затраты.

Qualifications

• Продвинутые навыки SQL и реляционных БД.
• Практический опыт со стеком GCP: BigQuery, Cloud Composer, GCS.
• Опыт построения PROD ETL/ELT пайплайнов и аналитических моделей.
• Опыт развёртывания управляемых облачных сервисов, включая оркестрацию и серверless.
• Сильные навыки Python или другого общего языка программирования.
• Понимание концепций облачной инфраструктуры: IAM, сети, мониторинг, CI/CD.
• Свободное владение русским языком.

Responsibilities

• Миграция дата-продуктов и аналитических нагрузок в облако.
• Анализ legacy SQL, ETL и бизнес-логики; переработка под целевую архитектуру.
• Построение и обслуживание масштабируемых пакетных пайплайнов и аналитических моделей.
• Валидация мигрированных данных; расследование расхождений и обеспечение качества.
• Сотрудничество с аналитиками и стейкхолдерами по требованиям.

Skills

SQL

GCP

BigQuery

ETL/ELT

Python

CI/CD

Russian

Tools

Cloud Composer

GCS

Job description

Описание

Social Discovery Group (SDG) is a group of social discovery companies. SDG solves the problems of loneliness, isolation, and disconnection - transforming virtual intimacy into the new normal. SDG's products redefine the way people interact and connect with one another. Our portfolio includes social entertainment platforms designed to connect people online across different cultures and regions of the world.

Задачи

Migrate data products and analytical workloads from MS SQL Server to a modern cloud data platform. Analyze legacy SQL, ETL processes and business logic and redesign them for the target architecture. Build and maintain scalable batch data pipelines and analytical models. Validate migrated data, investigate discrepancies and ensure data quality. Work with analysts and business stakeholders to clarify requirements and business logic. Contribute to platform reliability, performance, cost optimization and engineering practices. Develop and improve AI-assisted engineering automation for Data Engineering workflows, including shared agent harnesses, specifications, reusable skills, evaluation frameworks and quality controls

Требования

Strong Data Engineering background with advanced SQL and relational databases. Strong hands-on experience with the GCP data stack (or any other Cloud), including deep practical knowledge of managed services such as BigQuery, Cloud Composer, and GCS. Experience building production ETL/ELT pipelines and analytical data models. Experience deploying, configuring and operating managed cloud data services, including workflow orchestration, managed/serverless compute and analytical warehouses. Strong Python skills (or another general-purpose programming language) and experience applying them across data engineering, platform automation, and analytical workloads. Good understanding of cloud infrastructure concepts: IAM, networking, monitoring, CI/CD and infrastructure configuration. Experience working with legacy data warehouses and complex business logic. Fluent Russian

Условия

REMOTE OPPORTUNITY to work full-time The initial pay level or pay range for this role will be shared with candidates during the recruitment process and before the commencement of employment Vacation 28 calendar days per year 7 wellness days per year (time off) that can be used to deal with household issues, to lie down and recover without taking sick leave Bonuses up to $5000 for recommending successful applicants for positions in the company 50% payment for professional training, international conferences, and meetings Corporate discount for English lessons Health benefits. According to the paychecks, if you are not eligible for corporate medical insurance, the company will compensate you with up to $ 1,000 gross per year per employee. This can be spent on self-purchase of health insurance or on doctor's fees for yourself and close relatives (spouse, children) Workplace organization. The company provides all employees with an equipped workplace and all the necessary equipment (table, armchair, wifi, etc.) in our offices or co-working locations. In the other locations, the company provides reimbursement of workplace costs up to $ 1000 gross once every 3 years, according to the paychecks. This money can be spent on the rent of the co-working room, on equipping the working place at home (desk, chair, Internet, etc.) during those 3 years Internal gamified gratitude system: receive bonuses from colleagues and exchange them for our merchandise, team building activities, massage certificates, etc.