Senior Cloud Data Engineer - Remote, AI Pipelines

Social Discovery Group; Ireland; Remote; EUR 90,000 - 120,000; Full time

Benefits offered by this job

Vacation 28 calendar days per year

Wellness days 7 per year

Referral bonuses up to $5000

Training reimbursement 50%

Health benefits

Job summary

Social Discovery Group is seeking a Senior Data Engineer (Cloud) to migrate data products from MS SQL Server to a modern cloud data platform. You will build scalable pipelines, validate data, and collaborate with analysts to translate business logic into robust analytics.

The role emphasizes GCP stack expertise, Python programming, and cloud infrastructure concepts, with a remote-friendly setup and competitive compensation.

Qualifications

• Strong Data Engineering background with advanced SQL
• Deep practical knowledge of the GCP data stack (BigQuery, Cloud Composer, GCS)
• Experience building production ETL/ELT pipelines and analytical data models
• Experience deploying, configuring and operating managed cloud data services (workflow orchestration, managed/serverless compute, analytical warehouses)
• Strong Python skills across data engineering, platform automation and analytics workloads
• Good understanding of cloud infrastructure concepts: IAM, networking, monitoring, CI/CD, infrastructure configuration
• Experience with legacy data warehouses and complex business logic
• Fluent Russian

Responsibilities

• Migrate data products and analytical workloads from MS SQL Server to a modern cloud data platform
• Analyze legacy SQL, ETL processes and business logic and redesign for the target architecture
• Build and maintain scalable batch data pipelines and analytical models
• Validate migrated data, investigate discrepancies and ensure data quality
• Work with analysts and stakeholders to clarify requirements and business logic
• Contribute to platform reliability, performance, cost optimization and engineering practices
• Develop and improve AI-assisted engineering automation for Data Engineering workloads

Skills

SQL

Python

ETL/ELT

Data modeling

Russian language

Tools

BigQuery

Cloud Composer

GCS

CI/CD

Serverless architectures

IAM

Job description

Social Discovery Group is seeking a Senior Data Engineer (Cloud) to migrate data products from MS SQL Server to a modern cloud data platform. You will build scalable pipelines, validate data, and collaborate with analysts to translate business logic into robust analytics.

The role emphasizes GCP stack expertise, Python programming, and cloud infrastructure concepts, with a remote-friendly setup and competitive compensation.