Senior Data Engineer, Cloud & AI Automation (Remote)

Social Discovery Group; Ireland; Remote; USD 110,000 - 170,000; Full time

Benefits offered by this job

Remote opportunity

Vacation 28 days

Wellness days 7

Referral bonuses up to $5000

Training reimbursement 50%

English lessons discount

Health benefits up to $1000/year

Workspace reimbursement every 3 years

Job summary

Social Discovery Group (SDG) seeks a Senior Data Analyst to join our main product team. You will migrate data products from MS SQL Server to a modern cloud platform and redesign legacy processes for the target architecture.

You will build scalable ETL pipelines, validate data quality, and collaborate with stakeholders to clarify requirements while contributing to reliability, performance, and cost optimization of data engineering workflows.

Qualifications

• Strong Data Engineering background with advanced SQL and relational databases.
• Strong hands-on experience with the GCP data stack (BigQuery, Cloud Composer, and GCS).
• Experience building production ETL/ELT pipelines and analytical data models.
• Experience deploying managed cloud data services including workflow orchestration and analytical warehouses.
• Strong Python skills and experience applying them across data engineering and automation.
• Good understanding of cloud infrastructure concepts: IAM, networking, monitoring, CI/CD.
• Experience with legacy data warehouses and complex business logic.
• Fluent Russian.

Responsibilities

• Migrate data workloads and analytical workloads from MS SQL Server to a modern cloud data platform.
• Analyze legacy SQL, ETL processes and business logic and redesign them for the target architecture.
• Build and maintain scalable batch data pipelines and analytical models.
• Validate migrated data, investigate discrepancies and ensure data quality.
• Work with analysts and business stakeholders to clarify requirements and business logic.
• Contribute to platform reliability, performance, cost optimization and engineering practices.
• Develop and improve AI-assisted engineering automation for Data Engineering workflows.

Skills

Advanced SQL

Relational databases

GCP data stack

ETL/ELT pipelines

Python

Cloud infrastructure

Data modeling

Russian

Tools

BigQuery

Cloud Composer

Google Cloud Storage

MS SQL Server

Job description

Social Discovery Group (SDG) seeks a Senior Data Analyst to join our main product team. You will migrate data products from MS SQL Server to a modern cloud platform and redesign legacy processes for the target architecture.

You will build scalable ETL pipelines, validate data quality, and collaborate with stakeholders to clarify requirements while contributing to reliability, performance, and cost optimization of data engineering workflows.