Senior DataOps Engineer (Remote) - Data Pipelines & Cloud

IRIUM Portugal; United States; Remote; USD 46,000 - 53,000; Full time

Benefits offered by this job

Medical insurance

Flexible pay access

Training and development

Job summary

IRIUM is seeking a Senior DataOps Engineer to design and maintain scalable data pipelines, models, and lakehouse architectures in a remote-friendly setup. You will implement CI/CD for data workflows, enforce data quality and governance, and optimize performance across distributed environments.

Required: 5+ years in data engineering with DevOps exposure, strong SQL and Python skills, plus experience with Airflow, Spark/Flink, and AWS data services.

Qualifications

• 5+ years in data engineering with DevOps/platform exposure.
• Strong SQL and data modelling skills (dimensional, normalised, lakehouse).
• Proficient in Python; working knowledge of Scala, Java, or Go.
• Hands-on with data pipeline/orchestration tools (Airflow, DBT).
• Experience with distributed processing frameworks (Spark, Flink, or similar).
• AWS expertise (Glue, EMR, Redshift, Athena, S3, Lambda, Kinesis).
• CI/CD tools (GitHub Actions, GitLab CI, Jenkins, CircleCI).
• Infrastructure as Code (CDK, CloudFormation).
• Streaming/event-driven architecture (Kafka, Kinesis, Apache Flink, or Pub/Sub).
• Observability tools: Grafana, CloudWatch.
• Data warehouse platforms (Redshift, Snowflake).
• Containerisation/orchestration (Docker, ECS, Kubernetes).
• Data governance, cataloguing, and security/compliance (GDPR).
• GitHub Enterprise, Atlassian APIs, and Slack bots.

Responsibilities

• Design, build, and maintain scalable data pipelines (batch and streaming).
• Develop and optimise data models, warehouses, and lakehouse architectures.
• Build and automate CI/CD pipelines for data workflows and deployments.
• Ensure data quality, integrity, lineage, and governance across environments.
• Implement monitoring for pipelines and data infra (CloudWatch, Grafana).
• Manage IaC for reliable data infrastructure.
• Troubleshoot and optimise pipeline/query performance; lead incident analysis.
• Collaborate with analysts, data scientists, and engineering teams; ensure security/scalability.
• Document data architecture, lineage, and workflows.

Skills

Data pipelines design

Data modeling

Python

SQL

DevOps

Airflow

GitHub Actions

Scala/Java/Go (basic)

AWS (Glue, EMR, Redshift, Athena, S3,)

CI/CD

Kubernetes (basic)

Kafka/Kinesis

Education

5+ years in data engineering

Tools

Airflow

DBT

Spark / Flink

Docker

ECS

Job description

IRIUM is seeking a Senior DataOps Engineer to design and maintain scalable data pipelines, models, and lakehouse architectures in a remote-friendly setup. You will implement CI/CD for data workflows, enforce data quality and governance, and optimize performance across distributed environments.

Required: 5+ years in data engineering with DevOps exposure, strong SQL and Python skills, plus experience with Airflow, Spark/Flink, and AWS data services.