Senior DataOps Engineer: Cloud Lakehouse & AI Analytics

N-iX; Warszawa; Hybrid; PLN 180,000 - 280,000; Full time

Benefits offered by this job

Flexible working format

Competitive salary

Career growth

Education reimbursement

Tech talks and training

Job summary

N-iX is seeking a Senior DataOps Engineer to join our data modernization initiative. You will design and implement scalable data platforms on AWS, enabling secure, compliant data flows across the organization.

You will work with cross-functional teams to deliver batch and streaming pipelines, ensure data governance, and drive observability and cost controls. Remote-friendly, competitive salary, and strong career growth.

Qualifications

• 4+ years of hands-on experience as a Data Engineer or DataOps Engineer building enterprise-grade data platforms and pipelines.
• Strong expertise with AWS Data Analytics stack: Amazon S3, AWS Glue Data Catalog, AWS Lake Formation, Amazon EMR (EMR-on-EKS / Serverless), Amazon Athena, AWS DataSync, and Amazon MSK.
• Deep experience with Apache Iceberg table format, cataloging, compaction, and schema evolution.
• Proficient in Apache Spark / PySpark and Spark Streaming for batch, micro-batch, and real-time data processing.
• Strong experience in Medallion Lakehouse Architecture design and implementation (Bronze, Silver, Gold layers).

Responsibilities

• Design, implement, and maintain the AWS Data Platform foundation, including Amazon S3 lake layout, Iceberg table standardization, and AWS Glue Data Catalog integration.
• Build and optimize scalable batch and streaming data pipelines using Amazon EMR (Serverless and EMR-on-EKS), Apache Spark/PySpark, Apache Flink, and Amazon Athena with workgroup cost caps.
• Implement data tokenization and de-identification pipelines on the data side (PA-T) using Protegrity/Spark UDFs for batch, Spark Streaming for micro-batch, and Kafka Connect SMT for streaming PII masking prior to cloud transit.
• Build and manage real-time streaming architectures with Amazon MSK, MSK Replicator/MirrorMaker2, and Schema Registry integration.
• Implement Medallion Architecture (Bronze, Silver, Gold layers) for lakehouse data modeling, automating Iceberg table registration and backfill frameworks.
• Execute data migration waves across non-PII and PII datasets using AWS DataSync, automated register steps, and streaming migration configs.
• Configure data access control and governance models using AWS Lake Formation, cross-engine authorization, AWS Macie for PII detection, and Informatica Data Catalog integration.
• Build automated schema-drift identification components, GitLab CI/CD pipeline integration for dataset synchronization, and automated data contracts/circuit breakers.
• Implement DataOps observability, centralizing logging via Amazon CloudWatch, configuring FinOps cost & anomaly monitoring, and setting up automated alerts.
• Author technical documentation, operational runbooks, disaster recovery procedures, and cutover/rollback playbooks for data platform hardening.

Skills

Data Engineering

DataOps Engineering

AWS Data Analytics

Apache Spark

Kafka / MSK

CI/CD

Terraform

Tools

Amazon S3

AWS Glue Data Catalog

Amazon EMR

Apache Iceberg

Apache Flink

Apache Spark

Amazon Athena

MSK

Kafka

Terraform

AWS CDK

Job description

N-iX is seeking a Senior DataOps Engineer to join our data modernization initiative. You will design and implement scalable data platforms on AWS, enabling secure, compliant data flows across the organization.

You will work with cross-functional teams to deliver batch and streaming pipelines, ensure data governance, and drive observability and cost controls. Remote-friendly, competitive salary, and strong career growth.