Senior Data Platform Engineer

Orca AI; United States; Remote; USD 100,000 - 145,000; Full time

Job summary

Orca AI is seeking a Senior Data Platform Engineer for a fully remote role limited to Athens metropolitan area. You will design, build, and evolve our data infrastructure powering analytics, AI workloads, and large-scale model execution.

You will own end-to-end data ingestion, data lake architecture, and scalable pipelines, while guiding the team on best practices around infrastructure, CI/CD, and performance optimization.

Qualifications

• 5+ years of experience as a Data Platform/Infra Engineer.
• Experience building scalable data infrastructure in Data Lake architectures.
• Experience operating large-scale data workloads on Kubernetes with KEDA autoscaling.
• Strong Python and SQL skills; IaC with Terraform.
• Experience with data orchestration platforms such as Airflow or Prefect, and Snowflake.

Responsibilities

• Build high-volume batch and near-real-time ingestion services and scale streaming capabilities.
• Design and implement data solutions in a distributed microservices environment.
• Develop and optimize large-scale data pipelines for batch and streaming use cases.
• Ensure data quality, governance, and compliance.
• Manage Kubernetes infrastructure with dynamic scaling (KEDA) and Terraform provisioning.
• Provide technical guidance and promote best practices for infrastructure, CI/CD, and system design.
• Investigate memory management and performance tuning for cost-effective, fast-distributed systems.

Skills

Python

SQL

Kubernetes

Data Lake architectures

Data pipelines

Infrastructure as Code

Terraform

KEDA

Airflow

Prefect

Snowflake

Tools

Terraform

Airflow

Prefect

KEDA

Snowflake

Kubernetes

Job description

Description

**This is a remote position for candidates in Athens metropolitan only***

We are looking for a highly skilled Senior Data Platform Engineer to join our Data Platform team and play a key role in designing, building, and evolving the company’s data infrastructure.

This is a hands-on engineering position focused on developing scalable data platforms, high-volume ingestion pipelines, and the foundational data systems that power analytics, product applications, AI workloads, and large-scale model execution. You will help architect our data lake, build reliable ingestion capabilities at scale, and shape the core infrastructure that supports the company’s future growth.

This is an exciting opportunity to work with cutting-edge technologies and have a defining impact on the architecture and evolution of our data platform.

What You’ll Do

• Build complex, high-volume batch and near-real-time ingestion services while helping evolve the platform’s streaming capabilities.
• Design and implement data solutions for all application requirements in a distributed microservices environment
• Develop and optimize large-scale data pipelines for batch and streaming use cases.
• Ensure data quality, compliance, and governance.
• Manage and optimize Kubernetes infrastructure, utilizing KEDA to dynamically scale resources for large-scale data processing workloads.
• Own the full lifecycle of our data stack using Terraform and Kubernetes, from provisioning to application-level frameworks.
• Provide technical guidance for the team, drive best practices around infrastructure, CI/CD, testing, and system design.
• Deep-dive into memory management and performance tuning to ensure our large-scale distributed systems are both cost-effective and lightning-fast.

Requirements

• 5+ years of experience as a Data Platform/Infra Engineer
• Proven track record of building and operating scalable data infrastructure specifically within Data Lake architectures.
• Proven experience designing and operating large-scale data processing workloads on Kubernetes, including workload autoscaling with KEDA.
• Strong proficiency in Python and SQL.
• Hands-on experience with Infrastructure as Code, preferably Terraform.
• Experience with managing a data orchestration platform such as Airflow or Prefect
• Experience with Snowflake.