Remote Senior Big Data Engineer: AI & MLOps

Talanto; Poland; Remote; PLN 416,000 - 450,000; Full time

Job summary

Talanto is seeking a senior Data Engineer for a 100% remote role with teams across NYC. You will design, build, and maintain scalable data pipelines and data lake components, integrating AI/LLMs into data products and improving development productivity through AI-driven tools.

The position focuses on processing billions of records in a cloud environment and delivering real-time, globally distributed systems.

Qualifications

• 8+ years of professional software engineering experience in data engineering.
• Expert-level Python and at least one other high-level language (e.g., Java, Scala, C++).
• Proven experience building and optimizing large-scale data pipelines with Apache Spark.
• Hands-on experience deploying data solutions in AWS, GCP, or Azure.
• Experience with AI/LLMs in products and for development productivity.
• Experience in the advertising industry.
• Experience with big data visualization and OLAP tools.
• Familiarity with MLFlow, dbt, Kafka, Airflow, Databricks.
• Experience with Parquet/Delta Lake/Iceberg formats.

Responsibilities

• Design, develop, and maintain scalable data pipelines, ETL processes, and data models using Python and Apache Spark in cloud environments.
• Lead AI/LLM integration into data products with data scientists to productionize models.
• Champion AI-driven tools to boost productivity and code quality.
• Build and maintain reliable, scalable distributed data processing systems.
• Own a complex set of services and applications in the data lake.
• Ensure data pipelines run 24/7 and scale to billions of records.

Skills

Python

Java

Scala

Spark

Cloud (AWS/GCP/Azure)

Kafka

Airflow

Databricks

Parquet/Delta Lake/Iceberg

Tools

Kafka

Airflow

Databricks

MLFlow

dbt

AWS/GCP/Azure

Parquet/Delta Lake

Job description

Talanto is seeking a senior Data Engineer for a 100% remote role with teams across NYC. You will design, build, and maintain scalable data pipelines and data lake components, integrating AI/LLMs into data products and improving development productivity through AI-driven tools.

The position focuses on processing billions of records in a cloud environment and delivering real-time, globally distributed systems.