Databricks Data Engineer

Optiveum; United States; Remoto; USD 49.000 - 69.000; Tempo integral

Resumo da vaga

Optiveum is partnering with a leading technology organization to hire a Senior Databricks Data Engineer for 100% remote work with Poland as the focal location. You will design and implement scalable data solutions on Databricks across AWS, Azure, and GCP, leveraging modern data engineering practices and DevOps.

The role emphasizes Python-based pipelines, data security and governance, and collaboration with architects to uphold best practices.

Qualificações

• Commercial experience in data engineering with Databricks.
• Strong Python for automation and data transformation.
• Experience with at least one major cloud platform (AWS/Azure/GCP).
• Strong English and Polish language communication.
• Experience with DevOps, CI/CD, and IaC (Terraform, Bicep).
• Experience with real-time data streaming (Kafka, Spark Streaming).
• Knowledge of Data Lake, Snowflake, Synapse.
• Hands-on PySpark for distributed data processing.

Responsabilidades

• Design data processing solutions using Databricks for large-scale datasets.
• Build and enhance data pipelines with Python and cloud-native tools.
• Collaborate with solution architects to uphold best data engineering practices.
• Ensure data security, consistency, and scalability in cloud environments.

Conhecimentos

Strong communication skills

English proficiency

Polish proficiency

Formação

Databricks Certified Data Engineer Associate

Ferramentas

Databricks

Python

AWS

Azure

GCP

Kafka

Spark Streaming

PySpark

Terraform

Bicep

Data Lake

Snowflake

Synapse

Descrição da vaga

Описание:

Senior Databricks Data Engineer Location: 100% Remote (Poland) Rate: up to 38 EUR + VAT (B2B) Work model: B2B Contract Contracting Party: Optiveum

Optiveum is currently looking for a Senior Databricks Data Engineer to join the team of our client—a thriving technology organization with over 400 professionals dedicated to delivering advanced, data-driven solutions. In this role, you will be part of a team whose expertise lies in Cloud & Big Data engineering. You will help build scalable architectures for processing large and complex datasets across AWS, Azure, and GCP while leveraging modern data frameworks, programming methodologies, and DevOps best practices. Please note: Optiveum acts as the recruitment partner and the direct contracting party for this position.

Задачи:

• Designing and implementing data processing solutions using Databricks for large-scale and diverse datasets.
• Designing, building, and enhancing data pipelines with Python and cloud-native tools.
• Working closely with solution architects to define and uphold best practices in data engineering.
• Ensuring data consistency, security, and scalability within cloud-based environments.

Требования:

• Solid commercial experience in data engineering, coupled with hands-on Databricks expertise.
• Strong proficiency in Python for automation and data transformation.
• Commercial experience working with at least one major cloud platform (AWS, Azure, or GCP).
• Strong communication skills.
• Advanced command of both English and Polish.
• Solid understanding of SQL, including experience in query optimization and data modeling.
• Familiarity with DevOps methodologies, CI/CD pipelines, and Infrastructure as Code (Terraform, Bicep).
• Experience with real-time data streaming technologies such as Kafka or Spark Streaming.
• Knowledge of cloud storage solutions like Data Lake, Snowflake, or Synapse.
• Hands-on experience with PySpark for distributed data processing.
• Relevant industry certifications (e.g., Databricks Certified Data Engineer Associate or cloud-based data certifications).