Senior Databricks Platform Architect (Remote)

KATBOTZ LLC; Poland; Remote; PLN 260,000 - 420,000; Full time

Benefits offered by this job

Competitive compensation

Remote options

Professional development

Dynamic work environment

Job summary

KATBOTZ LLC is seeking an experienced Databricks SME to support enterprise data engineering and analytics initiatives across global clients. The ideal candidate will have deep expertise in Databricks, Spark, Delta Lake, and modern lakehouse architectures, working with cross-functional teams to design scalable data solutions.

You will lead pipelines, implement data governance, mentor teams, and ensure security and cost-efficient data processing in cloud environments (Azure, AWS, GCP).

Qualifications

• 10+ years of experience in Data Engineering and Big Data technologies.
• Strong hands-on expertise in Databricks and Apache Spark.
• Experience with Python, PySpark, SQL, and Scala.
• Expertise in Delta Lake, Unity Catalog, and Databricks Workflows.
• Strong understanding of data warehousing and modern lakehouse architecture.
• Experience with cloud platforms such as Microsoft Azure, Amazon AWS, or Google GCP.
• Experience integrating Databricks with BI and reporting tools.
• Knowledge of CI/CD pipelines and DevOps practices.
• Strong analytical and problem-solving skills.
• Excellent communication and stakeholder management abilities.

Responsibilities

• Lead the design, development, and optimization of Databricks-based data platforms and pipelines.
• Provide technical expertise on Databricks architecture, performance tuning, and best practices.
• Build scalable ETL/ELT workflows using Apache Spark and Databricks.
• Collaborate with business stakeholders, architects, and engineering teams to gather requirements and deliver solutions.
• Implement Delta Lake, data governance, and data quality frameworks.
• Support migration of legacy data platforms to Databricks.
• Optimize data processing workflows for performance and cost efficiency.
• Mentor development teams on Databricks, Spark, and cloud-native solutions.
• Troubleshoot production issues and provide timely resolutions.
• Ensure adherence to security, compliance, and coding standards.

Skills

Databricks

Apache Spark

Python

PySpark

SQL

Scala

Delta Lake

Unity Catalog

Databricks Workflows

Azure

AWS

GCP

Data warehousing

Lakehouse

CI/CD

DevOps

BI integration

Stakeholder mgmt

Tools

CI/CD pipelines

Job description

KATBOTZ LLC is seeking an experienced Databricks SME to support enterprise data engineering and analytics initiatives across global clients. The ideal candidate will have deep expertise in Databricks, Spark, Delta Lake, and modern lakehouse architectures, working with cross-functional teams to design scalable data solutions.

You will lead pipelines, implement data governance, mentor teams, and ensure security and cost-efficient data processing in cloud environments (Azure, AWS, GCP).