Senior Databricks Data Engineer

Fiekon; Deutschland; Remote; EUR 110.000 - 150.000; Vollzeit

Zusammenfassung

Fiekon is seeking a Senior Databricks Data Engineer to design and build large-scale data platforms using Databricks, Spark, PySpark, and cloud technologies. The role focuses on security, governance, Unity Catalog, and fine-grained data access controls in enterprise environments.

Remote-based, long-term engagement requiring deep core data engineering expertise and hands-on development across AWS/Azure ecosystems, with emphasis on data pipelines and data governance practices.

Qualifikationen

• 10+ years of Data Engineering experience.
• 7+ years of hands-on Databricks experience.
• Expert-level Apache Spark/PySpark experience.
• Strong Python and SQL development skills.
• Deep experience with Delta Lake, Databricks Workflows, and Databricks data pipelines.
• Strong hands-on experience with Unity Catalog.
• Experience implementing row-level filtering, column masking, RBAC, permissions, and fine-grained data security in Databricks.
• Experience with large-scale data volumes and complex enterprise data environments.
• Strong experience with AWS or Azure, including S3/ADLS and cloud security.
• Experience with data governance, lineage, data quality, and enterprise security standards.
• Experience with CI/CD, Git, Terraform, or other DevOps/IaC technologies.

Kenntnisse

Data engineering

Databricks

Spark PySpark

Python

SQL

Delta Lake

Unity Catalog

RBAC & data security

Cloud: AWS/Azure

Data governance

CI/CD / IaC

Troubleshooting

Tools

Databricks Workflows

Databricks pipelines

S3 / ADLS

Terraform

Jobbeschreibung

Job Description

We are seeking a Senior Databricks Data Engineer with recent, hands-on experience designing and building large-scale data platforms using Databricks, Spark, PySpark, and cloud technologies. The ideal candidate will have deep core data engineering experience combined with strong knowledge of Databricks security, governance, Unity Catalog, and fine-grained data access controls.

Role: Senior Databricks Data Engineer

Location: Remote

Duration: Long term

Required Skills

• 10+ years of Data Engineering experience with strong recent hands-on development.
• 7+ years of hands-on Databricks experience, preferably in large-scale enterprise environments.
• Expert-level Apache Spark/PySpark experience.
• Strong Python and SQL development skills.
• Deep experience with Delta Lake, Databricks Workflows, and Databricks data pipelines.
• Strong hands-on experience with Unity Catalog.
• Demonstrated experience implementing row-level filtering, column masking, RBAC, permissions, and fine-grained data security in Databricks.
• Experience working with large-scale data volumes and complex enterprise data environments.
• Strong experience with AWS or Azure, including S3/ADLS and cloud security.
• Experience with data governance, lineage, data quality, and enterprise security standards.
• Experience with CI/CD, Git, Terraform, or other DevOps/IaC technologies is preferred.
• Strong troubleshooting and problem-solving skills.