Lead Data Engineer – Databricks

Jobtailor; Deutschland; Remote; EUR 90.000 - 130.000; Vollzeit

Zusammenfassung

Jobtailor is seeking an experienced data migration lead to own end-to-end initiatives, ensuring secure, business-aligned transitions across cloud platforms like AWS Redshift and Databricks. You will coordinate dependencies, validate data integrity, and align engineering, analytics, product, and business stakeholders to drive timely delivery.

The role requires advanced English, strong data engineering experience, and fluency with BI tools such as Looker or Tableau to translate technical changes

Qualifikationen

• Experience in Data Engineering, including building and optimizing data pipelines.
• Experience working with Databricks, Python, and Spark, building batch and streaming
• Advanced English Level
• Familiarity with a BI visualization tool like Looker or Tableau

Aufgaben

• Lead end-to-end data migration initiatives, ensuring a smooth, secure, and business-aligned transition.
• Define and communicate data architecture decisions across cloud data platforms such as AWS Redshift, Databricks, and related technologies.
• Coordinate discovery and documentation of dependencies, schema inventories, data flows, and critical migration processes.
• Own migration and cutover planning, including validations and contingency measures.
• Serve as primary liaison between engineering, analytics, product, and business stakeholders.
• Translate technical changes into clear business impact assessments.
• Define and document assumptions, requirements, and acceptance criteria.
• Oversee validation of migrated datasets for accuracy, consistency, and integrity.
• Identify, assess, and mitigate migration-related risks and elevate blockers and dependencies.
• Drive problem-solving and decision-making in fast-paced, ambiguous environments.
• Create and maintain migration runbooks, testing strategies, rollback plans, and operational procedures.
• Provide project status updates to technical and executive stakeholders.
• Promote data governance, quality, and operational best practices.
• Align engineers, analysts, and product stakeholders around priorities, timelines, and delivery expectations.

Kenntnisse

Data Migration Leadership

Data Engineering

Data Pipeline Optimization

Data Validation

Risk Assessment

Tools

Databricks

AWS Redshift

Python

Spark

Looker

Tableau

Jobbeschreibung

• Lead end-to-end data migration initiatives, ensuring a smooth, secure, and business-aligned transition
• Define and communicate data architecture decisions across cloud data platforms such as AWS Redshift, Databricks, and related technologies
• Coordinate discovery and documentation of dependencies, schema inventories, data flows, and critical migration processes
• Own migration and cutover planning, including validations and contingency measures
• Serve as primary liaison between engineering, analytics, product, and business stakeholders
• Translate technical changes into clear business impact assessments
• Define and document assumptions, requirements, and acceptance criteria
• Oversee validation of migrated datasets for accuracy, consistency, and integrity
• Identify, assess, and mitigate migration-related risks and elevate blockers and dependencies
• Drive problem-solving and decision-making in fast-paced, ambiguous environments
• Create and maintain migration runbooks, testing strategies, rollback plans, and operational procedures
• Provide project status updates to technical and executive stakeholders
• Promote data governance, quality, and operational best practices
• Align engineers, analysts, and product stakeholders around priorities, timelines, and delivery expectations

Requirements

• Experience in Data Engineering, including building and optimizing data pipelines
• Experience working with Databricks, Python, and Spark, building batch and streaming
• Advanced English Level
• Familiarity with a BI visualization tool like Looker or Tableau

Core Competencies

Demonstrates expertise in leading data migration initiatives, ensuring data integrity and alignment with business objectives. Proficient in data engineering practices, including building and optimizing data pipelines across cloud platforms.

Highest-signal resume keywords

• Data Migration Leadership
• Data Engineering
• AWS Redshift
• Databricks
• Python

Hard Skills

• Data Pipeline Optimization
• Batch Processing
• Streaming Processing
• Data Architecture
• Data Validation
• Risk Assessment
• Contingency Planning
• Data Governance
• Business Impact Assessment
• Schema Documentation

Soft Skills

• Problem-Solving
• Communication
• Collaboration
• Stakeholder Management
• Decision-Making

Industry Keywords

• Data Migration
• Data Governance
• Data Quality
• Operational Best Practices
• Business Intelligence

Tools & Technologies

• Databricks
• AWS Redshift
• Looker
• Tableau
• Spark