Data Engineer Lead - Databricks

Mutt Data; United States; Remoto; USD 140.000 - 210.000; Tempo pieno

Vantaggi offerti da questo lavoro

Birthday off + extra vacation week

Referral bonuses

Maslow Monthly benefits credits

Annual Mutters' Trip

Monthly childcare reimbursement

In-Company English Lessons

Remote-first culture – work from anyw­

Descrizione del lavoro

Muttdata seeks a Data Engineer Lead to drive end-to-end data migrations, define architecture decisions, and coordinate dependencies across cloud platforms including AWS Redshift and Databricks. You will liaise with engineering, analytics, product, and business teams to ensure timely, high-quality migrations.

The role requires hands-on data engineering with PySpark, Databricks, and streaming/batch pipelines, plus strong English communication and governance mindset.

Competenze

• Experience in Data Engineering, including building and optimizing data pipelines.
• Advanced English level.
• Familiarity with BI visualization tools like Looker or Tableau.
• Experience with Databricks, Python, and Spark, building batch and streaming pipelines.

Mansioni

• Lead end-to-end data migration initiatives with secure, business-aligned transitions.
• Define and communicate data architecture decisions across cloud platforms (AWS Redshift, Databricks).
• Coordinate discovery of dependencies, schemas, data flows, and critical processes for migration.
• Own migration and cutover planning with validations and contingency measures.
• Serve as the liaison between engineering, analytics, product, and business stakeholders to ensure alignment.
• Translate technical changes in data pipelines and warehouses into clear business impact.
• Define assumptions, requirements, and acceptance criteria for migration outcomes.
• Oversee data validation to ensure data integrity against source-of-truth systems.
• Identify and mitigate migration risks; escalate blockers to protect timelines.
• Create, maintain, and improve migration runbooks, testing strategies, and rollback plans.
• Provide status updates to technical and executive stakeholders; highlight risks and next steps.
• Promote data governance, quality, and operational best practices throughout migration lifecycle.
• Align engineers, analysts, and product stakeholders on priorities and delivery expectations.

Conoscenze

Data engineering

English proficiency

Strumenti

Databricks

Python

Spark

Looker/Tableau

AWS

DBT

Google Cloud

Azure

Descrizione del lavoro

Join Our Data Products and Machine Learning Development Remote Startup!

Muttdata is a dynamic startup committed to crafting innovative systems using cutting‑edge Big Data and Machine Learning technologies.

We’re looking for a Data Engineer Lead to help take our expertise to the next level. If you consider yourself a data nerd like us, we’d love to connect!

• Leveraging our expertise, we build modern Machine Learning systems for demand planning and budget forecasting.
• Developing scalable data infrastructures, we enhance high‑level decision‑making, tailored to each client.
• Offering comprehensive Data Engineering and custom AI solutions, we optimize cloud‑based systems.
• Using Generative AI, we help e‑commerce platforms and retailers create higher‑quality ads, faster.
• Building deep learning models, we enhance visual recognition and automation for various industries, improving product categorization, quality control, and information retrieval.
• Developing recommendation models, we personalize user experiences in e‑commerce, streaming, and digital platforms, driving engagement and conversions.
• Amazon Web Services
• Astronomer
• Databricks
• We are Data Nerds
• We are Open Team Players
• We Take Ownership
• We Have a Positive Mindset

• Lead end‑to‑end data migration initiatives, ensuring a smooth, secure, and business‑aligned transition.
• Define and communicate data architecture decisions, evaluating impacts, risks, and performance considerations across cloud data platforms such as AWS Redshift, Databricks, and related technologies.
• Coordinate the discovery and documentation of dependencies, schema inventories, data flows, and critical processes involved in migration efforts.
• Own migration and cutover planning, ensuring all activities, validations, and contingency measures are properly defined and executed.
• Serve as the primary liaison between engineering, analytics, product, and business stakeholders, facilitating clear communication and alignment throughout the project lifecycle.
• Translate technical changes in data pipelines, data warehouses, and platform architecture into clear business impact assessments.
• Define and document assumptions, requirements, and acceptance criteria to ensure successful migration outcomes.
• Oversee data validation processes to guarantee the accuracy, consistency, and integrity of migrated datasets against source‑of‑truth systems.
• Proactively identify, assess, and mitigate migration‑related risks, escalating blockers and dependencies when necessary to maintain project timelines and quality standards.
• Drive problem‑solving and decision‑making in fast‑paced, ambiguous environments, helping cross‑functional teams stay focused on priorities and deliverables.
• Create, maintain, and improve project documentation, including migration runbooks, testing strategies, rollback plans, and operational procedures.
• Provide regular project status updates to technical and executive stakeholders, ensuring transparency around progress, risks, and next steps.
• Promote data governance, quality, and operational best practices throughout the migration lifecycle.
• Align engineers, analysts, and product stakeholders around priorities, timelines, and delivery expectations to ensure successful project execution.
• Experience in Data Engineering, including building and optimizing data pipelines.
• Experience working with Databricks, Python, and Spark, building batch and streaming.
• Advanced English Level.
• Familiarity with a BI visualization tool like Looker or Tableau.
• Remote-first culture – work from anywhere!
• AWS, DBT, Google Cloud, Azure & Databricks certifications fully covered
• In-Company English Lessons.
• Birthday off + an extra vacation week (Mutt Week!)
• Referral bonuses – help us grow the team & get rewarded!
• Maslow: Monthly credits to spend in our benefits marketplace.
• Annual Mutters' Trip – an unforgettable getaway with the team.
• Monthly Childcare Reimbursement – Because supporting families matters too