Remote Data Engineering Manager: Medallion Platform Lead

DevHub, Inc.; United States; On-site; USD 140,000 - 185,000; Full time

Benefits offered by this job

Fully remote work

Medical insurance

Dental & Vision plans

401(k) with company match

Unlimited PTO

Job summary

Skillable is seeking a Manager of Data Engineering to lead a remote team responsible for turning data architecture vision into scalable pipelines and products. You will manage a team of at least five engineers, own delivery, and enforce best practices across ingestion, transformation, testing, deployment, and support.

You will collaborate with the Data Architect to implement reference patterns, guardrails, and data governance while promoting strong DataOps and observability.

Qualifications

• Bachelor's degree in Computer Science, Data Science, Engineering, or relevant professional experience.
• 10+ years of relevant professional experience in software / data engineering, including building production data pipelines and data platforms.
• 2+ years of experience in lead capacity (formal or informal) including team leadership, task breakdown, reviews, delivery ownership, and cross-functional coordination.
• Experience directly managing a team, including hiring/interviewing and conducting formal performance reviews.
• Deep hands-on experience with Databricks (Spark), Boomi/Rivery, and Delta Lake patterns for scalable lakehouse processing.
• Strong experience with ETL/ELT design and implementation, including orchestration/ingestion into transformation workflows across curated layers.
• Experience partnering with application and database teams to define efficient, non-disruptive data access patterns for upstream SQL Server systems (read replicas, CDC, snapshot isolation, batching strategies).
• Demonstrated expertise implementing Medallion architecture with clear separation of concerns across Bronze/Silver/Gold, including enforcing "no consumer reads from Bronze" style guardrails.
• Strong understanding of ingestion/source variability (APIs, CDC-enabled databases, file drops) and the ability to select appropriate ingestion strategies per source contract.
• Track record of improving team maturity from reactive delivery to repeatable engineering execution (standards, patterns, documentation, and predictable throughput).
• Interest and ability in mentoring and/or training other team members as applicable.
• Experience working cross-functionally and promoting collaborative partnerships to drive results.
• Proven ability to communicate effectively to various audiences/levels, both internal and external stakeholders, including leadership through various mediums.
• Ability to present and convey material both formally and informally to all levels of an organization.
• Proven organization skills with the ability to address short-term and long-term demands simultaneously.
• Easily adaptable with the ability to pivot with changing business needs, keeping a professional demeanor and leading by example for other colleagues.
• Demonstrated ability to prioritize and manage workload and meet project deadlines.
• High level of confidence, integrity, and professional courtesy.
• Strong Microsoft suite experience, including teams or similar web conferencing and internal communication software experience preferred.
• Naturally inquisitive with a desire to learn, solve problems, and dig into detailed analysis.
• Experience working in a fully remote team is preferred but not required.
• Thorough understanding (or willingness to learn expeditiously) of business operations and processes.

Responsibilities

• Manage a team by hiring and onboarding talent, setting clear expectations, conducting formal performance reviews, and coaching accountability.
• Lead the team to deliver on the enterprise data platform roadmap by translating architecture direction into sequenced execution plans, team backlogs, and measurable outcomes.
• Create a strong engineering culture across the team by setting standards for maintainability, organization, and repeatability; growing engineers via regular 1:1s, timely feedback, development plans, and formal review cycles; and being responsible for overall team performance and cohesion.
• Own day-to-day execution for the Data Engineering team by breaking work into tasks, driving sprint-level planning, delegating effectively to grow ownership, unblocking delivery, and ensuring high-quality outcomes through engineering reviews and feedback.
• Drive implementation of the Medallion architecture (Bronze -> Silver -> Gold) with strong enforcement of layer responsibilities, ensuring repeatable and auditable pipeline behavior leveraging Boomi, Dbt, Azure Data Bricks, Boomi/Rivery, Delta tables, and Sql Server.
• Partner closely with the Data Architect to bring the architecture to life through concrete implementation patterns, reference pipelines, and guardrails - ensuring the team can consistently execute the intended approach.
• Reduce friction by driving crisp decisions and forward motion - using lightweight decision records, seeking the right input, and then executing accountability (while avoiding overly heavy process).
• Establish DataOps practices aligned with modern software development lifecycle (SDLC): CI/CD for data assets, consistent branching/release patterns, code review standards, and runbooks/operational readiness for pipelines.
• Improve pipeline observability and operational reliability by implementing monitoring for freshness/staleness, failure modes, and quality signals, and ensuring the team responds predictably to incidents and support requests.
• Drive stakeholder partnership and intake stream: collaborate with business partners to clarify requirements, reduce ad-hoc thrash, and shape requests into deliverable, well-scoped work that fits the platform strategy.
• Develop future leaders and succession plans for key roles through assigning regularly occurring responsibilities, mentoring, and strategic delegation.
• Support and promote the company values through positive interactions with both internal and external stakeholders on a regular basis.
• Other strategic business initiatives or special cross-functional project involvement as required.

Skills

Team leadership

Data engineering

Databricks

Boomi/Rivery

Delta Lake

ETL/ELT design

Medallion architecture

Data ingestion

Cross-functional collaboration

Mentoring

Education

Bachelor's degree in CS/Engineering/Data Science

Tools

Databricks (Spark)

Bo​omi/Rivery

Delta Lake

Job description

Skillable is seeking a Manager of Data Engineering to lead a remote team responsible for turning data architecture vision into scalable pipelines and products. You will manage a team of at least five engineers, own delivery, and enforce best practices across ingestion, transformation, testing, deployment, and support.

You will collaborate with the Data Architect to implement reference patterns, guardrails, and data governance while promoting strong DataOps and observability.