Staff Data Engineer

Abbott Laboratories; Madison (WI); On-site; USD 99,000 - 199,000; Full time

Job summary

Abbott Laboratories seeks a Staff Data Engineer in Madison, WI to lead the most complex data initiatives with hands‑on delivery and strong design leadership. You will build scalable data products, define data contracts, and ensure observability and quality across the analytics platform.

Ideal candidates combine deep technical execution with business context, mentor peers, and collaborate with teams across IT and Enterprise Architecture.

Qualifications

• Bachelor's degree in a technical field; 8+ years in data engineering or related discipline.
• Demonstrated ownership of design and hands-on delivery for complex data products, pipelines, or platforms.
• Strong SQL and Python with data modeling experience (relational, dimensional, semi-structured).
• Experience with modern data platforms such as Databricks (Spark) and cloud services (AWS/Azure/GCP).
• Familiarity with CI/CD, automated testing, and orchestration tools (Databricks Workflows, Delta Live Tables, Airflow, dbt).
• Experience delivering governed data using catalogs, lineage, access control, and data quality capabilities.

Responsibilities

• Own technical design and hands-on delivery for the most complex data work across data products and initiatives.
• Produce design documentation and drive design reviews with peers.
• Build and evolve data products that are documented, governed, and observable for reuse.
• Define data contracts, schemas, and freshness expectations for published products.
• Design data products for AI/ML with reproducibility, lineage, and data quality controls.
• Diagnose and resolve complex production and data quality issues; drive root cause analysis.
• Leverage AI-assisted development tooling while ensuring security, privacy, and quality.
• Optimize compute, storage, and pricing; consider serverless options and cost-to-serve implications.
• Mentor engineers and review code/design for quality and consistency.
• Lead adoption of testing, observability, CI/CD, and delivery practices.

Skills

Advanced SQL

Python

Databricks / Spark

Cloud platforms

CI/CD & testing

Data governance

ETL / pipelines

Stakeholder collaboration

Version control

Education

Bachelor's degree in Data Science, Computer Science, Information Systems, Mathematics, or Engineering

Tools

Databricks

Delta Live Tables

Airflow

dbt

Job description

The Staff Data Engineer is a senior, hands‑on technical contributor within an Enterprise Data domain, owning technical design and the most complex implementation work for assigned data products, capabilities, and integrations. The role establishes, communicates, and evolves the technical approach for the work it leads and is accountable for the quality, durability, and supportability of the solutions it shapes.

Staff Data Engineers work directly with business stakeholders to understand needs and shape technical solutions, engaging at a level appropriate to the work they lead. The role is expected to be fluent in both technical execution and business context, translating between them without losing precision in either.

The Staff Data Engineer sets technical direction for assigned capabilities and initiatives within the domain, applies enterprise standards and platform patterns, engages Principal Engineers where cross‑domain considerations apply, and multiplies the effectiveness of the domain team through design leadership, code review, and mentoring.

This role is based in Madison, WI.

Essential Duties

Include, but are not limited to, the following:

Technical design and solutioning

• Own technical design and hands‑on delivery for the most complex or highest‑risk work across assigned data products, capabilities, and initiatives, including data models, pipeline architecture, integration patterns, and platform usage decisions.

• Produce design documentation that allows others to understand, review, and build on technical decisions, and drive design review with domain and cross‑domain peers.

• Build and evolve assigned domain data products so they are documented, discoverable, governed, observable, and supported throughout their lifecycle for reuse across analytics, semantic layers, machine learning, and AI applications.

• Define and uphold data contracts for the products the domain publishes, including schemas, freshness and availability expectations, breaking‑change policy, and producer and consumer responsibilities.

• Design data products for AI and machine learning consumption with reproducibility, lineage, timeliness, and defined data quality controls appropriate to the use case.

• Diagnose and resolve complex production and data quality issues, and drive root cause resolution rather than recurring remediation.

• Use approved AI‑assisted development tooling where appropriate to accelerate engineering work, validating output against correctness, security, privacy, and quality standards.

• Own the technical cost efficiency of assigned data products, including compute and warehouse sizing, job and query optimization, serverless and storage tradeoffs, and cost-to‑serve implications.

• Evaluate and recommend tools, patterns, and platform capabilities within enterprise standards, raising cases where an exception may be warranted.

Stakeholder engagement

• Work directly with business stakeholders to understand needs, clarify requirements, and shape technical solutions.

• Communicate technical concepts, tradeoffs, constraints, and delivery implications clearly to non‑technical audiences.

• Participate in technical working sessions with partner organizations such as Software Engineering, IT Applications, and Enterprise Architecture on integration and design questions affecting the domain.

• Surface scope, priority, resourcing, and technical‑debt implications of technical decisions for leadership review rather than resolving them independently.

Technical leadership and multiplication

• Serve as a technical lead for assigned domain capabilities and initiatives, guiding engineers through design and implementation without formal authority.

• Provide code and design review that raises quality and consistency across the domain team.

• Mentor engineers and support their technical growth, including engineers transitioning into data engineering from adjacent disciplines.

• Engage Principal Engineers on cross‑domain architecture patterns and enterprise standards, and contribute domain perspective to initiatives that extend beyond the domain.

• Lead adoption and continuous improvement of domain testing, observability, CI/CD, and delivery practices within enterprise standards.

Operational excellence and compliance

• Ensure delivered solutions meet requirements for quality, reliability, scalability, performance, observability, security, privacy, access, and lifecycle management.

• Design and implement appropriate handling of protected health information and other sensitive data, including access control, masking and de‑identification, lineage, retention, and audit support consistent with HIPAA, CLIA, and enterprise privacy standards.

• Serve as domain subject matter expert for significant production incidents affecting domain systems.

• Uphold company mission and values through accountability, innovation, integrity, quality, and teamwork.

• Support and comply with the company's Quality Management System policies and procedures.

• Maintain regular and reliable attendance.

Ability to act with an inclusion mindset and model these behaviors for the organization.

Minimum Qualifications

• Bachelor's degree in Data Science, Computer Science, Information Systems, Mathematics, or Engineering.

• 8+ years of progressively responsible experience in data engineering or a closely related discipline.

• Demonstrated experience owning technical design and hands‑on delivery for complex data products, pipelines, or platform capabilities from design through production support.

• Advanced SQL and Python, with experience applying relational, dimensional, and semi‑structured data modeling approaches.

• Experience designing and operating scalable, reliable distributed data systems on a modern data platform such as Databricks, including Spark, and using cloud infrastructure services such as AWS, Azure, or Google Cloud Platform.

• Experience with version control, automated testing, and CI/CD practices, and with orchestration and transformation tooling such as Databricks Workflows, Delta Live Tables, Airflow, or dbt.

• Experience delivering governed data using catalog, lineage, access control, and data quality capabilities such as Unity Catalog.

• Demonstrated ability to work directly with business stakeholders to translate needs into technical solutions, mentor engineers, and raise technical quality across a team.

• Demonstrated ability to perform the essential duties of the position with or without accommodation.

Preferred Qualifications

• Experience with streaming and event‑driven architectures such as Kafka.

• Experience in a regulated environment such as HIPAA, CLIA, SOX, FDA, ISO 13485, or IEC 62304, ideally in life sciences, diagnostics, or clinical laboratory data handling protected health information.

• Experience with semantic layers, metric definitions, data products, or feature pipelines supporting analytics, machine learning, and AI use cases in production.

• Experience with open data file and table formats such as Parquet, Avro, and Delta Lake.

• Experience with REST API development and integration patterns.

• Familiarity with business intelligence concepts and semantic consumption patterns, including how data models and platform design affect performance in tools such as Tableau.

The base pay for this position is $99,300.00 – $198,700.00. In specific locations, the pay range may vary from the range posted.