Sr Data Architect

embecta

Bengaluru

On-site

INR 2,000,000 - 4,000,000

Full time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

embecta is seeking an experienced Senior Data Engineer to design, build, and optimize scalable data pipelines across Azure, Databricks, and SAP systems. You will develop Delta Lake tables and Unity Catalog permissions to support BI reporting and AI/ML workloads.

You will collaborate with data architects and engineers to ensure reliable, reusable data-products, mentor juniors, and stay current with Azure, Fabric, and lakehouse capabilities to drive data-driven decisions across the organization.

Qualifications

  • 8+ years of data engineering / ETL/ELT experience in cloud environments.
  • Hands-on with Azure Data Factory and Databricks using Python / PySpark.
  • Experience designing enterprise data pipelines with cost, performance, reliability tradeoffs.
  • Experience supporting BI and AI/ML data needs, including Power BI datasets.
  • Regulated industry experience preferred.

Responsibilities

  • Design, build, and maintain scalable production ETL/ELT pipelines across Azure, Databricks, and SAP source systems.
  • Develop and optimize Databricks notebooks and Delta Lake tables to support BI reporting and AI/ML workloads.
  • Integrate SAP S/4HANA and SAP Datasphere data into lakehouse using Azure Data Factory or Fabric.
  • Implement data-quality checks, monitoring, and alerting for reliable downstream reporting.
  • Build curated datasets and semantic models for Power BI dashboards and KPIs.
  • Collaborate with data architects to implement enterprise data integration patterns.
  • Write clean, tested, and version-controlled code with CI/CD practices.
  • Own pipeline reliability and participate in on-call rotations.
  • Collaborate in Hub & Spoke model with analysts and business teams.
  • Mentor junior data engineers on coding standards and platform conventions.
  • Stay current on Azure, Fabric, Databricks, and data-engineering trends.

Skills

SQL
Python
Azure
Databricks
Spark SQL
Power BI
CI/CD
Data modeling
Data governance

Education

Bachelor's degree in CS/IS/Engineering

Tools

Azure Data Factory
Databricks
Delta Lake
Unity Catalog
Power BI
SAP S/4HANA
SAP Datasphere
Microsoft Fabric

Job description

embecta is a global medical device company with a 100-year legacy in insulin delivery and diabetes care. Driven by innovation, purpose, and a commitment to improving lives, we are expanding our portfolio of solutions to serve even more patients, healthcare providers, and communities around the world.

Responsibilities
  • Design, build, and maintain scalable production ETL/ELT pipelines across Azure, Databricks, and SAP source systems in accordance with enterprise architecture and engineering standards.
  • Develop and optimize Databricks notebooks and jobs, Delta Lake tables, and Unity Catalog permissions to support BI reporting and AI/ML workloads.
  • Integrate data from SAP S/4HANA, SAP Datasphere, and other enterprise applications into the lakehouse using Azure Data Factory, Microsoft Fabric, or equivalent orchestration tools.
  • Implement data-quality checks, monitoring, observability, and alerting so pipeline issues are identified and resolved before affecting downstream reporting or AI/ML consumers.
  • Build and tune curated datasets and semantic models that support Power BI reporting, standard KPIs, and single-source-of-truth dashboards.
  • Partner with data architects and senior engineers to define and implement enterprise data-integration patterns and reference architectures.
  • Write clean, tested, and version-controlled code, and actively participate in code reviews and CI/CD practices for data pipelines.
  • Own pipeline reliability by troubleshooting production issues, participating in on-call or escalation rotations as needed, and documenting root causes and corrective actions.
  • Collaborate within the Hub & Spoke model with analytics engineers and business teams to understand data needs and promote reusable data-product standards.
  • Mentor junior data engineers on coding standards, pipeline design, troubleshooting, and platform conventions.
  • Stay current on capabilities across Azure, Microsoft Fabric, Databricks, and the broader data-engineering landscape, and provide practical recommendations to the team.
Experience & Education
  • Bachelor's degree in Computer Science, Information Systems, Engineering, Data Science, or a related field; an advanced degree is preferred.
  • 8+ years of experience in data engineering, ETL/ELT development, or a related data-platform engineering role.
  • Hands‑on experience building and operating pipelines in Azure Data Factory and Databricks using Python, PySpark and/or Spark SQL, including Delta Lake table design.
  • Experience designing and maintaining enterprise data pipelines in cloud environments, with attention to cost, performance, reliability, and scalability tradeoffs.
  • Experience supporting both BI and AI/ML data needs, including curated datasets for Power BI and feature pipelines for model training.
  • Preferred experience in manufacturing, supply chain, life sciences, healthcare, or another regulated industry.
  • Willingness to work overlapping hours with US and other global stakeholders as needed for cross-time-zone collaboration.
Knowledge, Skills And Abilities
  • Strong SQL and Python skills, supported by sound software‑engineering practices in version control, testing, code review, and CI/CD.
  • Working knowledge of Azure data services, including Azure Data Lake, Azure Data Factory, Azure Databricks, and Microsoft Fabric or comparable cloud services.
  • Practical experience with SAP S/4HANA and SAP Datasphere data extraction is preferred.
  • Knowledge of Databricks or modern lakehouse platforms, Delta Lake, and Unity Catalog or similar access‑control tooling.
  • Experience with Power BI, enterprise analytics, semantic models, dimensional modeling, star schemas, and data‑in‑tegration patterns.
  • Working knowledge of data governance, data quality, monitoring, and observability practices.
  • Clear, proactive verbal and written communication, including the ability to raise issues, document technical designs and decisions, and collaborate with architects, analysts, and business stakeholders.
  • Ability to operate in a Hub & Spoke or federated data organization, following centrally established standards while adapting to domain‑specific needs.
  • Sound engineering judgment, a continuous‑improvement mindset, and the ability to deliver reliable pipelines in a fast‑paced environment with competing priorities.

embecta is an Equal Opportunity/Affirmative Action Employer. We do not unlawfully discriminate on the basis of race, color, religion, age, sex, creed, national origin, ancestry, citizenship status, marital or domestic or civil union status, familial status, affectional or sexual orientation, gender identity or expression, genetics, disability, military eligibility or veteran status, or any other protected status.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Sr Data Architect
Sr Data Architect

embecta • Maharashtra

On-site
INR 4,000,000 - 6,000,000
Sr Data Architect
Sr Data Architect

embecta • Gurugram District

Hybrid
INR 2,500,000 - 4,200,000
Sr Data Architect
Sr Data Architect

embecta • Mumbai

Hybrid
INR 4,000,000 - 7,000,000
Sr Data Architect
Sr Data Architect

1720 embecta Medical II LLC • Bengaluru

On-site
INR 3,000,000 - 6,000,000
Sr Data Architect
Sr Data Architect

embecta • Kolkata

On-site
INR 2,600,000 - 4,200,000
Sr Data Architect
Sr Data Architect

Embecta Corp. • Bengaluru, Kolkata, Gurugram District, Mumbai

Hybrid
INR 4,000,000 - 7,000,000
Data Engineer
Data Engineer

Techcarrot • Chennai

On-site
INR 1,500,000 - 2,100,000
Sr Data Engineer
Sr Data Engineer

The Versatile Club • India

Remote
INR 1,500,000 - 2,500,000
Lead Data Engineer
Lead Data Engineer

Algoworks • Dadri

On-site
INR 1,200,000 - 2,400,000
Senior Data Engineer
Senior Data Engineer

Kanini Software Solutions • Pune District, Chennai, Bengaluru

Hybrid
INR 3,500,000 - 7,000,000