Sr Data Architect

embecta

Mumbai

Hybrid

INR 4,000,000 - 7,000,000

Full time

7 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

embecta is seeking a Senior Data Engineer to design, build, and operate scalable ETL/ELT pipelines across Azure, Databricks, SAP sources, and the lakehouse, enabling reliable BI and AI/ML workloads.

You will optimize Databricks notebooks, Delta Lake tables, and Unity Catalog permissions, implement data-quality checks, and contribute to CI/CD for data pipelines while partnering with analytics teams.

Qualifications

  • Bachelor's degree or higher in a technical field; advanced degree preferred.
  • 8+ years in data engineering, ETL/ELT development, or related data-platform role.
  • Hands-on experience with Azure Data Factory and Databricks using Python, PySpark, or Spark SQL.
  • Experience designing and maintaining enterprise data pipelines in cloud environments.
  • Experience supporting BI and AI/ML data needs, including Power BI datasets and feature pipelines.

Responsibilities

  • Design, build, and maintain scalable production ETL/ELT pipelines across Azure, Databricks, and SAP sources.
  • Develop and optimize Databricks notebooks, Delta Lake tables, and Unity Catalog for BI/ML workloads.
  • Integrate data from SAP S/4HANA, SAP Datasphere, and other apps into the lakehouse using orchestration tools.
  • Implement data-quality checks, monitoring, observability, and alerting to prevent downstream issues.
  • Build and tune curated datasets and semantic models for Power BI reporting and dashboards.
  • Mentor junior data engineers and participate in code reviews and CI/CD practices.

Skills

SQL
Python

Education

Bachelor's degree in Computer Science, Information Systems, Engineering, Data Science, or related field

Tools

Azure Data Lake
Azure Data Factory
Azure Databricks
Microsoft Fabric
Delta Lake
Unity Catalog
Power BI
SAP S/4HANA

Job description

Hybrid

IND Bangalore

IND Kolkata

IND Gurgaon

IND Mumbai

IND Chennai - Bharati Vilas

Full time

R21-00608460

embecta is a global medical device company with a 100-year legacy in insulin delivery and diabetes care. Driven by innovation, purpose, and a commitment to improving lives, we are expanding our portfolio of solutions to serve even more patients, healthcare providers, and communities around the world.

RESPONSIBILITIES:
  • Design, build, and maintain scalable production ETL/ELT pipelines across Azure, Databricks, and SAP source systems in accordance with enterprise architecture and engineering standards.

  • Develop and optimize Databricks notebooks and jobs, Delta Lake tables, and Unity Catalog permissions to support BI reporting and AI/ML workloads.

  • Integrate data from SAP S/4HANA, SAP Datasphere, and other enterprise applications into the lakehouse using Azure Data Factory, Microsoft Fabric, or equivalent orchestration tools.

  • Implement data-quality checks, monitoring, observability, and alerting so pipeline issues are identified and resolved before affecting downstream reporting or AI/ML consumers.

  • Build and tune curated datasets and semantic models that support Power BI reporting, standard KPIs, and single-source-of-truth dashboards.

  • Partner with data architects and senior engineers to define and implement enterprise data-integration patterns and reference architectures.

  • Write clean, tested, and version-controlled code, and actively participate in code reviews and CI/CD practices for data pipelines.

  • Own pipeline reliability by troubleshooting production issues, participating in on-call or escalation rotations as needed, and documenting root causes and corrective actions.

  • Collaborate within the Hub & Spoke model with analytics engineers and business teams to understand data needs and promote reusable data-product standards.

  • Mentor junior data engineers on coding standards, pipeline design, troubleshooting, and platform conventions.

  • Stay current on capabilities across Azure, Microsoft Fabric, Databricks, and the broader data-engineering landscape, and provide practical recommendations to the team.

EXPERIENCE & EDUCATION:
  • Bachelor's degree in Computer Science, Information Systems, Engineering, Data Science, or a related field; an advanced degree is preferred.

  • 8+ years of experience in data engineering, ETL/ELT development, or a related data-platform engineering role.

  • Hands-on experience building and operating pipelines in Azure Data Factory and Databricks using Python, PySpark and/or Spark SQL, including Delta Lake table design.

  • Experience designing and maintaining enterprise data pipelines in cloud environments, with attention to cost, performance, reliability, and scalability tradeoffs.

  • Experience supporting both BI and AI/ML data needs, including curated datasets for Power BI and feature pipelines for model training.

  • Preferred experience in manufacturing, supply chain, life sciences, healthcare, or another regulated industry.

  • Willingness to work overlapping hours with US and other global stakeholders as needed for cross-time-zone collaboration.

KNOWLEDGE, SKILLS AND ABILITIES:
  • Strong SQL and Python skills, supported by sound software-engineering practices in version control, testing, code review, and CI/CD.

  • Working knowledge of Azure data services, including Azure Data Lake, Azure Data Factory, Azure Databricks, and Microsoft Fabric or comparable cloud services.

  • Practical experience with SAP S/4HANA and SAP Datasphere data extraction is preferred.

  • Knowledge of Databricks or modern lakehouse platforms, Delta Lake, and Unity Catalog or similar access-control tooling.

  • Experience with Power BI, enterprise analytics, semantic models, dimensional modeling, star schemas, and data-integration patterns.

  • Working knowledge of data governance, data quality, monitoring, and observability practices.

  • Clear, proactive verbal and written communication, including the ability to raise issues, document technical designs and decisions, and collaborate with architects, analysts, and business stakeholders.

  • Ability to operate in a Hub & Spoke or federated data organization, following centrally established standards while adapting to domain-specific needs.

  • Sound engineering judgment, a continuous-improvement mindset, and the ability to deliver reliable pipelines in a fast‑paced environment with competing priorities.

#LI-AH1

embecta is an Equal Opportunity/Affirmative Action Employer. We do not unlawfully discriminate on the basis of race, color, religion, age, sex, creed, national origin, ancestry, citizenship status, marital or domestic or civil union status, familial status, affectional or sexual orientation, gender identity or expression, genetics, disability, military eligibility or veteran status, or any other protected status.

At embecta, a career is more than a job, it is an opportunity to make a meaningful difference in the lives of about 30 million people around the world who depend on our products to manage a chronic condition every single day.

As we expand our capabilities, reach, and impact, there’s never been a more exciting time to join us.

Follow embecta on LinkedIn

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Sr Data Architect
Sr Data Architect

embecta • Gurugram District

Hybrid
INR 2,500,000 - 4,200,000
Sr Data Architect
Sr Data Architect

1720 embecta Medical II LLC • Bengaluru

On-site
INR 3,000,000 - 6,000,000
Sr Data Architect
Sr Data Architect

embecta • Maharashtra

On-site
INR 4,000,000 - 6,000,000
Sr Data Architect
Sr Data Architect

embecta • Bengaluru

On-site
INR 2,000,000 - 4,000,000
Sr Data Architect
Sr Data Architect

Embecta Corp. • Bengaluru, Kolkata, Gurugram District, Mumbai

Hybrid
INR 4,000,000 - 7,000,000
Sr Data Architect
Sr Data Architect

embecta • Kolkata

On-site
INR 2,600,000 - 4,200,000
Senior Data Engineer
Senior Data Engineer

Bayer AG • Bengaluru

On-site
INR 2,200,000 - 3,400,000
Data Engineer
Data Engineer

Bristol Myers Squibb • Hyderabad

On-site
INR 1,500,000 - 2,400,000
Data Engineer
Data Engineer

Bristolmyerssquibb • Hyderabad

On-site
INR 900,000 - 1,400,000
Technical Lead - BI
Technical Lead - BI

Medline Industries, LP • Pune District

On-site
INR 4,000,000 - 7,000,000
Health insurance
401(k) contributions
Paid time off
+1