Lead Data Engineer

Providence Global Center; Hyderabad; On-site; INR 1,800,000 - 3,200,000; Full time

Benefits offered by this job

Competitive Pay

Supportive Reporting Relation

Job summary

Providence India, part of Providence Global Center, is building a robust data engineering platform. You will engineer, develop, and support the lifecycle of data archival, conversion services, data warehouse, and Azure-based ETL/ELT processes.

You will translate data insights into actionable recommendations for stakeholders across the organization. The role requires strong skills in SQL, Azure data services, Databricks, Python, and API development, with a focus on delivering reliable data

Qualifications

• 6–9 years of experience in Azure Data Engineering.
• 6–9 years of experience in BI Development.
• Experience with cloud technologies such as Azure/AWS/Google Cloud.
• Experience with Apache Spark and Azure Databricks.
• Working knowledge of Microsoft Fabric.

Responsibilities

• Work with service teams to determine project engagement and data reporting needs.
• Gather requirements, data analysis and modelling.
• Create scripts to support enhancements.
• Work with external vendors on bi-directional API integrations.
• Collaborate with DWH and Reporting teams on data analysis and integrity.
• Develop solutions across the Microsoft stack endpoints.

Skills

SQL

Azure SQL

Databricks

Python

Spark

C# API development

Data modeling

Data analysis

Team collaboration

Education

Bachelor’s Degree in Computer Science / Data Analytics / IS

Tools

Azure Data Factory

Azure Functions

Azure SQL

PowerBI

Kubernetes

Job description

Select how often (in days) to receive an alert:

Providence, one of the US’s largest not-for-profit healthcare systems, is committed to high quality, compassionate healthcare for all. Driven by the belief that health is a human right and the vision, ‘Health for a better world’, Providence and its 121,000 caregivers strive to provide everyone access to affordable quality care and services.

Providence has a network of 51 hospitals, 1,000+ care clinics, senior services, supportive housing, and other health and educational services in the US.

Providence India is bringing to fruition the transformational shift of the healthcare ecosystem to Health 2.0. The India center will have focused efforts around healthcare technology and innovation, and play a vital role in driving digital transformation of health systems for improved patient outcomes and experiences, caregiver efficiency, and running the business of Providence at scale.

Why Us?

• Competitive Pay
• Supportive Reporting Relation

Lead Data Engineer, Enterprise Platform and Technology Services - LES Data Team

Organization Background:

The ESI Enablement & Platform Technology - LES Team provides analytical services to business units and IS Stakeholders. In this role you will engineer, develop, and support the complete lifecycle of the Enterprise Data Archival and Electronic Data Conversion service, Caregiver Training, Data Warehouse, and a variety of Azure Services for ETL/ELT processes. The successful candidate will possess a strong understanding of Azure Data Services, Data Analysis, and ability to articulate findings and recommendations to stakeholders .

What will you be responsible for?

• Strong knowledge of SQL, Azure SQL, TSQL
• Strong knowledge of database, datawarehouse and data analysis
• Strong knowledge of Databricks, python, spark.
• Working experience in writing scripts on C# or similar languages for API development
• Integrate unstructured data from multiple systems to create a single source of truth
• Develop, monitor, and manage report curation and data modeling
• Creating/implementing/Adopting API Governance and Standards for Data Analytics
• Creating APIs to integrate unstructured data from a variety of systems to create a single source of truth (SailPoint, ServiceNow, Project Online, ADO, Intune, Azure licensing, and other systems of records for single/bi-direction data sets)
• Working on Azure Services like Azure Data Factory, Azure Workbook, Log Analytics, Azure Functions, and other data analytics tools
• Leveraging various Azure Services such as Azure Storage, Logic Apps, Data Factory, Azure SQL SaaS, Runbooks, Automation, Graph API, and various other data tools Developing/maintaining microservice automation (Prisma Cloud/Kubernetes)
• Working experience in data visualization, PowerBI, writing complex SQL queries

What would your day look like?

• Work closely with service teams to determine project engagement and priority, business data reporting and analysis requirements
• Gather Requirements, Data analysis and modelling
• Create scripts to support enhancements
• Work with external vendors on bi-directional API integrations
• Collaborate with DWH and Reporting teams on data analysis and integrity
• Gather requirements, develop, and implement solutions across all endpoint technologies in the Microsoft stack

Who we are looking for?

• Minimum 6-9 years of experience in Azure Data Engineering
• Minimum 6-9 years of experience in BI Development
• 6-9 years of experience working in cloud technologies such as Azure/AWS/Google cloud service
• Experience with Apache Spark and Azure Databricks
• Working knowledge of Microsoft Fabric
• Ability to troubleshoot technical problems, demonstrate problem solving
• Ability to effectively communicate and excellent interpersonal skills
• Experience working in Agile/sprints in a global team setup
• Bachelor’s Degree in Computer Science, Data Analytics, Business Management, or IS

Providence’s vision to create ‘Health for a Better World’ aids us to provide a fair and equitable workplace for all in our employment, whether temporary, part-time or full time, and to promote individuality and diversity of thought and background, and acknowledge its role in the organization’s success. This makes us committed towards equal employment opportunities, regardless of race, religion or belief, color, ancestry, disability, marital status, gender, sexual orientation, age, nationality, ethnic origin, pregnancy, or related needs, mental or sensory disability, HIV Status, or any other category protected by applicable law. In furtherance to our mission in building a more inclusive and equitable environment, we shall, from time to time, undertake programs to assist, uplift and empower underrepresented groups including but not limited to Women, PWD (Persons with Disabilities), LGTBQ+ (Lesbian, Gay, Transgender, Bisexual or Queer), Veterans and others. We strive to address all forms of discrimination or harassment and provide a safe and confidential process to report any misconduct.

Providence Global Center 8th Floor, Skyview 1083/1, Raidurgam, Hitech City Main Rd, Hyderabad, Telangana 500081, India