Principal Azure Data Engineer (12 to 15 yrs) (Python / PySpark / SQL/ DataBricks) - Remote India

Nexaminds; Coimbatore District; Remote; INR 4,000,000 - 6,400,000; Full time

Benefits offered by this job

Stock options

Remote work options

Flexible hours

Benefits above the law

Mentorship program

Learning opportunities

Job summary

Nexaminds in India is seeking a Principal Data Engineer with healthcare domain experience to partner with product teams and clinical leaders to expose data products for internal and external clients. You will own end-to-end data pipelines and data models leveraging Databricks and Azure, ensuring data quality and scalability across a million+ lives.

The role requires 10+ years in data engineering, strong SQL and PySpark skills, cloud experience (AWS/GCP/Azure), and excellent communication to

Qualifications

• Bachelor's degree in CS/IT or related field.
• Master's preferred in healthcare domain.
• Strong understanding of database structures and data modeling.
• Experience with SDLC, documentation, code reviews, deployment, and operations.
• Healthcare domain data experience.

Responsibilities

• Develop Databricks pipelines and enhance existing ones.
• Work with business stakeholders to understand data needs.
• Create high-quality, scalable data models.
• Define and implement new entities for unified data model.
• Interact with customers to gather requirements for datasets.
• Identify and address data quality issues promptly.
• Extract and combine data from diverse sources.
• Design and support a platform for ad-hoc large datasets access.
• Model data and metadata to support ML/AI.
• Assist integrations from acquisitions as needed.

Skills

SQL

Python

Spark

SDLC

Data modeling

Debugging

Education

Bachelor's degree in Computer Science/IT

Master's degree in healthcare-related field (preferred)

Tools

Databricks

Azure

AWS

GCP

Azure Certification

Job description

Unlock Your Future with Nexaminds!

At Nexaminds, we're on a mission to redefine industries with AI. We're passionate about the limitless potential of artificial intelligence to transform businesses, streamline processes, and drive growth.

Join us on our visionary journey. We're leading the way in AI solutions, and we're committed to innovation, collaboration, and ethical practices. Become a part of our team and shape the future powered by intelligent machines. If you're driven by ambition, success, fun, and learning, Nexaminds is where you belong.

We are currently seeking a highly motivated Principal Data Engineer with experience in Healthcare Domain. This role collaborate closely with product teams, Data engineers and clinical leaders to expose various data products for internal and external clients. With over a million managed lives across the country and terabytes of data generated, our teams need to be continuously equipped with the tools and insights to drive strategy and innovation to further our core values of improving patient outcomes and empowering our providers.

Are you a PRO at developing Databricks Pipelines / enhance or support existing pipelines?

Are you strong in SQL / PySpark / Python debugging skills dealing with business critical data with extensive exposure to Azure?

Do you have hand-on experience in Healthcare Data?

Then don't wait any further — your next big opportunity is here!

What You’ll Do

• Develop Databricks pipeline's and enhance existing pipelines.
• Deal with business-critical data , with close monitoring Business Stakeholders.
• Use data engineering best practices to produce high quality, maximally available data models which are intuitive and trusted by stakeholders.
• Scope and implement new entities for unified data model.
• Interfacing with business customers, gathering requirements and developing new datasets in data platform
• Identifying the data quality issues to address them immediately to provide great user experience
• Extracting and combining data from various heterogeneous data sources
• Designing, implementing and supporting a platform that can provide ad-hoc access to large datasets
• Modelling data and metadata to support machine learning and AI
• Support integration efforts from acquisitions as necessary.

Qualifications

• Bachelor's degree required in computer science, information technology, or related field. Master's degree in healthcare-related field is preferred.
• Strong understanding of database structures, theories, principles, and practices.
• Working knowledge with programming or scripting languages such as Python, Spark, and SQL.
• Demonstrated track record executing best practices for the full software development life cycle (SDLC), including documentation, coding standards, code reviews, source control management, deployment processes, testing, and operations.
• Familiarity with normalized, dimensional, star schema and snowflake schematic models.
• Healthcare domain and data experience
• Working experience with Databricks preferred.
• Databricks/Microsoft Azure Certification is a plus
• Strong written and oral communication skills.

You're a Great Fit for This Role If:

• You're naturally curious. You want know what the data means, and how it will be used upstream.
• You proactively identify issues and lean in to improve data quality for common use cases.
• You are an independent contributor
• You are strong with SQL & Spark debugging skills
• 10+ years of experience working with diverse healthcare data sources, for example, claims, encounters, ADT data, FHIR, EHR data etc.
• 8+ years' using cloud-based services from AWS, GCP, or Azure.

What You Can Expect From Us

• Stock options
• Remote work options
• Flexible working hours
• Benefits above the law
• But it's not just about the work; it's about the people too. You'll be collaborating with some seriously awesome IT pros.
• You'll have access to mentorship and tons of opportunities to learn and level up.