Data Engineer

TigerHire; Pune District; Sur place; INR 1 000 000 - 1 500 000; Plein temps

Résumé du poste

TigerHire in Pune/Bangalore is seeking a Data Engineer with 4–7 years of experience to build automated data extraction solutions for healthcare vendor portals, transform and validate data, and migrate it via REST APIs.

You will work on MFA challenges, ensure data quality, and develop reusable connectors while coordinating with US-based customers in English.

Qualifications

• 4–7 years of experience in data engineering, system integrations, or data migration.
• Strong programming skills in Python or Node.js/TypeScript for production pipelines.
• Strong understanding of SQL, data transformation, and data-wrangling techniques.
• Experience integrating with REST APIs at scale, including authentication, pagination, batching, and retry handling.
• Proven ability to develop reusable automation frameworks and configurable connectors.
• Strong problem-solving skills and the ability to manage multiple data migration projects under tight deadlines.
• Excellent English communication skills and confidence interacting with non-technical customers in the US.

Responsabilités

• Data Extraction and Web Scraping: Build automated crawlers to access healthcare vendor portals.
• Data Transformation and Validation: Map fields, clean, deduplicate, validate, and normalise data.
• Data Migration and API Integration: Load data into target systems via REST APIs with batching and retries.
• Reusable Connector Development: Create configurable, reusable data connectors and automation frameworks.
• Customer Coordination and Migration Execution: Manage credentials, scope, and cutovers with customers.
• Data Security and Compliance: Ensure HIPAA-compliant handling and secure credentials.

Connaissances

Python

Node.js/TS

SQL

REST APIs

Data pipelines

Automation frameworks

English communication

Outils

AWS

Docker

Description du poste

This role is for one of Weekday’s clients

Salary range Rs 1000000 - Rs 1500000 (ie INR 10 - 15 LPA)

Min Experience: 4+ years

Location Pune, Bangalore

JobType: full-time We are looking for a skilled Data Engineer with hands-on experience in data engineering, web scraping, system integrations, and data migration. The role involves building automated data extraction solutions to retrieve information from healthcare vendor portals, transforming and validating the extracted data, and migrating it into target systems through REST APIs.

Requirements

Key Responsibilities

• Data Extraction and Web Scraping

Design, develop, and maintain automated crawlers to access healthcare vendor portals such as WebPT, Prompt, Raintree, Clinicient, and Jane.

Extract and retrieve structured information, including patient records, insurance details, appointments, provider information, documents, and account balances.

Handle portal-specific challenges such as multi-factor authentication (MFA), session timeouts, pagination, rate limits, and frequent UI or layout changes.

• Data Transformation and Validation

Map vendor-specific fields to the target data model and ensure accurate data transformation.

Clean, deduplicate, validate, and normalise extracted datasets.

Identify unmapped fields, inconsistencies, and missing information, and flag them for resolution.

Use SQL and data-processing libraries such as Pandas to perform data wrangling and validation.

• Data Migration and API Integration

Load extracted and transformed data into target systems through REST APIs.

Ensure data is migrated in the correct sequence with appropriate authentication, batching, pagination, and retry mechanisms.

Implement structured logging, error handling, reconciliation, and rollback processes to maintain data integrity.

Perform test migrations, production go-live cutovers, and post-migration validation.

• Reusable Connector Development

Convert one-time scripts into reusable, configurable, and scalable data connectors.

Develop standardised frameworks that reduce the time and effort required to onboard new healthcare vendors.

Improve automation, reliability, and maintainability across data extraction and migration workflows.

• Customer Coordination and Migration Execution

Work closely with customers and Onboarding Managers to obtain portal credentials, understand migration requirements, and finalise data scope.

Coordinate customer sign-offs before production go-live.

Manage test data loads, migration cutovers, and reconciliation activities.

Troubleshoot and resolve post-go-live data issues promptly.

Manage multiple migration projects simultaneously while meeting fixed delivery timelines.

Communicate effectively with non-technical US-based customers in English.

• Data Security and Compliance

Handle sensitive patient information securely throughout extraction, processing, storage, and migration.

Follow HIPAA requirements and applicable data protection practices.

Ensure appropriate access controls and secure handling of customer credentials and healthcare data.

AWS and Docker

Large Language Models (LLMs) for automated field mapping and document parsing

Qualifications and Experience

• 4–7 years of experience in data engineering, system integrations, or data migration.
• Strong programming skills in Python or Node.js/TypeScript, with experience developing production-ready scripts and pipelines.
• Strong understanding of SQL, data transformation, and data-wrangling techniques.
• Experience integrating with REST APIs at scale, including authentication, pagination, batching, and retry handling.
• Proven ability to develop reusable automation frameworks and configurable connectors rather than relying solely on one-off scripts.
• Strong problem-solving skills and the ability to manage multiple data migration projects under tight deadlines.
• Excellent English communication skills and confidence interacting with non-technical customers in the US.

Preferred Experience

• Exposure to US healthcare data and Electronic Health Record (EHR) or Practice Management (PM) systems, preferably in Physical Therapy (PT), Occupational Therapy (OT), or Speech-Language Pathology (SLP).
• Familiarity with healthcare data standards and terminology, including HL7, FHIR, X12 (837/835), CPT, and ICD-10 codes.