Senior Consultant - Python/DBT (Data Engineering)

enGen Global; Chennai District; On-site; INR 1,500,000 - 2,800,000; Full time

Job summary

enGen Global is seeking a Python Data Engineer with 4+ years of experience to design and implement robust data pipelines in a healthcare data environment. You will work with HL7/Hl7 v2/v3, FHIR resources, and REST APIs while leveraging dbt for modeling and testing. Experience with vector embeddings and GenAI integrations is valued.

Candidates should be proficient in SQL, Spark/PySpark, and cloud services (GCP preferred). Strong collaboration in an Agile team is essential.

Qualifications

• 4+ years of Python data engineering experience.
• 4+ years in Core Python (data structures, scripting, packaging).
• 2+ years of dbt modeling and documentation.
• 3+ years HL7 v2/v3, CCDA, EDI standards.
• 3+ years RESTful API integration experience.
• 1+ years GenAI/LANG Chain tooling experience.
• 1+ years vector DB embeddings experience.
• 1+ years ML/NLP frameworks exposure.
• 4+ years ETL/ELT data pipelines experience.
• 4+ years SQL data modeling (star schema, SCDs).
• 1+ year experience with Airflow or similar orchestration.
• 1+ year cloud exposure (GCP preferred).
• Strong communication and Scrum/Agile experience.

Skills

Python Programming

Data Engineering

Pandas

PySpark

SQL

Airflow

dbt

REST APIs

HL7

FHIR

GenAI

Vector Databases

LLM

GCP

Cloud

Kafka

Education

Bachelor’s degree in Computer Science or related field

Tools

Git

CI/CD

Kafka

Job description

Job Description

Python / dbt (Data Engineering)

• Total years of experience in Python Data Engineering minimum 4+ years
• Core Python (data structures, OOP, scripting, packaging) 4+ years
• HL7 FHIR resource modeling, profiles, IG mapping, FHIR APIs 3+ years
• Healthcare data standards HL7 v2/v3, CCDA, EDI (837/834/835/PHONE_NUMBER) 3+ years
• GenAI / LLM development prompt engineering, RAG, LangChain / LlamaIndex 1+ years
• Vector databases embeddings at least 1 year
• ML/NLP frameworks 1+ years
• RESTful services API integration at least 4 years
• FHIR servers / platforms HAPI FHIR / Smile CDR / Google Healthcare API at least 1 year
• Any cloud service (GCP, AWS, Azure) 1 year (GCP / Vertex AI preferred, Optional)
• dbt (data build tool) models, tests, macros, snapshots, documentation 2+ years
• Advanced SQL data modeling (dimensional / star schema, SCDs) 3+ years
• ELT/ETL pipeline development data transformation (Good to have)
• Workflow orchestration Airflow / Dagster / Cloud Composer (Good to have)
• Python data libraries Pandas / PySpark / NumPy 4+ years
• Version control CI/CD for data (Git, GitLab CI, dbt Cloud/Core deployment) at least 1 year
• Any cloud service (GCP, AWS, Azure) 1 year (GCP preferred, Optional)
• Any messaging/streaming tool like Kafka / Pub/Sub at least 1 year (Optional)
• Good communication skills
• Development methodologies Scrum / Agile
• Strong database development tools knowledge
• Knowledge on requirement analysis creating design/data-mapping documents
• Knowledge on data quality, testing validation frameworks (dbt tests, Great Expectations)
• US healthcare domain knowledge (payer/provider interoperability, CMS-0057-F, prior auth)