Senior Data Engineer

NationsBenefits India; Hyderabad; On-site; INR 2,400,000 - 4,200,000; Full time

Job summary

NationsBenefits is seeking an experienced Data Engineer to design and implement orchestrated data pipelines, ensuring data accuracy and enabling data-driven decisions. The ideal candidate has 8+ years of hands-on experience with DBT, Airflow, Azure Databricks, SQL, Python and PySpark, preferably in Healthcare/Fintech domains with an automation-first mindset.

The role involves gathering requirements, collaborating with cross-functional teams, and delivering robust data solutions that support

Qualifications

• Bachelor’s degree in computer science, information technology, or a related field.

Responsibilities

• 8+ years with DBT, Airflow, Azure Databricks, Python, PySpark, SQL; healthcare/fintech domain a plus.
• Data collection, analysis, modeling, and processing using the listed tech stack.
• Optimize and automate data pipelines; debug DAGs.
• Build robust pipelines with CI/CD.
• Collaborate with data scientists, analysts, and stakeholders.
• Ensure data quality, validation, and reliability.
• Advise on solutions and drive adoption.
• Ad hoc data analysis and dashboard development.
• Stay current with trends in data engineering.

Skills

DBT

Airflow

Azure Databricks

Python

SQL

PySpark

Automation

Education

Bachelor's degree in computer science or related field

Job description

NationsBenefits is recognized as one of the fastest-growing companies in America and a leading Healthcare Fintech provider. We specialize in supplemental benefits, flex cards, and member engagement solutions.

Partnering with managed care organizations, we offer innovative healthcare solutions that drive growth, improve outcomes, reduce costs, and deliver value to members.

Through our comprehensive suite of supplemental benefits, fintech payment platforms, and member engagement solutions, we enablehealth plans to provide high-quality benefits that address social determinants of health, ultimately improving member health outcomes and satisfaction.

We offer a dynamic and fulfilling work environment that attracts top talent, where associates are encouraged to contribute to delivering premier service to both internal and external customers. Our goal is to transform the healthcare industry for the better! We provide opportunities for career advancement across multiple locations in the US, South America, and India.

Position Overview:

As a Data Engineer, you will be responsible for the Requirement Gathering, Data Analysis, Development and implementation of Orchestrated data pipeline solutions to support our organization's data-driven initiatives to ensure data accuracy and enable data-driven decision-making across the organization. The ideal candidate will possess a minimum of 6+ years of hands‑onexperience in data engineer on high-performing teams. Expertise in DBT, Airflow, Azure Databricks, SQL, Python, Py-spark, Automation is a must and knowledge of reporting tools is addon.

Key Responsibilities:

• 8+ years of hands-on experience using DBT. Airflow, Azure Databricks, Python, Py-spark and SQL , Preferred from Healthcare & FintechDomain having Automation First Mindset.
• Hands-on experience with Data Collection, Data Analysis, Data modeling, Data Processing using DBT, Airflow, Azure Databricks, Py-spark, SQL, Python.
• Performance Optimization and Automation: Continuously monitor and optimize existing solutions and Debugging DAG failures and resolving.
• DataProcessing: Leverage his expertise buildingRobust Data pipelines using mentioned tech stack with CI/CD.
• Collaboration: Collaborate with cross-functional teams,including data scientists, business analysts, and stakeholders, to understand their data needs and deliver solutions.
• DataQuality: Implement data validation and cleansing processes to ensure data accuracy, consistency, and reliability.
• Influence: bring right solutionfor use cases and convincethe team to use.
• Open to Ad hoc Data Analysis and Reporting/Dashboard Development: Perform exploration data analysis, developdata visualizations, and generate actionable insights to support business decision-making.
• Stay Current: Stay up to date with emerging trends and technologies in data engineering and analytics and make recommendations for their adoption.

Requirements:

• Bachelor’s degree in computerscience, Information Technology, or a related field.
• Minimum 8+ years of hands-on experience using DBT. Airflow,Azure Databricks, Py-spark, SQL, Python, Automation
• Flexible to build Data Reports and Dashboards using SQL, Python, Reporting Tools
• Strong Debugging and Automation skills
• Strong understanding of DWH/DataLake concepts and methodologies.
• Experience with cloud platforms such as Azure,AWS or GCP
• Excellent communication, Presentation and interpersonal skills
• Excellent problem-solving skillsand attention to detail
• Knowledge of data quality, data Validation, data security and compliance standards is a plus