Senior Data Engineer

NationsBenefits India; Hyderabad; On-site; INR 1,600,000 - 2,100,000; Full time

Job summary

NationsBenefits is seeking a senior Data Engineer to design and implement orchestrated data pipelines supporting data-driven decision making. The ideal candidate has 8+ years of hands-on experience with DBT, Airflow, Azure Databricks, SQL, Python, PySpark, and automation, preferably in Healthcare or Fintech.

You will collaborate with data scientists and analysts to deliver robust data solutions and ensure data quality and security.

Qualifications

• Bachelor’s degree in computer science, IT, or a related field.
• 8+ years hands-on experience with DBT, Airflow, Azure Databricks, PySpark, SQL, Python, and automation.
• Ability to build data reports and dashboards using SQL, Python, Reporting Tools.
• Strong debugging and automation skills.

Responsibilities

• Build and optimize orchestrated data pipelines using DBT, Airflow, Databricks, PySpark, SQL, and Python.
• Monitor and debug DAG failures and optimize performance.
• Create data processing workflows with CI/CD.
• Collaborate with data scientists, analysts, and stakeholders to meet data needs.
• Ensure data quality, validation, and compliance.

Skills

DBT

Airflow

Azure Databricks

SQL

Python

PySpark

Automation

Education

Bachelor’s degree in computer science, IT, or related field

Tools

Reporting Tools

Job description

NationsBenefits is recognized as one of the fastest-growing companies in America and a leading Healthcare Fintech provider. We specialize in supplemental benefits, flex cards, and member engagement solutions.

Partnering with managed care organizations, we offer innovative healthcare solutions that drive growth, improve outcomes, reduce costs, and deliver value to members.

Through our comprehensive suite of supplemental benefits, fintech payment platforms, and member engagement solutions, we enablehealth plans to provide high-quality benefits that address social determinants of health, ultimately improving member health outcomes and satisfaction.

We offer a dynamic and fulfilling work environment that attracts top talent, where associates are encouraged to contribute to delivering premier service to both internal and external customers. Our goal is to transform the healthcare industry for the better! We provide opportunities for career advancement across multiple locations in the US, South America, and India.

Position Overview:

As a Data Engineer, you will be responsible for the Requirement Gathering, Data Analysis, Development and implementation of Orchestrated data pipeline solutions to support our organization's data-driven initiatives to ensure data accuracy and enable data-driven decision-making across the organization. The ideal candidate will possess a minimum of 6+ years of hands‑onexperience in data engineer on high-performing teams. Expertise in DBT, Airflow, Azure Databricks, SQL, Python, Py-spark, Automation is a must and knowledge of reporting tools is addon.

Key Responsibilities:

• 8+ years of hands-on experience using DBT. Airflow, Azure Databricks, Python, Py-spark and SQL , Preferred from Healthcare & FintechDomain having Automation First Mindset.
• Hands-on experience with Data Collection, Data Analysis, Data modeling, Data Processing using DBT, Airflow, Azure Databricks, Py-spark, SQL, Python.
• Performance Optimization and Automation: Continuously monitor and optimize existing solutions and Debugging DAG failures and resolving.
• DataProcessing: Leverage his expertise buildingRobust Data pipelines using mentioned tech stack with CI/CD.
• Collaboration: Collaborate with cross-functional teams,including data scientists, business analysts, and stakeholders, to understand their data needs and deliver solutions.
• DataQuality: Implement data validation and cleansing processes to ensure data accuracy, consistency, and reliability.
• Influence: bring right solutionfor use cases and convincethe team to use.
• Open to Ad hoc Data Analysis and Reporting/Dashboard Development: Perform exploration data analysis, developdata visualizations, and generate actionable insights to support business decision-making.
• Stay Current: Stay up to date with emerging trends and technologies in data engineering and analytics and make recommendations for their adoption.

Requirements:

• Bachelor’s degree in computerscience, Information Technology, or a related field.
• Minimum 8+ years of hands-on experience using DBT. Airflow,Azure Databricks, Py-spark, SQL, Python, Automation
• Flexible to build Data Reports and Dashboards using SQL, Python, Reporting Tools
• Strong Debugging and Automation skills
• Strong understanding of DWH/DataLake concepts and methodologies.
• Experience with cloud platforms such as Azure,AWS or GCP
• Excellent communication, Presentation and interpersonal skills
• Excellent problem-solving skillsand attention to detail
• Knowledge of data quality, data Validation, data security and compliance standards is a plus