Data Engineer

HealthEdge; Bengaluru Urban; On-site; INR 900,000 - 1,400,000; Full time

Job summary

A leading company specializing in software development and data analytics is seeking a Data Engineer with significant experience in building large-scale data systems. You will be part of agile teams focused on developing cutting-edge solutions in the Provider Data Management space, working closely with diverse stakeholders to ensure robust data management and analytics capabilities.

Qualifications

• 3+ years of data engineering experience with large data sets.
• Experience building data pipelines using ETL tools and SQL/Python.
• Strong problem-solving and communication skills.

Responsibilities

• Build data pipelines to assemble large, complex data sets.
• Collaborate with stakeholders to support data infrastructure needs.
• Act as a subject matter expert for technical guidance.

Skills

Data Engineering

Data Pipeline Development

SQL

Python

Problem Solving

Communication

Education

Bachelor’s or Master’s degree in Computer Science, Analytics, Mathematics, Statistics

Tools

ETL Tools (Glue, ADF)

RDBMS (Postgres, SQL Server)

Cloud Platforms (AWS, GCP, Azure)

Orchestration Tools (Airflow)

Real-time Data Streaming Tools (Kafka, Kinesis)

Job description

Get AI-powered advice on this job and more exclusive features.

Direct message the job poster from HealthEdge.

You will be working with agile cross-functional software development teams developing cutting-edge software to solve a significant problem in the Provider Data Management space. This hire will have experience building large-scale complex data systems involving multiple cross-functional data sets and teams. The ideal candidate will be excited about working on new product development, comfortable pushing the envelope and challenging the status quo, setting high standards for themselves and the team, and working well with ambiguity.

What you will do:

• Build data pipelines to assemble large, complex sets of data meeting both non-functional and functional business requirements.
• Work closely with data architects, SMEs, and other technology partners to develop and execute data architecture and product roadmap.
• Build analytical tools to utilize the data pipeline, providing actionable insights into key business performance metrics including operational efficiency.
• Collaborate with stakeholders such as leadership, product, and customer teams to support their data infrastructure needs and resolve data-related technical issues.
• Act as a subject matter expert for technical guidance, solution design, and best practices within the organization.
• Stay current on big data and data visualization technology trends, evaluate new tools, and make cloud technology recommendations.

What you bring:

• 3+ years of data engineering experience working with large data sets (preferably terabyte scale).
• Experience building data pipelines using ETL tools such as Glue, ADF, Notebooks, Stored Procedures, SQL/Python constructs, or similar.
• Deep experience with RDBMS like Postgres, SQL Server, Oracle, MySQL, and analytical cloud databases such as BigQuery, Redshift, Snowflake.
• Advanced SQL skills and solid programming experience with Python and/or Spark.
• Experience with orchestration tools like Airflow and building complex dependency workflows.
• Experience developing and implementing Data Warehouse or Data Lake architectures, OLAP technologies, and data modeling with star/snowflake schemas for analytics and reporting.
• Strong problem-solving skills, troubleshooting data issues, and stabilizing big data systems.
• Excellent communication and presentation skills for stakeholder and leadership interactions.
• Bachelor’s or master’s degree in fields like Computer Science, Analytics, Mathematics, Statistics, or related scientific disciplines.
• Hands-on experience with cloud data migration and analytic platforms like Fabric and Databricks.
• Certification in cloud platforms such as AWS, GCP, or Azure.
• Understanding of real-time data streaming tools like Kafka or Kinesis.

Seniority level

• Associate

Employment type

• Full-time

Job function

• Information Technology

Industries

• Software Development and Data Infrastructure and Analytics

This job posting is active.