Senior Data Engineer

HeartCentrix Solutions; United States; On-site; USD 110,000 - 160,000; Full time

Job summary

HeartCentrix Solutions is seeking an experienced Data Engineer to design, build, and support data solutions in a large-scale Azure environment. You will collaborate with engineering, product, and business teams to turn data into actionable insights and to improve data platforms.

This hands-on role covers the full development lifecycle—from design and implementation to testing, deployment, monitoring, and production support.

Qualifications

• 3+ years developing software or data engineering in an Agile/DevOps environment.
• 3+ years of data analytics experience using SQL.
• 3+ years of Azure cloud development and data lake experience.

Responsibilities

• Design, build, and support data engineering and analytics solutions.
• Build and maintain batch and real-time data pipelines using Azure and Databricks.
• Develop data pipelines using Azure Data Factory, Azure Data Lake, Azure Event Hub, Azure Functions, Azure Databricks, and Azure Stream Analytics.
• Work with SQL, data modeling, data warehousing, and databases such as SQL Server and Oracle.
• Build and maintain CI/CD pipelines using Azure DevOps and/or GitHub.
• Support cloud infrastructure, security, networking, deployments, monitoring, and production issues.
• Work with BI and reporting tools such as Power BI, Tableau, or Cognos.
• Help improve coding standards, development practices, security, and data privacy.
• Troubleshoot performance and data quality issues and identify ways to improve reliability.
• Provide technical guidance and mentor other team members.
• Work in a DevOps environment where the team owns the product from development through production support.

Skills

PySpark

Strong SQL

Data modeling & data warehousing

SQL Server / Oracle

CI/CD pipelines

Batch and streaming data pipelines

BI/Reporting (Power BI/Tableau/Cognos)

Education

Bachelor's degree in CS/IT or equivalent

Tools

Azure Data Factory

Azure Data Lake

Azure Databricks

Azure Stream Analytics

Power BI

Tableau

Cognos

Job description

We're looking for an experienced Data Engineer to help build and support data solutions in a large-scale Azure environment. You'll work closely with engineering, product, and business teams to build data pipelines, improve data platforms, and turn data into useful insights.

This is a hands-on role where you'll be involved throughout the development lifecycle - from designing and building solutions to testing, deployment, monitoring, and production support.

What You'll Be Doing

• Design, build, and support data engineering and analytics solutions.
• Build and maintain batch and real-time data pipelines using Azure and Databricks.
• Work with source application teams and product owners to understand data needs and build solutions that support business decisions.
• Develop data pipelines using tools such as Azure Data Factory, Azure Data Lake, Azure Event Hub, Azure Functions, Azure Databricks, and Azure Stream Analytics.
• Work with SQL, data modeling, data warehousing, and databases such as SQL Server and Oracle.
• Build and maintain CI/CD pipelines using Azure DevOps and/or GitHub.
• Support cloud infrastructure, security, networking, deployments, monitoring, and production issues.
• Work with BI and reporting tools such as Power BI, Tableau, or Cognos.
• Help improve coding standards, development practices, security, and data privacy.
• Troubleshoot performance and data quality issues and identify ways to improve reliability.
• Work closely with engineers, technical analysts, product managers/owners, technical leads, and business teams.
• Provide technical guidance and help mentor other team members.
• Work in a DevOps environment where the team owns the product from development through production support.

Must-Have Technical Skills

• PySpark
• Strong SQL
• Data modeling and data warehousing
• SQL Server and/or Oracle
• CI/CD pipelines - Azure DevOps and/or GitHub
• Experience with batch and streaming data pipelines
• BI/reporting experience with Power BI, Tableau, or Cognos

Experience

• 3+ years of experience developing software solutions or data engineering solutions in an Agile/DevOps environment.
• 3+ years of data analytics experience using SQL.
• 3+ years of Azure cloud development and data lake experience.
• Bachelor's degree in Computer Science, Computer Engineering, Information Systems, Engineering, Technology, or a related field, or equivalent experience.

Nice to Have

• 5+ years of data engineering/software development experience.
• 5+ years of SQL/data analytics experience.
• Full-stack development experience, preferably within Azure.
• Airline industry experience.
• Experience working with large-scale enterprise data environments.