Data Engineer - PROD support

REALIGN LLC; Charlotte (NC); On-site; USD 110,000 - 150,000; Full time

Job summary

REALIGN LLC in Charlotte, NC is seeking a Data Engineer with 5–10 years of experience to design, implement, and operate robust data pipelines that support analytics and reporting. You will work with PySpark, Hive, Python, SQL, and Hadoop ecosystems, building ETL/ELT processes, managing datasets, and ensuring data quality, lineage, and security.

Collaborating across engineering, product, and business teams, you will help implement monitoring, CI/CD, and performance tuning to keep data workflows

Qualifications

• 5–10 years of experience in Data Eng, Software Eng, or related field.
• Strong Python and SQL for advanced data transformations.
• Experience designing ETL/ELT pipelines and data ingestion processes.
• Experience with distributed data tools such as Spark, Databricks, or Hadoop.
• Experience with cloud data platforms (Teradata, Snowflake, SQL Server, Azure/AWS/GCP).
• Understanding of data modeling, data quality, lineage and security.
• Ability to support test-driven development and CI/CD practices.
• Knowledge of data governance and regulatory compliance.
• Strong collaboration across engineering, product, and business teams.

Responsibilities

• Build and maintain scalable data pipelines and DAGs across stacks.
• Ensure data quality, lineage, and secure data handling.
• Collaborate with analytics, product, and ops teams to meet data needs.

Skills

PySpark

Hive

Python

SQL

Hadoop

Unix

Agile

Base support

Tools

Apache Spark

Databricks

Hadoop

Job description

Charlotte, North Carolina 28105 Posted September 12th, 2026

Primary Skill: PySpark, Hive, Python, SQL, Hadoop

Secondary: Unix, Agile, Base support

Experience: 5 to 10 years

• 5 to 10 years of experience in Data Engineering, Software Engineering, or related technical discipline.
• Strong proficiency in Python, and SQL for advanced data transformations.
• Hands-on experience designing and building ETL/ELT pipelines, data ingestion processes, and distributed data processing jobs.
• Practical experience working with distributed data tools such as Apache Spark, Databricks, or Hadoop ecosystems.
• Experience building and managing datasets in relational and/or cloud based data platforms (Teradata, Snowflake, SQL Server, Azure/AWS/GCP).
• Solid understanding of data modeling, metadata, data quality controls, data lineage, and secure data management.
• Experience contributing to automated test suites, analyzing test failures, and supporting test-driven development.
• Knowledge of CI/CD pipelines, version control (Git), and automated deployment practices.
• Experience adhering to enterprise data governance, compliance, and operational risk frameworks.
• Ability to troubleshoot pipeline issues, performance bottlenecks, and data discrepancies.
• Strong communication skills and ability to collaborate across engineering, product, and business teams.
• Experience implementing monitoring and observability for data pipelines (logs, metrics, health checks).
• Advanced experience with performance tuning of SQL, Spark, or distributed data workflows.
• Knowledge of data security practices (encryption, masking, PII handling).
• Experience supporting analytical workloads, BI tools, or data science teams.
• Prior experience in a financial institution or other regulated industry

A Data Engineer is essential to implement efficient data flows, enforce data management standards, enhance data quality, and support continuous delivery and release cycles. Without this role, the project risks delays in data readiness, gaps in data compliance, reduced quality of analytical outputs, and inability to support downstream systems effectively.

Client is mainly looking for Production support ole to be able to root cause analysis of prod issues across different tech stack that we have(Hadoop, Oracle and MongoDB).Autosys knowledge, Analyze and fix performance issues, Dev work related to App Gov and other mandates.