Senior Data Engineer - Cybersecurity & Big Data (Charlotte)

Realign LLC; Charlotte (NC); On-site; USD 101,000 - 137,000; Full time

Job summary

Realign LLC in Charlotte, NC is seeking a Data Engineer to design and implement complex data solutions with a focus on big data processing and cyber security domain knowledge. This onsite role requires close collaboration with business partners, the Product Owner, and the development team to deliver data-driven outcomes.

You will mentor junior engineers, build scalable data pipelines, and participate in governance, deployment, and CI/CD activities, ensuring data quality and timely insights for

Qualifications

• Minimum 8+ years of hands-on data engineer and/or software development experience.
• Experience with big data processing systems such as Hadoop and Cloudera.
• Programming with Python, including modular Python programming.
• Strong SQL and UNIX experience.

Responsibilities

• Ensure the design and engineering approach for complex data solutions remains consistent across multiple flows and systems.
• Perform research, design, and prototyping activities, including evaluating new toolsets.
• Build processes for data transformation, data structures, metadata, data quality controls, dependency tracking, and workload management.
• Define and build data pipelines that support faster, better, data-informed business decisions.
• Mentor more junior Data Engineers and coach team members for delivery and release CI-CD events, including branching timelines, pull requests, issue triage, merge or conflict resolution, and release notes.

Skills

Python

SQL

UNIX

Hadoop

Cloudera

Hive

Spark

PySpark

AWS

Azure

Bitbucket

CI/CD

Data security

SDLC

Tools

Bitbucket

Job description

Realign LLC in Charlotte, NC is seeking a Data Engineer to design and implement complex data solutions with a focus on big data processing and cyber security domain knowledge. This onsite role requires close collaboration with business partners, the Product Owner, and the development team to deliver data-driven outcomes.

You will mentor junior engineers, build scalable data pipelines, and participate in governance, deployment, and CI/CD activities, ensuring data quality and timely insights for