Data Engineer-4

Realign Llc; Charlotte (NC); On-site; USD 110,000 - 140,000; Full time

Job summary

Realign Llc in Charlotte, NC is seeking a senior Data Engineer to design and deliver complex data solutions on-site. You will lead data architecture discussions, mentor junior engineers, and collaborate with partners, product owners, and the development team to ensure reliable, scalable data delivery.

The role requires 8+ years of experience, strong Hadoop/Spark/Hive skills, and cloud experience. Expect a hands-on leadership position within a time-critical data platform project.

Qualifications

• 8+ years hands-on data engineer or software development experience, with at least 5 years onsite.
• Experience with big data processing systems like Hadoop and Cloudera.
• Proficiency in Python (modular programming).
• Strong SQL and UNIX skills.
• Hadoop ecosystem knowledge: Hive, Spark, Pispark.
• Proven leadership guiding junior engineers to delivery.
• Experience in cybersecurity domain, preferably vulnerability data management.
• Ability to switch to hands-on coding when needed.
• Experience with Cloud Services (AWS, Azure).
• Data stores experience: HIVE, HBase, Elastic.
• Experience with Bitbucket and CI/CD pipelines.
• Solid understanding of data engineering principles and SDLC.

Responsibilities

• Ensure design and engineering approaches for complex data solutions are consistent across flows.
• Research, prototype, and evaluate new toolsets.
• Utilize architectural components in client data solutions.
• Maintain and manipulate data for operational and analytics systems.
• Collaborate with teams to align data architecture with requirements.
• Assemble large data sets meeting functional and non-functional requirements.
• Build data pipelines enabling faster, data-informed decisions.
• Contribute to test suites and triage issues from reports.
• Document deployment, maintenance, and business functionality details.
• Lead CI/CD events and coach junior engineers in releases.

Skills

Data engineering

Python

SQL

Unix

Hadoop

Spark

Cloudera

Hive

HBase

Cloud (AWS/Azure)

CI/CD

Linux/Unix scripting

Mentoring juniors

Education

Bachelor’s degree in Computer Science or related field

Tools

Hadoop

Cloudera

Hive

HBase

Elastic

Job description

Charlotte, North Carolina 28105 Posted October 17th, 2026

The candidate is expected to have knowledge in the cyber security domain.

Primary Level of Engagement: Works as a team member under supervision from a more senior domain expert.

Primary Interactions

• Business partners and stakeholders
• Product Owner
• Development Team
• Architect
• Domain Community of Practice
• Data Scientists
• Scrum Master
• Feature Lead

Job Information

• Role: Data Engineer
• Location: Charlotte, NC - Onsite
• Fulltime - Permanent
• Job Type: Full Time
• Job Category: IT
• Job Description

Required Skills

• Minimum 8+ years hands-on data engineer/Software development exp (at least 5 years of onsite exp)
• Experience with big data processing systems like Hadoop, Cloudera etc
• Experience with one or more of the programming languages like Python (Modular python programming exp)
• Strong SQL and UNIX experience
• Hadoop - Hive, Spark , Pispark
• Proven experience with technology leadership guiding junior engineers towards project completion and deliveries
• Experience with cyber security domain, preferably vulnerability data management
• Ability to switch from technology leadership to hands on coding when required
• Experience with Cloud Services\Technologies like AWS, Azure, etc.
• Experience with data stores like HIVE, HBase Elastic
• Experience with code versioning systems like Bitbucket
• Experience with CICD pipelines
• Good knowledge on Data engineering principles and SDLC process
• Ability to detect early and articulate with business partners the challenges and gaps in requirements

Roles & Responsibilities

• Ensure that the design and engineering approach for complex data solutions is consistent across multiple flows and systems.
• Conduct research, designs prototyping and other exploration activities such as evaluating new toolsets.
• Utilize multiple architectural components in design and development of client requirements.
• Maintain, improve, clean and manipulate data for the operational and/or analytics data systems.
• Constantly looking for better ways of solving technical problems and designing the solution without being afraid of challenging the status quo.
• Collaborate with development teams to understand data requirements and ensure the data architecture is feasible to implement and subsequently implemented accurately.
• Assemble large, complex data sets that meet functional/ non-functional requirements.
• Build processes supporting data transformation, data structures, metadata, data quality controls, dependency and workload management.
• Define and build data pipelines that enable faster, better, data-informed decision-making within the business.
• Contribute to existing test suites (integration, regression, performance), analyze test reports, identify any test issues/errors, and triage the underlying cause.
• Document and communicate required information for deployment, maintenance, support, and business functionality.
• Adhere to team delivery/release process and cadence pertaining to code deployment and release
• Identify gaps in data management standards adherence and work with appropriate partners to develop plans to close gaps.
• Lead concept and experimentation testing, and synthesize the results to validate and improve analytical solution.
• Define key performance indicators and internal controls.
• Mentor more junior Data Engineers and coach team members in the delivery/release CI-CD events – (for example, branching timelines, pull requests, issue triage, merge/conflict resolution, and release notes).