Senior Data Engineer — Cloud-Native Data Platform Lead

Realign LLC; Charlotte (NC); On-site; USD 110,000 - 128,000; Full time

Job summary

Realign LLC is seeking a data engineer in Charlotte, NC to build cloud-native data platforms and high-throughput pipelines onsite. Responsibilities include designing large-scale data pipelines with Python and leading data lake/warehouse architectures in a hands-on environment.

Required 8+ years of experience, BS/MS in CS or related field, strong Python/SQL and data ingestion/ETL skills. Onsite role with opportunities to mentor and shape governance and ML deployment processes.

Qualifications

• 8+ years of relevant experience.
• Bachelor’s or master’s degree in computer science or a related field.
• Primary skills: Python, SQL; Data ingestion and ETL; API development and integration; Mongo DB; Oracle or relational databases; Elastic or Solr search; Vector database; Linux/Bash; OpenShift containers; Git, Jenkins; CI/CD and data modelling.

Responsibilities

• Design and build large-scale data pipelines using Python.
• Develop and support data ingestion, processing, indexing, and retrieval for structured and unstructured data.
• Lead the architecture of cloud-native data lakes and data warehouses.
• Optimize big data processing jobs to improve speed and cost.
• Mentor junior data engineers and conduct code reviews.
• Implement data governance, data quality, and monitoring systems.
• Partner with data scientists to deploy machine learning models.

Skills

Python

SQL

Data ingestion and ETL

API development and integration

Mongo DB

Relational databases

Elastic

Vector database

Linux/Bash

OpenShift containers

Git

Jenkins

CI/CD

Data modelling

Education

Bachelor’s or Master’s degree in computer science or related field

Tools

OpenShift containers

Git

Jenkins

CI/CD

Job description

Realign LLC is seeking a data engineer in Charlotte, NC to build cloud-native data platforms and high-throughput pipelines onsite. Responsibilities include designing large-scale data pipelines with Python and leading data lake/warehouse architectures in a hands-on environment.

Required 8+ years of experience, BS/MS in CS or related field, strong Python/SQL and data ingestion/ETL skills. Onsite role with opportunities to mentor and shape governance and ML deployment processes.