Senior Data Engineer | Python, ETL & Data Lakes

Realign Llc; Charlotte (NC); On-site; USD 120,000 - 160,000; Full time

Job summary

Realign Llc in Charlotte, NC is seeking an experienced data engineer to design and operate large-scale data pipelines. You will work with Python, SQL, ETL, and API integrations to ingest, process, and index diverse datasets.

The role requires 8+ years of experience, a BS/MS in computer science, and strong skills in OpenShift, Linux, MongoDB, Oracle, and cloud-native data lake architectures. You will mentor juniors and collaborate with data scientists to deploy ML models.

Qualifications

• Design and build large-scale data pipelines using Python.
• Build and support data ingestion, processing, indexing and retrieval pipelines for structured and unstructured data
• Lead the architecture of cloud-native data lakes and warehouses.
• Optimize big data processing jobs for speed and cost.
• Mentor junior data engineers and lead code reviews.
• Set up data governance, data quality, and monitoring systems.
• Partner with data scientists to deploy machine learning models.

Responsibilities

• Design and build large-scale data pipelines using Python.
• Lead the architecture of cloud-native data lakes and warehouses.
• Mentor junior data engineers and run code reviews.
• Collaborate with data scientists to deploy ML models.

Skills

Python

SQL

ETL

API development

MongoDB

Oracle

Linux

OpenShift

Git

CI/CD

Data modelling

Elastic

Solr

Vector Database

FastAPI

Education

Bachelor’s or Master’s degree in Computer Science or related field

Tools

OpenShift

Jenkins

Git

Job description

Realign Llc in Charlotte, NC is seeking an experienced data engineer to design and operate large-scale data pipelines. You will work with Python, SQL, ETL, and API integrations to ingest, process, and index diverse datasets.

The role requires 8+ years of experience, a BS/MS in computer science, and strong skills in OpenShift, Linux, MongoDB, Oracle, and cloud-native data lake architectures. You will mentor juniors and collaborate with data scientists to deploy ML models.