Technical Lead, Data Engineering & Platform

Dexian; Charlotte (NC); On-site; USD 140,000 - 180,000; Full time

Job summary

Dexian is seeking a highly skilled Technical Lead in Data Engineering to steer and shape our data platform, partnering with architects and senior engineers to design scalable, reliable data solutions for batch and streaming workloads.

You will guide the team using AWS Glue (PySpark), Python, Kafka, AWS DMS, AWS Lambda, and Aurora PostgreSQL, ensuring architectural integrity, reliability, and data trust. Dexian is a global Talent + Technology firm with 70+ locations and 10,000+ professionals.

Qualifications

• 8+ years of experience in data engineering or backend data platform development.
• 3+ years in a senior or technical leadership role with shared architectural responsibility.
• Expert-level experience with AWS Glue (PySpark), Python, and distributed data processing.
• Proven experience with Kafka and streaming architectures.
• Hands-on AWS DMS pipelines for batch loads and CDC.
• Advanced SQL and data modeling with Amazon Aurora PostgreSQL.
• Serverless, event-driven architectures using AWS Lambda.
• Strong collaboration, communication, and documentation skills.

Responsibilities

• Provide hands-on leadership within the data engineering team and define platform standards.
• Collaborate with peers to ensure consistency in data ingestion, transformation, streaming, and consumption patterns.
• Contribute to technical roadmaps, design reviews, and architecture discussions.
• Lead development of complex ETL/ELT processes using AWS Glue (PySpark) and Python.
• Build, optimize, and manage Kafka-based streaming pipelines.
• Implement and fine-tune AWS DMS pipelines for full-load and CDC.
• Design and optimize database schemas and performance for Aurora PostgreSQL.
• Mentor data engineers and promote knowledge sharing.
• Engage with analytics, BI, and business teams to translate requirements.

Skills

AWS Glue

PySpark

Python

Kafka

Data modeling

SQL

Communication

Leadership

Tools

AWS DMS

AWS Lambda

Aurora PostgreSQL

Job description

Dexian is seeking a highly skilled Technical Lead in Data Engineering to steer and shape our data platform, partnering with architects and senior engineers to design scalable, reliable data solutions for batch and streaming workloads.

You will guide the team using AWS Glue (PySpark), Python, Kafka, AWS DMS, AWS Lambda, and Aurora PostgreSQL, ensuring architectural integrity, reliability, and data trust. Dexian is a global Talent + Technology firm with 70+ locations and 10,000+ professionals.