Data Engineering Manager

Relha LLC; Charlotte, Northern (NC, KY); Hybrid; USD 140,000 - 190,000; Full time

Job summary

Deloitte Consulting LLP in Charlotte, NC seeks a Data Engineering Manager to lead the PySpark-based data processing framework and drive cloud modernization. You will guide architecture, oversee development, and collaborate with clients to transform on-premise projects to AWS data lake ecosystems.

Responsibilities include building data lineage, designing metadata-driven processing, and implementing ingestion and orchestration with Talend, Airflow, and Databricks.

Qualifications

• 8+ years of AWS cloud services and data lake build & support.
• Strong experience in PySpark-based data engineering and ETL development.
• SQL (Snowflake) pipeline build, data analysis, and data validation.
• Requirements gathering and stakeholder coordination.
• Bachelor's degree, preferably in Computer Science, Information Technology, Computer Engineering, or related IT discipline; or equivalent experience.

Responsibilities

• Lead solution architecture for a PySpark-based data processing framework.
• Migrate major projects from on-premises platforms to AWS-based data lake ecosystems.
• Design and implement a metadata-driven processing framework using PySpark, Python, Databricks, and AWS.
• Build data lineage capabilities and data observability PoCs to speed delivery.
• Develop ingestion frameworks and orchestration with Airflow to improve onboarding.
• Perform performance tuning of data quality rules to reduce costs.

Skills

AWS cloud

PySpark

Snowflake SQL

Stakeholder coordination

Education

Bachelor's degree in CS/IT/Eng

Tools

Talend

Apache Airflow

Databricks

Python

Job description

Deloitte Consulting's technology professionals help clients identify and solve their most critical information and technological challenges. We provide advisory through end-to-end implementation services as well as outsourcing services and are recognized in the marketplace for capabilities across the spectrum.

Recruiting for this role ends on 10/1/2026

Our experienced technology professionals offer deep technical experience in their area of focus and are committed to delivering efficient, technology-based solutions to our clients. Our professionals are also aligned to industry sectors. By combining our technical capabilities with our industry experience, we create unmatched market offerings to solve our clients' business issues. Additionally, we have long-term partnerships with many of the world's leading technological companies, allowing us to understand solution alternatives and recommend and support the most appropriate solution for our clients. By leveraging these elements, we can help our clients convert leading edge ideas into tangible results.

A Data Engineering Manager will lead solution architecture for a PySpark-based enterprise data processing framework, improving scalability and standardizing transformation patterns across programs. Migrate major projects from on-premises platforms to AWS-based cloud data lake ecosystems, improving platform flexibility and modernization readiness. Design and implement a metadata-driven processing framework using PySpark, Python, Databricks, and AWS, reducing project go-live timelines. Build data lineage capabilities and conducted POCs in data observability, improving change impact analysis and accelerating enhancement delivery. Develop ingestion frameworks in Talend and later migrated orchestration to Apache Airflow, improving data onboarding efficiency. Performance tuning complex data quality rules, improving processing efficiency and reducing run-cost and maintenance overhead. Work across the full SDLC, including client discussions, requirements gathering, architecture design, development oversight, and production deployment. The successful candidate would possess these skills:

• Ability to work independently and collaborate as part of a team
• Effective written and verbal communication skills
• Meticulous attention to detail and quality of work product
• Ability to build and sustain professional relationships
• Ability to lead projects or workstreams
• Ability to manage and prioritize multiple tasks in a fast-paced and dynamic environment
• Strong interpersonal skills and professional demeanor
• Ability to meet deadlines
• Ability to provide clear guidance to others

The Team

AI & Data offers a full spectrum of solutions for designing, developing, and operating cutting-edge Data and AI platforms, products, insights, and services. Our offering helps clients innovate, and enhance their data, AI, and analytics capabilities, ensuring they can mature and scale effectively.

Required Qualifications

• 8+ years of AWS cloud services and data lake build & support
• Strong experience in PySpark-based data engineering and ETL development
• SQL (Snowflake) pipeline build, data analysis, and data validation
• Requirements gathering and stakeholder coordination

Bachelor's degree, preferably in Computer Science, Information Technology, Computer Engineering, or related IT discipline; or equivalent experience

Limited immigration sponsorship may be available.

Ability to travel 10%, on average, based on the work you do and the clients and industries/sectors you serve

Preferred

• Strong analytical, problem-solving, communication, stakeholder-management, offshore coordination, documentation, and knowledge-transfer skills
• Analytical ability to manage multiple projects and prioritize tasks into manageable work product
• Can operate independently or with minimum supervision
• Excellent Written and Communication Skills
• Ability to deliver technical demonstrations

The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Deloitte, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case.

You may also be eligible to participate in a discretionary annual incentive program, subject to the rules governing the program, whereby an award, if any, depends on various factors, including, without limitation, individual and organizational performance.

Deloitte is committed to providing reasonable accommodations for people with disabilities. If you require a reasonable accommodation to participate in the recruiting process, please direct your inquiries to the Global Call Center (GCC) at [email protected].

Our people and culture

Our inclusive culture empowers our people to be who they are, contribute their unique perspectives, and make a difference individually and collectively. It enables us to leverage different ways of thinking, ideas, and perspectives, and bring more creativity and innovation to help solve our clients' most complex challenges. This makes Deloitte one of the most rewarding places to work.

Our purpose

Deloitte’s purpose is to make an impact that matters for our people, clients, and communities. At Deloitte, purpose is synonymous with how we work every day. It defines who we are. Our purpose comes through in our work with clients that enables impact and value in their organizations, as well as through our own investments, commitments, and actions across areas that help drive positive outcomes for our communities. Learn more.

From entry-level employees to senior leaders, we believe there’s always room to learn. We offer opportunities to build new skills, take on leadership opportunities and connect and grow through mentorship. From on-the-job learning experiences to formal development programs, our professionals have a variety of opportunities to continue to grow throughout their career.

As used in this posting, "Deloitte" means Deloitte Consulting LLP, a subsidiary of Deloitte LLP. Please see https://www.deloitte.com/us/about for a detailed description of the legal structure of Deloitte LLP and its subsidiaries.

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability or protected veteran status, or any other legally protected basis, in accordance with applicable law.