Data Engineering Associate Manager

Inclusively; Charlotte (NC); On-site; USD 100,000 - 130,000; Full time

Job summary

A global professional services firm is seeking a Data Engineering Associate Manager in Charlotte, NC. This role involves leveraging data tools to provide insights and develop systems and architectures while collaborating with teams. Candidates should have a bachelor's degree in a related field and at least five years in IT consulting, as well as expertise in data architecture, cloud services, and pipeline creation. Willingness to travel approximately 80% is required.

Qualifications

• 5+ years of experience in IT consulting.
• Experience in data architecture solutions.
• Proficient in creating high-performance data pipelines.
• Utilized big data platforms including Hadoop and Spark.
• Familiar with cloud services on Azure, AWS, and GCP.

Responsibilities

• Leverage data tools to develop insights.
• Integrate systems and data efficiently.
• Develop scalable data infrastructure.
• Translate business issues into analytic solutions.
• Collaborate on addressing business issues.

Skills

Data architecture design

High-performance data pipeline creation

Utilization of big data platforms

Cloud platform services

Microservices and API development

ETL/ELT processes

Agile methodologies

AI Governance

Education

Bachelor’s degree in IT related field

Tools

PySpark

Go

Kubeflow

Kafka Streams

Airflow

Docker

Hadoop

Spark

Snowflake

Databricks

Terraform

Azure

AWS

GCP

Python

SAS

Job description

Inclusively is partnering with a global professional services company to hire a Data Engineering Associate Manager. **Please note: this role is NOT an internal position with Inclusively but with the partner company.**

ABOUT INCLUSIVELY

Inclusively is a digital tech platform that empowers job seekers with disabilities, caregivers, and veterans by using Success Enablers–accommodations and personalized workplace modifications that help all job seekers reach their full potential and excel. This includes all disabilities under the ADA, including mental health conditions (e.g. anxiety, depression, PTSD), chronic illnesses (e.g. diabetes, Long COVID), and neurodivergence (e.g. autism, ADHD).

Create your profile, select Success Enablers, and connect to jobs from our partnered employers who are committed to creating diverse and inclusive teams. When registering, you must acknowledge that this platform is for people with disabilities, caregivers, and veterans. However, Inclusively does not require candidates to disclose their specific disability to join the platform.

Has multiple openings for the position of Data Engineering Associate Manager in Charlotte, NC, and the job duties are as follows:

• Leverage analytical and data management tools and techniques to develop quantitative and qualitative business insights for the company or our clients.
• Integrate systems and data efficiently and effectively.
• Develop scalable data infrastructure in line with data governance practices to enhance system performance and build integrations for batch or real-time consumption patterns.
• Develop intellectual property involving specific analytical methodologies, mathematical modeling, or optimization techniques and their applications to business issues.
• Translate business issues into specific requirements to develop analytic and operational solutions and manage appropriate data to support the solution.
• Collaborate with the company and/or external consulting teams to address business issues and influence change using strategy, industry, and analytical skills.
• Analyze and solve moderately complex problems.
• Understand strategic direction set by senior management and implement senior management’s strategic direction and procedures.
• Work with team members to meet deliverable requirements, service level measures, and specific targets.

BASIC QUALIFICATIONS

Must have a bachelor’s degree in Computer Science, Technology, Computer Information Systems, Computer Applications, Engineering, Mechanical Engineering, Electrical Engineering, aerospace Engineering, Industrial Engineering, Computer Hardware, Computer Software, or related field, plus 5 years of experience in the IT consulting industry.

Must have 4 years of experience in each of the following:

• Designing and developing data architecture solutions using Data Mesh, Fabric Architectures, Data Warehouse, Data Mart, and Data Lake;
• Creating high-performance data pipelines and integrated solutions for large volumes of streaming data utilizing PySpark, Go, Kubeflow, Kafka Streams, Airflow and Dockers;
• Utilizing big data and data management platforms, including Hadoop, Spark, Snowflake, and Databricks;
• Designing, implementing, and monitoring data services on cloud platforms, including Azure, AWS, and GCP while managing infrastructure-as-a-code through technologies such as Terraform and Azure JSON configuration;
• Developing Spark applications with Python and SAS;
• Developing microservices and API endpoints, performance tuning, and query optimization using Indexing, Partitioning, and Denormalization;
• Developing ETL/ELT workflows, including data cleansing, classification, migration, profiling, and transformation;
• Experience in AI Governance and Data Modeling projects including knowledge of Data Security, Encryptions and Enterprise Compliance practices in financial services industry;
• Utilizing Agile delivery methodologies for iterative development within Scrum and Kanban frameworks to lead small teams, plan team capacity and prioritize deliverables, effectively translating business and functional requirements into technical architecture and design implementations; and
• Providing IT services such as requirement gathering, solution design, and techno-function collaboration with business and technical teams, and domain knowledge of the financial services industry.

Must have willingness and ability to travel domestically approximately 80% of the time to meet client needs.