Principal Data Engineer

Kaleidoscope Innovation, Inc.; Charlotte, Northern (NC, KY); Hybrid; USD 130,000 - 190,000; Full time

Job summary

Kaleidoscope Innovation, Inc. is seeking a Principal Data Engineer in Charlotte, NC to design, build, and maintain scalable data platforms across data engineering, warehousing, and cloud ecosystems.

The role emphasizes hands-on AWS, Snowflake, Python, and SQL with modern data practices, coupling technical leadership with enterprise-scale delivery. The ideal candidate will manage data modeling (Data Vault), ETL/ELT processes, and API integrations, while driving governance and quality across data

Qualifications

• Strong experience in data engineering and enterprise data environments.
• Hands-on AWS experience (S3, Lambda, DynamoDB).
• Snowflake and cloud data warehousing expertise.
• Advanced Python and SQL development skills.
• Experience developing ETL/ELT and data integration solutions.
• Experience with data warehousing and Data Vault modeling.
• Experience with dbt or similar data transformation frameworks.
• Experience with data quality, governance, metadata management, and data lineage.
• Strong understanding of relational and non-relational databases.
• Ability to lead independently while guiding other engineers.

Responsibilities

• Design, develop, and optimize scalable data pipelines and data integration solutions.
• Develop and maintain data architectures supporting enterprise data warehouses, data lakes, and analytics platforms.
• Build and optimize ETL/ELT processes using modern data engineering tools and technologies.
• Develop solutions using AWS services including S3, Lambda, and DynamoDB.
• Design and implement data solutions within Snowflake and other cloud-based data environments.
• Develop and maintain data models, including Data Vault modeling methodologies.
• Write and optimize complex SQL and Python code for data processing and integration.
• Work with dbt to develop, transform, test, and manage data workflows.
• Support data replication and integration using tools such as Qlik Replicate.
• Work with enterprise data platforms including IBM InfoSphere DataStage and CP4D.
• Develop and integrate APIs to support enterprise data and application needs.
• Establish and maintain data quality, governance, metadata management, and data lineage processes.
• Collaborate with engineering, architecture, analytics, and business teams to translate requirements into scalable data solutions.
• Troubleshoot performance, data quality, and integration issues across complex data environments.
• Provide technical leadership and guidance on data engineering architecture and best practices.

Skills

Data engineering

AWS (S3, Lambda, DynamoDB)

Snowflake

Python

SQL

ETL/ELT

Data warehousing & Data Vault

dbt

Data governance

Technical leadership

Tools

dbt

Qlik Replicate

IBM InfoSphere DataStage

IBM CP4D

Job description

If you are unable to complete this application due to a disability, contact this employer to ask for an accommodation or an alternative application process.

Principal Data Engineer

Charlotte, NC, US

4 days ago Requisition ID: 1336

Job Posting Title

Principal Data Engineer

Job Description

* Applicants must be authorized to work for ANY employer in the U.S. We are unable to sponsor or take over sponsorship of an employment Visa at this time.*

Location: Charlotte, NC/Detroit, MI
Work Arrangement: Onsite
Job Type: Full-Time

Job Overview

We are seeking an experienced Principal Data Engineer to design, develop, and maintain scalable data solutions supporting enterprise data engineering and analytics initiatives. This role will work across data engineering, data warehousing, data integration, and cloud technologies to build reliable and high-performing data platforms.

The ideal candidate has strong hands-on experience with AWS, Snowflake, Python, SQL, ETL/ELT, and modern data engineering practices, along with the ability to work across complex enterprise data environments.

Key Responsibilities

• Design, develop, and optimize scalable data pipelines and data integration solutions.
• Develop and maintain data architectures supporting enterprise data warehouses, data lakes, and analytics platforms.
• Build and optimize ETL/ELT processes using modern data engineering tools and technologies.
• Develop solutions using AWS services including S3, Lambda, and DynamoDB.
• Design and implement data solutions within Snowflake and other cloud-based data environments.
• Develop and maintain data models, including Data Vault modeling methodologies.
• Write and optimize complex SQL and Python code for data processing and integration.
• Work with dbt to develop, transform, test, and manage data workflows.
• Support data replication and integration using tools such as Qlik Replicate.
• Work with enterprise data platforms including IBM InfoSphere DataStage and CP4D.
• Develop and integrate APIs to support enterprise data and application needs.
• Establish and maintain data quality, governance, metadata management, and data lineage processes.
• Collaborate with engineering, architecture, analytics, and business teams to translate requirements into scalable data solutions.
• Troubleshoot performance, data quality, and integration issues across complex data environments.
• Provide technical leadership and guidance on data engineering architecture and best practices.

Required Qualifications

• Strong experience in data engineering and enterprise data environments.
• Hands-on experience with AWS, particularly S3, Lambda, and/or DynamoDB.
• Strong experience with Snowflake and cloud data warehousing.
• Advanced Python and SQL development skills.
• Experience developing ETL/ELT and data integration solutions.
• Experience with data warehousing and data modeling, including Data Vault.
• Experience with dbt or similar modern data transformation frameworks.
• Experience with data quality, governance, metadata management, and data lineage.
• Strong understanding of relational and non-relational databases.
• Experience with enterprise data integration platforms and tools.
• Ability to work independently while providing technical leadership to other engineers.

Preferred Qualifications

• Experience with Qlik Replicate.
• Experience with IBM InfoSphere DataStage.
• Experience with IBM CP4D.
• Experience developing and integrating APIs.
• Experience with NoSQL databases.
• Experience working with Git and DevOps practices.Experience in large-scale enterprise environments.
• Strong communication and cross-functional collaboration skills.

This is an onsite position that requires the ability to work from the client site on a regular basis.

Kaleidoscope, an Infosys Company, is an equal opportunity employer, and all qualified applicants will receive consideration without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, spouse of protected veteran, or disability.