Principal Data Engineer

Kaleidoscope; Charlotte (NC); On-site; USD 140,000 - 190,000; Full time

Job summary

Kaleidoscope in Charlotte, NC is seeking a Principal Data Engineer to design, develop, and maintain scalable data solutions across data engineering, warehousing, and cloud technologies. You will lead efforts across data pipelines, data integration, and analytics platforms, leveraging AWS, Snowflake, Python, SQL, and dbt to deliver robust data ecosystems.

Ideal candidates will have extensive experience in enterprise data environments, data modeling (Data Vault), and data quality governance, with

Qualifications

• Strong hands-on data engineering in enterprise environments.
• Experience with AWS services (S3, Lambda, DynamoDB).
• Snowflake and cloud data warehousing expertise.
• Advanced Python and SQL development skills.
• Experience building ETL/ELT and data integration solutions.
• Experience with data warehousing and Data Vault modeling.
• Familiarity with data transformation tools like dbt.
• Experience with data quality, governance, metadata management, and data lineage.

Responsibilities

• Design, develop, and optimize scalable data pipelines and data integration solutions.
• Support data warehouses, data lakes, and analytics platforms with scalable architectures.
• Build and optimize ETL/ELT processes using modern data engineering tools.
• Develop data solutions using AWS services (S3, Lambda, DynamoDB) and Snowflake.
• Model data including Data Vault and manage data across enterprise environments.
• Write and optimize SQL and Python for data processing; work with dbt workflows.
• Collaborate with teams to translate requirements into scalable data solutions.
• Ensure data quality, governance, and lineage across data platforms.

Skills

AWS

Python

SQL

ETL/ELT

Data Warehousing

Data Modeling

Data Vault

dbt

Data Governance

Data Quality

Tools

Snowflake

Qlik Replicate

IBM InfoSphere DataStage

IBM CP4D

dbt

Job description

If you are unable to complete this application due to a disability, contact this employer to ask for an accommodation or an alternative application process.

Principal Data Engineer

Charlotte, NC, US

3 days ago Requisition ID: 1336

Job Posting Title

Principal Data Engineer

Job Description

* Applicants must be authorized to work for ANY employer in the U.S. We are unable to sponsor or take over sponsorship of an employment Visa at this time.*

Location: Charlotte, NC/Detroit, MI
Work Arrangement: Onsite
Job Type: Full-Time

Job Overview

We are seeking an experienced Principal Data Engineer to design, develop, and maintain scalable data solutions supporting enterprise data engineering and analytics initiatives. This role will work across data engineering, data warehousing, data integration, and cloud technologies to build reliable and high-performing data platforms.

The ideal candidate has strong hands-on experience with AWS, Snowflake, Python, SQL, ETL/ELT, and modern data engineering practices, along with the ability to work across complex enterprise data environments.

Key Responsibilities

• Design, develop, and optimize scalable data pipelines and data integration solutions.
• Develop and maintain data architectures supporting enterprise data warehouses, data lakes, and analytics platforms.
• Build and optimize ETL/ELT processes using modern data engineering tools and technologies.
• Develop solutions using AWS services including S3, Lambda, and DynamoDB.
• Design and implement data solutions within Snowflake and other cloud-based data environments.
• Develop and maintain data models, including Data Vault modeling methodologies.
• Write and optimize complex SQL and Python code for data processing and integration.
• Work with dbt to develop, transform, test, and manage data workflows.
• Support data replication and integration using tools such as Qlik Replicate.
• Work with enterprise data platforms including IBM InfoSphere DataStage and CP4D.
• Develop and integrate APIs to support enterprise data and application needs.
• Establish and maintain data quality, governance, metadata management, and data lineage processes.
• Collaborate with engineering, architecture, analytics, and business teams to translate requirements into scalable data solutions.
• Troubleshoot performance, data quality, and integration issues across complex data environments.
• Provide technical leadership and guidance on data engineering architecture and best practices.

Required Qualifications

• Strong experience in data engineering and enterprise data environments.
• Hands-on experience with AWS, particularly S3, Lambda, and/or DynamoDB.
• Strong experience with Snowflake and cloud data warehousing.
• Advanced Python and SQL development skills.
• Experience developing ETL/ELT and data integration solutions.
• Experience with data warehousing and data modeling, including Data Vault.
• Experience with dbt or similar modern data transformation frameworks.
• Experience with data quality, governance, metadata management, and data lineage.
• Strong understanding of relational and non-relational databases.
• Experience with enterprise data integration platforms and tools.
• Ability to work independently while providing technical leadership to other engineers.

Preferred Qualifications

• Experience with Qlik Replicate.
• Experience with IBM InfoSphere DataStage.
• Experience with IBM CP4D.
• Experience developing and integrating APIs.
• Experience with NoSQL databases.
• Experience working with Git and DevOps practices.
• Experience in large-scale enterprise environments.
• Strong communication and cross-functional collaboration skills.

This is an onsite position that requires the ability to work from the client site on a regular basis.

Kaleidoscope, an Infosys Company, is an equal opportunity employer, and all qualified applicants will receive consideration without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, spouse of protected veteran, or disability.