Senior Data Platform Engineer - AWS & Snowflake

Kaleidoscope Innovation, Inc.; Charlotte, Northern (NC, KY); Hybrid; USD 130,000 - 190,000; Full time

Job summary

Kaleidoscope Innovation, Inc. is seeking a Principal Data Engineer in Charlotte, NC to design, build, and maintain scalable data platforms across data engineering, warehousing, and cloud ecosystems.

The role emphasizes hands-on AWS, Snowflake, Python, and SQL with modern data practices, coupling technical leadership with enterprise-scale delivery. The ideal candidate will manage data modeling (Data Vault), ETL/ELT processes, and API integrations, while driving governance and quality across data

Qualifications

• Strong experience in data engineering and enterprise data environments.
• Hands-on AWS experience (S3, Lambda, DynamoDB).
• Snowflake and cloud data warehousing expertise.
• Advanced Python and SQL development skills.
• Experience developing ETL/ELT and data integration solutions.
• Experience with data warehousing and Data Vault modeling.
• Experience with dbt or similar data transformation frameworks.
• Experience with data quality, governance, metadata management, and data lineage.
• Strong understanding of relational and non-relational databases.
• Ability to lead independently while guiding other engineers.

Responsibilities

• Design, develop, and optimize scalable data pipelines and data integration solutions.
• Develop and maintain data architectures supporting enterprise data warehouses, data lakes, and analytics platforms.
• Build and optimize ETL/ELT processes using modern data engineering tools and technologies.
• Develop solutions using AWS services including S3, Lambda, and DynamoDB.
• Design and implement data solutions within Snowflake and other cloud-based data environments.
• Develop and maintain data models, including Data Vault modeling methodologies.
• Write and optimize complex SQL and Python code for data processing and integration.
• Work with dbt to develop, transform, test, and manage data workflows.
• Support data replication and integration using tools such as Qlik Replicate.
• Work with enterprise data platforms including IBM InfoSphere DataStage and CP4D.
• Develop and integrate APIs to support enterprise data and application needs.
• Establish and maintain data quality, governance, metadata management, and data lineage processes.
• Collaborate with engineering, architecture, analytics, and business teams to translate requirements into scalable data solutions.
• Troubleshoot performance, data quality, and integration issues across complex data environments.
• Provide technical leadership and guidance on data engineering architecture and best practices.

Skills

Data engineering

AWS (S3, Lambda, DynamoDB)

Snowflake

Python

SQL

ETL/ELT

Data warehousing & Data Vault

dbt

Data governance

Technical leadership

Tools

dbt

Qlik Replicate

IBM InfoSphere DataStage

IBM CP4D

Job description

Kaleidoscope Innovation, Inc. is seeking a Principal Data Engineer in Charlotte, NC to design, build, and maintain scalable data platforms across data engineering, warehousing, and cloud ecosystems.

The role emphasizes hands-on AWS, Snowflake, Python, and SQL with modern data practices, coupling technical leadership with enterprise-scale delivery. The ideal candidate will manage data modeling (Data Vault), ETL/ELT processes, and API integrations, while driving governance and quality across data