Principal Data Engineer

Creative Testing Solutions, Inc.; United States; Remote; USD 140,000 - 190,000; Full time

Job summary

Creative Testing Solutions is seeking a Principal Data Engineer to design, build, and maintain data infrastructure including data lakes, warehouses, and analytics platforms. You will develop scalable data solutions, collaborate with analysts and scientists, and drive data democratization across the organization.

The role emphasizes leadership, architectural oversight, and delivering robust analytics capabilities while ensuring data quality and governance. Remote role within the United States.

Qualifications

• Bachelor’s degree in Computer Engineering or related field or equivalent technical experience.
• At least 10 years of data engineering experience including Data Warehouse architectures, preferably in lead/architect role.
• Experience with ETL/ELT pipelines and data processing automation.
• Advanced knowledge of SQL, data modeling, warehousing concepts, and data governance practices.

Responsibilities

• Conceptualizes and implements foundational data models, Data Lake, ETL pipelines and curated layer servicing multiple reporting platforms.
• Writes and optimizes SQL queries for high performance and cost-effectiveness in large-scale data environments.
• Develops and manages data engineering architecture, and designs and implements Lakehouse and analytics solutions.
• Develops and coordinates cloud architecture across areas including application development, IAM, network and data management, and security.
• Implements data governance, cleansing, deduplication, validation, and governance to ensure data integrity.

Skills

Data modeling

SQL proficiency

ETL/ELT pipelines

Cloud architecture

Data governance

Analytical thinking

Cross-functional collaboration

Education

Bachelor’s degree in Computer Engineering or related field

10+ years of data engineering experience

Experience with Data Warehouse architectures

Tools

Azure

ADF

DevOps

Fabric data platform

Job description

Job Description Summary

The Principal Data Engineer holds a pivotal role in enabling data-driven decision-making across CTS. This position involves designing, building, and maintaining the processes that collect, store, and process data for analysis and business use. This individual is responsible for creating data pipelines that transform raw data into usable formats for analysts, data scientists, visualization engineers, and other stakeholders. This includes developing and maintaining databases, data warehouses, and other data infrastructure. The Principal Data Engineer collaborates closely with stakeholders to deliver and support business operations, with a focus on democratizing data and building robust analytics solutions. This role will develop data solutions, enhance internal analytics platforms, and streamline processes to drive efficiently.

Job Description

PRIMARY DUTIES AND RESPONSIBILITIES

• Conceptualizes and implements foundational data models, Data Lake, ETL pipelines and curated layer servicing multiple reporting platforms.
• Writes and optimizes SQL queries for high performance and cost-effectiveness in large-scale data environments.
• Develops and manages data engineering architecture, and designs and implements Lakehouse and analytics solutions.
• Develops and coordinates cloud architecture across diverse areas including application development, identity and access management, network and data management, and security.
• Implements data management best practices including cleansing, deduplication, validation, and governance to ensure data integrity and quality.
• Designs, develops, and maintains robust scalable ETL/ELT data pipelines across multiple data sources and destinations.
• Collaborates with data analysts, data scientists, and software engineers to understand data needs and translates them into technical solutions.
• Optimizes data workflows for performance, scalability, and reliability.
• Builds and maintains data models and warehouse schemas in support of analytics and business intelligence initiatives.
• Optimizes query performance and database operations
• Ensures data quality, integrity, and compliance across all systems.
• Participates in architectural discussions and help drive best practices in data engineering.
• Collaborates with fellow data & analytics colleagues to foster a culture of teamwork and innovation.
• Mentors junior data engineers and contributes to the development of team standards and practices.
• Monitors data pipelines and resolves production issues in a timely manner.
• Partners closely with DevOps and platform teams to manage infrastructure and deployment of data tools.
• Performs all assigned duties in compliance with internal SOPs and external regulations. Brings compliance issues to the attention of management.
• Assures quality customer service to all customers.
• Maintains good attendance and punctuality per the absence policy.
• Performs all other duties, at the discretion of management, as assigned.

REQUIRED QUALIFICATIONS

• Education: Bachelor’s degree in Computer Engineering or related field of study, or equivalent technical experience.
• Experience: A minimum of ten (10) years of data engineering related experience; To include:
  • Experience designing and implementing Data Warehouse Architectures, preferably in a lead or architect capacity.
  • Experience with ETL/ELT pipelines, to-and-from various datastores (incl. operating systems, network share protocols, web APIs, and databases), as well as for data processing automation.
  • Advanced experience with database concepts; solid understanding of query languages (e.g., SQL), data transformation techniques, data modeling, warehousing concepts, and best practices.

PREFERRED QUALIFICATIONS

• Knowledge of Azure cloud platform, Fabric data platform, ADF and DevOps is highly preferred
• Professional database certification

SKILLS & ABILITIES

• Strong business acumen, critical thinking, and ability to work cross functionally through collaboration with engineering and business partners.
• Ability to read and understanding various data structures.
• Ability to work independently and as part of a team.
• Strong analytical, technical, and troubleshooting skills.
• Familiarity with data governance, privacy, and compliance standards.
• Must possess the skills and abilities to successfully perform all assigned duties and responsibilities.
• Must be able to maintain confidentiality.
• Ability to work in a team environment and participate as an active team member.
• Effective oral and written communication skills.
• Able to organize, prioritize, and execute a variable workload and multiple priorities.

PHYSICAL & TRAVEL REQUIREMENTS

• Office work environment
• Travel: < 10%
• 5+ hours per shift: Sitting, finger dexterity, reaching waist to shoulder
• Up to 3 hours per shift: Standing, walking, bending, squatting, kneeling, handling, driving, reaching above shoulders, reaching waist to shoulder, reaching knee to waist, reaching floor to knee, grasping items, lift/carry/move items up to 40 pounds, push/pull items up to 10 pounds

The above statements are intended to describe the general nature and level of work performed by people assigned to this job. They are not intended to be an exhaustive list of responsibilities, duties, and skills required of personnel so classified. The job description reflects the general details considered necessary to describe the principal functions of the job identified and shall not necessarily be construed as a detailed description of all the work requirements that may be inherent in the job. Creative Testing Solutions is an Equal Opportunity Employer.

Additional Job Details:

This is a remote role, but you must reside in one of the following states: Arizona, Colorado, Florida, Illinois, Indiana, Minnesota, Missouri, North Carolina, South Carolina, Tennessee, Texas, Wisconsin.

Shift 1

Creative Testing Solutions is an equal opportunity employer.

EEO/Minorities/Females/Disabled/Veterans

Our organization is an equal employment/affirmative action employer. If you need accommodation for any part of the employment process because of a medical condition or disability, please send an e-mail to [e-mail] to let us know the nature of your request. A representative will respond to accommodation requests within five business days. Please note that this email is for medical/disability accommodations only and any other inquiries will not receive a response.

Please see the below information about applicant rights and our commitment to compliance:

Know Your Rights: Workplace Discrimination is Illegal

Pay Transparency Nondiscrimination Provision

E-Verify Participation

Right to Work

All candidates who receive a conditional written offer of employment will be required to undergo a pre-employment drug test in accordance with the Company’s established guidelines.