Principal Data Engineer

Habitat For Humanity Of Durham; Durham (NC); On-site; USD 90,000 - 120,000; Full time

Job summary

Habitat For Humanity Of Durham is looking for a Principal Data Engineer to design and deliver data lakes, data warehouses, and analytics solutions using the Snowflake Cloud Platform. The ideal candidate will have a Bachelor’s degree in Computer Science and five years of experience in the financial services environment, along with expertise in SQL, Python, and AWS.

Tasks include building automated pipelines, managing data services, and developing comprehensive documentation for multiple applications. The role emphasizes the development of software testing and validation procedures.

Qualifications

• Five years of experience as a Principal Data Engineer or closely related occupation.
• Experience designing and building database and data models in a financial services environment.
• Understanding of Continuous Integration and Continuous Delivery (CI/CD) processes.

Responsibilities

• Design and maintain data structures, batch jobs, and interfaces to external systems.
• Develop technical solutions for ongoing development efforts.
• Responsible for documentation and testing of applications.

Skills

SQL

Python

Java

Scala

AWS

CI/CD

Bigdata

Airflow

NIFI

Education

Bachelor's degree in Computer Science

Master's degree in Computer Science

Tools

Snowflake

Jenkins

GitHub

Stash

uDeploy

Job description

Principal Data Engineer

Position Description: Design and deliver data lakes, data warehouses, and report platforms. Develop data and analytics solutions on Snowflake Cloud Platform and provide technical guidance in the implementation and practice of relational database technologies and tools – Snowflake, Oracle, SQL Server, and PL/SQL. Work with teams to support multiple source databases and build extract replication metrics using replication and programming tools. Build automated pipelines to deploy to various environments and services using Amazon Web Services (AWS), Python, Concourse, Jenkins, and Groovy script.

Primary Responsibilities

• Design, implement, and maintain data structures, batch jobs, and interfaces to external systems.
• Develop original and creative technical solutions to ongoing development efforts.
• Develop applications for multiple projects supporting several divisional initiatives.
• Support and perform all phases of testing leading to implementation.
• Assist in the planning and conducting of user acceptance testing.
• Develop comprehensive documentation for multiple applications supporting several corporate initiatives.
• Responsible for post-installation validation and triaging of any issues.
• Establish project plans for projects of moderate scope.
• Perform independent and complex technical and functional analysis for multiple projects supporting several initiatives.
• Manage data services hosted on the operational data stores and file-based interfaces.
• Consult with systems analysts and other software engineers/developers to design systems.
• Gather information on project limitations and capabilities, performance requirements, and interfaces.
• Develop and oversee software system testing and validation procedures, programming, and documentation.

Education and Experience

Bachelor’s degree in Computer Science, Engineering, Information Technology, Information Systems, or a closely related field (or foreign education equivalent) and five years of experience as a Principal Data Engineer (or closely related occupation) designing and building database and data models in a financial services environment.

Or, alternatively, Master’s degree in Computer Science, Engineering, Information Technology, Information Systems, or a closely related field (or foreign education equivalent) and three years of experience as a Principal Data Engineer (or closely related occupation) designing and building database and data models in a financial services environment.

Skills and Knowledge

• Demonstrated Expertise translating business requirements into technical validations – examining data to determine accuracy, quality, or condition using SQL, Python, Java, and Scala; and automating the Continuous Integration and Continuous Delivery (CI/CD) REST APIs pipeline for deployments using Stash, GitHub, Jenkins, and uDeploy.
• Developing data ingestion frameworks using Python to load structured data from relational databases into a Cloud Software as a Service (SaaS) Data Lake Platform (Snowflake), using AWS, NIFI, Java, Snowflake, and Python.
• Developing data masking, reconciliation framework, and comparison dashboard metrics using Bigdata, Python, Java, Snowflake, and Airflow.
• Building metadata-driven frameworks for file feed data ingestion to load data into Snowflake using AWS, Python, Java, Snowflake, and Airflow.

Certifications

None specified.

Equal Opportunity Employer

Fidelity Investments is an equal opportunity employer. We believe that the most effective way to attract, develop, and retain a diverse workforce is to build an enduring culture of inclusion and belonging.

Reasonable Accommodations

Fidelity will reasonably accommodate applicants with disabilities who need adjustments to participate in the application or interview process. To initiate a request for an accommodation contact the HR Accommodation Team by sending an email to [e-mail], or by calling 800-835-5099, prompt 2, option 3.

Applicant Screening

At Fidelity, we value honesty, integrity, and the safety of our associates and customers within a heavily regulated industry. Certain roles may require candidates to go through a preliminary credit check during the screening process. Candidates who are presented with a Fidelity offer will need to go through a background investigation and may be asked to provide additional documentation. This investigation includes but is not limited to a criminal, civil litigations, and regulatory review, employment, education, and credit review (role dependent). These investigations will account for 7 years or more of history, depending on the role. Where permitted by federal or state law, Fidelity will also conduct a pre-employment drug screen, which will review for the following substances: Amphetamines, THC (marijuana), cocaine, opiates, phencyclidine.

AI Guidelines

Learn about our guidelines for use of AI when applying for a Fidelity job.