Software / Data Engineer (1433)

Zapata Technology, Inc.; Fayetteville (NC); Remote; USD 90,000 - 130,000; Full time

Job summary

A leading technology company is seeking a Software / Data Engineer to enhance its ETL processes and support the migration to modern data solutions. This remote position involves working with cross-functional teams to design efficient data workflows, ensuring data integrity and compliance with governance requirements. The ideal candidate will bring over 4 years of experience, strong SQL skills, and hold a Security+ Certification. Join us to contribute to innovative data solutions in a collaborative environment!

Qualifications

• Experience in data engineering and database management.
• Proficient in developing ETL solutions and managing data workflows.
• Must have Security+ Certification.

Responsibilities

• Collaborate with ETL team on data infrastructure.
• Develop modular ETL solutions and maintain scalable data storage systems.
• Document data processes ensuring compliance with governance standards.

Skills

ETL Processes

Database Management

SQL Optimization

Data Governance

Scripting

Agile Methodologies

Education

4+ years of Software Development

Security+ Certification

Tools

ASP.NET

Postgres

AWS

Spark

Databricks

Job description

Software / Data Engineer (1433) (Remote) | Augusta, 30901, Augusta, Georgia, US

Summary:

The Engineer will collaborate closely with our ETL team and the customer in transforming AAG RFL data infrastructure. This role involves utilizing custom ASP.NET applications, developing Postgres stored procedures, and migrating existing VBA scripts to modern platforms to build and manage ETL processes. Essential for meeting the customer's current needs, the position also requires preparation for a future transition to modern ETL tools such as Apache NiFi. This position requires extensive experience in data engineering, database management, and designing efficient ETL workflows without relying on traditional ETL tools, working in collaborative environments involving both team members and customers.

This position can be performed remotely.

Check out the details below and our awesome benefits here.

Job Qualifications:

• Design and develop modular ETL solutions that facilitate data ingestion and delivery across various systems, utilizing custom ASP.NET applications and Postgres stored procedures.
• Develop and maintain scalable data storage systems, focusing on Postgres or other relational databases, to support efficient data retrieval and transformation processes.
• Develop optimized SQL queries and stored procedures that process and transform both structured and unstructured data, ensuring performance and reliability in data handling.
• Build and manage data pipelines tailored for reporting and analytics, leveraging custom scripting rather than relying on third-party ETL tools to maintain flexibility and control.
• Collaborate with cross-functional teams to understand data requirements and implement custom data solutions that support the organization’s analytics and reporting needs.
• Create custom scripts and applications to enhance data transformation capabilities and address specific data management requirements.
• Document data ingestion and transformation processes thoroughly, ensuring compliance with data governance frameworks, including HRPP, Privacy, HIPAA, and SOP guidelines.
• Perform quality assurance tasks to validate data accuracy and troubleshoot data quality issues, upholding system integrity and reliability.
• Support metadata management practices, ensuring all data processes comply with governance standards and industry best practices.

Preferred Qualifications and Skills include:

• Experience with ASP.NET, C#, and related web application development frameworks.
• Advanced knowledge of Postgres, particularly in writing complex stored procedures, query optimization, and transitioning data infrastructure to Postgres.
• Strong familiarity with AWS cloud environments, with experience in migrating data systems to AWS.
• Experience with low-code/no-code platforms and distributed data processing tools such as Spark, Databricks, or similar.
• Knowledge of real-time data processing, streaming applications, and data warehousing concepts, especially in cloud-native environments.
• Proficiency in shell scripting and automation to support cloud migrations and system integrations.
• Experience working in Agile methodologies, particularly within cloud-based or hybrid cloud environments.
• Requires Security+ Certification.

Education/Experience includes:

• 4+ years of Software Development

Working Conditions:

Prolonged periods sitting at a desk and working on a computer

Position Type/Expected Hours of Work:

Full-time position

Clearance:

This position requires an active Secret clearance with the ability to obtain TS/SCI.

AAP/EEO Statement:

Equal Opportunity Employer – Disabled/Veteran

Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status.

Zapata Technology, Inc. provides reasonable accommodation to applicants who are veterans or who have disabilities and are unable to fully use our company application system. If you need a reasonable accommodation for any part of the application and hiring process, please notify Christina Hall, EEO Coordinator at Zapata Technology. 706-955-4809