Lead Software Engineer (ETL/AWS Cloud)

First Citizens; Raleigh (NC); Remote; USD 80,000 - 130,000; Full time

Job summary

An established industry player is seeking a skilled Lead Software Engineer to enhance enterprise data processing systems. This remote role involves developing software and procedures to improve data processing capabilities, analyzing and implementing solutions, and providing technical support for data integration and warehousing. You'll work closely with technical teams to ensure high-quality code development and system functionality. If you're passionate about data engineering and looking to make an impact in a collaborative environment, this role offers the perfect opportunity to showcase your skills and drive innovation in data solutions.

Qualifications

• 6+ years of experience in software application development and maintenance.
• Experience with cloud-based data technologies and ETL processes.

Responsibilities

• Develop and support enterprise data processing systems and enhance related software.
• Provide data integration services and perform data analysis for accuracy.

Skills

Software application development

Data analysis

Data integration

Technical support

Data modeling

Agile engineering practices

Process optimization

Team leadership

Education

Bachelor's Degree in relevant field

High School Diploma or GED

Tools

AWS Glue

Snowflake

SSIS

Informatica IICS

SAP BODS

DataStage

Hadoop

Kafka

Job description

Overview

This is a remote role that may only be hired in the following locations: NC, NJ, AZ.

This position is responsible for development/support of Enterprise data processing systems through enhancement of related software and processes. Develops software and procedures that improve processing capabilities. Analyzes, codes, tests, and implements in coordination with management, associates, and end users. Serves as production system support by resolving issues and ensuring ongoing functionality. May oversee the work of less experienced analysts or assist in special projects as needed.

Responsibilities

• Data Integration - Provide data integration services for all batch/real-time data movement in data warehouse, data platforms (data lake), and dependent data marts (Cloud/OnPrem).
• Data Analysis - Sources, compiles, and interprets data. Performs analysis for accuracy and efficiencies, effectively communicates analysis output.
• Technical Proficiency - Provides technical support by performing coding, ensuring processes run smoothly, and working to continuously improve processing capabilities. Works closely with technical and operation teams to support their business objectives.
• System Testing - Thoroughly tests data integration, data warehouse, and data marts to ensure accuracy, completeness, and overall efficiency. Evaluates and conveys testing results. Performs coding and assists in implementing system modifications and enhancements.
• Ensure that new solutions meet defined technical, functional, and service level requirements and standards and manage the end-to-end lifecycle for new data migration, data integration, and data services-oriented solutions.
• Additionally, the Lead Software Engineer will engage with partners in testing, release management, and operations to ensure quality of code development, deployment, and post-production support.

Qualifications

Bachelor's Degree and 6 years of experience in Software application development and maintenance OR High School Diploma or GED and 10 years of experience in Software application development and maintenance.

Preferred area of experience:

• 5+ Years of Experience in designing & building data pipeline/ETL Frameworks with cloud-based data technologies (Preferred AWS Cloud Services Skills).
• 8+ years of experience in creating and maintaining ETL processes and architecting complex data pipelines - knowledge of data modeling techniques and high-volume ETL/ELT design.
• 3+ years of Experience with data warehousing/Data Lake solutions using Snowflake, AWS- Redshift.
• 5+ years of Experience with ETL and Data Ingestion tools such as (SSIS, Informatica IICS, AWS Glue, SAP BODS, DataStage).
• Experience in programming languages such as ANSI-SQL, Python, Scala, and/or Java.
• Extensive knowledge of data warehouse principles, design, and data modeling concepts.
• 1+ years of experience in designing data privacy related constructs to enable data tokenization, encryption & data access controls on a public cloud data lake.
• 3+ years of experience in Data Engineering related AWS services like Lake formation, Glue, S3, Lambda, DynamoDB and other AWS accelerators.
• 3+ years of experience in Bigdata technologies like Hadoop, Hive, SPARK, No-SQL DB, Kafka and API.
• Experience in leading team of engineers across geographies.
• Use agile engineering practices and various data development technologies to rapidly develop creative and efficient data products.
• Identify inefficiencies, optimize processes and data flows, and make recommendations for improvements.
• Communicate with other developers across teams, both for ad hoc problem solving and check-ins/discussions with other initiatives.
• Technical Skills: Snowflake, AWS Services like S3, Glue, Lambda, DynamoDB, Redshift, Redshift spectrum, Lake formation, Sagemaker, Quicksight, Athena.
• Scripting and languages: Python, SQL, PySpark, Hive.
• ETL tools like SSIS, Informatica IICS, SAP BODS, DataStage.