Senior Data Engineer

Talentify; McLean (VA); Remote; USD 120,000 - 160,000; Full time

Job summary

Talentify is seeking a Senior Data Engineer to lead the design and deployment of the Unified Data Platform on AWS. You will build scalable ETL pipelines, ingest diverse data sources, and optimize infrastructure for reliability and cost use.

The role emphasizes data integrity, governance, and HIPAA compliance within a collaborative, cross-functional environment. You will develop PL/SQL routines, model relational schemas, perform query tuning, and support testing across SIT/UAT.

Qualifications

• Bachelor’s degree in computer science or information systems or related field.
• 7+ years of PL/SQL development, performance tuning, troubleshooting, and working with large datasets in RDBMS.
• Experience with AWS services Glue, Redshift, Lambda, S3, IAM, EC2 for data processing and pipeline development.
• Ability to write and optimise complex SQL queries efficiently.
• Strong foundation in relational schema design, indexing strategies, and scalable architecture.
• Knowledge of data validation, cleansing techniques and quality frameworks.

Responsibilities

• Design and deploy scalable ETL pipelines on AWS using Glue, Lambda, S3, and Redshift.
• Ingest and process UDP-based data sources via EC2 instances or containerised ingestion services.
• Configure and optimise AWS infrastructure for performance, reliability, and cost-effectiveness.
• Develop and maintain efficient PL/SQL code including stored procedures, packages, triggers, and functions.
• Design and optimise relational database schemas for scalability and normalisation.

Skills

AWS

ETL

PL/SQL

Data modeling

SQL tuning

Shell scripting

Education

Bachelor's degree

Tools

AWS Glue

AWS Redshift

AWS Lambda

Amazon S3

IAM

EC2

Job description

Position Status Label: Exempt

Labor Category: Information Technology

Remote/Onsite: Remote

Senior Data Engineer

The purpose of this position is to manage and enhance the Unified Data Platform (UDP) leveraging the power of AWS. In this role, you will design and deploy robust, scalable ETL pipelines and data workflows that enable seamless integration, transformation, and accessibility of enterprise data assets. You’ll lead the development of cloud-native solutions using key AWS services such as Glue, Lambda, S3, Redshift, and EC2, while ensuring cost-efficiency, reliability, and optimized performance. Your expertise in PL/SQL development and relational data modeling will be essential in supporting complex transactional and analytical use cases within a large-scale data environment. This is a highly collaborative position that will see you partnering with cross-functional teams to drive system testing, application integration, and continuous platform enhancements. As a champion of data integrity, governance, and regulatory compliance (e.g., HIPAA).

Responsibilities

• Design and deploy scalable ETL pipelines on AWS using services such as Glue, Lambda, S3, and Redshift.
• Ingest and process UDP-based data sources via EC2 instances or containerised ingestion services.
• Configure and optimise AWS infrastructure for performance, reliability, and cost-effectiveness.
• Develop and maintain efficient PL/SQL code including stored procedures, packages, triggers, and functions.
• Design and optimise relational database schemas for scalability and normalisation.
• Perform query tuning and performance optimisation across SQL and PL/SQL workloads.
• Build and schedule robust ETL jobs and data workflows using cron or enterprise orchestration tools.
• Develop and support integration of disparate data sources (flat files, third-party databases).
• Conduct data validation and cleansing operations to ensure accuracy and completeness.
• Troubleshoot and resolve data quality issues across systems.
• Support SIT, UAT, and performance testing of Oracle Financial Applications.
• Work autonomously within well-defined system design frameworks to implement Unified Data Platform (UDP) components.
• Collaborate with development and business analysis teams to understand functional and technical design.
• Participate in code review sessions and implement feedback for quality improvements.
• Perform impact and gap analysis in response to system software changes.
• Maintain technical documentation, coding standards, and system architecture artefacts.
• Ensure compliance with industry regulations and internal governance policies (e.g., HIPAA).
• Communicate technical impacts, root cause findings, and resolutions effectively to leadership.
• Read, understand, and adhere to all corporate policies including policies related to HIPAA and its Privacy and Security Rules.

Requirements

• Bachelor’s degree in computer science, Information Systems, or related field.
• Requires 7+ years of experience with PL/SQL development, performance tuning, troubleshooting, and working with large datasets in RDBMS.
• Experience with AWS services such as Glue, Redshift, Lambda, S3, IAM, EC2 for data processing and pipeline development.
• Ability to write and optimise complex SQL queries efficiently.
• Solid foundation in relational schema design, indexing strategies, and scalable architecture.
• Skilled in applying data validation, cleansing techniques, and quality frameworks.
• Understanding of SDLC and STLC processes for structured development and testing.
• Excellent interpersonal skills with a demonstrated ability to work effectively across technical and business teams.
• Experience developing listener services and managing real-time data. Proven background designing, implementing, and scheduling ETL workflows and data integration solutions.
• Proficient in Unix environments with hands-on shell scripting experience.
• Knowledge of business intelligence and data warehouse methodologies.
• Knowledgeable of the healthcare industry, managed care, and operational systems.
• Excellent verbal and written communication skills.