Onsite AWS Data Engineer (PostgreSQL) | ETL & Data Lakes

E-Solutions; Basking Ridge (NJ); On-site; USD 95,000 - 150,000; Full time

Job summary

E-Solutions in Basking Ridge, NJ seeks a Data Reliability Engineer II to build, optimize, and manage data lakes and warehouses from multiple sources using PostgreSQL and AWS. You will monitor RDS performance, tune queries, and support data pipelines with Debezium, Kafka Connect, and Airflow, while implementing security and backup strategies.

The role emphasizes automation through Terraform/Crossplane and on-call incident response, with collaboration across teams to improve reliability and

Qualifications

• Experience with PostgreSQL and AWS data pipelines (ETL/ELT).
• Monitor PostgreSQL RDS using CloudWatch/Prometheus.
• Identify and tune performance with query plans and indexes.
• Monitor Debezium and Kafka Connect data capture.
• Oversee ETL workflows and data pipelines for reliability.
• Support data-related issues and root cause analysis.
• Monitor Airflow DAGs and troubleshoot tasks.
• Develop IaC scripts (Terraform, Crossplane) for automation.
• Participate in on-call rotations for DB incidents.
• Implement cloud DB security controls and encryption best practices.
• Audit DB security configurations.
• Configure backup/recovery strategies for data integrity.

Responsibilities

• Develop, optimize, and manage large data lakes and data warehouses from multiple sources.
• Proactively monitor and optimize PostgreSQL RDS performance and resources.
• Troubleshoot data capture issues with Debezium and Kafka Connect.
• Oversee ETL/ELT pipelines and airflow DAG executions.
• Create automation scripts and IaC templates for deployments.
• Participate in on-call rotations for incident response.
• Ensure database security and compliance with regulations.
• Collaborate with developers to optimize SQL queries and schemas.
• Design and optimize cloud database schemas for scalability.

Skills

PostgreSQL

AWS

ETL/ELT pipelines

SQL scripting

Python

Bash

Airflow

Debezium

Kafka Connect

Security best practices

Education

Bachelor's degree in Computer Science or IT

Tools

Terraform

Crossplane

CloudWatch

Prometheus

Kafka Connect

Debezium

Apache Airflow

Apache Spark

Amazon Redshift

S3

Job description

E-Solutions in Basking Ridge, NJ seeks a Data Reliability Engineer II to build, optimize, and manage data lakes and warehouses from multiple sources using PostgreSQL and AWS. You will monitor RDS performance, tune queries, and support data pipelines with Debezium, Kafka Connect, and Airflow, while implementing security and backup strategies.

The role emphasizes automation through Terraform/Crossplane and on-call incident response, with collaboration across teams to improve reliability and