Data Reliability Engineer

Novasoft; Basking Ridge (NJ); On-site; USD 150,000 - 210,000; Full time

Job summary

Novasoft in the United States is seeking a highly experienced Data Reliability Engineer to ensure the performance, availability, and security of PostgreSQL and cloud-based data environments.

The role focuses on ETL/ELT data pipelines, monitoring and tuning PostgreSQL RDS, Debezium and Kafka Connect, and building scalable data platforms with Airflow, Spark, and IaC tooling. On-site in Basking Ridge, NJ five days weekly.

Qualifications

• 13+ years in data engineering or related tech roles.
• Deep PostgreSQL experience, preferably on AWS RDS.
• Strong SQL and data pipeline design skills.
• Experience with cloud data platforms, monitoring, and security.

Responsibilities

• Design, develop, and troubleshoot ETL/ELT pipelines for data lakes/warehouses.
• Monitor PostgreSQL RDS performance, availability, and resources.
• Track metrics with CloudWatch/Prometheus; tune DB performance.
• Troubleshoot Debezium and Kafka Connect for reliable data delivery.
• Manage Airflow DAGs; fix failed tasks and re-run workflows.
• Develop automation scripts in Python or Bash.
• Create IaC with Terraform and Crossplane for data infra.
• Support backups, DR plans, security, and RCA.
• Work on-site in Basking Ridge, NJ.

Skills

PostgreSQL

AWS

ETL/ELT pipelines

SQL

Data reliability

Python

Bash

Terraform

Crossplane

Prometheus

Airflow

Kafka Connect

Debezium

Tools

AWS RDS

Debezium

Kafka Connect

Apache Airflow

Apache Spark

Python

Bash

Terraform

Crossplane

Prometheus

CloudWatch

S3

Job description

Location:Basking Ridge, NJ (In person)
Employment Type:Contract
Experience:13+ Years

Position Overview:

We are seeking a highly experiencedData Reliability Engineerwith strong expertise inPostgreSQL, AWS, and data pipeline engineering. The ideal candidate will have extensive experience building and supportingETL/ELT data pipelines, monitoring cloud databases, troubleshooting data reliability issues, and maintaining highly available data platforms.

This role will focus on ensuring theperformance, availability, reliability, security, and scalabilityof PostgreSQL and cloud-based data environments. The successful candidate will work across database infrastructure, data pipelines, streaming platforms, and workflow orchestration technologies.

Key Responsibilities:

• Design, develop, maintain, and troubleshootETL/ELT data pipelinessupporting large-scale data lakes and data warehouses.
• MonitorPostgreSQL RDSinstances for performance, availability, resource utilization, and overall system health.
• Monitor CPU, memory, storage, database connections, and other PostgreSQL RDS metrics using tools such asAWS CloudWatch and Prometheus.
• Identify PostgreSQL performance bottlenecks and perform basic database tuning, including query execution plan analysis, indexing, and parameter optimization.
• Analyze SQL query performance and collaborate with development teams to optimize queries, database schemas, and data access patterns.
• Monitor and troubleshootDebezium and Kafka Connectconnectors to ensure reliable data capture and delivery.
• Monitor ETL workflows and data pipelines for failures, processing delays, data quality issues, and performance bottlenecks.
• MonitorApache Airflow DAGs, troubleshoot failed tasks, and rerun workflows as required.
• Support data-related incidents, perform troubleshooting, and participate inroot cause analysis (RCA).
• Develop automation scripts usingPython, Bash, or similar scripting languagesto improve operational efficiency.
• Develop and maintain Infrastructure as Code (IaC) using tools such asTerraform and Crossplane.
• Support database deployments, configuration changes, upgrades, and routine maintenance.
• Implement and maintain database backup, recovery, and disaster recovery strategies.
• Support database security through access controls, encryption, configuration reviews, and compliance practices.
• Regularly audit database security configurations and identify potential risks or areas for improvement.
• Assist with the design and optimization of database schemas for cloud environments.
• Participate in on-call rotations and respond to database and data platform incidents.
• Contribute to continuous improvement initiatives focused on data reliability, scalability, availability, and operational efficiency.

Required Skills and Qualifications

• 13+ years of experiencein data engineering, database engineering, data reliability, or related technology roles.
• Extensive hands-on experience withPostgreSQL, preferably PostgreSQL running onAWS RDS.
• Strong experience developing and supportingETL/ELT data pipelines.
• Strong SQL skills, including query development, troubleshooting, optimization, and data manipulation.
• Strong experience withAWS cloud services, particularly database and data platform technologies.
• Experience monitoring and troubleshooting production database environments.
• Experience with database performance tuning, query execution plans, indexing, and schema optimization.
• Experience with data pipeline monitoring, incident resolution, and root-cause analysis.
• Experience with cloud database security, access controls, encryption, backup, and recovery.
• Strong troubleshooting and problem-solving skills in production environments.
• Ability to work onsite inBasking Ridge, NJ, five days per week.

Preferred Technical Skills

• AWS:RDS, CloudWatch, S3, Redshift
• Databases:PostgreSQL, database performance tuning, schema design
• Data Engineering:ETL/ELT, data pipelines, data lakes, data warehouses
• Streaming:Debezium, Kafka, Kafka Connect
• Orchestration:Apache Airflow
• Data Processing:Apache Spark
• Automation:Python, Bash
• Infrastructure as Code:Terraform, Crossplane
• Monitoring:AWS CloudWatch, Prometheus
• Security:Database access controls, encryption, compliance, backup/recovery

Additional Qualifications

• Familiarity withAmazon Redshift and Amazon S3.
• Exposure toApache Sparkfor data processing.
• Working knowledge ofApache Airflowfor workflow orchestration.
• Experience supporting production data platforms and participating in on-call rotations.
• Knowledge of database security and compliance requirements such asGDPR and HIPAA.
• AWS Certified Database - Specialty certification is a plus.