Senior Data Engineer | ETL/Databricks, AWS Python & Spark

TechDigital Group; Holmdel Township (NJ); On-site; USD 130,000 - 180,000; Full time

Job summary

TechDigital Group seeks an experienced data engineer to transform conceptual designs into scalable data pipelines and provide timely production support. Requirements include 10+ years IT, 7+ years ETL/ELT, Databricks/Spark, Python, SQL, UNIX shell, and experience with GitHub/Jenkins/Informatica.

Finance/insurance domain knowledge is a plus. Collaborate across teams to ensure robust, reliable data solutions.

Qualifications

• 10+ years of IT experience with 7+ years as ETL/ELT developer or data engineer.
• Databricks data engineering experience; Spark certification preferred.
• Knowledge of GitHub, Jenkins, and Informatica.
• Finance or Insurance industry knowledge is a plus.
• Expert in AWS Databricks, Python, Spark.
• Strong SQL and UNIX shell scripting experience.
• Performance tuning of data pipelines and issue resolution.
• Production support for applications and incident triage.

Responsibilities

• Transform conceptual designs into reliable, scalable data pipelines.
• Collaborate with Development teams, technology partners, and stakeholders to deliver timely support.
• Maintain quality and resolution standards to meet business needs.

Skills

Analytical thinking

Problem solving

Root cause analysis

Troubleshooting

Stakeholder communication

Tools

Databricks

Spark

Python

SQL

UNIX shell

GitHub

Jenkins

Informatica

AWS

Job description

TechDigital Group seeks an experienced data engineer to transform conceptual designs into scalable data pipelines and provide timely production support. Requirements include 10+ years IT, 7+ years ETL/ELT, Databricks/Spark, Python, SQL, UNIX shell, and experience with GitHub/Jenkins/Informatica.

Finance/insurance domain knowledge is a plus. Collaborate across teams to ensure robust, reliable data solutions.