Senior Spark Engineer for Production Support & Automation

DEF; Charlotte (NC); On-site; USD 100,000 - 140,000; Full time

Job summary

DEF is seeking a Senior Software Engineer to join the production support/DevOps team in Charlotte. The role requires independent work, proactive troubleshooting, and opportunities to optimize and automate complex data pipelines.

Ideal candidates will have strong Spark development experience, ETL with Hadoop, and proficiency in SQL, Unix, and data warehousing. Collaboration with multiple teams and business stakeholders is essential.

Qualifications

• Mid to senior level Software Engineer with strong experience in Platform / Production Support / DevOps.
• Experience in ETL, Bigdata- Hadoop, SQL; Spark knowledge is essential.
• Strong data and code analysis skills (troubleshooting data quality/integrity, root causes).

Responsibilities

• Collaborate with internal and external tech, production support, and middleware teams.
• Self-manage work and take initiative to troubleshoot and resolve issues independently.
• Identify opportunities for optimization and automation in the production environment.
• Engage with the business team to ensure alignment and timely delivery.

Skills

Spark development

ETL / Hadoop

SQL

Unix

Data warehousing

Scripting

Troubleshooting

Root cause analysis

Performance optimization

Production Support

Tools

Bitbucket

Gradle

Jenkins

Ansible

Job description

DEF is seeking a Senior Software Engineer to join the production support/DevOps team in Charlotte. The role requires independent work, proactive troubleshooting, and opportunities to optimize and automate complex data pipelines.

Ideal candidates will have strong Spark development experience, ETL with Hadoop, and proficiency in SQL, Unix, and data warehousing. Collaboration with multiple teams and business stakeholders is essential.