Senior Software Engineer

Global Business Ser. 4u; Lake Saint Louis (MO); On-site; USD 120,000 - 180,000; Full time

Job summary

Global Business Ser. 4u is seeking a lead data engineer to design and maintain scalable data quality frameworks and validation pipelines.

You will develop ETL/ELT workflows using Python, Spark, Hadoop, Airflow, and NiFi while mentoring engineers and aligning with stakeholders on system architecture and quality metrics. The role requires strong Python skills, hands-on Spark/Hadoop, Airflow and NiFi expertise, and experience with data quality, CI/CD, Jenkins, Oracle, Power BI and Splunk; cloud

Qualifications

• Requires a bachelor’s or master’s degree in Computer Science, Engineering, or a related field.
• 5+ years of software development experience including two years in a senior or lead role.
• Strong Python skills with hands-on Spark and Hadoop experience.
• Experience with Airflow and NiFi; knowledge of data quality, CI/CD, Jenkins, Oracle, Power BI and Splunk; cloud experience a plus.

Responsibilities

• Lead design, development, and maintenance of scalable data quality frameworks and validation pipelines.
• Develop and manage ETL/ELT workflows using Python, Spark, Hadoop, Airflow, and NiFi.
• Mentor engineers, collaborate with stakeholders, and document system architecture and quality metrics.

Education

Bachelor's or Master's degree in Computer Science, Engineering, or related field

Tools

Python

Apache Spark

Hadoop

Apache Airflow

Apache NiFi

Data Quality Automation

CI/CD

Jenkins

Oracle

Power BI

Splunk

ETL/ELT

Data Validation

Data Engineering

Distributed Systems

Cloud Platforms

Job description

Lead the design, development, and maintenance of scalable data quality frameworks, validation pipelines, and ETL/ELT workflows using Python, Spark, Hadoop, Airflow, and NiFi. Establish data quality standards and monitoring, resolve data issues, mentor engineers, collaborate with stakeholders, and document system architecture and quality metrics.

Requirements: Requires a bachelor's or master's degree in Computer Science, Engineering, or a related field, along with data engineering experience and at least five years of software development experience, including two years in a senior or lead role. Candidates should have strong Python skills, hands‑on Spark and Hadoop experience, Airflow and NiFi expertise, and knowledge of data quality, CI/CD, Jenkins, Oracle, Power BI, and Splunk; cloud experience is a plus.

Key Skills: Python, Apache Spark, Hadoop, Apache Airflow, Apache NiFi, Data Quality Automation, CI/CD, Jenkins, Oracle, Power BI, Splunk, ETL/ELT, Data Validation, Data Engineering, Distributed Systems, Cloud Platforms