Lead Software Engineer - Data Engineering | Data Technology

ARCHER; Columbus (OH); On-site; USD 110,000 - 160,000; Full time

Benefits offered by this job

Health Care Coverage

On-Site Health And Wellness Centers

Retirement Savings Plan

Backup Childcare

Tuition Reimbursement

Mental Health Support

Financial Coaching

Commission-Based Pay (Eligible Roles)

Discretionary Incentive Compensation

Job summary

ARCHER seeks a seasoned data engineer to design, develop, and optimize large-scale ETL pipelines and distributed data processing solutions using Python, PySpark, AWS services, Snowflake, and modern data lake formats.

You will lead engineering quality through testing, code reviews, CI/CD, workflow orchestration, and responsible use of approved AI-assisted development tools. Five+ years of data engineering experience highly preferred, with mentoring exposure valued.

Qualifications

• Five+ years of applied data engineering experience.
• Proficiency in Python, PySpark, DBT, AWS data services, Snowflake, SQL, and modern data lake formats.
• Experience with streaming technologies, AI/ML, and mentoring preferred.

Responsibilities

• Design, develop, and optimize large-scale ETL pipelines and distributed data processing solutions.
• Lead engineering quality through testing, code reviews, CI/CD, workflow orchestration, and AI-assisted development tools.

Skills

Mentoring

Testing

Code reviews

Education

Software engineering certification

Tools

Python

PySpark

DBT

AWS Data Services

Snowflake

SQL

ETL Development

Apache Airflow

Control-M

Iceberg

Delta Lake

CI/CD

AI-Assisted Development

Data Pipeline Engineering

Job description

Design, develop, and optimize large-scale ETL pipelines and distributed data processing solutions using Python, PySpark, AWS services, Snowflake, and modern data lake formats. Lead engineering quality through testing, code reviews, CI/CD, workflow orchestration, and responsible use of approved AI-assisted development tools.

Requirements: Requires formal training or certification in software engineering concepts and at least five years of applied experience, with a strong focus on data engineering. Candidates should have experience with Python, PySpark, DBT, AWS data services, workflow orchestration, Snowflake, SQL, and modern data lake formats; streaming technologies, AI/ML, financial services, and mentoring experience are preferred.

Key Skills: Python, Java, PySpark, DBT, ETL Development, Apache Airflow, Control-M, AWS Data Services, Snowflake, SQL, Iceberg, Delta Lake, CI/CD, Automated Testing, AI-Assisted Development, Data Pipeline Engineering

Benefits: Health Care Coverage, On-Site Health And Wellness Centers, Retirement Savings Plan, Backup Childcare, Tuition Reimbursement, Mental Health Support, Financial Coaching, Commission-Based Pay (Eligible Roles), Discretionary Incentive Compensation