Lead Data Engineer | DataOps & Cloud Architect

Rudder Analytics; United States; Remote; USD 90,000 - 130,000; Full time

Job summary

Rudder Analytics is seeking a professional to design and lead scalable data architectures and pipelines across cloud and hybrid setups. This role requires proficiency in Python, PySpark, SQL, and ETL tools like Airflow, as well as experience with cloud environments including AWS, GCP, and Azure. The ideal candidate will implement DataOps/DevOps practices, guiding teams to ensure quality, automation, and timely delivery of technical solutions.

Qualifications

• Proficient in Python, PySpark, SQL, and ETL tools like Airflow, dbt, and Talend.
• Experienced with BigQuery, Redshift, AWS, GCP, Azure, and Snowflake.
• Skilled in CI/CD, DevOps, APIs, and monitoring.

Responsibilities

• Design and lead scalable, secure data architectures and pipelines across cloud and hybrid setups.
• Implement DataOps/DevOps, guide teams, ensure automation, quality, and timely delivery.

Skills

Python

PySpark

SQL

ETL tools (Airflow, dbt, Talend)

BigQuery

Redshift

AWS

GCP

Azure

Snowflake

CI/CD

DevOps

APIs

Monitoring

Job description

Rudder Analytics is seeking a professional to design and lead scalable data architectures and pipelines across cloud and hybrid setups. This role requires proficiency in Python, PySpark, SQL, and ETL tools like Airflow, as well as experience with cloud environments including AWS, GCP, and Azure. The ideal candidate will implement DataOps/DevOps practices, guiding teams to ensure quality, automation, and timely delivery of technical solutions.