Senior Data Pipeline Lead with Clearance — ETL & Real-Time

3M Consultancy; United States; Remote; USD 80,000 - 100,000; Full time

Job summary

3M Consultancy is looking for a Data Analyst with IRS MBI Clearance. The role requires 3–5 years of experience in backend data engineering, leading data pipeline projects, and mentoring junior engineers. Proficiency in SQL, Python, or Scala, along with expertise in ETL/ELT pipelines, is crucial.

Applicants should be familiar with tools like Apache Airflow, AWS, and should have a solid background in cloud platforms and containerization.

Qualifications

• 3–5+ years of experience in data engineering or backend data systems.
• Experience leading data pipeline projects and mentoring junior engineers.
• Strong skills in SQL, Python, or Scala.

Responsibilities

• Build and optimize ETL/ELT pipelines using tools like Apache Airflow and Spark.
• Work with cloud platforms and containerization technologies.
• Collaborate with analytics and BI teams on data governance.

Skills

Data pipeline projects leadership

ETL/ELT pipeline optimization

SQL

Python

Backend data systems

Tools

Apache Airflow

Spark

Docker

AWS

Job description

3M Consultancy is looking for a Data Analyst with IRS MBI Clearance. The role requires 3–5 years of experience in backend data engineering, leading data pipeline projects, and mentoring junior engineers. Proficiency in SQL, Python, or Scala, along with expertise in ETL/ELT pipelines, is crucial.

Applicants should be familiar with tools like Apache Airflow, AWS, and should have a solid background in cloud platforms and containerization.