Lead Data Engineer - Pipelines & AI Tools

OCLC; Dublin (OH); Hybrid; USD 100,000 - 130,000; Full time

Benefits offered by this job

Comprehensive health coverage

Tuition reimbursement

Paid parental leave

On-site fitness center

Flexible work environment

Job summary

A global technology company for libraries is seeking a Lead Software Engineer. This role involves leading software development for large-scale data pipelines, designing scalable ETL processes, and mentoring junior engineers. You will collaborate with cross-functional teams to align technical solutions with product needs and drive agile methodologies. Excellent scripting skills and extensive experience with ETL and big data frameworks are required. Join a mission-driven team dedicated to connecting libraries and enhancing access to information.

Qualifications

• Proven experience with large-scale data pipelines including ETL design.
• Strong scripting skills with Python or bash.
• Experience with big data frameworks for distributed processing.

Responsibilities

• Own and evolve large-scale data pipelines and ensure reliability.
• Lead solution architecture for scalable ETL and indexing strategies.
• Champion agile methodologies and influence engineering practices.

Skills

ETL design and implementation

Large-scale data pipelines

Scripting and automation

Big data tooling (Hadoop, Spark)

CI/CD tools (GitLab, Ansible)

Job description

A global technology company for libraries is seeking a Lead Software Engineer. This role involves leading software development for large-scale data pipelines, designing scalable ETL processes, and mentoring junior engineers. You will collaborate with cross-functional teams to align technical solutions with product needs and drive agile methodologies. Excellent scripting skills and extensive experience with ETL and big data frameworks are required. Join a mission-driven team dedicated to connecting libraries and enhancing access to information.