AWS Data Platform Lead Engineer - Spark & ETL

Next Frontier Capital; Dublin; On-site; EUR 80,000 - 110,000; Full time

Job summary

Next Frontier Capital is seeking a Manager of Software Engineering to lead data integration projects within our Workforce Technology team. The role involves enhancing software components and managing a team of engineers to deliver innovative technology solutions.

The ideal candidate has experience in Big Data technologies, AWS data platforms, and hands-on Spark engineering with strong problem-solving skills. Join us in a diverse environment where your contributions will make a difference.

Qualifications

• Experience in data integration projects related to human resources analytics.
• 5+ years of experience on Spark engineering with PySpark/Scala.
• Experience managing a team of at least 5-10 engineers.

Responsibilities

• Manage data integration and analysis of systems.
• Build data acquisition solutions.
• Implement processes to extract and transform data.
• Provide complex analysis for business intelligence.

Skills

Data integration using Big Data Technologies

Experience with AWS Data Warehousing

Hands-on experience with Spark engineering

Strong experience in CI/CD

Knowledge of querying tools

Experience with API standards

Strong problem-solving skills

Knowledge of NoSQL data stores

Tools

Jenkins

Git

Apache Airflow

Terraform

Java

SQL

Job description

Next Frontier Capital is seeking a Manager of Software Engineering to lead data integration projects within our Workforce Technology team. The role involves enhancing software components and managing a team of engineers to deliver innovative technology solutions.

The ideal candidate has experience in Big Data technologies, AWS data platforms, and hands-on Spark engineering with strong problem-solving skills. Join us in a diverse environment where your contributions will make a difference.