Data Engineer with banking - Senior Consultant

Ernst & Young Advisory Services Sdn Bhd; Katowice; Hybrid; PLN 200,000 - 300,000; Full time

Job summary

A global integrated service delivery center seeks a Data Engineer in Katowice. You will create and deploy data pipelines, optimize processes, and work with both structured and unstructured datasets. Required skills include Apache Spark and Python expertise along with a minimum of 3 years of experience. The role offers a hybrid work model, allowing for flexibility in your work environment.

Benefits

Continuous learning opportunities

Flexible work environment

Diverse and inclusive culture

Qualifications

• Minimum 3 years hands-on experience building complex data pipelines.
• Strong experience in data processing and optimization using Apache Spark.
• Good knowledge of data manipulation and transformation.
• Experience with Apache Airflow, Python, SQL.
• Deployment and provisioning automation tools (Docker, Kubernetes, CI/CD).
• Experience managing distributed systems and clusters for both batch and streaming data.
• Hands-on experience in training and evaluating ML models.
• Experience with Golang and monitoring with ELK stack.
• Experience working in a cloud environment (GCP).

Responsibilities

• Create, build and deploy data pipelines that clean and process data for analysis.
• Build reusable component pipelines for complex pipelines.
• Identify, design, and implement internal process improvements.

Skills

Building complex data pipelines

Data processing using Apache Spark

Data manipulation and transformation

Apache Airflow

Python

SQL

Docker

Kubernetes

CI/CD

Managing distributed systems

Training ML models

Golang

Monitoring with ELK stack

Bash scripting

Linux systems

Security and authentication

Cloud environment (GCP)

Job description

The opportunity

Data Engineer with banking

Hybrid model: 2 days office/3 days remote

Let us introduce you the job offer by EY GDS Poland – a member of the global integrated service delivery centre network by EY.

Your key responsibilities

• Create, build and deploy data pipelines that clean and process data for analysis
• Build reusable component pipelines that can be assembled for more complex pipelines
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability
• Work with structured and unstructured data sets
• Work with QA to develop an automation test strategy for data pipelines that aligns with the platform’s architecture

Skills and attributes for success

• Minimum 3 years hands-on experience building complex data pipelines
• Strong experience in data processing and optimization using Apache Spark
• Good knowledge of data manipulation and transformation
• Experience with Apache Airflow, Python, SQL
• Deployment and provisioning automation tools (e.g., Docker, Kubernetes, CI/CD)
• Hands-on experience managing and further developing distributed systems and clusters for both batch as well as streaming data (S3/Spark and/or Kafka/Flink)
• Hands-on experience in training and evaluating ML models
• Experience with Golang
• Experience with monitoring and observability (ELK stack)
• Bash scripting and Linux systems
• Experience with buildpacks
• Security, authentication, and authorisation (LDAP / Kerberos / PAM)
• Experience working in cloud environment (e.g., GCP)

Ideally, you’ll also have

• Experience with data warehousing solutions
• Knowledge of big data tools and technologies
• Strong problem-solving skills and attention to detail
• Excellent communication and collaboration skills
• Ability to work independently and as part of a team

What we offer

EY Global Delivery Services (GDS) is a dynamic and truly global delivery network. We work across ten locations – Argentina, China, Hungary, India, the Philippines, Poland, Sri Lanka, Mexico, Spain and the United Kingdom – and with teams from all EY service lines, geographies and sectors, playing a vital role in the delivery of the EY growth strategy. From accountants to coders to advisory consultants, we offer a wide variety of fulfilling career opportunities that span all business disciplines. In GDS, you will collaborate with EY teams on exciting projects and work with well-known brands from across the globe. We’ll introduce you to an ever-expanding ecosystem of people, learning, skills and insights that will stay with you throughout your career.

• Continuous learning:You’ll develop the mindset and skills to navigate whatever comes next.
• Success as defined by you:We’ll provide the tools and flexibility, so you can make a meaningful impact, your way.
• Transformative leadership:We’ll give you the insights, coaching and confidence to be the leader the world needs.
• Diverse and inclusive culture:You’ll be embraced for who you are and empowered to use your voice to help others find theirs.

About EY

EY | Building a better working world

EY exists to build a better working world, helping to create long-term value for clients, people and society and build trust in the capital markets.

Enabled by data and technology, diverse EY teams in over 150 countries provide trust through assurance and help clients grow, transform and operate.

Working across assurance, consulting, law, strategy, tax and transactions, EY teams ask better questions to find new answers for the complex issues facing our world today.

If you can demonstrate that you meet the criteria above, please contact us as soon as possible.

The exceptional EY experience. It’s yours to build.

In compliance with the requirements of the Whistleblower Protection Act, our company has established the Procedure for reporting breaches of law and undertaking appropriate follow-up actions. Any misconduct should be reported through the EY Ethics Hotline.