Data Lead - Client Technology

Ernst & Young Advisory Services Sdn Bhd; Wrocław; On-site; PLN 276,242 - 361,240; Full time

Job summary

A global consultancy firm is seeking a Data Engineering Lead in Wrocław, Poland. The role includes designing and implementing processes for data extraction, transformation, and loading for analytics. Candidates should have expertise in batch processing, data integration, and quality. Strong leadership and analytical skills are essential, alongside experience with distributed systems like Databricks and NoSQL databases. The firm values comprehensive data solutions and innovation in AI-driven projects.

Qualifications

• Capability to design efficient batch processing for high data volumes.
• Experience with data integration and migration solutions.
• Ability to review and cleanse data for quality assurance.
• Experience with stream data systems for real-time data processing.

Responsibilities

• Own the design and implementation of ETL processes for analytics.
• Accountability for creating complex data models and assets.
• Lead design and implementation of data pipelines.
• Evaluate and resolve data quality and integration issues.
• Provide leadership for the work group ensuring successful project delivery.

Skills

Batch Processing

Data Integration

Data Quality

Stream Systems

Distributed Systems

NoSQL Document Stores

Vector Databases & Semantic Search

Job description

Data Engineering Lead - Client Technology

Your key responsibilities

• You will be owning the design and implementation of processes to extract, transform and load data from disparate sources into a form that is consumable by analytics processes, AI and Agentic AI systems, for large or more sophisticated projects, using advanced technical capabilities
• You will take accountability for the production of a suite of high‑complexity data models, semantic layers and feature models, demonstrating strong understanding of data modelling standards to ensure high‑quality, AI‑ready and reusable data assets.
• Working with departments across the business to help define and deliver business value, including AI‑driven use cases, while interfacing and presenting with program teams, management and partners to deliver large, sophisticated data, analytics and Agentic AI initiatives.
• Leading the design, development and implementation of data pipelines supporting analytics, machine learning and autonomous agent workflows, reviewing work to ensure high quality, scalability, governance and secure AI data access.
• Evaluating and resolving issues regarding data quality reviews, cleansing, data integration and migration, demonstrating sophisticated technical knowledge and showing technical leadership in aspects of data engineering while driving continuous improvement efforts
• Providing a leadership role for the work group, ensuring the appropriate expectations, principles, structures, tools and responsibilities are in place to deliver the project
• Analyzing the latest industry trends such as agentic ai, cloud computing and distributed processing and inferring potential impact on businesses (short and long-term)
• Providing sophisticated technical expertise to maximize efficiency, reliability and value from current data engineering processes. Researching and supervising existing client base and industry developments to identify potential new product opportunities from emerging technologies
• Developing strong working relationships with peers across engineering, collaborating to develop leading data engineering solutions
• Driving consistency to the relevant data engineering and data modelling processes, procedures, standards, and may input into the definition, maintenance and implementation of technology standards Skills and attributes for success

Skills and attributes for success

To qualify for the role you must have

• Batch Processing - Capability to design an efficient way of processing high volumes of data where a group of transactions is collected over a period of time.
• Data Integration (Sourcing, Storage and Migration) - Capability to design and implement models, capabilities and solutions to manage data within the enterprise (structured and unstructured, data archiving principles, data warehousing, data sourcing, etc.). This includes the data models, storage requirements and migration of data from one system to another.
• Data Quality, Profiling and Cleansing - Capability to review (profile) a data set to establish its quality against a defined set of parameters and to highlight data where corrective action (cleansing) is required to remediate the data.
• Stream Systems - Capability to discover, integrate, and ingest all available data from the machines that produce it, as fast as it’s produced, in any format, and at any quality.

Ideally, you’ll also have

• Distributed Systems – Databricks, Spark, Hadoop, HDFS, Kafka, MapReduce/Hive, Storm, Zookeeper
• NoSQL Document Stores – MongoDB, Elastic Search, DocumentDB, Apache CouchDB
• Vector Databases & Semantic Search – Azure AI Search (Vector Search), ElasticSearch, Pinecone, Weaviate, FAISS, Milvus, semantic retrieval for RAG architectures

What we look for

• Strong analytical skills and problem-solving ability
• A self-starter, independent-thinker, curious and creative person with ambition and passion
• Good interpersonal, communication, teamwork, and presentation skills
• Customer focused
• Excellent time leadership skills
• Positive and constructive minded
• Takes ownership for continuous self-learning
• Takes the lead and makes decisions in critical times and tough circumstances
• Attention to detail
• High levels of integrity and honesty

To help create an equitable and inclusive experience during the recruitment process, please inform us as soon as possible about any disability-related adjustments or accommodations you may need.