Senior Data Engineer — Scalable Data Pipelines & Search

Wipro Technologies; Kraków; Hybrid; PLN 120,000 - 170,000; Full time

Job summary

Wipro Technologies in Kraków, Poland, is seeking an experienced Data Engineer to design and maintain scalable data pipelines for large-scale environments. You will build relational and NoSQL databases, implement data models, and develop robust search and information retrieval features including indexing pipelines and semantic search.

The role requires expertise in Python, Scala, Spark, and cloud-native tools on Azure/Databricks, plus experience with graph databases like Neo4j or Cosmos DB.

Qualifications

• 5+ years of experience as a Data Engineer in big data environments.
• Strong experience with SQL and database systems (relational and NoSQL), including query optimization and schema design.
• Hands-on experience with search platforms or information retrieval technologies (indexing, ranking, text search, semantic search, metadata modeling, vector search, relevance tuning).
• Knowledge of Graph Databases (e.g., Neo4j, Cosmos DB Gremlin API) and their application to knowledge graphs or entity-relationship search.
• Strong programming skills in Python, Scala, Spark, and experience with Big Data tools such as Azure Cloud, Databricks, and PowerBI (or equivalents).
• Experience designing or maintaining search APIs, indexing pipelines, or metadata-driven search components.
• Good understanding of Agile methodologies and experience delivering incrementally within an Agile team.
• Strong communication and stakeholder-management skills, with the ability to translate search-related needs into technical solutions.
• Solid analytical, problem-solving, and data-management abilities.

Responsibilities

• Design, develop, and maintain scalable data pipelines and data processing solutions for large-scale and Big Data environments.
• Build, optimize, and manage relational and NoSQL databases, ensuring high performance, reliability, and efficient query execution.
• Design and implement robust data models, schemas, and data storage architectures to support business and analytical requirements.
• Develop and maintain search and information retrieval solutions, including indexing pipelines, semantic search capabilities, metadata-driven search components, and relevance optimization.
• Design, implement, and support search APIs and data discovery services to enhance access to enterprise data assets.
• Build and maintain graph-based data solutions using technologies such as Neo4j or Cosmos DB Gremlin API to enable knowledge graph and entity relationship use cases.
• Develop data engineering solutions using Python, Scala, Spark, and modern cloud-native technologies within Azure and Databricks environments.
• Create and optimize ETL/ELT processes to ingest, transform, and deliver high-quality data from multiple sources.
• Collaborate with cross-functional stakeholders to understand business requirements and translate them into scalable technical data solutions.
• Analyze complex data challenges and proactively identify opportunities to improve data quality, discoverability, accessibility, and performance.
• Implement monitoring, troubleshooting, and performance tuning strategies for data platforms, databases, and search services.
• Support the development of reporting and analytics capabilities through integration with visualization and business intelligence tools such as Power BI.
• Participate in Agile ceremonies and contribute to iterative solution delivery, ensuring alignment with project objectives and timelines.
• Work closely with data scientists, analysts, product owners, and business users to deliver meaningful search and data discovery experiences.
• Establish and promote data engineering best practices, coding standards, documentation standards, and operational excellence.
• Drive continuous improvement initiatives across data management, search platforms, and information retrieval workflows.
• Ensure data governance, security, and compliance requirements are incorporated into all data engineering solutions.
• Mentor junior engineers and provide technical guidance on data architecture, search technologies, and engineering best practices.
• Communicate technical concepts, risks, and recommendations effectively to both technical and non-technical stakeholders in a global environment.
• Contribute to the strategic evolution of data platforms and search capabilities by evaluating and adopting emerging technologies and best practices.

Skills

Data engineering

SQL/NoSQL

Python/Scala/Spark

Search/IR concepts

Agile methodologies

Stakeholder communication

Tools

Azure

Databricks

Power BI

Neo4j

Cosmos DB

Job description

Wipro Technologies in Kraków, Poland, is seeking an experienced Data Engineer to design and maintain scalable data pipelines for large-scale environments. You will build relational and NoSQL databases, implement data models, and develop robust search and information retrieval features including indexing pipelines and semantic search.

The role requires expertise in Python, Scala, Spark, and cloud-native tools on Azure/Databricks, plus experience with graph databases like Neo4j or Cosmos DB.