Principal Data Engineer

Konecranes; Chennai District; On-site; INR 420,000 - 680,000; Full time

Benefits offered by this job

Global environment

Work-Life balance

Dynamic work environment

Global team support

Leading technology

Job summary

Konecranes seeks an experienced Lead Data Engineer to provide technical leadership in building scalable data solutions within a Lakehouse architecture. You will drive ingestion, transformation, and consumption strategies, leading complex ETL/ELT initiatives across multiple domains.

You will mentor data engineers, collaborate with data architects and analysts, and ensure governance, security, and high-quality data products across the organization.

Qualifications

• Graduation or post-graduation required.
• 10–15 years of professional experience in data engineering or equivalent.
• Strong expertise in Lakehouse architecture and modern data platforms.
• Hands-on experience with Azure Databricks, Spark, PySpark, and Delta Lake.
• Deep understanding of layered data architectures (Bronze–Silver–Gold).
• Proven ability to design scalable, reusable data solutions and enterprise ETL/ELT pipelines.
• Expert SQL with complex transformations and performance tuning.
• Proficiency in Python and PySpark; code reviews and coding standards.
• Knowledge of data governance, metadata, lineage, and quality.

Responsibilities

• Lead design, development, and delivery of scalable data engineering solutions in Lakehouse environments.
• Define technical approaches for ingestion, transformation, integration, and consumption.
• Oversee ETL/ELT initiatives across multiple source systems and domains.
• Design data pipelines with Databricks, PySpark, SQL and Delta Lake.
• Mentor Data Engineers and ensure alignment with data architecture and governance.

Skills

Lakehouse architecture

Azure Databricks

Apache Spark

PySpark

Delta Lake

SQL

Python

Data governance

Git

CI/CD

Education

Graduation/Post Graduation

Tools

Git

CI/CD

Delta Lake

Azure Databricks

Job description

At Konecranes, we believe that great customer experience is built on the people behind the Konecranes name. Everything we do, we do with passion and drive.We believe diversity drives business success and is the foundation for our growth. We welcome different backgrounds and skills that enrich our community and we promote a place where we can ALL be ourselves. This is what makes Konecranes a unique place to work.

Job Description

We are seeking an experienced Lead Data Engineer to provide technical leadership in designing, developing, and evolving scalable data solutions within a modern Lakehouse architecture. The role will be responsible for leading complex data engineering initiatives, defining technical approaches and development standards, and ensuring the delivery of scalable, reliable, and well-governed data products. The Lead Data Engineer will work closely with Data Architects, Business Analysts, Analytics teams, and business stakeholders to translate strategic and business requirements into robust technical solutions. The role will also provide technical guidance and mentorship to Data Engineers while ensuring alignment with the organization's data architecture and governance standards.

• Lead the design, development, and implementation of scalable data engineering solutions within the Lakehouse environment.
• Define and drive technical approaches for data ingestion, transformation, integration, and consumption.
• Lead complex ETL/ELT development initiatives involving multiple source systems and business domains.
• Design and oversee scalable data pipelines using Azure Databricks, PySpark, SQL, and Delta Lake.
• Lead the migration of existing data assets, SQL views, transformation logic, and data models into the Lakehouse architecture.
• Define and implement data engineering standards, reusable frameworks, and best practices.
• Design and evolve layered data architecture to support business intelligence, analytics, and future advanced data use cases.
• Ensure data models and curated datasets are optimized for scalability, performance, and business consumption.
• Review and optimize complex SQL queries, data pipelines, and processing workloads.
• Define strategies for incremental data loading, historical data management, schema evolution, and pipeline recovery.
• Establish data quality, validation, reconciliation, monitoring, and exception-handling processes.
• Ensure data solutions comply with defined governance, security, metadata, lineage, and access management requirements.
• Conduct technical reviews and provide guidance on solution design and development practices.
• Mentor and support Data Engineers in improving technical capabilities and engineering practices.
• Collaborate with Data Architects to ensure engineering solutions align with the overall data architecture.
• Work with Business Analysts and stakeholders to understand complex business requirements and convert them into scalable technical solutions.
• Support project estimation, technical planning, dependency management, and risk identification.
• Drive continuous improvement in data engineering processes, automation, performance, and maintainability.
• Awareness of ISO 14001 & 45001 Standards

Qualifications

Education Required:Graduation/Post Graduation

Professional Experience Required (Max – Min.):10-15 years

Technical Competence:

• Strong expertise in Lakehouse architecture and modern data platform concepts.
• Extensive experience with Azure Databricks.
• Strong expertise in Apache Spark, PySpark, and Delta Lake.
• Deep understanding of layered data architecture, including Bronze, Silver, and Gold layers.
• Ability to design scalable, reusable, and maintainable data engineering solutions.
• Extensive experience designing and implementing enterprise-scale ETL/ELT pipelines.
• Expert-level proficiency in SQL, including complex transformations and performance optimization.
• Strong hands-on experience with Python and PySpark.
• Ability to establish coding standards and perform technical code reviews.
• Strong expertise in analytical and dimensional data modelling.
• Experience designing Fact and Dimension models, Star Schemas, and business-oriented data models.
• Strong understanding of data governance, metadata management, lineage, and data quality.
• Strong knowledge of Git, version control, CI/CD, and automated deployment.
• Understanding of data security, access management, and compliance requirements.

Functional & Behavioral Skills:

• Strong ability to understand complex business processes and translate them into scalable data solutions.
• Ability to work with Data Architects to convert enterprise architecture into practical engineering solutions.
• Strong understanding of how data products support Business Intelligence, analytics, and reporting.
• Experience engaging with senior business and technical stakeholders.
• Ability to lead requirement discussions and identify technical dependencies and risks.
• Experience in planning and managing complex data engineering initiatives.
• Ability to assess existing data solutions and define approaches for modernization and migration.
• Strong understanding of end-to-end data flow, from source systems through transformation to reporting and analytics consumption.
• Ability to balance business requirements, technical feasibility, performance, and long-term maintainability.
• Experience supporting and guiding multiple projects or workstreams simultaneously.
• Ability to mentor, coach, and provide technical guidance to Data Engineers.
• Excellent analytical, problem-solving, and decision-making skills.
• Ability to influence technical decisions and drive alignment across teams.
• High level of accountability and commitment to delivery.

Additional Information

We are a global company with history dating back to 1910 - with future looking attitude that has brought us here today. Now together, we are shaping the next generation of material handling for smarter and safer world.

We believe in creating a workplace that is built on trust, flexibility, friendliness and inclusivity towards each other and culture with open communication and low hierarchy. We are a strong expert organisation where you are able to use modern tools and technologies - while embracing agile methodologies and continuous learning and development.

What we can offer you

• Work in a global environment
• Work-Life balance
• Innovative and dynamic working environment
• Support of an excellent Global Team
• Possibility to work in leading crane building company with leading technology

Konecranes moves what matters. We are a global leader in material handling solutions, serving a broad range of customers across multiple industries. We consistently set the industry benchmark, from everyday improvements to the breakthroughs at moments that matter most, because we know we can always find a safer, more productive and sustainable way. That's why, with 16 000+ professionals in over 50 countries, we are trusted every day to lift, handle and move what the world needs.
Konecranes is committed to ensuring that all employees and job applicants are treated fairly in an environment which is free from any form of discrimination.