Senior Data Engineer

Takeda; Bengaluru; On-site; INR 1,200,000 - 2,800,000; Full time

Job summary

Takeda in Bengaluru, India is seeking a Senior Data Engineer to join an Agile team and build scalable data pipelines for analytic solutions. You will design and maintain data architectures, optimize ETL processes, and support data scientists with data sourcing to generate actionable insights.

Lead the evaluation and deployment of new analytic data tools, mentor peers, and collaborate with architects on enterprise projects.

Qualifications

• Expert in designing and maintaining scalable data architectures.
• Proficient in SQL and data manipulation languages with query optimization.
• Skilled in DevOps practices and CI/CD to improve workflows.
• Experience with distributed data technologies like Spark and Hadoop.
• Familiar with cloud deployment and Kubernetes for data solutions.
• Ability to mentor peers and communicate across teams.
• Strong knowledge of data structures and algorithms.

Responsibilities

• Design, develop, and optimize data pipelines and architectures.
• Define data requirements and validate data quality.
• Support data scientists with data sourcing.
• Lead evaluation and deployment of analytic data tools.
• Develop education plans on data engineering standards.
• Collaborate with analysts and architects on enterprise projects.
• Mentor data and analytics professionals.

Skills

SQL

Python

Scala

Java

Spark

Kubernetes

Data architecture

Tools

Spark

Hadoop

Kubernetes

MongoDB

PL/SQL

CI/CD

Job description

Job Description

About The Role

The Senior Data Engineer collaborates with a multidisciplinary Agile team to build high-quality data pipelines that drive analytic solutions. This role focuses on integrating and managing data to generate insights, enabling advanced data-driven decision-making capabilities.

How you will contribute

• Design, develop, optimize, and maintain data architecture and pipelines that adhere to ETL principles and business goals
• Define data requirements, gather and mine large-scale structured and unstructured data, and validate data using various data tools in the Big Data Environment
• Support Data Scientists in data sourcing and preparation to visualize data and synthesize insights of commercial value
• Lead the evaluation, implementation, and deployment of emerging tools and processes for analytic data engineering to improve productivity
• Develop and deliver communication and education plans on analytic data engineering capabilities, standards, and processes
• Partner with business analysts and solutions architects to develop technical architectures for strategic enterprise projects and initiatives
• Mentor and coach other data and analytic professionals on data standards and practices

Skills And Qualifications

• Expert in designing and maintaining scalable data architectures, capable of handling complex data systems.
• Proficient in SQL and other data manipulation languages, with a strong ability to optimize and troubleshoot queries.
• Skilled in DevOps practices and continuous integration to enhance workflow efficiencies.
• Experienced in software development methodologies, contributing to both project and operational goals.
• Knowledgeable in data structures and algorithms, enhancing data processing and storage solutions.
• Familiar with distributed data technologies like Spark and Hadoop, capable of managing large-scale data operations.
• Efficient in system integration, ensuring seamless data flow and connectivity across platforms.
• Proficient in programming languages such as Python, Scala, Java, and C++, applying them effectively in data engineering tasks.
• Experienced in SQL database management, performance tuning, and complex query handling.
• Skilled in cloud platform deployment and tools like Kubernetes, optimizing cloud-based data solutions.
• Capable of performing advanced troubleshooting and guiding others through complex problem-solving processes.
• Advanced in PL/SQL and MongoDB, providing guidance and advice on complex database programming and optimization.

As an experienced professional, you specialize in solving various complex problems, sometimes referring to established precedents and policies. Your work involves analyzing diverse data and selecting appropriate methods for solutions, while networking with senior professionals in your field. You possess a complete understanding of principles, concepts, and industry practices, exerting some influence on organizational objectives. You often work independently under general direction, occasionally leading small project teams, and may represent the organization in contractual or project matters, interacting with senior internal and external personnel. You might also participate in training junior staff.

Locations

IND - Bengaluru

Worker Type

Employee

Worker Sub-Type

Regular

Time Type

Full time