Principal Data Engineer

Amgen Technology; Hyderabad; On-site; INR 1,200,000 - 2,400,000; Full time

Job summary

Amgen Technology in Hyderabad, India, seeks a seasoned Principal Data Engineer to lead the design, development, and implementation of our data strategy and platforms. You will architect robust data platforms, mentor a team of data engineers, and drive data governance and security across the organization.

You will lead cloud-based data solutions on AWS/Azure/GCP, optimize data pipelines, partner with stakeholders, and continuously explore innovative data technologies to meet business goals.

Qualifications

• Demonstrated proficiency in leveraging cloud platforms (AWS, Azure, GCP) for data engineering solutions.
• Strong understanding of cloud architecture principles and cost optimization strategies.
• Proficient in Python, PySpark, SQL. Hands-on experience with big data ETL performance tuning.
• Proven ability to lead and develop high-performing data engineering teams.
• Strong problem-solving, analytical, and critical thinking skills to address complex data challenges.

Responsibilities

• Possesses strong rapid prototyping skills and can quickly translate concepts into working code.
• Provide expert guidance and mentorship to the data engineering team, fostering a culture of innovation and best practices.
• Design, develop, and implement robust data architectures and platforms to support business objectives.
• Oversee the development and optimization of data pipelines, and data integration solutions.
• Establish and maintain data governance policies and standards to ensure data quality, security, and compliance.
• Architect and manage cloud-based data solutions, leveraging AWS or other preferred platforms.
• Lead and motivate a high-performing data engineering team to deliver exceptional results.
• Identify, analyze, and resolve complex data-related challenges.
• Collaborate closely with business stakeholders to understand data requirements and translate them into technical solutions.
• Stay abreast of emerging data technologies and explore opportunities for innovation.

Skills

Cloud platforms (AWS/Azure/GCP)

Python

PySpark

SQL

ETL performance tuning

Data engineering leadership

Data governance

Problem solving

Team mentoring

Education

Bachelor's degree

AWS Certified Data Engineer

Databricks Certification

Tools

Apache Spark

Apache Airflow

Git

Subversion

Jenkins

Maven

DevOps

Job description

Role Overview

We are seeking a seasoned Principal Data Engineer to lead the design, development, and implementation of our data strategy. The ideal candidate possesses a deep understanding of data engineering principles, coupled with strong leadership and problem-solving skills. As a Principal Data Engineer, you will architect and oversee the development of robust data platforms, while mentoring and guiding a team of data engineers.

Responsibilities

• Possesses strong rapid prototyping skills and can quickly translate concepts into working code.
• Provide expert guidance and mentorship to the data engineering team, fostering a culture of innovation and best practices.
• Design, develop, and implement robust data architectures and platforms to support business objectives.
• Oversee the development and optimization of data pipelines, and data integration solutions.
• Establish and maintain data governance policies and standards to ensure data quality, security, and compliance.
• Architect and manage cloud-based data solutions, leveraging AWS or other preferred platforms.
• Lead and motivate a high-performing data engineering team to deliver exceptional results.
• Identify, analyze, and resolve complex data-related challenges.
• Collaborate closely with business stakeholders to understand data requirements and translate them into technical solutions.
• Stay abreast of emerging data technologies and explore opportunities for innovation.

Functional Skills

• Demonstrated proficiency in leveraging cloud platforms (AWS, Azure, GCP) for data engineering solutions. Strong understanding of cloud architecture principles and cost optimization strategies.
• Proficient in Python, PySpark, SQL. Hands-on experience with big data ETL performance tuning.
• Proven ability to lead and develop high-performing data engineering teams.
• Strong problem-solving, analytical, and critical thinking skills to address complex data challenges.

Good-to-Have Skills

• Experienced with data modeling and performance tuning for both OLAP and OLTP databases
• Experienced with Apache Spark, Apache Airflow
• Experienced with software engineering best-practices, including but not limited to version control (Git, Subversion, etc.), CI/CD (Jenkins, Maven etc.), automated unit testing, and Dev Ops
• Experienced with AWS, GCP or Azure cloud services

Education and Professional Certifications

• Bachelors degree and 12 to 17years' experience
• AWS Certified Data Engineer preferred
• DatabricksCertificate preferred

Soft Skills

• Excellent analytical and troubleshooting skills.
• Strong verbal and written communication skills
• Ability to work effectively with global, virtual teams
• High degree of initiative and self-motivation.
• Ability to manage multiple priorities successfully.
• Team-oriented, with a focus on achieving team goals
• Strong presentation and public speaking skills.