Principal Data Engineer – Python Backend

1074 Amgen Technology Pvt Ltd.

Hyderabad

On-site

INR 2,500,000 - 4,000,000

Full time

11 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Amgen Inc. in India is seeking a Data Engineer with Python backend development to build scalable data pipelines and services. The role combines data engineering with backend API development, including integrating data platforms with applications and AI agents.

The ideal candidate has hands-on experience with Python, SQL, Databricks, and Apache Spark. You will design and maintain ETL/ELT pipelines, develop REST APIs with FastAPI/Flask/Django, and optimize Spark workloads for performance and

Qualifications

  • Master's or Bachelor's degree in IT/Computer Science/Engineering.
  • 12 to 17 years of work experience.
  • Hands-on Python development with backend experience.
  • Experience with data pipelines, ETL/ELT, and API development.

Responsibilities

  • Design, build, and maintain data ingestion and ETL/ELT pipelines using Python, SQL, Databricks, and Spark/PySpark.
  • Integrate data from APIs, databases, files, and third-party systems.
  • Develop and maintain backend services and REST APIs using Python frameworks such as FastAPI, Flask, or Django.
  • Build API integrations for applications and AI agents to access data.
  • Design relational and NoSQL databases, schemas, data models, and queries.
  • Optimize Spark jobs and Databricks workloads for performance and cost.
  • Apply distributed computing principles to process large datasets.
  • Implement data validation, logging, and monitoring.
  • Troubleshoot pipeline, API, and database issues in development and production environments.
  • Write tests and documentation, participate in Git, CI/CD, and deployment workflows.
  • Collaborate with data, backend, AI/ML, product, and application teams.

Skills

Python development
SQL
Databricks
Apache Spark/PySpark
REST APIs
NoSQL databases
AI agent integration
Spark optimization
Git, testing, debugging
FastAPI/Flask/Django
Delta Lake / Azure data services
Airflow / Kafka / Docker / Kubernetes
GenAI data pipelines

Education

Master's degree in IT/CS/Engineering
Bachelor's degree in IT/CS/Engineering

Tools

Databricks
Apache Spark
Git
Kubernetes
Docker

Job description

Career Category Strategy and Innovation Job Description Role Summary

We're hiring a Data Engineer with Python backend development experience to build scalable data pipelines and services. The role combines data engineering with backend API development, including integrating data platforms with applications and AI agents. The ideal candidate has hands-on experience with Python, SQL, Databricks, and Apache Spark. They should also understand REST APIs, relational and NoSQL databases, and how to improve Spark workloads for performance and scale.

Key Responsibilities
  • Design, build, and maintain data ingestion and ETL/ELT pipelines using Python, SQL, Databricks, and Spark/PySpark.
  • Integrate data from APIs, databases, files, and third-party systems.
  • Develop and maintain backend services and REST APIs using Python frameworks such as FastAPI, Flask, or Django.
  • Build API integrations that allow applications and AI agents to access approved data and services.
  • Design and work with relational and NoSQL databases, including schemas, data models, and queries.
  • Optimize Spark jobs and Databricks workloads for performance, scalability, and cost.
  • Apply distributed computing principles to process large datasets reliably.
  • Implement data validation, error handling, logging, and monitoring.
  • Troubleshoot pipeline, API, and database issues in development and production environments.
  • Write tests and documentation, and participate in Git, code reviews, CI/CD, and deployment workflows.
  • Collaborate with data, backend, AI/ML, product, and application teams.
Basic Qualifications and Experience

Master's OR Bachelor's degree in IT/Computer Science/Engineering. and 12 to 17 years of work experience

Required Skills
  • Strong Python development skills.
  • Strong SQL skills and experience with relational databases.
  • Hands-on experience with Databricks and Apache Spark/PySpark.
  • Experience building data pipelines and integrating data from multiple sources.
  • Experience developing or integrating REST APIs.
  • Working knowledge of NoSQL databases.
  • Hands-on experience integrating APIs with AI agents or AI/ML applications.
  • Understanding of Spark performance optimization, scalability, and distributed systems.
  • Familiarity with Git, testing, debugging, and production support.
  • Strong problem-solving and communication skills.
  • Good to Have Experience with FastAPI, Flask, or Django.
  • Experience with Delta Lake, Azure Data Lake, or Azure Data Factory.
  • Familiarity with Airflow, Kafka, Docker, or Kubernetes.
  • Experience supporting GenAI or machine learning data pipelines.
Preferred Candidate Profile

We're looking for someone who can work across the data and backend layers: ingest and transform data, store it in suitable relational or NoSQL systems, and expose it through APIs for applications or AI agents. The candidate should be able to design, build, optimize, test, and support a solution such as: Source systems Databricks/Spark processing relational or NoSQL storage Python API application or AI agent

EQUAL OPPORTUNITY STATEMENT

Amgen is an Equal Opportunity employer and will consider you without regard to your race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, or disability status. We will ensure that individuals with disabilities are provided with reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request an accommodation.

Amgen is committed to unlocking the potential of biology for patients suffering from serious illnesses by discovering, developing, manufacturing and delivering innovative human therapeutics. This approach begins by using tools like advanced human genetics to unravel the complexities of disease and understand the fundamentals of human biology. Amgen focuses on areas of high unmet medical need and leverages its biologics manufacturing expertise to strive for solutions that improve health outcomes and dramatically improve people's lives. A biotechnology pioneer since 1980, Amgen has grown to be one of the world's leading independent biotechnology companies, has reached millions of patients around the world and is developing a pipeline of medicines with breakaway potential.

For more information, visit www.amgen.com and follow us on www.twitter.com/amgen

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Principal Data Engineer - Python Backend
Principal Data Engineer - Python Backend

Amgen Inc. • India

On-site
INR 1,800,000 - 3,200,000
Principal Data Engineer – Python Backend
Principal Data Engineer – Python Backend

Mployee.me • Hyderabad

On-site
INR 2,500,000 - 4,500,000
Principal Data Engineer – Python Backend
Principal Data Engineer – Python Backend

Amgen • Hyderabad

On-site
INR 1,500,000 - 2,100,000
Principal Data Engineer
Principal Data Engineer

Amgen • Hyderabad

On-site
INR 3,500,000 - 7,000,000
Specialist Data Analytics
Specialist Data Analytics

Amgen • Hyderabad

On-site
INR 1,500,000 - 2,800,000
Associcate Python Developer- Backend (Commercialization Technology)
Associcate Python Developer- Backend (Commercialization Technology)

Amgen • Hyderabad

On-site
INR 900,000 - 1,300,000
Sr Manager Data Engineer
Sr Manager Data Engineer

Amgen • Hyderabad

On-site
INR 3,200,000 - 5,200,000
Sr Data Engineer
Sr Data Engineer

Amgen Technology • Hyderabad

On-site
INR 1,800,000 - 3,200,000
Senior Data Engineer
Senior Data Engineer

Amgen Inc. • Hyderabad

On-site
INR 3,500,000 - 6,000,000
Sr Associate IS Engineer, Commercialization Technology
Sr Associate IS Engineer, Commercialization Technology

Amgen • Hyderabad

On-site
INR 1,500,000 - 2,500,000