Senior Data Engineer: End-to-End Lakehouse Architect

Amgen Inc. (IR); Portugal; Presencial; EUR 90 000 - 120 000; Tempo integral

Resumo da oferta

Amgen Capability Center Portugal is seeking a Senior Data Engineer to lead scalable data pipelines and lakehouse solutions for Global Medical Data and Analytics in Lisbon. You will partner with product owners and analytics teams to deliver secure, reliable data capabilities across source-to-consumption layers.

The role requires advanced Python/SQL, Spark, Databricks, and cloud experience, with a focus on data modeling, governance, and API integrations in an Agile/SAFe environment.

Qualificações

• 9+ years of professional experience in data engineering or related field.
• Bachelor’s degree in computer science, information systems, engineering, or related discipline.
• Demonstrated experience designing data architecture and delivering production-grade data pipelines and analytical data platforms.
• Strong hands-on proficiency with Python and SQL, and experience with Apache Spark or a comparable distributed data processing framework.
• Experience with Databricks and cloud data platforms, preferably AWS, including lakehouse or data lake technologies.
• Experience with data modeling, ETL/ELT design, API or system integration, and workflow orchestration.
• Ability to communicate technical designs and data concepts clearly to technical and non-technical partners.

Responsabilidades

• Lead the design, development, testing, deployment, and support of robust batch and near-real-time data pipelines across source, landing, curated, and analytics layers.
• Design end-to-end data architecture for cloud-based lakehouse solutions, including data ingestion, transformation, storage, serving, and integration patterns.
• Build and optimize solutions on Databricks using Python, SQL, Spark, Delta Lake, and related platform capabilities; work with AWS cloud services and enterprise data lake technologies.
• Design data models and curated datasets for analytics and reporting, applying dimensional modeling and other appropriate modeling patterns while maintaining clear definitions and lineage.
• Develop and support API-based integrations and reusable ingestion frameworks that connect enterprise and business systems.
• Apply engineering practices for orchestration, configuration, CI/CD, automated testing, version control, deployment, and environment management.
• Own data quality, reconciliation, observability, performance, scalability, and cost efficiency; diagnose production issues and improve reliability.
• Build in privacy, access controls, retention, auditability, and regulatory expectations such as HIPAA and GDPR into data solutions in partnership with governance and security teams.
• Collaborate with product owners and cross-functional teams in an Agile/SAFe environment to shape requirements, estimate work, communicate trade-offs, and deliver iteratively.
• Provide technical guidance, conduct design and code reviews, document architectural decisions, and mentor engineers across the team.
• Enable downstream analytics and visualization, including Tableau or comparable BI tools, by delivering well-governed, performant, and documented data products.

Conhecimentos

Python

SQL

Spark

Data modeling

Data architecture

API integration

CI/CD

Data quality

Formação académica

Bachelor's degree in Computer Science/Information Systems/Engineering

Ferramentas

Databricks

AWS

Tableau

Power BI

Descrição da oferta de emprego

Amgen Capability Center Portugal is seeking a Senior Data Engineer to lead scalable data pipelines and lakehouse solutions for Global Medical Data and Analytics in Lisbon. You will partner with product owners and analytics teams to deliver secure, reliable data capabilities across source-to-consumption layers.

The role requires advanced Python/SQL, Spark, Databricks, and cloud experience, with a focus on data modeling, governance, and API integrations in an Agile/SAFe environment.