Senior Data Engineer: Cloud Lakehouse & Data Pipelines Lead

Amgen; Lisboa; In loco; EUR 75.000 - 115.000; Tempo pieno

Descrizione del lavoro

Amgen is seeking a Senior Data Engineer to advance scalable data pipelines and lakehouse architectures within Global Medical Data and Analytics in Lisbon. You will partner with product owners, architects, and analytics teams to deliver secure, reliable data capabilities across the enterprise.

The role emphasizes hands-on development with Python, SQL, Spark, and Databricks, cloud platforms, data governance, and collaboration in an Agile/SAFe environment to drive impactful medical data solutions.

Competenze

• 9+ years of professional experience in data engineering or related field.
• Bachelor’s degree in computer science, information systems, engineering, or related discipline.
• Proven track record delivering production-grade data pipelines and analytics platforms.
• Strong Python and SQL proficiency; experience with Spark or similar framework.
• Experience with Databricks and cloud data platforms (AWS); data lake/ lakehouse tech.
• Data modeling, ETL/ELT design, API/system integration, and orchestration.

Mansioni

• Lead the design, development, testing, deployment, and support of robust batch and near-real-time data pipelines across source, landing, curated, and analytics layers.
• Design end-to-end data architecture for cloud-based lakehouse solutions, including ingestion, transformation, storage, serving, and integration patterns.
• Build and optimize solutions on Databricks using Python, SQL, Spark, Delta Lake, and AWS services.
• Design data models and curated datasets for analytics and reporting with clear definitions and lineage.
• Develop API-based integrations and reusable ingestion frameworks across enterprise systems.
• Apply engineering practices for orchestration, CI/CD, automated testing, version control, and deployment.
• Own data quality, reconciliation, observability, performance, scalability, and cost efficiency.
• Incorporate privacy, access controls, retention, auditability, and regulatory needs (HIPAA, GDPR) with governance teams.
• Collaborate with product owners and cross-functional teams in Agile/SAFe to shape requirements and deliver iteratively.
• Provide technical guidance, code reviews, and architectural documentation; mentor engineers.
• Enable downstream analytics and visualization (Tableau/BI) with well-governed data products.

Conoscenze

Python

SQL

Apache Spark

Databricks

AWS

Data Pipelines

Data Architecture

APIs & Integrations

CI/CD

Data Governance

Tableau & BI

Formazione

Bachelor's degree

Strumenti

Databricks

Delta Lake

Tableau

Airflow

Descrizione del lavoro

Amgen is seeking a Senior Data Engineer to advance scalable data pipelines and lakehouse architectures within Global Medical Data and Analytics in Lisbon. You will partner with product owners, architects, and analytics teams to deliver secure, reliable data capabilities across the enterprise.

The role emphasizes hands-on development with Python, SQL, Spark, and Databricks, cloud platforms, data governance, and collaboration in an Agile/SAFe environment to drive impactful medical data solutions.