Data Engineer (Python & AWS)

Verisk; Madrid; Híbrido; EUR 40.000 - 60.000; Jornada completa

Descripción de la vacante

A leading data analytics company in Madrid is seeking a Full-Stack Data Engineer skilled in Python and AWS. The role involves application development, data engineering, and managing AWS infrastructure. Ideal candidates will have experience with geospatial data processing and a passion for continuous improvement. This position offers a hybrid working model with 2 days in the office and 3 days remote.

Formación

• Strong proficiency in Python is mandatory.
• Hands-on experience with AWS services in production environments is needed.
• 2+ years of experience with Python for data processing or automation.

Responsabilidades

• Design and implement RESTful APIs and microservices.
• Build and maintain data pipelines using AWS Glue for ETL processes.
• Monitor and troubleshoot production systems.

Conocimientos

Python

AWS

Node.js

Geospatial Data Processing

Data Quality Checks

Herramientas

AWS Glue

Snowflake

Amazon Athena

Git

Descripción del empleo

Verisk Madrid, Community of Madrid, Spain

Join or sign in to find your next job

Join to apply for the Data Engineer (Python & AWS) role at Verisk

Verisk Madrid, Community of Madrid, Spain

Join to apply for the Data Engineer (Python & AWS) role at Verisk

Direct message the job poster from Verisk

Recruiter, Talent Acquisition at Verisk | Hiring for Verisk Corporate functions & Tech positions

Position Overview

JOB DESCRIPTION

We are seeking a motivated Full-Stack Data Engineer to join our team and work on application development using AWS and Python. This role combines backend development with data engineering, requiring expertise in AWS services, modern data lake technologies, and geospatial data processing.

We need someone with a continuous improvement mindset who takes ownership of tasks and delivers results. Knowledge of other languages such as Node.js is valued. The ideal candidate will have exposure to machine learning and LLM concepts to help us leverage AI capabilities in our data platform.

Responsibilities

Application Development

• Design and implement RESTful APIs and microservices
• Optimize application performance and scalability
• Write clean, maintainable, and well-documented code
• Participate in code reviews and technical design discussions

Data Engineering

Build and maintain data pipelines using AWS Glue for ETL / ELT processes

Design and optimize queries for Snowflake and Amazon Athena

Implement and manage Apache Iceberg tables for efficient data lake operations

Process and analyze geospatial data using appropriate libraries and tools

Implement data quality checks and monitoring

Work with structured and semi-structured data formats (JSON, Parquet, CSV, GeoJSON, etc.)

Ensure data security and compliance with best practices

AWS Infrastructure

Design and implement AWS Step Functions for complex workflow orchestration

Manage and optimize AWS services including Lambda, S3, EventBridge, and IAM

Implement infrastructure as code using CloudFormation or Terraform

Monitor and troubleshoot production systems

Ensure high availability and disaster recovery

Qualifications

Required Qualifications

Languages

Strong proficiency in Python is mandatory, while experience with in other languages like Node.js / JavaScript is valuable

AWS Services

Hands-on Experience With

AWS Step Functions (State Machines)

AWS Glue (ETL jobs, crawlers, data catalog)

Amazon Athena

Lambda, S3, CloudWatch

Data Platforms

Working knowledge of Apache Iceberg for data lake management

Understanding of data lake architectures and best practices

Geospatial Technologies

Experience with geospatial data formats (GeoJSON, Shapefile, etc.)

Familiarity with spatial queries and geographic information systems

Knowledge of coordinate systems and spatial indexing

Databases

Understanding of both SQL and NoSQL databases

Version Control

Proficiency with Git and collaborative development workflows

Experience

2+ years of experience with Python for data processing or automation

2+ years working with AWS services in production environments

Experience building and maintaining data pipelines at scale

Experience with geospatial data processing and analysis

Proven track record of working with large datasets and optimizing query performance

Preferred Qualifications

Technical Skills

Machine Learning / AI Experience

Understanding of ML pipelines and model deployment

Familiarity with LLM concepts and applications (GPT, Claude, etc.)

Experience with ML frameworks (TensorFlow, PyTorch, Scikit-learn)

Knowledge of vector databases and embeddings

Geospatial Libraries

Experience with PostGIS, GeoPandas, H3, or similar tools

Other

Experience with serverless architectures and event-driven systems

Knowledge of data modeling and data warehouse concepts

Familiarity with CI / CD pipelines (Jenkins, GitHub Actions, AWS CodePipeline)

Experience with monitoring tools (CloudWatch, DataDog, New Relic)

AWS certifications (Solutions Architect, Data Analytics, or Database specialty)

Essential Soft Skills

Execution & Ownership

Takes complete ownership of assigned tasks and sees them through to completion

Resourceful problem-solver who finds solutions independently

Persistent in overcoming obstacles and technical challenges

Results-oriented with a track record of delivering on commitments

Continuous Improvement Mindset

Constantly seeks ways to optimize and improve existing systems

Stays current with emerging technologies and industry best practices

Questions the status quo and proposes better alternatives

Learns from failures and applies lessons to future work

Please notice that our office is located in Alcorcón and we are working in a hybrid model - 2 days from the office, 3 days remotely so the presence in the office is mandatory.

About Us

For over 50 years, Verisk has been the leading data analytics and technology partner to the global insurance industry by delivering value to our clients through expertise and scale. We empower communities and businesses to make better decisions on risk, faster.

At Verisk, you'll have the chance to use your voice and build a rewarding career that's as unique as you are, with work flexibility and the support, coaching, and training you need to succeed.

For the eighth consecutive year, Verisk is proudly recognized as a Great Place to Work for outstanding workplace culture in the US, fourth consecutive year in the UK, Spain, and India, and second consecutive year in Poland. We value learning, caring and results and make inclusivity and diversity a top priority. In addition to our Great Place to Work Certification, we’ve been recognized by The Wall Street Journal as one of the Best-Managed Companies and by Forbes as a World’s Best Employer and Best Employer for Women, testaments to the value we place on workplace culture.

We’re 7,000 people strong. We relentlessly and ethically pursue innovation. And we are looking for people like you to help us translate big data into big ideas. Join us and create an exceptional experience for yourself and a better tomorrow for future generations.

Verisk Businesses

Underwriting Solutions — provides underwriting and rating solutions for auto and property, general liability, and excess and surplus to assess and price risk with speed and precision

Claims Solutions — supports end-to-end claims handling with analytic and automation tools that streamline workflow, improve claims management, and support better customer experiences

Property Estimating Solutions — offers property estimation software and tools for professionals in estimating all phases of building and repair to make day-to-day workflows the most efficient

Extreme Event Solutions — provides risk modeling solutions to help individuals, businesses, and society become more resilient to extreme events.

Specialty Business Solutions — provides an integrated suite of software for full end-to-end management of insurance and reinsurance business, helping companies manage their businesses through efficiency, flexibility, and data governance

Marketing Solutions — delivers data and insights to improve the reach, timing, relevance, and compliance of every consumer engagement

Life Insurance Solutions – offers end-to-end, data insight-driven core capabilities for carriers, distribution, and direct customers across the entire policy lifecycle of life and annuities for both individual and group.

Verisk Maplecroft — provides intelligence on sustainability, resilience, and ESG, helping people, business, and societies become stronger

Verisk Analytics is an equal opportunity employer.

All members of the Verisk Analytics family of companies are equal opportunity employers. We consider all qualified applicants for employment without regard to race, religion, color, national origin, citizenship, sex, gender identity and / or expression, sexual orientation, veteran's status, age or disability. Verisk’s minimum hiring age is 18 except in countries with a higher age limit subject to applicable law.

resumes sent to Verisk, including unsolicited resumes sent to a Verisk business mailing address, fax machine or email address, or directly to Verisk employees, will be considered Verisk property. Verisk will NOT pay a fee for any placement resulting from the receipt of an unsolicited resume.

Verisk Employee Privacy Notice

Seniority level

Seniority level Entry level

Employment type

Employment type Full-time

Job function

Job function Information Technology

Industries Information Services

Referrals increase your chances of interviewing at Verisk by 2x

Sign in to set job alerts for “Data Engineer” roles.

Madrid, Community of Madrid, Spain 2 weeks ago

Madrid, Community of Madrid, Spain 1 week ago

Madrid, Community of Madrid, Spain 16 hours ago

Madrid, Community of Madrid, Spain 1 week ago

Madrid, Community of Madrid, Spain 16 hours ago

Madrid, Community of Madrid, Spain 1 week ago

Madrid, Community of Madrid, Spain 3 days ago

Madrid, Community of Madrid, Spain 4 days ago

Madrid, Community of Madrid, Spain 3 months ago

Madrid, Community of Madrid, Spain 1 week ago

Madrid, Community of Madrid, Spain 2 weeks ago

Madrid, Community of Madrid, Spain 2 weeks ago

Madrid, Community of Madrid, Spain 1 month ago

Madrid, Community of Madrid, Spain 1 week ago

Madrid, Community of Madrid, Spain 1 week ago

Madrid, Community of Madrid, Spain 1 week ago

Madrid, Community of Madrid, Spain 2 weeks ago

Madrid, Community of Madrid, Spain 5 days ago

Madrid, Community of Madrid, Spain 5 months ago

Madrid, Community of Madrid, Spain 2 weeks ago

Greater Madrid Metropolitan Area 6 days ago

Madrid, Community of Madrid, Spain 3 days ago

Madrid, Community of Madrid, Spain 1 week ago

Madrid, Community of Madrid, Spain 6 months ago

Madrid, Community of Madrid, Spain 16 hours ago

Madrid, Community of Madrid, Spain 2 years ago

Madrid, Community of Madrid, Spain 1 month ago

Madrid, Community of Madrid, Spain 5 days ago

Madrid, Community of Madrid, Spain 3 days ago

Madrid, Community of Madrid, Spain 5 days ago

Madrid, Community of Madrid, Spain 3 months ago

Madrid, Community of Madrid, Spain 2 weeks ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

J-18808-Ljbffr