Senior Big Data Engineer

Grid Dynamics

Lisboa

Teletrabalho

EUR 50 000 - 70 000

Tempo integral

14 dias+

Recebe mais respostas dos empregadores

Envia um currículo específico para a oferta em poucos minutos.

Vantagens oferecidas por esta oferta de emprego

Opportunity to work on bleeding-edge projects

Flexible schedule

Professional development opportunities

Competitive salary

Resumo da oferta

A leading technology consulting firm is seeking a Senior Big Data Engineer to design and maintain data processing pipelines using Scala and Spark. This fully remote role offers a competitive salary and professional development opportunities, ideal for those with experience in distributed systems and a passion for innovative data solutions.

Qualificações

Proficiency in Scala/Spark required.
Hands-on expertise with Hadoop necessary.
Experience with processing frameworks like Spark and Kafka is a plus.

Responsabilidades

Design and maintain data processing pipelines using Apache Spark and Scala.
Collaborate with teams on distributed data architecture.
Support CI/CD workflows and infrastructure automation.

Conhecimentos

Scala/Spark

Hadoop

Kafka

Oracle

Postgres

Teradata

Cassandra

Descrição da oferta de emprego

Join to apply for the Senior Big Data Engineer role at Grid Dynamics.

Fully remote from Portugal — As a Senior Big Data Engineer (Scala/Spark), you’ll be responsible for developing robust data pipelines, maintaining infrastructure, and optimizing performance across distributed systems. You’ll also have opportunities to contribute to DevOps and CI/CD workflows, working closely with platform teams to ensure smooth delivery and deployment of big data solutions.

The project goal is to implement pipelines and infrastructure for generating reports based on huge amounts of collected data. Our team is responsible for designing, coding, and verifying jobs written in the latest version of Scala/Spark, ensuring that the algorithms we implement return accurate statistics that will be used by our stakeholders.

Although this is a Big Data Engineer position, CI/CD and DevOps knowledge would be a big plus, as working with infrastructure will also be part of the role.

Responsibilities

Design, develop, and maintain scalable data processing pipelines using Apache Spark and Scala
Ensure accuracy and efficiency of statistical algorithms implemented in production
Collaborate with global engineering teams on distributed data architecture and design
Work with large-scale distributed systems (e.g., Hadoop, Kafka, Cassandra) for data ingestion and processing
Contribute to the build and optimization of Data Lakes and Data Warehousing solutions
Support and enhance CI/CD workflows, infrastructure automation, and deployment processes

Requirements

Proficiency in Scala/Spark
Hands-on expertise with Hadoop
Processing and computation frameworks: Kafka, Spark, Dataframe/SQL API
DB engines: Oracle, Postgres, Teradata, Cassandra
Experience implementing Data Lakes, Data Warehousing or analytics systems is an advantage
Good understanding of distributed computing technologies, approaches, and patterns

Nice to have

DevOps/CI/CD skills

We offer

Opportunity to work on bleeding-edge projects
Work with a highly motivated and dedicated team
Competitive salary
Flexible schedule
Professional development opportunities

About Us

Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation. A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud & DevOps, application modernization and customer experience. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.

Seniority level