Data Engineer

CloudSquad LLC.; Offre d’emploi; Hybride; EUR 60 000 - 80 000; Plein temps

Résumé du poste

A leading technology consulting firm is seeking a Data Engineer to design and optimize data pipelines, ensuring data integrity and collaborating with cross-functional teams. Candidates should have a degree in Computer Science and proficiency in SQL, Python, and big data technologies. The role is fully remote and offers a competitive salary with opportunities for professional development and career advancement in a collaborative environment.

Prestations

Competitive salary and benefits

Opportunities for professional development

Support for certifications

Collaborative work environment

Qualifications

• Proven experience as a Data Engineer or similar role.
• Strong programming skills in languages like Python, Java, or Scala.
• Familiarity with big data technologies and frameworks.

Responsabilités

• Design, implement, and optimize data pipelines.
• Ensure data integrity and performance in databases.
• Collaborate with teams to understand and meet data requirements.

Connaissances

SQL

Python

Data Governance

Data Modeling

ETL

Collaboration

Formation

Bachelor’s/Master’s degree in Computer Science or related field

Outils

MySQL

PostgreSQL

Apache Hadoop

Tableau

Terraform

Description du poste

Overview

CloudSquad is a strategic technology consulting company focused on helping clients realize the full potential of their business by utilizing the Cloud and implementing AI. We review and analyze client systems and work with them to design and implement solutions that enable our clients to take advantage of the latest technology available.

Key Responsibilities

• Design, implement, and optimize end-to-end data pipelines for the extraction, transformation, and loading (ETL) of structured and unstructured data.
• Collaborate with cross-functional teams to understand data requirements and translate them into scalable pipeline solutions.
• Design and implement efficient data models that support business requirements.
• Work on database architecture and schema design, ensuring data integrity and performance.
• Integrate data from various sources, both internal and external, to create a unified and comprehensive view of the organization’s data.
• Implement and maintain data integration solutions for seamless data flow.
• Develop and implement data quality checks and monitoring processes.
• Enforce data governance policies and standards to ensure data accuracy, consistency, and security.
• Optimize database performance to ensure efficient and timely access to data.
• Identify and fix performance bottlenecks in data processing workflows.
• Implement and maintain data security measures to protect sensitive information.
• Collaborate with security teams to ensure compliance with data privacy regulations.
• Work closely with data scientists, analysts, and other stakeholders to understand data use cases and provide assistance.
• Collaborate with client IT and business teams to align data solutions with organizational goals.
• Create and maintain comprehensive documentation for data processes, architectures, and workflows.
• Share knowledge and best practices with the broader team to foster a culture of continuous learning.

Qualifications

• Bachelor’s/Master’s degree in Computer Science, Information Technology, or a related field.
• Proven experience as a Data Engineer or similar role.
• Proficiency in SQL and experience with relational databases (e.g. MySQL, PostgreSQL, Oracle).
• Strong programming skills, especially in languages like Python, Java, or Scala.
• Familiarity with big data technologies and frameworks (e.g. Apache Hadoop, Spark).
• Knowledge of data warehousing concepts and Cloud-based data platforms.

Preferred Skills

• Experience with Cloud platforms such as Google Cloud, AWS or Azure.
• Knowledge of NoSQL databases (e.g. MongoDB, Cassandra).
• Familiarity with data visualization tools (e.g. Looker, Tableau, Power BI).
• Experience with Terraform for infrastructure as code (IaC), enabling the provisioning and management of Cloud resources, and ensuring consistency and repeatability across environments.
• Deep understanding of platform engineering principles, including designing and building robust, scalable, and fault-tolerant data platforms to support diverse data processing and analytics requirements.
• Understanding of data science and machine learning concepts.

100% remote.

Competitive salary and benefits package.

Opportunities for professional development and training.

Support for certifications or further education related to Cloud technologies.

Opportunities for career advancement within the rapidly growing environment.

Collaborative and innovative work environment.

Join CloudSquad, a fast-growing company, with a strong technology culture, and an innovative work environment where you can work on the cutting-edge of technology. If you have a passion for solving complex technical problems, we want to hear from you! Apply now and play a crucial role in shaping the future success of CloudSquad and our clients!