Data Engineering Mastermind

Critical TechWork; Braga; Presencial; EUR 35 000 - 55 000; Tempo integral

Resumo da oferta

A leading technology company in Braga is seeking a Data Engineer to innovate the data landscape in automotive technology. Responsibilities include developing data pipelines and optimizing data models. Ideal candidates have at least 3 years of data engineering experience, proficiency in AWS, and strong coding skills in Python or Java. Join a dynamic team emphasizing collaboration, continuous learning, and innovative problem-solving in a fast-paced agile environment.

Qualificações

• At least 3 years of experience in data engineering.
• Experience with public cloud platforms, especially AWS.
• Ability to code in at least one programming language (Python, Java, JavaScript, Scala) is a must.
• Advanced knowledge of multiple SQL/noSQL data environments.

Responsabilidades

• Design and maintain robust data pipelines for seamless data flow.
• Craft and optimize data models for analysis.
• Implement quality assurance protocols.
• Identify and solve data processing issues.
• Engage in large-scale data projects.

Conhecimentos

Data Pipeline Development

Data Quality Assurance

Troubleshooting

Big Data Processing

Real-Time Data Streaming

Agile Methodologies

English Communication

Ferramentas

AWS

Terraform

SQL

Apache Spark

Airflow

Descrição da oferta de emprego

We’re looking for bright Data Engineer Mastermindsto join our team

At Critical TechWorks, we're not just engineering software; we're sculpting the data landscape of tomorrow. Our Data Engineers are pivotal in transforming the BMW Group into a data-driven powerhouse. From handling vast datasets to optimizing data flows, you will be at the forefront of innovation in automotive technology.

• Data Pipeline Development: Design and maintain robust data pipelines, ensuring seamless data flow from various sources to storage and analytical platforms.
• Data Modeling: Craft and optimize data models for efficient data retrieval and analysis, balancing performance and scalability.
• Data Quality Assurance: Implement rigorous testing and validation protocols to guarantee the accuracy and integrity of data.
• Troubleshooting and System Optimization: Proactively identify and solve data processing issues, enhancing the performance and reliability of data systems.
• Big Data Processing: Engage in large-scale data projects, utilizing frameworks like Apache Spark for efficient data handling and processing.
• Real-Time Data Streaming: Work on cutting-edge projects that process and analyze data in real-time, ensuring swift data delivery and insights.

Whatever you’re working on, here’s the lowdown on the technical skills you’re likely to have:

• At least 3 years of experiencein data engineering.
• Experience working with public cloud platforms, especially AWS.
• Experience with IaC tools, such as Terraform.
• Ability to code in at least one programming language (Python, Java, JavaScript, Scala) is a must.
• Experience working with and creating data-driven architectures, preferably in public cloud platforms.
• Experience using a querying language such as SQL.
• Experience with Big Data and data modelling.
• Advanced knowledge of multiple SQL/noSQL data environments and a strong understanding of why and when to use a particular solution.
• Familiarity with tools in the Big Data ecosystem (like Hadoop, Cassandra, Apache Hive, Apache Spark, and others alike).
• Experience with orchestration tools like Airflow is a big plus.

CTW's Daily Toolkit

Apart from great technical skills, our environment is fast-paced and 100% agile, and prioritizes autonomy, teamwork, interaction and resilience. This means our Data Engineers must also possess the following:

• Embrace agile and its implementation frameworks namely Scrum, to make the most out of all its events and work to keep evolving a high-performing team.
• Be available to be a cross-functional team member by using and developing new skills and enabling a fully responsible team able to cover the whole product lifecycle.
• Use standard software engineering practices and tools like version control, IDEs, data dashboards, to manage and keep a systematic and organized development process.
• Use state of the art DevOps quality practices and tools such as Continuous Integration /Continuous Deployment (CI/CD) pipelines to build, analyse, perform automated testing and deployment processes, to ensure a streamlined and reliable development workflow.
• Run and operate developed software inside and outside working hours if needed, to provide high quality software services (extra compensation will be applicable).
• Be available to travel abroad for short periods, as required to support all the phases of the product development cycle when needed.
• Have excellent English oral and written skills. German communication skills will be a plus.

Who we are

Critical TechWorks seeks a distinct and treasured corporate culture, that is very much our own. This means:

• Growth and Innovation: Be a key player in shaping the future of mobility through innovative ideas.
• Engineering Excellence: Immerse yourself in an environment valuing engineering process, where we create, innovate, lead, and make a tangible impact.
• Autonomy and Collaboration: Thrive in a culture that blends autonomy with teamwork, contributing to groundbreaking developments.
• Continuous Learning: Embrace constant skill enhancement in a dynamic workplace, where your contributions impact cutting-edge technology projects.

Join Critical TechWorks on our journey of innovation, excellence, and redefining the future of motion, one product at a time.

Notice: Apply to only one job; our Talent Team will analyze your profile and consider you for all relevant positions.

At Critical Techworks we are creating an inclusive culture that values our people’s different viewpoints and experiences, regardless of sexual orientation, gender identity, age, color, ethnicity, religion, or disability.