Data Platform Engineer — AI-Driven Global Forecasting

Stealth AI Startup; Porto; Presencial; EUR 55 000 - 85 000; Tempo integral

Resumo da oferta

Stealth AI Startup is seeking a Data Engineer to build and scale the data infrastructure behind a world-scale forecasting product. You will collect, transform and serve diverse datasets—economic, industrial, environmental and commercial—collaborating with data, ML and product teams.

You’ll own end-to-end data pipelines from ingestion to serving, ensuring data quality and reliability as the platform grows in a fast-paced startup environment.

Qualificações

• Professional experience in data engineering or a closely related role.
• Strong Python and SQL skills.
• Experience building and maintaining production data pipelines.
• Experience working with relational databases, data warehouses or data lakes.
• Familiarity with workflow orchestration and data-transformation tools.
• Understanding of data modelling, schema design and software-engineering fundamentals.
• Experience working with APIs and external data sources.
• Ability to investigate data-quality problems and trace issues across a pipeline.
• Comfortable working independently while asking for support when needed.
• Strong communication skills and an interest in collaborating across engineering, data science and product teams.
• Comfortable operating in a startup environment with changing priorities and incomplete information.

Responsabilidades

• Build and maintain reliable data pipelines for structured and unstructured data
• Integrate data from APIs, databases, files and external data providers
• Transform raw data into consistent, documented and usable datasets
• Develop systems for processing large-scale temporal and economic data
• Monitor pipeline performance, data freshness and data quality
• Investigate and resolve data inconsistencies, failures and performance issues
• Work with machine learning engineers to make data available for model training and inference
• Work with product and software engineers to serve data through internal systems, APIs and customer-facing products
• Improve the scalability, reliability and maintainability of the data platform
• Contribute to data architecture, engineering standards and technical documentation
• Help automate manual data-ingestion and validation processes

Conhecimentos

Python

SQL

Production data pipelines

Relational databases

Data modelling

Data quality investigations

APIs and external data sources

Ferramentas

Airflow

Dagster

dbt

Spark|Databricks|Snowflake

Descrição da oferta de emprego

Stealth AI Startup is seeking a Data Engineer to build and scale the data infrastructure behind a world-scale forecasting product. You will collect, transform and serve diverse datasets—economic, industrial, environmental and commercial—collaborating with data, ML and product teams.

You’ll own end-to-end data pipelines from ingestion to serving, ensuring data quality and reliability as the platform grows in a fast-paced startup environment.