Data Engineer - Natural Gas

Kpler; Norte; On-site; USD 80,000 - 120,000; Full time

Job summary

Kpler is seeking a Data Engineer to join their Natural Gas business unit and contribute to the new US Gas product's development. This role demands significant experience in Python, particularly with FastAPI, and experience with PostgreSQL. Responsibilities include enhancing data scrapers, developing features, and ensuring API performance. Kpler values diversity and is an equal opportunity employer, committed to providing a fair and inclusive work environment.

Qualifications

• 3-5 years' experience as a data focused Software Engineer.
• Significant experience working with Python, with FastAPI as a plus.
• Experience with PostgreSQL or similar data stores.

Responsibilities

• Codify, structure, expand and maintain existing data scrapers.
• Enrich the product and participate in the development of new features.
• Build and improve monitoring and alerting tools and dashboards.

Skills

Data focused Software Engineer experience

Python proficiency

RESTful APIs development

Git and Agile methodologies

PostgreSQL experience

Time-series data expertise

English proficiency

Tools

AWS

Terraform

Docker

Kubernetes

Airflow

Datadog

Grafana

Job description

Kpler are looking for a Data Engineer to sit within our Natural Gas business unit and contribute to the build of our new US Gas product, which will complement our existing European Gas product. The product is currently under development and the scope of the role will include data engineering to scale the data sources used for the product, supporting the development of tailored analytics and be instrumental in merging the data across both products.

Your mission is to:

• Codify, structure, expand and maintain the data scrapers in place
• Enrich the product and participate in the development of new features
• Build and improve monitoring and alerting tools and dashboards
• Ensure high quality performance of our API to distribute the data to end users
• Discuss the roadmap in collaboration with the product team
• Help the team build ambitious yet sustainable plans

You could be a match if you are or have:

• Circa 3-5 years' of experience as a data focused Software Engineer
• Significant experience working with Python (FastAPI is a plus)
• Experience with Postgresql or similar data stores
• Proficiency in building and consuming RESTful APIs
• Comfortable working with Git, code reviews, and Agile methodologies
• Experience with time-series, events data, normalization, database design
• Strong command of written and spoken English
• Understanding of performance optimization and caching strategies

Desirable:

• Have experience with AWS (or another cloud provider), using Terraform
• Experience with orchestration tool Airflow on a production environment
• Experience with containerization (Docker) and orchestration (Kubernetes)
• Knowledge on hexagonal architecture and medallion architecture
• Used monitoring solutions (Datadog, Grafana, etc...)
• Experience with NoSQL database

Kpler is committed to providing a fair, inclusive and diverse work‑environment. We believe that different perspectives lead to better ideas, and better ideas allow us to better understand the needs and interests of our diverse, global community. We welcome people of different backgrounds, experiences, abilities and perspectives and are an equal opportunity employer.