Data Engineer

Bloomfield Robotics; Paris; À distance; EUR 60 000 - 75 000; Plein temps

Résumé du poste

A leading technology firm in agriculture is seeking a Data Engineer to design and maintain data processing pipelines. The successful candidate will have over 5 years of experience, strong Python skills, and familiarity with AWS technologies. This primarily remote role requires living in Paris, with collaboration in a co-working space once a week. Join us to innovate agriculture through data and AI.

Qualifications

• 5+ years of experience as a Data Engineer or similar role.
• Experience with real Data monitoring and alerting in production.
• Familiarity with data cleaning, processing, and analytics of image data.

Responsabilités

• Design and maintain the data pipeline, including schema definition.
• Ensure reliability, quality, security, and performance of data pipelines.
• Troubleshoot and debug issues with data pipelines.
• Collaborate with other engineers to meet data needs.
• Optimize the data pipeline for efficiency and scalability.
• Develop and maintain documentation for the data pipeline.

Connaissances

Proficiency in Python

Strong proficiency in dbt

SQL knowledge

Good knowledge of AWS Redshift

Data monitoring skills

Good communication skills

Problem-solving skills

Formation

Bachelor's or Master's degree in Computer Science

Outils

AWS (Lambdas, S3, Glue)

GCP BigQuery

Data Warehouse design experience

Business Intelligence tools (Metabase, Tableau)

Description du poste

About the Company

At Bloomfield, we are revolutionizing the way crops are monitored and managed. Our AI-powered imaging technology provides continuous, plant-level health and performance insights from seed to harvest. Our mission is to empower farmers with the tools they need to increase crop productivity and quality while using fewer scarce resources, ultimately contributing to a more sustainable and food-secure future.

In 2024, Kubota Corporation, a global leader in agricultural machinery and solutions, through its North American subsidiary, Kubota North America Corporation, acquired Bloomfield. This acquisition unites Bloomfield’s innovative technology with Kubota’s extensive resources and commitment to provide comprehensive smart agriculture solutions to farmers worldwide. Our combined expertise and resources will drive innovation and deliver benefits to farmers, ensuring a more sustainable and prosperous agricultural industry.

About the Role

Our rapidly growing engineering team is searching for a Data Engineer to help build and maintain our data and image processing pipelines. You will be responsible for designing, implementing, and maintaining the various components of our pipelines, which need to support processing more than 75k images per day. You will be involved in all parts of the data engineering lifecycle, including data generation, ingestion, transformation, storage, and serving of our data.

To be successful in this role, you should have a strong background in software engineering and be proficient in Python. Familiarity with AWS technologies such as Lambdas, Step Functions, Redshift, S3, Athena, and Glue is a big plus.

As a Data Engineer, you will be a part of our engineering team, working to ensure that our data ecosystem is efficient, scalable, and able to support our rapidly growing data needs. You will be responsible for ensuring that the data is cleaned, processed, and transformed appropriately to support our data analytics and machine learning efforts.

Responsibilities

• Designing, implementing, and maintaining our data pipeline, including data schema definition, ingestion, transformation, and serving
• Ensuring the reliability, quality, security, and performance of the data pipelines
• Troubleshooting and debugging any issues with our data pipelines
• Working with other engineers to understand their data needs and ensure that our data ecosystem can support their requirements
• Optimizing the data pipeline for efficiency, scalability, and reliability
• Developing and maintaining documentation for the data pipeline

While this is primarily a remote position, we ask that candidates live in Paris, France and join the team in a co-working space once per week.

Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, or a similar field
• 5+ years of experience as a Data Engineer or a similar role
• Strong proficiency in dbt, SQL and Python
• Good knowledge of data warehouse solutions such as GCP BigQuery, AWS Redshift, experience with Dremio is a plus
• Experience with Data Warehouse design and maintenance
• Experience with real Data monitoring and alerting in production
• Experience with self-serve BI tools such as Metabase, Looker, Tableau - experience with LightDash is a plus
• Familiarity with data cleaning, processing, and analytics of image data
• Strong problem-solving and troubleshooting skills
• Excellent communication and collaboration abilities