Data engineer in computer vision

Andersen; United States; Hybrid; USD 120,000 - 180,000; Full time

Benefits offered by this job

Гибридная работа

Возможность удаленно/из офиса

Прогресс по карьерному развитию

До 1000 EUR дополнительного бонуса/мес

Доступ к корпоративному обучению

Корпоративная жизнь и мероприятия

Компенсация за сертификации AWS/PMP

Referral program

Частная медицинская страховка и спорт

Job summary

Andersen приглашает инженера по данным для работы над платформой анализа изображений на базе ML, нацеленную на автоматизацию дефектов и контроль качества в процессе электрохимического покрытий и полировки поверхностей. Вы будете проектировать структуры данных, обеспечивать трассируемость и работать над интеграцией данных с AWS, включая S3, RDS, Glue и Lambda.

Требуется 5+ лет опыта в Data Engineering, сильные знания SQL и моделирования БД, а также опыт работы с Python и облачными сервисами AWS.

Qualifications

• 5+ лет опыта Data Engineering.
• Глубокие знания проектирования баз данных и моделирования.
• Продвинутые навыки SQL и PostgreSQL/реляционные БД.
• Опыт разработки пайплайнов на Python и AWS сервисах (S3, RDS, Glue, Lambda).
• Уровень английского Intermediate+ и выше.
• Желателен опыт Terraform и CI/CD.

Responsibilities

• Проектирование структур данных для справочных данных, метаданных изображений и промежуточных/результатных данных.
• Обеспечение трассируемости от изображения до результата модели и финального решения.
• Внедрение схем данных и потоков данных для ML конвейера.
• Интеграция данных между локальными инструментами и AWS.
• Добавление проверок качества данных и правил валидации.
• Документация модели данных и потоков.

Skills

SQL

Python

AWS

PostgreSQL

Data modeling

Data pipelines

Terraform

CI/CD

Tools

S3

Glue

Lambda

RDS

Job description

Описание

Andersen is hiring a Data Engineer for a project developing an ML-powered image analysis platform to automate defect detection and improve quality control in electroplating and surface finishing. The project is focused on developing and enhancing an image analysis platform for quality control in electroplating and surface finishing processes. It leverages Machine Learning and Computer Vision to automate defect detection, image segmentation, feature measurement, and comparison with expert reference values, enabling accurate, consistent, and objective quality assessments.

Задачи

Designing data structures for reference data, image metadata, intermediate and inference results and pass/fail decisions. Ensuring traceability from image to model result to final decision. Assessing extending the existing database versus introducing a separate data store. Implementing database schema and data flows for the ML pipeline. Implementing data integration and synchronization between on-premise tools and AWS. Adding data quality checks and validation rules. Documenting data model and data flows.

Требования

Experience in Data Engineering for 5+ years. Strong experience with database design and data modeling from scratch. Advanced SQL skills and hands-on experience with PostgreSQL or other relational databases. Strong proficiency in Python for developing and maintaining data pipelines. Experience with data integration and synchronization across multiple systems. Experience with storing and versioning ML model outputs, features, and scoring results. Hands-on experience with AWS, including S3, RDS, Glue, and Lambda. Level of English - from Intermediate+ and above. Будет плюсом: Experience with SQLite and migrating local databases to cloud environments; Knowledge of data lineage, auditing, and traceability; Experience with Terraform and CI/CD pipelines for data engineering workflows

Условия

The opportunity to change the project and/or develop expertise in an interesting business domain. Job conditions - you can work both fully remotely and from the office or can choose a hybrid variant.

• Guarantee of professional, financial, and career growth!
• The company has introduced systems of mentoring and adaptation for each new employee.
• The opportunity to earn up to an additional 1,000 EUR per month, depending on the level of expertise, which will be included in the annual bonus, by participating in the company's activities.
• Access to the corporate training portal, where the entire knowledge base of the company is collected and which is constantly updated.
• Bright corporate life (parties / pizza days / PlayStation / fruits / coffee / snacks / movies).
• Certification compensation (AWS, PMP, etc).
• Referral program.
• Private health insurance and sports compensation, depending on the type of employment.