Data Engineer: Cloud Pipelines for AI & Analytics

ProSearch; Westbrook (ME); Hybrid; USD 62,000 - 83,000; Full time

Benefits offered by this job

Hybrid work schedule

Job summary

ProSearch is seeking a Data Engineer in Westbrook, Maine to design, build, and optimize scalable data pipelines and SQL transformations. You will join a collaborative Data & AI Center of Excellence to deliver production-ready data solutions across analytics, ML, and AI initiatives.

You will modernize legacy processes, transform manual workflows, and deploy pipelines on Databricks, Snowflake, and AWS. The role targets about 2–4 years of related experience with growth in cloud data platforms and

Qualifications

• Bachelor's degree or equivalent combination of education and experience.
• 2-4 years of experience in Data Engineering, Data Analytics, or a related technical field.
• Advanced SQL skills with experience supporting data transformation and pipeline development.
• Strong understanding of data warehousing concepts and ELT/ETL methodologies.
• Experience building data pipelines on platforms such as Databricks, Snowflake, AWS, or similar cloud environments.
• Experience with testing, deployment, data modeling, and documentation practices.
• Experience using GitHub or similar version control tools.
• Strong communication and collaboration skills.

Responsibilities

• Design, build, and maintain robust data pipelines that collect, transform, and deliver structured data.
• Develop SQL-based transformation logic and pipeline workflows.
• Support end-to-end ELT processes following modern data architecture patterns.
• Contribute to data modeling, transformation, testing, deployment, and documentation.
• Convert one-off scripts and manual processes into scalable, reusable solutions.
• Build and maintain dbt models, tests, and pipeline components.
• Monitor data quality and pipeline performance and proactively identify issues.
• Develop pipelines within modern cloud platforms such as Databricks, Snowflake, AWS, or similar environments.
• Work with structured and semi-structured data sources.
• Support batch and streaming ingestion workflows.
• Manage schema evolution and file ingestion processes involving Parquet and JSON formats.
• Contribute to data lineage and governance practices.
• Partner closely with Machine Learning Engineers, Data Scientists, and Data Analysts.
• Support data preparation for algorithm development and model training.
• Participate in GitHub-based version control and CI/CD deployment workflows.
• Follow established engineering standards, reusable patterns, and team best practices.
• Contribute to a culture of documentation, collaboration, and continuous improvement

Skills

Advanced SQL

Data warehousing

ELT/ETL

Databricks

Snowflake

AWS

dbt Core

GitHub

Python

Spark SQL

Education

Bachelor's degree or equivalent

Tools

Databricks

Snowflake

AWS

dbt

Job description

ProSearch is seeking a Data Engineer in Westbrook, Maine to design, build, and optimize scalable data pipelines and SQL transformations. You will join a collaborative Data & AI Center of Excellence to deliver production-ready data solutions across analytics, ML, and AI initiatives.

You will modernize legacy processes, transform manual workflows, and deploy pipelines on Databricks, Snowflake, and AWS. The role targets about 2–4 years of related experience with growth in cloud data platforms and