Hybrid Senior Data Engineer - Enterprise-Scale Pipelines

ProSearch; Westbrook (ME); Híbrido; USD 87.000 - 98.000; Jornada completa

Descripción de la vacante

ProSearch in Westbrook, ME is hiring a Senior Data Engineer to design and build scalable data pipelines and cloud-based data platforms for enterprise analytics. You will develop data lakes, warehouses, and integration platforms while collaborating with cross-functional teams.

You will optimize storage, processing, and data models, create robust SQL queries, and help define governance and best practices for data engineering. This hybrid role supports analytics and BI initiatives.

Formación

• Bachelor's degree or equivalent combination of education and experience.
• Experience building large-scale data pipelines, ETL/ELT workflows, and distributed data processing solutions.
• Strong experience with Hadoop technologies including Spark, Hive, Presto, Pig, and MapReduce.
• Advanced SQL experience with Oracle, PostgreSQL, MySQL, or similar platforms.
• Python development experience or proficiency in another high-level programming language.
• Experience with cloud-based data pipelines and distributed data architectures.
• Understanding of NoSQL databases including Cassandra and MongoDB.
• Experience with data warehousing, data lakes, and enterprise data management solutions.
• Knowledge of software APIs, system integrations, and modern data engineering practices.
• Strong problem-solving, communication, customer service, and project management skills.

Responsabilidades

• Design, build, and maintain scalable data pipelines that collect, process, transform, and deliver large volumes of structured and unstructured data.
• Develop and optimize cloud-based and distributed data processing solutions using Hadoop ecosystem technologies.
• Build and support data lakes, data warehouses, operational data stores, and enterprise data integration platforms.
• Create high-performance SQL queries, database solutions, and data models that support analytics and business intelligence initiatives.
• Design reliable backup, recovery, and data management processes to ensure data availability and system performance.
• Implement scalable data architecture standards, governance practices, and operational best practices.
• Develop automated deployment and integration solutions across distributed environments.
• Monitor system performance, troubleshoot data issues, and drive continuous improvements.
• Partner with technical and business stakeholders to deliver data solutions that support organizational goals.
• Lead efforts to establish standards, processes, and best practices across the data engineering function.

Conocimientos

Python Development

Data Warehousing

Distributed Data Processing

Educación

Bachelor's degree

Herramientas

Hadoop

Spark

Hive

Presto

Pig

MapReduce

Descripción del empleo

ProSearch in Westbrook, ME is hiring a Senior Data Engineer to design and build scalable data pipelines and cloud-based data platforms for enterprise analytics. You will develop data lakes, warehouses, and integration platforms while collaborating with cross-functional teams.

You will optimize storage, processing, and data models, create robust SQL queries, and help define governance and best practices for data engineering. This hybrid role supports analytics and BI initiatives.