Data Engineer: Real-Time Data Pipelines & Insights

A-dec, Inc. (USA); Newberg (OR); On-site; USD 110,000 - 150,000; Full time

Job summary

A-dec is seeking a Data Engineer to expand and optimize data warehouse architecture and data pipelines. You will support software developers, the data architect, and data analysts across multiple teams and products.

You will design real-time and batch ETL processes, write complex SQL queries, and ensure data quality and reliability in a mixed cloud/on-prem environment. This role offers growth in a collaborative, inclusive culture.

Qualifications

• Bachelor's degree in Computer Science or related technical field or equivalent practical experience.
• 2+ years of experience in IT with a focus on Business Applications, Data Engineering, Data Architecture, Data Analytics and Science.
• Good understanding of data warehousing and BI environments.
• Excellent problem solving, critical thinking, and communication skills.
• Experience with distributed source code version control system (e.g. git).
• Experience with ticketing systems (ServiceNow; JIRA etc.).
• Expertise with Python, databases, and SQL expertise.
• Strong analytic skills related to working with unstructured datasets.
• Experience with data pipeline and workflow management tools.

Responsibilities

• Build real-time and batch data integrations from disparate sources into the EDW.
• Collaborate with data/analytics experts to enhance data systems functionality.
• Write complex queries for reporting and consumption.
• Assemble large, complex data sets meeting business requirements.
• Design and implement real-time ETL and batch processing for modeling/reporting.
• Provide production support for data pipelines and transformations.
• Scale and tune data pipelines, databases, and SQL queries.
• Create data reconciliation processes.
• Identify trends and develop algorithms to make raw data more useful.
• Connect data to users in mixed cloud/on-prem environments.
• Improve data reliability, efficiency and quality.
• Partner with data architects/analysts to support modeling/reporting and internal data processing.
• Translate requests into replicable analytic reports using various applications.
• Create APIs and data-serving tools as needed.
• Troubleshoot and perform root-cause analysis for DB software and data integrity issues.

Skills

Analytical thinking

Communication

Problem solving

Unstructured data analytics

Education

Bachelor's degree in Computer Science or related technical field

Equivalent practical experience

Tools

Git

ServiceNow

JIRA

Python

SQL

Data pipeline tools

Job description

A-dec is seeking a Data Engineer to expand and optimize data warehouse architecture and data pipelines. You will support software developers, the data architect, and data analysts across multiple teams and products.

You will design real-time and batch ETL processes, write complex SQL queries, and ensure data quality and reliability in a mixed cloud/on-prem environment. This role offers growth in a collaborative, inclusive culture.