Data Engineer: Scalable Pipelines & ML Enablement

ARMADA Supply Chain Solutions; Wexford (Allegheny County); On-site; USD 80,000 - 100,000; Full time

Job summary

ARMADA Supply Chain Solutions is seeking a Data Engineer for its Digital Services division in Wexford, Allegheny County, to design and maintain advanced data pipelines. The successful candidate will collaborate with cross-functional teams to evolve data infrastructure supporting analytics.

Required qualifications include a BS/MS in Computer Science or related field and a minimum of 3 years’ experience in data engineering. Proficiency in Python, SQL, and cloud platforms like Azure is essential.

Qualifications

• 3+ years’ experience in data engineering or ETL development.
• Strong problem-solving skills to resolve issues.
• Ability to translate technical concepts for stakeholders.

Responsibilities

• Design and maintain data infrastructure for analytics.
• Build processing pipelines for machine learning models.
• Manage ETL/ELT processes as code.

Skills

Python

SQL

Git

Cloud platforms (Azure, AWS, GCP)

Data processing tools (Snowflake, Azure Synapse)

Business Intelligence (Power BI, Tableau)

Education

BS/MS Degree in Computer Science, Engineering, Data Analytics

Job description

Summary

As a Data Engineer for our Digital Services division, you will drive the evolution of our next generation data infrastructure, which powers a wide range of analytics and software products. You will be responsible for designing, developing, and maintaining advanced data pipelines using the latest technologies in cloud computing and data processing. In this pivotal role, you will collaborate with cross-functional teams including data scientists, software engineers, and business analysts. You will use your excellent soft skills to interface with non-technical stakeholders and ensure that their needs are met in the form of functional and non-functional requirements.

Summary

As a Data Engineer for our Digital Services division, you will drive the evolution of our next generation data infrastructure, which powers a wide range of analytics and software products. You will be responsible for designing, developing, and maintaining advanced data pipelines using the latest technologies in cloud computing and data processing. In this pivotal role, you will collaborate with cross-functional teams including data scientists, software engineers, and business analysts. You will use your excellent soft skills to interface with non-technical stakeholders and ensure that their needs are met in the form of functional and non-functional requirements.

RESPONSIBILITIES:

• Design, build, and maintain our data infrastructure to support analytics and integration into software products and services.
• Partner with data scientists to build processing pipelines that enable them to rapidly create high-quality machine learning models.
• Work with software engineers to develop and maintain pipelines to feed data to our growing software portfolio.
• Manage ETL/ELT processes as code and foster a codebase that is extensible and maintainable by all team members.
• Manage the transition from quick prototype to full scalable solution that supports production products.
• Identify, recommend, and implement innovative approaches and technologies that will evolve our existing processes
• Provide ad hoc support to the engineering team, including POC software development, ML model development, and data analysis, as project needs arise.
  
  

Qualifications

Education and experience requirement

• BS/MS Degree in Computer Science, Engineering, Data Analytics, or related field.
• 3+ years’ experience in data engineering, ETL development, or similar role.
• Strong problem-solving skills to discover, address, and resolve issues.
• Demonstrated ability to translate technical concepts into actionable insights for different stakeholders.
  
  

Language And Technical Skills Requirement

• Proficient in programming languages such as Python and SQL and development tools such as Git.
• Experience with cloud platforms such as Azure, AWS, or GCP for deploying and managing data infrastructure.
• Skilled with rational database schema design.
• Hands-on experience with data processing tools and platforms such as Snowflake, Azure Synapse, Azure Data Factory, Data Bricks, etc.
• Solid understanding of machine learning models, tools, libraries, and approaches.
• Experience with business intelligence tools such as Power BI, Spotfire, Cognos, Tableau, Qlik.
  
  

Physical demands and work environment

The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this job. Reasonable accommodation may be made to enable individuals with disabilities to perform the essential functions.

• Work is usually performed in an office environment with normal noise levels. Involves prolonged sitting and computer usage.
• Work may involve limited travel.