Data Engineer – Data Integration & Analytics

Talent Management Plus, Inc.; Detroit, Chicago (IL, IL); On-site; USD 110,000 - 150,000; Full time

Job summary

Talent Management Plus, Inc. is seeking a Data Engineer - Data Integration & Analytics for on-site work in Addison, IL or Warren, MI (4 days per week).

The role focuses on leading enterprise application development and delivering capabilities in integration and analytics to support Sales, Operations and Shared Services. You will collaborate with business and technology leaders to advance customer and supplier integration, and drive advanced analytics to help the company capture market share

Qualifications

• Bachelor’s degree in computer science, engineering or information systems.
• Experience with Databricks and building data pipelines.
• 5+ years of data integration and analytics experience.
• 2 years of integration / ETL experience.
• Strong SQL Server RDBMS knowledge.

Responsibilities

• Lead BI solution development with ETL design and testing.
• Develop data models and ETL workflows on Databricks using Python and Spark.
• Support data integration with supplier partners for accurate data.
• Review complex code and implement maintainable solutions.
• Define data architecture and contribute to analytics roadmap.
• Participate in data governance and metadata management.

Skills

Databricks

Python

ETL

Data Integration

Spark

SQL Server

Data Modeling

Education

Bachelor's degree in computer science, engineering or information systems

Tools

Databricks

Power BI

SQL Server

Job description

Chicago or Detroit, IL

Position

Data Engineer - Data Integration & Analytics

Location

Addison, IL or Warren MI (on-site 4 days/week)

Duration

Full Time Employment

Description

Data Engineer to lead in the development and delivery of enterprise applications to support business strategy and growth. This position will work closely with business and technology leaders to understand the enterprise objectives and build capabilities in Integration and Analytical applications to support Sales, Operations and Shared Services. This role will also be instrumental in advancing Customer & Supplier Integration and Advanced Analytics capabilities to lead the industry in the utilization of data to capture market share.

Responsibilities

• Solution Delivery
  • Perform BI solution development activities including requirements gathering, technical specifications, ETL design & development, unit & integration testing.
  • Develop and support backend data models and ETL workflows on Databricks, with a focus on building scalable data processing pipelines using Python and Spark.
  • Support data integration between supplier partners to provide accurate and up to date information to our internal and external customers
  • Review, interpret, and debug complex code. Develop maintainable code via proper structures, comments, and design
  • Generate automated, repeatable and stable processes to support data transformation, data load, data movement, and data synchronizations
  • Contribute toward the continuous improvement of our internal data capabilities
• Solution Definition, Data Architecture & Strategy
  • Perform source data analysis - data profiling, validation, conceptual and logical data modeling, etc. - to determine the suitability of the source data for meeting the reporting requirements
  • Facilitate and lead senior IT and business teams through challenging data issues
  • Meet with subject matter experts in different areas of the business, be able to quickly learn the concepts and business language relevant to their line of business, and develop an understanding of how their data supports their business processes
  • Assist in developing the roadmap for Analytics and Advanced Analytics across the company to enable the business strategy
  • Participate in information architecture strategies such as data management, data governance, master data management and metadata management

Required Skills

• Bachelor’s degree in computer science, Engineering or Information Systems
• Experience working with Databricks (building data pipelines)
• 5+ years of Data Integration and Analytics experience
• 2 years of Integration / ETL experience
• Strong experience with ETL techniques, data processing concepts, and programming in Python (e.g., change data capture, slowly changing dimensions, data partitioning in Spark).
• Experience in data modeling and entity relationship diagram conventions and various data modeling patterns (e.g. - dimensional model, 3rd normal form)
• Experience with relational databases, including a STRONG understanding of SQL Server Database Management Systems (RDBMS) concepts

Preferred Experience

• Power BI Experience
• Experience with Advanced Analytics - Optimization, Machine Learning and/or Predictive Analytics
• Knowledge of ERP systems