Data Engineer

EPITEC

Warren (MI)

On-site

USD 85,000 - 137,500

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Vision insurance

401(k)

Medical insurance

Job summary

A leading company is seeking a Mid-Senior level Data Engineer to develop data assets and pipelines, enhancing business intelligence and analytics. You'll collaborate with a dynamic team, crafting innovative data solutions while utilizing Azure technologies and a range of data tools. Ideal candidates are passionate about data and possess solid ETL experience.

Qualifications

5-7 years of experience in building ETL.
Expert in Azure and multiple data technologies.
Passionate about data and data quality.

Responsibilities

Build and maintain data pipelines to support BI and analytics.
Collaborate with Data Scientists and BI developers.
Participate in daily stand-ups and sprint planning.

Skills

ETL

Azure Cloud Technologies

Data Quality

Python

SQL

Scala

Spark

REST API

Power BI

Education

Bachelor Degree in Computer Science

Bachelor Degree in Information Technology

Bachelor Degree in Mathematics

Tools

Databricks

SQL Server

PostgreSQL

SSIS

Angular

Job description

3 days ago Be among the first 25 applicants

Direct message the job poster from EPITEC

As a Data Engineer, you will build industrialized data assets and data pipelines in support of Business Intelligence and Advance Analytic objectives. The Data Engineer handles leading and delivering new and innovative data driven solutions that are elegant and professional. You will work closely with our forward-thinking Data Scientists, BI developers, System Architects, and Data Architects to deliver value to our vision for the future. Our team focuses on writing maintainable tests and code that meet the customer’s need and scale without rework. Our engineers and architects work in highly collaborative environments across many disciplines (user experience, database, streaming technology, custom rules engines, and ai/ml and most web technologies). We work on innovative technologies – understanding and inventing modern designs and integration patterns along the way.

Top 3 Skills

1) 5-7 years of experience building ETL

2) Working with azure cloud technologies

Degree Requirement – Bachelor Degree in the data space or a related field (computer science, information technology, mathematics are good fields)

Expert in multiple tools and technologies including Azure and Databricks

Scala, Spark, Python, SQL, .NET, REST API, Angular

SQL Server, PostgreSQL, SQL Server Integration Services (SSIS), Complex ETL with massive data, PowerBI

Daily Breakdown – every day is mostly the same, come in and start their daily responsibilities, has stand ups where they discuss the work that they have on top for the sprint, where they are at if there are any blockers, if they need help expediting the work with leadership, very independent working but still around other team members that will be working on the same data, some interaction with their business partners, understanding what is needed. Some adhoc meetings that may come up that they have to attend. Define what the scope of the sprint is going to be prior to the sprint, they have a lot of backlog to fulfill, sometimes priorities change they might be working on something and have to switch to something more critical.

Scope is defined in 3 week sprints - what’s assigned should be delivered in this timeframe

Interaction level with team – team of 9 data engineers, 2 data engineer testers 4 in Michigan and the rest are in different states. Interacting mostly with the people in Michigan.

They are looking for someone who is passionate about data and data quality, someone who has high interest in this will be a great fit. They handle critical data to get cars delivered to the customers and the bottom line for company, data passion and the ability to provide the products to customers

Seniority level