Data Engineer - Level 2

Golden Technology

Mason (OH)

On-site

USD 100,000 - 200,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

A leading tech recruiting firm is seeking a Data Engineer to work on data engineering pipelines, analytics, and support for data acquisition strategies. The ideal candidate will have a Bachelor's degree in a quantitative field, at least 3 years of IT experience, and strong skills in SQL and Python. This full-time position offers an opportunity to work with cloud platforms and participate in SDLC tasks.

Qualifications

Minimum 3 years of experience in Information Technology.
Experience in building and operationalizing large-scale enterprise data solutions.
Understanding of the development and architecture of SAP.

Responsibilities

Work on data engineering pipelines and data modelling.
Review data acquisition strategies and develop programs.
Build data models and generate reports/visualizations.

Skills

SQL

Python

Big Query

Cloud Composer

Cloud Pub/Sub

Education

Bachelor's degree in Statistics, Mathematics, Data Science, Engineering or related quantitative field

Master's degree in Statistics, Mathematics, Data Science, Engineering or related quantitative field

Tools

Docker

Kubernetes

PySpark

Apache Spark

Job description

Get AI-powered advice on this job and more exclusive features.

Our client is looking for a Data Engineer (Level 2) to join their Team! This role is responsible for working on data engineering pipelines, data modelling, analytics and supporting major issues. Specifically, the data engineer will work to review data acquisition strategies and develop programs to acquire data into Data Lake/Data Warehouse from transactional SAP ERP systems like ECC, CRM, EWM, EM BW, Hybris suing various tools like HANA SDI & SDA Adaptors, SLT, file, OData and other 3rd party adaptors as applicable; work with data team to efficiently use Google Cloud platform to analyze data, build data models and generate reports/visualizations; work with data scientists to build the views for ML use cases and work with Data Analysts to build reports and dashboards in visualization tools Looker or Power BI; design and develop database artifacts like Tables, Calculation Views, SQL Script Procedures to stage large amounts of input and output data in Data Lake; and participate in software development life cycle (SDLC) tasks like design reviews and approvals, detailed functional and technical documentation, migration of artifacts to production.

Top Skills You Need To Have

Bachelor’s degree in Statistics, Mathematics, Data Science, Engineering or related quantitative field
Minimum 3 years of experience in Information Technology, including experience with SQL, Python, Big Query, Cloud Composer, Cloud Pub/Sub
Minimum 2 years of experience in building and operationalizing large-scale enterprise data solutions and applications, with the ability to build production data pipelines from data ingestion to consumption within a hybrid big data architecture
Minimum 1 year of experience working with CI/CD pipelines using Code repositories like Gitlab, GitHub, etc. and deployment tools like Cloud Build or Gitlab Runners
Minimum 1 year of experience in Reporting, Data Analytics and building data pipelines
Experience in any cloud platforms such as GCP, Azure, AWS; with preference to GCP
Proven understanding of technical environment, including technical area development and architecture of SAP

Preferred

Master’s degree in Statistics, Mathematics, Data Science, Engineering or related quantitative field with 1 year of experience in Information Technology, including exposure to:

SQL, Python, Big Query, Cloud Composer, Cloud Pub/Sub
Reporting and data analytics, such as building and operationalizing large scale enterprise data solutions and applications, building production data pipelines from data ingestion to consumption within a hybrid big data architecture
Working with CI/CD pipelines using Code repositories like Gitlab, GitHub and deployment tools like Cloud Build or Gitlab Runners
Experience in any cloud platforms such as GCP, Azure, AWS, etc. with preference to GCP
Understanding of technical environment, including development and architecture of SAP

Experience in medallion architecture with Google Cortex framework
Experience with containerization technologies like Docker or Kubernetes
Experience in PySpark, Cloud Dataproc, Cloud Dataflow, Terraform, Hadoop, Hive, Apache Spark, Cloud Spanner, Cloud SQL and Data Fusion

About Golden Technology

Golden Technology was founded in 1997 with the goal of developing people and driving innovation. In other words, our aim is to pair world-class technologists like you with amazing companies that are doing impactful work.

After an initially slow start, and way too many late nights playing Final Fantasy 7, Golden Technology built a unique recruiting engine that would quickly prove itself to deliver top-tiered talent to fortune 500 clients across the US, time and time again.

Golden Technology has built a culture around family and helping the people we touch succeed in both their work and personal lives. Oh, everyone says that? Try us, you’ll see it.

We’re helping people find their calling and their dream jobs; and through our Golden Community initiatives we are actively working to improve the communities in which we work, live, and play.

Seniority level