Data Engineer: ETL, Python & Airflow for BigQuery

Horizon IT Inc; Charlotte (NC); On-site; USD 116,868 - 142,839; Full time

Benefits offered by this job

Standard Company Benefits

Job summary

Horizon IT Inc is seeking a Full Time Data Engineer in Charlotte, North Carolina. This role involves building scalable data systems and pipelines, migrating data to Google BigQuery, and managing workflows using Airflow. Candidates must have a Bachelor's degree in a relevant field and twelve months of experience with Python and Hadoop. Standard company benefits are included, along with potential travel to client sites throughout the USA.

Qualifications

• Twelve months of experience in the job offered or as an IT Consultant, Analyst, Programmer, Developer, or Engineer.
• Experience with the implementation of CI/CD pipelines is beneficial.

Responsibilities

• Analyze and organize raw data to build scalable data systems.
• Migrate data from various sources to Google BigQuery.
• Create and manage workflows in Airflow using Cloud Composer.
• Ensure data consistency and performance optimization.

Skills

Python

Hadoop

Data ingestion

ETL processes

Airflow

Education

Bachelor's degree in Computer Science/IT/IS/Engineering or closely related field

Tools

Google BigQuery

Cloud Composer

SQL Server

Teradata

DB2

Job description

Horizon IT Inc is seeking a Full Time Data Engineer in Charlotte, North Carolina. This role involves building scalable data systems and pipelines, migrating data to Google BigQuery, and managing workflows using Airflow. Candidates must have a Bachelor's degree in a relevant field and twelve months of experience with Python and Hadoop. Standard company benefits are included, along with potential travel to client sites throughout the USA.