Admin

Horizon IT Inc; Charlotte (NC); On-site; USD 116,868 - 142,839; Full time

Benefits offered by this job

Standard Company Benefits

Job summary

Horizon IT Inc is seeking a Full Time Data Engineer in Charlotte, North Carolina. This role involves building scalable data systems and pipelines, migrating data to Google BigQuery, and managing workflows using Airflow. Candidates must have a Bachelor's degree in a relevant field and twelve months of experience with Python and Hadoop. Standard company benefits are included, along with potential travel to client sites throughout the USA.

Qualifications

• Twelve months of experience in the job offered or as an IT Consultant, Analyst, Programmer, Developer, or Engineer.
• Experience with the implementation of CI/CD pipelines is beneficial.

Responsibilities

• Analyze and organize raw data to build scalable data systems.
• Migrate data from various sources to Google BigQuery.
• Create and manage workflows in Airflow using Cloud Composer.
• Ensure data consistency and performance optimization.

Skills

Python

Hadoop

Data ingestion

ETL processes

Airflow

Education

Bachelor's degree in Computer Science/IT/IS/Engineering or closely related field

Tools

Google BigQuery

Cloud Composer

SQL Server

Teradata

DB2

Job description

Job Details

• Posted By Admin
• Address HORIZONIT INC, 1945 J N Pease Place, Suite 101, Charlotte, NC 28262
• No Of Openings 1
• Posted On May 11, 2026
• End On June 11, 2026
• Job Type Full Time
• Pay/Salary $129,854.00 year

Job Description

Analyze and organize raw data to build scalable data systems and pipelines, handling data ingestion, cleansing, transformation, mapping, import/export, and integration using Python. Perform end-to-end ETL processes including data extraction, transformation, loading and integration to support enterprise data architectures such as data warehouses and operational data stores. Migrate data from multiple sources including Hive, Teradata, DB2, SQL Server, Excel, and flat files to Google BigQuery through GCS buckets, ensuring data consistency and performance optimization. Automate CI/CD pipelines by creating and scheduling workflows, developed Python wrapper scripts to trigger workflows based on refresh frequency. Create and manage DAGs in Airflow using Cloud Composer to schedule, orchestrate, and monitor workflows across various data pipelines. Build and maintain BigQuery authorized views to implement row-level security, supporting secure data access and compliance requirements. Work under supervision. Travel and/or Relocation to various unanticipated client sites throughout USA is required.

Education Required

Bachelor's degree in Computer Science/IT/IS/Engineering (any) or closely related field with Twelve (12) months of experience in the job offered or as an IT Consultant or Analyst or Programmer or Developer or Engineer or closely related field.

Experience Requirements

Experience of Twelve (12) months working with Python and Hadoop is required. Travel and/or relocation is required to unanticipated client sites within USA. International travel is not required. The frequency of travel is currently not known as it depends on the client and project requirement that cannot be currently anticipated. Employer provides Information technology services to various clients in USA and hence implementing projects will require such travel.

Job Benefit

Standard Company Benefits.