Data Engineer

Pantar Solutions Inc.; Weddington (NC); Remote; USD 80,000 - 120,000; Full time

Job summary

A technology solutions company is seeking a Data Engineer to design and implement large-scale data solutions. The role involves working with data ingestion, curation, and visualization using tools like Informatica and Tableau, along with machine learning techniques. You will also manage data in cloud repositories such as Google BigQuery and AWS Redshift. The position requires travel and/or relocation within the U.S.

Qualifications

• Experience designing and implementing data solutions.
• Strong Python skills for developing production-grade code.
• Ability to write UNIX shell scripts for ETL processes.

Responsibilities

• Design and implement large-scale data solutions.
• Manage and query data in cloud repositories.
• Automate data loading and validation processes.

Skills

Data ingestion

Data curation

Data visualization

Machine Learning

PySpark

Tools

Informatica

Snaplogic

Tableau

MicroStrategy

Google BigQuery

AWS Redshift

Job description

# Data Engineer**Job Duties:**Design and implement efficient large-scale data solutions in areas data ingestion, data curation, data quality, data visualization and data distribution using Informatica, Snaplogic, Tableau and MicroStrategy. Manage and query data in data lakes and/or cloud data repositories Google BigQuery and AWS Redshift. Responsible for writing well structured, testable PySpark code to implement use cases using Machine Learning techniques in a production grade environment. Design and develop UNIX shell scripts as part of the ETL process to automate the process of loading and pulling the data. Create test plans, test cases, test scripts and perform data testing and validation. Will work in Weddington, NC and/or various unanticipated client sites throughout the U.S. Must be willing to travel and/or relocate.**Job Type:** Full Time## Apply for this position