ETL & Informatica Engineer - Big Data Pipelines

Artifintech; Dallas (TX); On-site; USD 120,000 - 180,000; Full time

Job summary

ARTIFICIAL INTELLIGENCE TECHNOLOGIES LLC is seeking a data engineering specialist to design logical and physical databases, develop data pipelines, and expand big data analytics capabilities. You will identify new data sources, design ETL architectures, and apply predictive modeling and experimental approaches to scale data solutions.

Responsibilities include implementing Hadoop clusters, refining data processes, and mentoring junior team members while communicating progress to business

Qualifications

• Extensive experience designing ETL processes and data pipelines.
• Experience with large, complex data sets and Big Data technologies.
• Ability to design and validate predictive models and experiments.

Responsibilities

• Conducts logical and physical database design.
• Identifies opportunities to collect new data.
• Designs ETL processes and data pipelines to build large, complex data sets.
• Strategizes new uses for data and its interaction with data design.
• Finds new uses for existing data sources.
• Conducts statistical modeling and experiment design.
• Tests and validates predictive models.
• Implements automated processes for efficiently producing scale models.
• Designs, modifies and builds new data processes.
• Implement, configure, administer, monitor Hadoop clusters
• Implements new or enhanced software designed to access and handle data more efficiently.
• Prepare and communicate status, issues, and opportunities to the business.
• Provides technical assistance to junior team members
• Create, refine and enforce data management standards, policies, and procedures.
• Evaluates emerging Big Data technologies to develops next-generation Big Data analytics framework

Skills

ETL pipelines

Data modeling

Hadoop

Big Data

Predictive modeling

Experiment design

Data governance

Mentoring

Job description

ARTIFICIAL INTELLIGENCE TECHNOLOGIES LLC is seeking a data engineering specialist to design logical and physical databases, develop data pipelines, and expand big data analytics capabilities. You will identify new data sources, design ETL architectures, and apply predictive modeling and experimental approaches to scale data solutions.

Responsibilities include implementing Hadoop clusters, refining data processes, and mentoring junior team members while communicating progress to business