ETL & Informatica Data Pipeline Engineer

Valiant Technologies LLC; Dallas (TX); On-site; USD 110,000 - 160,000; Full time

Job summary

VALIANT TECHNOLOGIES LLC in Dallas seeks a data engineer to design databases, build ETL pipelines, and develop large-scale data sets. You will model data, implement scalable processes, and explore new data uses to drive analytics and business value.

You will validate predictive models, monitor Hadoop clusters, and collaborate with teammates to enforce data management standards and best practices.

Responsibilities

• Conducts logical and physical database design
• Identifies unique opportunities to collect new data
• Designs ETL processes and data pipelines to build large, complex data sets
• Strategizes new uses for data and its interaction with data design
• Finds new uses for existing data sources
• Conducts statistical modeling and experiment design
• Tests and validates predictive models
• Implements automated processes for efficiently producing scale models
• Designs, modifies and builds new data processes
• Implement, configure, administer, monitor Hadoop clusters
• Implements new or enhanced software designed to access and handle data more efficiently
• Prepare and communicate status, issues, and opportunities to the business
• Provides technical assistance to junior team members
• Create, refine and enforce data management standards, policies, and procedures
• Evaluates emerging Big Data technologies to develops next-generation Big Data analytics framework

Job description

VALIANT TECHNOLOGIES LLC in Dallas seeks a data engineer to design databases, build ETL pipelines, and develop large-scale data sets. You will model data, implement scalable processes, and explore new data uses to drive analytics and business value.

You will validate predictive models, monitor Hadoop clusters, and collaborate with teammates to enforce data management standards and best practices.