Data Transformation Engineer

Confie; Addison, Northern (TX, KY); Hybrid; USD 110,000 - 160,000; Full time

Benefits offered by this job

Comprehensive benefits package

Performance-based bonuses

Paid time off

Flexible remote/hybrid options

401k with company match

Education advancement scholarship

Job summary

Confie is seeking a seasoned Data Engineer to design, build, and optimize data pipelines using Snowflake, Python, and Airflow. You will transform business requirements into scalable data models and ELT workflows, ensuring data quality and timely delivery for analytics and BI.

The role offers remote/hybrid options and a comprehensive benefits package, including 401(k) matching, education support, and wellness programs.

Qualifications

• 4+ years of professional experience in data engineering and building data pipelines.

Responsibilities

• Design and develop data pipelines to populate Snowflake data lake and data warehouse.

Skills

Data engineering

Python programming

SQL

ETL development

Snowflake

Pandas/Numpy

Data modeling

Data warehousing

Data quality

Observability

Education

Bachelor's degree in Computer Science/Engineering or related field

Snowflake Advanced Certification

Tools

Snowflake

Coalesce

WhereScape

Azure Data Factory

Fivetran

Airbyte

Snowpipe

Airflow

Pandas

Job description

Work From Home - TX
7711 Center Ave
Ste 200
Addison, TX 75001, USA

Work From Home - TX
7711 Center Ave
Ste 200
Addison, TX 75001, USA

Work From Home - CA
7711 Center Avenue
Suite 200
Huntington Beach, CA 92647, USA

Work From Home - CA
7711 Center Avenue
Suite 200
Huntington Beach, CA 92647, USA

Work From Home - GA
7711 Center Avenue
Suite 200
Huntington Beach, GA 92647, USA

Work From Home - GA
7711 Center Avenue
Suite 200
Huntington Beach, GA 92647, USA

Work From Home - CO
7711 Center Avenue
Suite 200
Huntington Beach, CO 92647, USA

Work From Home - CO
7711 Center Avenue
Suite 200
Huntington Beach, CO 92647, USA

Work From Home - FL
7711 Center Avenue
Suite 200
Huntington Beach, FL 92647, USA

Work From Home - FL
7711 Center Avenue
Suite 200
Huntington Beach, FL 92647, USA

• Comprehensive benefits package including medical, dental, vision, and life insurance
• Performance-based bonusesto reward your contributions*
• Paid time off to recharge and maintain a healthy work-life balance
• Flexible work options, including remote and hybrid opportunities, if eligible
• Retirement Plan (401k)with company-matched contributions
• Education Advancement,for employees and qualified dependents, via the Confie Enablement Scholarship Fund
• Fitness Reimbursement – up to $15/month for gym memberships
• Inclusive workplacethrough a strong commitment to Diversity, Equity, and Inclusion
• Employee Assistance Program –confidential support for personal or professional challenges, at no cost
• Extra Perks– optional plans for disability, hospital indemnity, health advocate program, universal life, critical illness, accident insurance, and even pet insurance

Purpose

Work under the guidance and supervision of the Director of Enterprise Architecture to build Confie's next-generation Enterprise Data Solutions. Require expertise in implementing and maintaining data solutions on Snowflake data cloud environments that drive critical business insights and operations. Responsible for developing robust data models, creating efficient ELT processes, and optimizing performance to support the organization's data needs

Design and develop data pipelines, ELT workflows to populate the cloud Data Lake and Data Warehouse on Snowflake with transformation tools (e.g., Coalesce, WhereScape, Azure Data Factory) and replication tools (e.g., Fivetran, Airbyte, etc.)

Translate business requirements into technical specifications; establish and define details, definitions, and requirements of applications, components, and enhancements

Design and develop robust and scalable data pipelines to support data integrations using Snowflake, Coalesce, Python, Airflow, and Fivetran

Design and develop Snowflake data objects (tables, views, stored procedures, udf's, etc.)

Implement ELT (Extract, Load, Transform) processes using Snowflake's features, such as SnowPipe, Streams, and Tasks

Perform data cleaning, analysis, and integration using Python

Ability to work with multiple data sources and types (structured/semi-structured/unstructured)

Design and implement efficient data models and schemas within Snowflake to support reporting, analytics, and business intelligence needs

Monitor and optimize query performance and resource utilization within Snowflake using query profilling, query optimization techniques, and workload management features

Identify and resolve performance bottlenecks and optimize data warehouse configurations for maximum efficiency

Implement processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it

Monitor data pipelines for timely and accurate completion

Stay up-to-date with industry trends and advancements in data engineering, continuously improving the team's technical knowledge and skills

On-call support

Qualifications and Education Requirements

4+ years of professional experience in data engineering, designing and implementing data pipelines, and building data infrastructure

4+ years of strong experience required in Snowflake data cloud and ETL development, including Snowflake procedures, udf's in Python and SQL, streams, tasks, Snowpipe, and working with semi-structured data

3+ years of strong experience with Python programming and extensively used frameworks/packages like Snowpark, pandas, numpy, and requests for Data Analysis and integration

Solid understanding of data warehousing concepts, dimensional modeling, and data integration techniques

2+ years of strong experience with data integration and transformation tools like Coalesce, WhereScape, and Azure Data Factory

Experience with data quality and observability concepts is a plus

Bachelor's degree in Computer Science, Engineering, or a related field

Snowflake Advanced Certification is a plus

Additional certifications related to data platforms are a plus

Other Duties

This job description is not designed to cover or contain a comprehensive listing of activities, duties, or responsibilities that are required of the employee for this job. Duties, responsibilities, and activities may change at any time with or without notice

Notice

As permitted by applicable law and from time-to-time, Confie may use a computer system that has elements of artificial intelligence to help make decisions about your employment, including recruitment, hiring, renewal of employment, or the terms and conditions of your employment. Employees with questions about Confie’s use of these computer systems should contact Human Resources at [e-mail]

Equal Opportunity Employer
This employer is required to notify all applicants of their rights pursuant to federal employment laws.For further information, please review the Know Your Rights notice from the Department of Labor.