Data Engineer: Databricks + Snowflake Pipelines

Valiant Technologies LLC; Dallas (TX); On-site; USD 120,000 - 160,000; Full time

Job summary

Valiant Technologies LLC is seeking a skilled Data Engineer to design, develop, and maintain scalable data pipelines and cloud-based data platforms. The role focuses on reliable data integration and supporting enterprise data warehousing initiatives.

You will design and optimize ETL/ELT processes, work with Databricks and Snowflake, and ensure data quality across multiple sources while collaborating with analytics and BI teams.

Qualifications

• Proficient in designing scalable ETL/ELT pipelines.
• Experience with data warehousing concepts and cloud data platforms.
• Strong SQL, Python, and Spark skills for data processing and optimization.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines.
• Build and optimize data processing workflows using Databricks.
• Develop data warehouse solutions using Snowflake.
• Implement data ingestion and transformation processes.
• Work with structured and unstructured data from multiple sources.
• Develop complex SQL queries and optimize database performance.
• Implement data quality checks and validation procedures.
• Integrate data from cloud platforms and enterprise applications.
• Collaborate with analytics and business intelligence teams.
• Monitor pipeline performance and troubleshoot data processing issues.

Skills

Python

PySpark

SQL

Data Modeling

Data Integration

Data Quality

Performance Optimization

Tools

Databricks

Apache Spark

Snowflake

Airflow

Delta Lake

Cloud Platforms (AWS/Azure/GCP)

Job description

Valiant Technologies LLC is seeking a skilled Data Engineer to design, develop, and maintain scalable data pipelines and cloud-based data platforms. The role focuses on reliable data integration and supporting enterprise data warehousing initiatives.

You will design and optimize ETL/ELT processes, work with Databricks and Snowflake, and ensure data quality across multiple sources while collaborating with analytics and BI teams.