Data Engineer

TG Administration LLC; Scottsdale (AZ); Presencial; USD 95 000 - 130 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Healthcare Benefits

Retirement Benefits

Time Off

Resumo da oferta

TG Administration LLC is seeking a Data Engineer to design, build, and maintain scalable data pipelines on Azure, focusing on governed data flows and medallion architecture for analytics and apps. This onsite role is based in Scottsdale, AZ with 3+ years of experience.

You will collaborate across data engineering, analysts, and product teams to ingest, transform, and validate data, implement quality controls, and monitor pipelines for reliability and cost efficiency.

Qualificações

• 3+ years in data engineering, ETL/ELT development, or data integration.
• Hands-on experience building and maintaining production-grade data pipelines.
• Experience with Azure data services: Azure Data Factory, Azure Data Lake, and Synapse Analytics.
• Strong proficiency in SQL and data transformation techniques.
• Experience with APIs, file-based ingestion, and streaming data sources.
• Knowledge of data quality, validation, and error-handling techniques.

Responsabilidades

• Design, develop, and maintain end-to-end data pipelines to ingest data from internal and external systems into Azure data platforms.
• Build and manage data integration processes using Azure Data Factory, Azure Synapse, and/or Azure Data Lake.
• Implement medallion architecture (bronze, silver, gold) for refined data delivery.
• Transform raw data into clean, validated, and enriched datasets for analytics and business use.
• Develop and optimize data models and transformation logic for performance and scalability.
• Integrate data from APIs, SaaS platforms, databases, and third-party systems.
• Ensure data quality, consistency, and integrity across pipeline stages.
• Implement monitoring, alerting, and logging for pipeline performance and failures.
• Collaborate with data analysts, data scientists, and product teams to support reporting and analytics.
• Maintain and optimize data storage solutions for cost and performance efficiency.
• Follow CI/CD and deployment best practices for data pipelines.
• Document data flows, transformations, and system dependencies.

Conhecimentos

Analytical thinking

Problem solving

Communication

Formação académica

Bachelor's degree in Computer Science, Information Technology, Engineering, or related field

Ferramentas

Azure Data Factory

Azure Synapse

Azure Data Lake

Synapse Analytics

PySpark

Spark

Databricks

Delta Lake

CI/CD

DevOps

Descrição da oferta de emprego

TG Administration LLC is seeking a Data Engineer to design, build, and maintain scalable data integration pipelines and Azure-based data architectures. This role focuses on governed data flows that use medallion layering to support analytics and downstream applications, while keeping data reliable through quality controls and operational monitoring.

You will work across the data lifecycle, from ingesting internal and external sources to transforming raw inputs into clean, validated datasets. The position is based in Scottsdale, AZ and is onsite, with a minimum of 3+ years of relevant experience.

Responsibilities

• Design, develop, and maintain end-to-end data pipelines to ingest data from internal and external systems into Azure data platforms
• Build and manage data integration processes using tools such as Azure Data Factory, Azure Synapse, and/or Azure Data Lake
• Implement and enforce medallion architecture (bronze, silver, gold) for structured refinement and consumption
• Transform raw data into clean, validated, and enriched datasets for analytics and business use
• Develop and optimize data models and transformation logic for performance and scalability
• Integrate data from APIs, SaaS platforms, databases, and third-party systems
• Ensure data quality, consistency, and integrity across pipeline stages
• Implement monitoring, alerting, and logging for pipeline performance and failures
• Collaborate with data analysts, data scientists, and product teams to support reporting and advanced analytics needs
• Maintain and optimize data storage solutions (for example, Azure Data Lake and Synapse) for cost and performance efficiency
• Follow best practices for version control, CI/CD, and deployment of data pipelines
• Document data flows, transformations, and system dependencies

Requirements

• 3+ years of experience in data engineering, ETL/ELT development, or data integration
• Hands-on experience building and maintaining production-grade data pipelines
• Experience working within cloud-based data platforms (Azure preferred)
• Strong proficiency in SQL and data transformation techniques
• Experience with Azure data services: Azure Data Factory, Azure Data Lake, and Synapse Analytics
• Expertise in ETL/ELT pipeline design and orchestration
• Strong understanding of data modeling (relational and dimensional)
• Experience working with APIs, file-based ingestion, and streaming data sources
• Knowledge of data quality, validation, and error-handling techniques
• Strong problem-solving and troubleshooting skills
• Bachelor’s degree in Computer Science, Information Technology, Engineering, or related field
• Equivalent combination of education and experience may be considered

Technologies

Azure, Azure Data Factory, Azure Synapse, Azure Data Lake, Synapse Analytics, SQL, ETL/ELT, APIs, SaaS, PySpark, Spark, Databricks, Delta Lake, CI/CD, DevOps

Benefits

• Healthcare Benefits – Medical, Dental, and Vision coverage
• Retirement Benefits – 401(k) with employer match (19 years of age and older)
• Time Off – Paid time off (PTO) and leaves of absence, in accordance with applicable law and eligibility criteria

Preferred Qualifications

• Experience implementing medallion architecture (bronze/silver/gold layers)
• Experience integrating multiple enterprise systems (CRM, ERP, SaaS platforms)
• Experience supporting analytics or BI environments

Preferred Knowledge and Skills

• Experience with PySpark, Spark, or Databricks
• Familiarity with Delta Lake and lakehouse architectures
• Experience with CI/CD pipelines and DevOps practices in Azure
• Knowledge of data governance, lineage, and cataloging tools
• Experience optimizing performance and cost in cloud environments