Data Engineer

TechDigital Group; Glendale (WI); Hybrid; USD 90,000 - 130,000; Full time

Job summary

TechDigital Group is seeking a seasoned data engineer to join our hybrid day-shift team. The role focuses on delivering robust data solutions using ADF for OBP and Snowflake within a large multinational environment, designing and optimizing pipelines and ensuring secure and reliable data flows for global analytics.

You will collaborate with cross-functional teams, translate requirements into technical designs, tune performance, implement data quality checks, and maintain documentation.

Qualifications

• Eight years of enterprise data experience.
• Experience designing end-to-end pipelines with ADF and Snowflake.
• Strong SQL optimization and data transformation skills.

Responsibilities

• Design end-to-end data pipelines using ADF for OBP and Snowflake.
• Develop scalable Snowflake data models and optimize query performance.
• Implement robust data integration workflows with logging and error handling.
• Collaborate with analysts and product owners to translate requirements into technical designs.
• Perform performance tuning and optimize cloud resources for ADF and Snowflake.
• Establish data quality checks and prevent propagation of inaccuracies across reporting layers.
• Create technical documentation for ADF configurations and Snowflake models.
• Coordinate with infrastructure and security teams on access control and compliance.
• Investigate incidents related to data loads and pipeline failures.
• Support migration of existing solutions into Snowflake and ADF with minimal disruption.
• Engage testing teams to validate pipelines and objects before production.

Skills

ADF for OBP

Snowflake data modeling

SQL optimization

Cloud data engineering

Hybrid collaboration

Tools

ADF

Snowflake

Job description

Job Summary: This hybrid day shift role for a team member with eight to twelve years of experience focuses on delivering robust data solutions using ADF for OBP and Snowflake within a large multinational environment. The role involves designing and optimizing data pipelines, collaborating with cross functional teams, and ensuring secure and reliable data flows that support strategic business analytics and decision making across global operations.

Responsibilities:

• -Design end to end data pipelines using ADF for OBP to enable reliable movement and transformation of data between enterprise systems and analytical platforms, ensuring that business stakeholders receive timely and accurate insights for operational and strategic decisions.
• -Develop scalable Snowflake data models that align with enterprise standards and optimize query performance, enabling analytics and reporting teams to run complex workloads efficiently while maintaining data integrity and consistency across subject areas.
• -Implement robust data integration workflows that orchestrate ADF activities and Snowflake operations, focusing on error handling, logging, and recoverability to reduce downtime and improve trust in data driven processes.
• -Collaborate with business analysts and product owners to translate functional requirements into technical designs for ADF pipelines and Snowflake structures, ensuring that solutions directly support organizational goals and measurable outcomes.
• -Perform detailed performance tuning on ADF pipelines and Snowflake queries by analyzing execution patterns and resource usage, driving continuous improvements that reduce processing windows and optimize cloud consumption.
• -Establish and maintain data quality checks within ADF and Snowflake processes to detect anomalies, enforce validation rules, and prevent propagation of inaccurate information across reporting layers and downstream applications.
• -Create and maintain technical documentation for ADF configurations, OBP related integrations, and Snowflake data models, providing clear reference materials that support ongoing maintenance, audits, and onboarding of future team members.
• -Coordinate closely with infrastructure and security teams to align ADF and Snowflake implementations with enterprise guidelines on access control, encryption, and compliance, helping protect sensitive information while enabling appropriate data sharing.
• -Investigate and resolve incidents related to data loads, pipeline failures, and performance degradation in ADF and Snowflake environments, applying structured root cause analysis to prevent recurring issues and maintain stable operations.
• -Support migration of existing data solutions into Snowflake and ADF by assessing legacy implementations, planning transition steps, and executing cutover activities that minimize disruption to users and business processes.
• -Engage with testing teams to define and execute unit, integration, and regression tests for ADF pipelines and Snowflake objects, ensuring that changes are reliably validated before deployment to production environments.
• -Contribute to continuous improvement by recommending enhancements to development standards, reusable components, and monitoring dashboards for ADF and Snowflake, enabling the organization to scale data capabilities and innovate responsibly.
• -Participate in agile ceremonies and cross functional working sessions to provide technical input on backlog items, estimate effort for ADF and Snowflake tasks, and align delivery plans with business priorities and resource constraints.

Qualifications

• -Apply strong expertise in ADF for OBP to design and manage complex pipeline orchestration, including activities for data movement, transformation logic and scheduling, built on at least eight years of practical experience in enterprise projects.
• -Demonstrate advanced proficiency in Snowflake by designing normalized and denormalized schemas, configuring warehouses for appropriate workloads, and implementing secure data sharing models that support diverse analytics functions.
• -Utilize solid experience in data warehousing and dimensional modeling to structure Snowflake objects that reflect business domains clearly, simplify reporting, and allow stakeholders to trace information back to trusted sources.
• -Bring proven capability in SQL optimization and data transformation techniques to craft efficient queries and procedures that reduce execution times and support high volume processing without compromising accuracy.
• -Employ practical knowledge of cloud based data engineering practices, including monitoring, cost management, and environment segregation, to keep ADF and Snowflake solutions sustainable and aligned with organizational policies.
• -Use strong communication and collaboration skills to work effectively in a hybrid environment, coordinating with onsite and remote colleagues, clarifying requirements, and presenting technical decisions to both technical and nontechnical audiences.
• -Apply experience in structured delivery methodologies, such as agile or iterative approaches, to plan tasks, track progress, manage dependencies, and ensure timely completion of ADF and Snowflake deliverables within agreed quality expectations.