Data Engineer

TechDigital Group; Milwaukee (WI); Hybrid; USD 120,000 - 160,000; Full time

Job summary

TechDigital Group is seeking an experienced data professional to design and optimize data pipelines using ADF for OBP and Snowflake in a hybrid day-shift role. The candidate will build scalable data models, ensure secure data flows, and collaborate with cross-functional teams to support global analytics.

With eight to twelve years of enterprise experience, you will drive performance tuning, data quality, and documentation while aligning with organizational goals and compliance standards across

Qualifications

• Strong expertise in ADF for OBP to design and manage complex pipelines.
• Advanced Snowflake proficiency for schema design and secure sharing.
• Experience in data warehousing and dimensional modeling.
• SQL optimization and data transformation to reduce execution times.
• Cloud-based data engineering practices, monitoring, and cost management.
• Excellent communication to work in a hybrid environment with diverse teams.
• Structured delivery methods (agile/iterative) for task planning and tracking.

Responsibilities

• Design end-to-end data pipelines using ADF for OBP and Snowflake.
• Develop scalable Snowflake data models and optimize queries.
• Implement robust data integration workflows with monitoring and logging.
• Collaborate with analysts and product owners to translate requirements.
• Tune performance of ADF pipelines and Snowflake queries.
• Establish data quality checks to prevent propagation of inaccuracies.
• Create documentation for ADF configurations and Snowflake models.
• Coordinate with security teams on access control and encryption.
• Investigate and resolve data load incidents and performance issues.
• Support migration of legacy solutions to Snowflake and ADF.
• Engage testing teams for unit/integration/regression tests.
• Suggest improvements to standards, components, and dashboards.
• Participate in agile ceremonies and cross-functional sessions.

Skills

ADF for OBP

Snowflake

SQL optimization

Data warehousing

Cloud data engineering

Communication

Agile delivery

Job description

Required Skills: ADF for OBP, Snowflake

Job Summary:

This hybrid day shift role for a team member with eight to twelve years of experience focuses on delivering robust data solutions using ADF for OBP and Snowflake within a large multinational environment. The role involves designing and optimizing data pipelines, collaborating with cross functional teams, and ensuring secure and reliable data flows that support strategic business analytics and decision making across global operations.

Responsibilities:

• Design end-to-end data pipelines using ADF for OBP to enable reliable movement and transformation of data between enterprise systems and analytical platforms, ensuring that business stakeholders receive timely and accurate insights for operational and strategic decisions.
• Develop scalable Snowflake data models that align with enterprise standards and optimize query performance, enabling analytics and reporting teams to run complex workloads efficiently while maintaining data integrity and consistency across subject areas.
• Implement robust data integration workflows that orchestrate ADF activities and Snowflake operations, focusing on error handling, logging, and recoverability to reduce downtime and improve trust in data driven processes.
• Collaborate with business analysts and product owners to translate functional requirements into technical designs for ADF pipelines and Snowflake structures, ensuring that solutions directly support organizational goals and measurable outcomes.
• Perform detailed performance tuning on ADF pipelines and Snowflake queries by analyzing execution patterns and resource usage, driving continuous improvements that reduce processing windows and optimize cloud consumption.
• Establish and maintain data quality checks within ADF and Snowflake processes to detect anomalies, enforce validation rules, and prevent propagation of inaccurate information across reporting layers and downstream applications.
• Create and maintain technical documentation for ADF configurations, OBP related integrations, and Snowflake data models, providing clear reference materials that support ongoing maintenance, audits, and onboarding of future team members.
• Coordinate closely with infrastructure and security teams to align ADF and Snowflake implementations with enterprise guidelines on access control, encryption, and compliance, helping protect sensitive information while enabling appropriate data sharing.
• Investigate and resolve incidents related to data loads, pipeline failures, and performance degradation in ADF and Snowflake environments, applying structured root cause analysis to prevent recurring issues and maintain stable operations.
• Support migration of existing data solutions into Snowflake and ADF by assessing legacy implementations, planning transition steps, and executing cutover activities that minimize disruption to users and business processes.
• Engage with testing teams to define and execute unit, integration, and regression tests for ADF pipelines and Snowflake objects, ensuring that changes are reliably validated before deployment to production environments.
• Contribute to continuous improvement by recommending enhancements to development standards, reusable components, and monitoring dashboards for ADF and Snowflake, enabling the organization to scale data capabilities and innovate responsibly.
• Participate in agile ceremonies and cross functional working sessions to provide technical input on backlog items, estimate effort for ADF and Snowflake tasks, and align delivery plans with business priorities and resource constraints.

Qualifications:

• Apply strong expertise in ADF for OBP to design and manage complex pipeline orchestration, including activities for data movement, transformation logic, and scheduling, built on at least eight years of practical experience in enterprise projects.
• Demonstrate advanced proficiency in Snowflake by designing normalized and denormalized schemas, configuring warehouses for appropriate workloads, and implementing secure data sharing models that support diverse analytics functions.
• Utilize solid experience in data warehousing and dimensional modeling to structure Snowflake objects that reflect business domains clearly, simplify reporting, and allow stakeholders to trace information back to trusted sources.
• Bring proven capability in SQL optimization and data transformation techniques to craft efficient queries and procedures that reduce execution times and support high volume processing without compromising accuracy.
• Employ practical knowledge of cloud based data engineering practices, including monitoring, cost management, and environment segregation, to keep ADF and Snowflake solutions sustainable and aligned with organizational policies.
• Use strong communication and collaboration skills to work effectively in a hybrid environment, coordinating with onsite and remote colleagues, clarifying requirements, and presenting technical decisions to both technical and nontechnical audiences.
• Apply experience in structured delivery methodologies, such as agile or iterative approaches, to plan tasks, track progress, manage dependencies, and ensure timely completion of ADF and Snowflake deliverables within agreed quality expectations.