Senior Data & Software Engineer — AI-Ready Data Platform

ATG; United States; On-site; Full time

Job description

Senior Software and Data Engineer

Role Summary

We are seeking an experienced developer and data engineer to build and evolve data warehouse, data lake, lakehouse, and analytics solutions on the Microsoft data platform. The role is hands‑on: designing data models, building ELT/ETL pipelines using the Medallion Architecture (Bronze / Silver / Gold), and delivering reliable, well‑modeled data products on Microsoft Fabric and Azure SQL. As a data engineer you will build resilient data pipelines, create visibility into data quality issues, build data pipelines and position data for analytics, and design the scalable, secure architecture needed for the future and AI. Your expertise will be critical in shaping our clients’ data strategy, driving architectural decisions, and mentoring team members.

Key Responsibilities

• Design and build data warehouse solutions on Microsoft Fabric and Azure SQL aligned to client business needs.
• Implement and evolve the Medallion Architecture — Bronze (raw), Silver (cleansed/conformed), and Gold (business-ready) layers — on Fabric and Azure SQL.
• Develop and maintain ELT/ETL pipelines that are reliable, observable, and easy to operate.
• Model data for analytics and reporting — fact/dimension design, conformed dimensions, performant aggregates.
• Collaborate with ATG technical leads and client stakeholders to translate requirements into delivery‑ready solutions.
• Own quality — testing, validation, documentation, and monitoring of pipelines and datasets.
• Research and propose solutions independently; bring options and tradeoffs, not just questions.
• AI Readiness: understand leveraging Fabric and Azure AI Search to tag data and make data available to Enterprise AI Orchestration platforms such as Foundry.
• Consulting: explain various data and analytic approaches to non‑technical stakeholders, conduct Bronze to Silver analysis and mapping, present to clients, interview clients to design data marts for Gold.
• Technical Leadership: provide thought leadership on best practices for readable, maintainable, performant, and secure data pipelines.

Requirements

• 5+ years experience with data engineering, with at least 2 years on the Microsoft platform.
• Microsoft Fabric: OneLake, Lakehouse, Warehouse, Pipelines, Notebooks, Dataflows Gen2.
• Azure SQL: schema design, performance tuning, indexing, partitioning, and security.
• Medallion Architecture: hands‑on experience designing and building Bronze / Silver / Gold layers in Microsoft Fabric and Azure SQL.
• T‑SQL: advanced querying, stored procedures, window functions, performance optimization.
• ELT / ETL pipeline development: ingestion, transformation, orchestration, and monitoring across the Bronze → Silver → Gold flow using Azure Data Factory, Synapse Analytics, Azure Functions, Python and PySpark for Notebook development.
• Data warehouse modeling: dimensional modeling (Kimball), slowly changing dimensions, conformed dimensions in the Gold layer.

Professional and Consulting Skills

• Project Management: document requirements, data flows, and system architecture; estimate effort accurately and communicate blockers or timeline risks proactively.
• Team Player: champion best practices for readable, maintainable, performant, and secure code; mentor junior engineers; manage time effectively; communicate technical trade‑offs clearly; detail oriented: ability to understand business processes and data.

Nice To Haves

• Power BI and DAX for semantic models and reporting.
• Git‑based source control and CI/CD for data pipelines (Azure DevOps or GitHub Actions).
• Experience with Snowflake and Databricks.
• Experience with AEC data including Autodesk APS and Autodesk Forma.
• Familiarity with data governance, lineage, and cataloging (Microsoft Purview).
• Experience with Microsoft Foundry and Azure AI Search.
• .NET or Python Django Web Application and RESTful API development.
• Azure & AWS infrastructure, Terraform.

Benefits

• Health, Dental and Vision Benefits.
• Short‑Term and Long‑Term Disability.
• Wellness Programs.
• 3 weeks of PTO each year, paid holidays, and birthday off.
• 2 paid volunteer days each year.
• 401k match up to 4% after 90 days of employment.
• Great culture with frequent in‑person events and gatherings.

ATG is an Equal Opportunity Employer. We do not discriminate based on race, color, religion, sex (including gender identity and sexual orientation), national origin, age, disability, genetic information, or any other protected status under applicable laws. We’re committed to an inclusive workplace where all backgrounds and perspectives are valued, and we strive to build a team that reflects the diverse world we serve.

This full‑time role requires a minimum of 40 hours per week, with additional hours as needed to meet deadlines. Candidates must be able to sit or stand for extended periods, travel between office locations (including those with stairs), and lift up to 30 pounds. Strong verbal and written English communication skills, along with adequate visual and auditory abilities (with or without aids), are essential. The physical demands described are representative of those needed to perform the job’s essential functions, with or without reasonable accommodation.

If you need accommodation during the application or interview process—or on the job—please contact Human Resources.

Applicants must be authorized to work in the U.S. without company sponsorship. We appreciate your interest in ATG!