Data and AI Engineer (Mid-Level)
Shannon & Wilson
Get more replies from employers
Send a job-specific resume in minutes.
Benefits offered by this job
Job summary
Shannon & Wilson is seeking a Data Engineer to manage, optimize, and evolve our new Microsoft-based data platform (Fabric, Azure SQL, Power BI, etc.). This role will ensure engineers, supporting staff, and leadership have reliable, trusted access to data for project delivery, reporting, and strategic insights.
Responsibilities include platform operations, ingestion pipelines, data modeling, governance, and continuous improvement, collaborating with analysts and IT to meet business needs.
Qualifications
- Bachelor’s degree in Computer Science, Data Engineering, or related field (or equivalent experience).
- 7 to 14 years of experience with Microsoft data stack (Azure SQL Database, Azure Data Factory, Synapse, Power BI, or Fabric).
- Strong SQL development skills and data modeling (star/snowflake) required.
- Hands-on experience with ETL/ELT pipelines and automation scheduling required.
- Familiarity with cloud-based data security and access control practices.
- Experience with Microsoft Fabric Lakehouse and Mirrored Databases preferred.
- Familiarity with engineering or construction industry data (projects, cost, schedule) preferred.
- Python or Spark for data transformation preferred.
- DevOps/Git-based version control for data pipelines preferred.
- Strong collaboration skills – able to work with project managers, analysts, and IT staff.
- Excellent troubleshooting and problem-solving skills.
- Continuous improvement mindset and willingness to learn new technologies.
- Clear communication skills (technical and business-oriented).
Responsibilities
- Platform Operations & Maintenance: Administer Microsoft Fabric/Azure SQL Databases and Power BI workspaces.
- Ensure data pipelines, notebooks, and scheduled refreshes run reliably and on time.
- Implement monitoring, alerting, and cost optimization strategies for the platform.
- Data Engineering & Integration: Build and optimize ingestion pipelines from internal and external sources.
- Design clean, curated data models to support reporting and analytics needs.
- Collaborate with business analysts to ensure data structures meet business requirements.
- Governance & Security: Apply data governance standards for naming conventions, schema design, and access control.
- Work with IT to enforce security policies and compliance with client/regulatory requirements.
- Continuous Improvement: Stay current with Microsoft Fabric, Power BI, and related tools; identify automation opportunities.
- Partner with stakeholders to identify new use cases for analytics and reporting.
Skills
Education
Tools
Job description
Shannon & Wilson is a leading geotechnical engineering firm dedicated to delivering innovative solutions in infrastructure, transportation, and environmental projects. As part of our digital transformation journey, we are investing in modern data platforms and analytics capabilities to support better decision-making and operational excellence.
Full-time
We are seeking a Data Engineer to manage, optimize, and evolve our new Microsoft-based data platform (Microsoft Fabric, Azure SQL, Power BI, etc.). This role will be instrumental in ensuring that our engineers, supporting staff, and leadership have reliable, trusted access to data for project delivery, reporting, and strategic insights.
- Administer and monitor Microsoft Fabric (or Azure Synapse/Lakehouse), Azure SQL Databases, and Power BI workspaces.
- Ensure data pipelines, notebooks, and scheduled refreshes run reliably and on time.
- Implement monitoring, alerting, and cost optimization strategies for the platform.
- Build, maintain, and optimize ingestion pipelines from internal systems (ERP, project management software) and external data sources.
- Design and maintain clean, curated data models to support reporting and analytics needs.
- Collaborate with business analysts to ensure data structures meet business requirements.
- Apply data governance standards for naming conventions, schema design, and access control.
- Work with IT to enforce security policies, manage permissions, and ensure compliance with client and regulatory requirements.
- Stay current with Microsoft’s data platform capabilities (Fabric, Power BI, Azure Data Factory, etc.).
- Recommend new features, automation, or process improvements to enhance reliability and usability.
- Partner with stakeholders to identify and implement new use cases for analytics and reporting.
- Bachelor’s degree in Computer Science, Data Engineering, or related field (or equivalent experience).
- 7 to 14 years of experience with Microsoft data stack (Azure SQL Database, Azure Data Factory, Synapse, Power BI, or Fabric).
- Strong SQL development skills and experience with data modeling (star/snowflake schema) required.
- Hands-on experience with ETL/ELT pipelines and automation scheduling required.
- Familiarity with cloud-based data security and access control practices.
- Experience with Microsoft Fabric Lakehouse and Mirrored Databases preferred.
- Familiarity with engineering or construction industry data (projects, cost, schedule) preferred.
- Python or Spark experience for data transformation preferred.
- Knowledge of DevOps/Git-based version control for data pipelines preferred.
- Strong collaboration skills – able to work with project managers, analysts, and IT staff.
- Excellent troubleshooting and problem-solving skills.
- Continuous improvement mindset with willingness to learn and adopt new technologies.
- Clear communication skills (both technical and business-oriented).
Typically, depending on an applicant’s education, experience, other qualifications they possess, if they are a fit for the company and local office culture, and the current business needs, a Mid-Level Data Engineer typically would be placed at a Shannon & Wilson Senior Professional I, II, or III level with annual compensation ranging from $110,000 - $145,000.
Shannon & Wilson is committed to providing a comprehensive total rewards package that includes the following benefits:
- Employee stock ownership
- Medical, prescription, vision, dental, long-term care and life insurance plans are offered to employees (and their families).
- Pre-tax health and daycare FSA
- Profit sharing and 401(k) plans with annual safe-harbor contributions
- 10 - 20 paid vacation days per year for full-time employees, based on years of experience (prorated for part-time employment)
- Sick leave accrues based on state requirements
- 9 paid holidays per year + 1 personal holiday
- Paid volunteer day
- Paid time off for bereavement and jury duty
- Two weeks of paid parental leave
- Lunch & Live wellness webinars and an Employee Assistance Program
- Mentorship Program
- Tuition Reimbursement
- Free parking
Shannon & Wilson is an Equal Opportunity Employer
Shannon & Wilson participates in the E-Verify program.
Please note that non-solicited resumes from external recruitment agencies will not be considered as introductions to our business, unless a preapproved agreement is in place and the external recruitment agency has been engaged to work on this specific vacancy.
$110,000 - $145,000
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
