The Data Engineer plays a critical role in ensuring the integrity, security, and performance of the Firm's databases and data platforms. They will be responsible for managing, optimizing, and troubleshooting our database and Power Platform systems to support our mission-critical applications and business operations, with particular emphasis on Dynamics 365, Power BI, and Power Apps. They will collaborate with cross-functional teams to design, implement, and maintain data and platform solutions that meet the organization’s evolving needs.
Responsibilities
- The Data Engineer is responsible for the following data sets:
- ERP data
- Client data
- Contact management
- CRM data (Dynamics 365 / Dataverse)
- System meta data
- People and asset data
- Relationship data (Domestic and International)
- Third party application data and integration
- Power BI datasets, semantic models, and reporting outputs
- Power Apps data connections and application data sources
- Database Design and Maintenance: Design, create, and maintain database structures, tables, views, and indexes to ensure optimal performance and data integrity.
- Dynamics 365 / Power Platform Support: Maintain, extend, and troubleshoot Dynamics 365 (Dataverse) data structures, Power BI reports and semantic models, and Power Apps applications used across the business.
- Performance Tuning: Monitor and optimize database and Power Platform performance, identifying and resolving bottlenecks and inefficiencies in collaboration with development teams.
- Security and Access Control: Implement and maintain database and Power Platform security measures, including user access controls, encryption, and authentication mechanisms.
- Backup and Recovery: Develop and maintain database backup and recovery strategies to ensure data availability and disaster recovery.
- Data Migration and ETL: Plan and execute data migrations and ETL (Extract, Transform, Load) processes as needed, including data flowing into and out of Dynamics 365 and Power BI.
- Database Monitoring: Implement database monitoring tools and alerts to proactively identify and address issues.
- Documentation: Maintain comprehensive documentation of database, Dynamics 365, Power BI, and Power Apps configurations, processes, and procedures.
- Collaboration: Collaborate with software developers, system administrators, and other teams to ensure seamless integration of databases and Power Platform solutions into applications.
- Capacity Planning: Perform capacity planning and scalability assessments to accommodate future growth.
- Compliance: Ensure that database and Power Platform systems comply with regulatory and security requirements, such as GDPR, HIPAA, or industry-specific standards.
- Incident Response: Participate in incident response and troubleshooting for database, Dynamics 365, Power BI, and Power Apps-related issues.
- Vendor Management: Manage relationships with database and Power Platform software and service vendors, including software patching and updates.
Requirements
- We are ideally looking for someone with strong experience in Microsoft Dynamics 365, Power BI, and Power Apps. Candidates without demonstrable, hands-on experience across all three of these areas will be essential to maintaining CRM data and creating the required reporting dashboards.
- Bachelor's degree in computer science, information technology, or a related field (or equivalent work experience).
- Proven experience as a Data Engineer or in a similar role.
- Demonstrable experience with Microsoft Dynamics 365 / Dataverse - including data modelling, integration, CRM data structures, and reporting requirements. (Essential)
- Demonstrable experience with Power BI - including report and dashboard development, DAX measures, Power Query transformations, semantic/data models, and troubleshooting refresh issues. (Essential)
- Strong, demonstrable experience with Power Apps - including building and maintaining model-driven apps connected to Dataverse and other data sources. (Essential)
- Proficiency in database management systems such as Microsoft SQL Server, MySQL, or similar.
- Strong SQL query and scripting skills.
- Familiarity with database security best practices.
- Experience with database performance tuning and optimization.
- Knowledge of data backup, recovery, and disaster planning.
- Understanding of data modelling and database design principles.
- Excellent problem-solving and troubleshooting skills.
- Strong communication and teamwork abilities.
- Relevant certifications (e.g., Microsoft Certified: Power BI Data Analyst Associate, Power Platform Developer Associate, or Azure Database Administrator Associate) a plus.