Senior Data Integration Engineer

Friedman Williams; United States; Remote; USD 100,000 - 140,000; Full time

Job summary

A leading company seeks a Senior Data Integration Engineer to manage data integration pipelines, focusing on tools like Dell Boomi and Matillion. The candidate will design and optimize data workflows, ensuring data accuracy and facilitating API integrations with multiple systems. Strong problem-solving skills and extensive experience in data integration are required for this critical role.

Qualifications

• 7+ years of experience in data integration and ETL/ELT pipelines.
• Strong understanding of API integration and data synchronization.
• Proficiency in SQL databases and cloud-based data warehousing.

Responsibilities

• Design and manage scalable data integration pipelines using specific tools.
• Implement data quality checks and ensure governance policies are followed.
• Collaborate with teams to integrate API services into the data architecture.

Skills

Data integration

API integration

Change Data Capture (CDC)

Batch processing

Delta processing

Problem-solving

Tools

Dell Boomi

Matillion

Fivetran

Snowflake

DBT

Job description

Senior Data Integration Engineer Remote Remote

Job ID: 19560

Senior Data Integration Engineer who will report directly to the Data Integration and Data Warehouse Manager and play a critical role in building and optimizing the firm’s data integration pipelines. The ideal candidate will have deep hands-on expertise in designing, building, and managing complex data integration workflows, with a strong focus on tools like Dell Boomi, Matillion, and other modern data integration platforms. The role requires expertise in API integration, Change Data Capture (CDC), batch processing, delta processing, and experience working within enterprise bus architectures to ensure seamless data flow across systems. The Senior Data Integration Engineer will manage the end-to-end integration process, ensuring data is accurately and efficiently moved between source systems, data warehouses, and business intelligence platforms while maintaining data quality, consistency, and timeliness.

Responsibilities:
• Data Integration Pipeline Development: o Design, build, and manage scalable and reliable data integration pipelines using tools like Dell Boomi, Matillion, and Fivetran. o Implement and optimize ETL/ELT workflows to ensure efficient data movement between internal and external systems. o Develop real-time and batch integration processes that meet business requirements while ensuring data accuracy and timeliness.
• API and Enterprise System Integration: o Implement and maintain API-based integrations between various data sources and systems, including Salesforce, Workday, and Aderant. o Ensure seamless two-way data synchronization between SQL databases and external APIs. o Work closely with cross-functional teams to integrate API services into the firm’s data architecture.
• Change Data Capture (CDC) & Delta Processing: o Implement and manage Change Data Capture (CDC) mechanisms across various databases (e.g., SQL, cloud databases) to track and propagate changes in real-time. o Develop and implement batch and delta processing strategies to optimize data flow, minimize latency, and ensure timely updates. o Ensure accurate and consistent data capture for historical data tracking and auditing purposes.
• Data Quality and Governance: o Ensure high data quality across all integration processes, performing regular checks and validations to detect and correct any inconsistencies. o Collaborate with the data warehouse and analytics teams to ensure data governance policies are followed, with a focus on security and compliance.
• Enterprise Bus Architecture: o Contribute to designing and implementing the firm’s Enterprise Bus Architecture, ensuring smooth data exchange between various internal and external systems. o Build and manage processes to propagate real-time changes from SQL tables and other systems to the enterprise bus. o Ensure the enterprise bus efficiently handles data flows and event-driven processing across the firm’s data ecosystem.
• Performance Optimization: o Continuously monitor and improve the performance of data integration pipelines to ensure optimal throughput and latency. o Identify bottlenecks and inefficiencies in existing processes and propose solutions to improve data flow and processing time.
• Collaboration and Communication: o Work closely with the data warehouse and analytics teams to ensure the data integration pipelines meet business needs and reporting requirements. o Collaborate with external vendors and stakeholders to maintain integrations with third-party tools and systems (e.g., Aderant, Intapp, Workday). o Provide technical documentation and training to other team members to ensure data integration systems’ successful operation and maintenance.

Required Skills & Experience:
• 7+ years of hands-on experience in data integration and ETL/ELT pipelines.
• Deep experience with data integration platforms, particularly: o Dell Boomi o Matillion o Fivetran o DBT (or similar tools)
• Strong understanding of API integration and building real-time data synchronization between systems.
• Proven expertise in Change Data Capture (CDC), batch processing, delta processing, and incremental data loading strategies.
• Experience with enterprise bus architecture for managing real-time data flow and event-driven integrations.
• Hands-on experience with SQL databases and cloud-based data warehousing platforms (e.g., Snowflake).
• Proficiency in building data pipelines for systems like Salesforce, Workday, Aderant, and other cloud-based or enterprise applications.
• Strong problem-solving skills and the ability to troubleshoot complex data integration challenges.
• Excellent written and verbal communication skills to work effectively with both technical and non-technical stakeholders.

Preferred Qualifications:
• Experience with legal domain systems such as Aderant, Intapp Time, Workday, and Compulaw. • Familiarity with cloud platforms (AWS, Azure, or Google Cloud).
• Understanding of data governance and data security practices within the legal industry.
• Knowledge of data visualization tools (e.g., Tableau, Power BI) and how integrated data supports business reporting and analytics.
• Experience working within a regulated industry or compliance-heavy environment.

Tagged as: Senior Data Integration Engineer