Senior Data Engineer

Unite Us; New York (NY); Remote; USD 120,000 - 150,000; Full time

Job summary

A leading company is seeking a Senior Data Engineer to enhance data operational efficiency and manage data environments. The role involves leading teams in building solutions for data quality and security while collaborating with various departments. Telecommuting is available anywhere in the U.S.

Qualifications

• In-depth knowledge of data operational efficiency.
• Experience with data management technologies.

Responsibilities

• Lead team in building data management solutions across platforms.
• Develop best practices for controlled production environments.

Skills

Data Quality

Data Security

Agile Workflow

Tools

Apache Avro

Apache Atlas

Job description

Join to apply for the Senior Data Engineer role at Unite Us

Job Description

The Senior Data Engineer will hold in-depth knowledge of data operational efficiency and effective management of data environments – platforms, and tools that will inspire data engineering teams to build solutions to drive data quality and security and effectively manage and monitor the data ecosystem of analytics, data lakes, warehouses, and MDM platforms and tools. Additional responsibilities include:

1. Creating a strong partnership with Product Strategy, Data Engineering, IT, and leadership for Data Management technologies for “well managed” and effective data platform and tools operations;
2. Leading their team in building data management solutions that span all data platforms – MDM, data lake (relational, NoSQL), data warehouse, and data tools (Data Catalog, Schema Management, Data Discovery, and Data Lineage);
3. Leading the adoption of state-of-the-art data management tools like Apache Avro and Apache Atlas for federated data discovery and lineage;
4. Building out new or transforming existing Data Management tools or processes including data quality and governance, central monitoring, data cataloging, and reference data or MDM functions;
5. Developing best practices that support an agile workflow while maintaining a closely controlled production environment so that the source code and data can be audited and traced;
6. Partnering closely across the enterprise to ensure data management and quality are built-in upfront;
7. Being an evangelist across the organization for data quality, security, stable, reliable systems, and engineering excellence.

Additional Details

Telecommuting available anywhere in U.S.