Senior Data Engineer/ Architect

ALLTECH CONSULTING SVC INC; New York (NY); On-site; USD 130,000 - 160,000; Full time

Job summary

A leading company is seeking a hands-on technology lead with expertise in data engineering and sales processes. The successful candidate will utilize MDM tools and lead various data management initiatives, collaborating closely with multiple departments to meet client needs in a fast-paced environment.

Qualifications

• 8+ years of experience in data solutions and engineering.
• Experience with ETL/ELT tools like Azure Data Factory.
• Strong oral and written communication skills.

Responsibilities

• Lead setting up and maintaining Semarchy MDM tools.
• Design and develop data ingestion processes and models.
• Implement and optimize ETL/ELT workflows for data accuracy.

Skills

Data Management

Business Focus

Problem Solving

Education

Bachelor's Degree in Computer Science or related field

Tools

Snowflake

SQL

Python

Azure Data Factory

Fivetran

DBT

Job description

Primary Responsibility:

Client is searching for a hands-on business-focused technology lead. The ideal candidate will have functional knowledge in Sales and Marketing processes and core data engineering technologies such as databases, BI, ETL and AI tools. The individual will work closely and partner with global sales enablement, analytics client management, operations, and finance teams to deliver on projects that provide the capabilities defined in the target operating model.

•Setting up Semarchy MDM tools and maintenance. (Mandatory)

•Strong database management skills – Snowflake/SQL/ DBT. (Mandatory)

•Strong cloud infra e.g. ADLS & ADF.

•Expertise in relational and dimensional data modeling.

•Designing and developing efficient data ingestion processes, data models, and data pipelines leveraging the power of Snowflake/ Redshift / Bigquery

•Collaborating extensively with clients to gain a deep understanding of their data requirements and translating them into robust technical solutions.

•Implementing end-to-end ETL/ELT workflows to seamlessly extract, transform, and load data into Snowflake/ Redshift / Bigquery

•Optimizing data pipelines to achieve exceptional performance, scalability, and reliability.

•Conducting thorough data quality assessments and implementing effective data governance best practices.

•Monitoring and troubleshooting data integration processes to ensure the utmost accuracy and integrity of data.

QUALIFICATIONS AND EXPERIENCE: (Academic, Professional, Experience)

•Excellent oral and written, and problem-solving skills are required.

•Candidate should be comfortable working in a fast-paced environment and can help build APIs, Calculators, on new cutting-edge cloud and big data technologies such as Snowflake, Fivetran, DBT, Python etc.

•Top-notch lead engineering talent with 8+ years of experience building and managing data related solutions preferably in financial industry.

•Experience using ETL/ELT tools and technologies such as Azure Data Factory, SSIS a plus.

•Embrace data platform thinking, design and develop data pipelines keeping security, scale, uptime, and reliability in mind.