Sr Data Engineer (Azure Data Factory , Azure Databricks, Python and T-SQL.)

CloudIngest; Irving (TX); On-site; USD 75,768; Full time

Job summary

A data engineering firm is seeking a Senior Data Engineer to implement complex data platforms using Azure Data Factory and Azure Databricks. The ideal candidate will have at least 10 years of experience in data architecture, a strong command of Python and T-SQL, and a proven ability to manage large-scale data management projects. This position offers a W2 rate of $55 with H1B sponsorship. Candidates must possess excellent problem-solving and communication skills.

Qualifications

• 10 years of implementation knowledge of large complex Data platforms.
• At least three years of experience in designing and engineering Data platforms.
• Expertise in implementing large scale end-to-end Data management.

Responsibilities

• Design and architect data platforms based on entity models.
• Ensure data quality and implement data profiling processes.
• Develop ETL processes and manage data ingestion and cleansing.

Skills

Data Architecture

Data Strategy

ETL processes

Data Quality

Python

T-SQL

Problem-solving

Communication

Tools

Azure Data Factory

Azure Databricks

Azure SQL

Cosmos DB

Job description

Sr Data Engineer (Azure Data Factory , Azure Databricks, Data Architecture, Python and T-SQL.)

Location: Hamilton township NJ

Employment type: Contract

Seniority level: Associate

W2 Rate: $55 on W2 no benefits we will sponsor H1B

Job Description:

• 10 years of implementation knowledge of large complex Data platforms.
• At least three years of professional experience in designing and engineering/architecting Data platform (Entity based).
• Expertise in Data Architecture, Data Strategy and implemented large scale end-to-end Data management.
• Expertise in Data Quality, Data profiling.
• Deep understanding of ETL, data ingestion/cleansing and engineering skill
• Strong problem solving, influencing, communication and presentation skill
• Technical experience and knowledge, with depth / Subject Matter Expertise in Microsoft Data Platform Cloud solutions
• Data Engineering including Azure Data Factory and Azure Databricks with experience with Python and T-SQL.
• Relational Databases including Azure SQL, NoSQL Databases including Cosmos DB