Senior Data Engineer

Inizio Partners Corp; Jersey City (NJ); On-site; USD 85,000 - 115,000; Full time

Job summary

A leading data solutions firm in Jersey City is seeking a talented Data Engineer specializing in Azure services and data modelling. The ideal candidate should have experience in Python, SQL, and database management along with strong communication skills to liaise with clients and stakeholders. This role involves developing data transformation logics and collaborating with data teams to meet business needs.

Qualifications

• Hands-on experience with Azure Services.
• Proficient in Python, Apache Spark, and PySpark.
• Ability to write complex SQL queries.
• Experience in database management and data modelling.

Responsibilities

• Create data transformation logics in Azure Databricks.
• Develop and maintain data models and data warehouses.
• Collaborate with stakeholders to define data models.
• Manage client discussions effectively.

Skills

Azure Services

Python

Apache Spark

PySpark

SQL

Database Management

Data Modelling

ETL Processes

Agile Methodologies

Communication Skills

Tools

Snowflake

PowerBI

Git

Job description

• Hands-on experience with Azure Services: Databricks, Data Factory and DevOps
• Proficient in Python, Apache Spark, and PySpark
• Write advance and complex SQL queries with solid experience in database management
• Develop and maintain data models, data warehouses, and data marts in Snowflake
• Automation, build re-usable transformations, performance tuning
• Streamline ETL complexity- logics and transformations
• Collaborate with data scientists, analysts, and stakeholders to gather requirements and define data models that effectively support business requirements
• Demonstrate decision-making, analytical and problem-solving abilities
• Strong verbal and written communication skills to manage client discussions
• Familiar with working on Agile methodologies - daily scrum, sprint planning, backlog refinement

Key Responsibilities & Skillsets:

• Azure Databricks ability to create data transformation logics
• Strong programming skills in Python and experience with SQL.
• Should be able to write complex SQL, Transact SQL, Stored Procedures
• Experience with Data Modelling
• DWH - Snowflake
• Excellent communication skills and stakeholder management
• Ability to work independently in IC role

Good to have:

• Knowledge on Snowflake platform
• Knowledge on PowerBI
• Familiarity with CI/CD practices and version control (e.g., Git)