Sr. Data Engineer (ADF / SQL / Databricks)

Conquest Tech Solutions Inc; Minnesota; Hybrid; USD 130,000 - 170,000; Full time

Job summary

Conquest Tech Solutions Inc is seeking a Senior Data Engineer with deep expertise in SQL Server, Azure SQL and Databricks to design, optimize, and deliver scalable cloud-based data solutions.

Role emphasizes database development, data modelling, and collaboration with data engineers and BI teams in Eden Prairie, MN within a hybrid work model (3 days in office). 8+ years experience required with leadership responsibilities and production support.

Qualifications

• 10+ years of experience as a Database Developer or similar role.
• Strong expertise in SQL Server and Azure SQL.
• Advanced proficiency in T-SQL, including performance tuning and query optimization.
• Hands-on experience with Databricks and Apache Spark.
• Solid understanding of data warehousing concepts, dimensional modelling, and SCD.
• Experience working in Azure cloud environments.
• Strong analytical, problem-solving, and communication skills.

Responsibilities

• Design, develop, and maintain complex SQL Server and Azure SQL databases.
• Write and optimize advanced T-SQL queries, stored procedures, functions, and views.
• Perform query tuning, indexing strategies, and performance optimization for large-scale datasets.
• Implement best practices for database security, data integrity, and reliability.
• Develop and manage data solutions in Azure SQL Database.
• Work with Databricks (Apache Spark) to support data transformations and large-scale data processing.
• Integrate Azure SQL with Databricks using Delta Lake, Spark SQL, and PySpark/SQL where applicable.
• Support cloud-based data architectures and hybrid data environments.
• Data Modelling & Warehousing: Design and maintain relational and dimensional data models.
• Implement Slowly Changing Dimensions (SCD) and other data warehousing patterns.
• Support ETL/ELT processes and collaborate with data engineering teams.
• Collaboration & Leadership: Partner with application developers, data engineers, BI teams, and stakeholders to understand data requirements.
• Provide guidance and mentoring to junior developers.
• Participate in code reviews and enforce database development standards.
• Troubleshoot production issues and provide root cause analysis.

Skills

Data Engineering

SQL

Spark

PySpark

ADF

Databricks

Tools

Azure SQL

SQL Server

Job description

Role : Sr. Data Engineer (Databricks / SQL / ADF)

Location : Eden Prairie, MN (Hybrid 3 days' Work from Office)

Client Interview in-person in Eden Prairie, MN.

Experience: 8+ Years

Skills : Data Engineering, SQL, Spark, PySpark, ADF, Databricks

Seeking a Senior Data Engineer with deep expertise in SQL Server, Azure SQL, and Databricks to design, optimize, and deliver scalable cloud-based data solutions supporting analytics and enterprise data platforms

Roles and Responsibilities

Database Development & Optimization: Design, develop, and maintain complex SQL Server and Azure SQL databases.

Write and optimize advanced T-SQL queries, stored procedures, functions, and views.

Perform query tuning, indexing strategies, and performance optimization for large-scale datasets.

Implement best practices for database security, data integrity, and reliability.

Cloud & Data Platform: Develop and manage data solutions in Azure SQL Database.

Work with Databricks (Apache Spark) to support data transformations, analytics, and largescale data processing.

Integrate Azure SQL with Databricks using Delta Lake, Spark SQL, and PySpark/SQL where applicable.

Support cloud-based data architectures and hybrid data environments.

Data Modelling & Warehousing: Design and maintain relational and dimensional data models.

Implement Slowly Changing Dimensions (SCD) and other data warehousing patterns.

Support ETL/ELT processes and collaborate with data engineering teams.

Collaboration & Leadership: Partner with application developers, data engineers, BI teams, and stakeholders to understand data requirements.

Provide guidance and mentoring to junior developers.

Participate in code reviews and enforce database development standards.

Troubleshoot production issues and provide root cause analysis.

Mandatory skills

10+ years of experience as a Database Developer or similar role.

Strong expertise in SQL Server and Azure SQL.

Advanced proficiency in T-SQL, including performance tuning and query optimization.

Hands-on experience with Databricks and Apache Spark.

Solid understanding of data warehousing concepts, dimensional modelling, and SCD.

Experience working in Azure cloud environments.

Strong analytical, problem-solving, and communication skills.