Senior Data Engineer - Databricks, SQL & ADF (Hybrid)

Conquest Tech Solutions Inc; Minnesota; Hybrid; USD 130,000 - 170,000; Full time

Job summary

Conquest Tech Solutions Inc is seeking a Senior Data Engineer with deep expertise in SQL Server, Azure SQL and Databricks to design, optimize, and deliver scalable cloud-based data solutions.

Role emphasizes database development, data modelling, and collaboration with data engineers and BI teams in Eden Prairie, MN within a hybrid work model (3 days in office). 8+ years experience required with leadership responsibilities and production support.

Qualifications

• 10+ years of experience as a Database Developer or similar role.
• Strong expertise in SQL Server and Azure SQL.
• Advanced proficiency in T-SQL, including performance tuning and query optimization.
• Hands-on experience with Databricks and Apache Spark.
• Solid understanding of data warehousing concepts, dimensional modelling, and SCD.
• Experience working in Azure cloud environments.
• Strong analytical, problem-solving, and communication skills.

Responsibilities

• Design, develop, and maintain complex SQL Server and Azure SQL databases.
• Write and optimize advanced T-SQL queries, stored procedures, functions, and views.
• Perform query tuning, indexing strategies, and performance optimization for large-scale datasets.
• Implement best practices for database security, data integrity, and reliability.
• Develop and manage data solutions in Azure SQL Database.
• Work with Databricks (Apache Spark) to support data transformations and large-scale data processing.
• Integrate Azure SQL with Databricks using Delta Lake, Spark SQL, and PySpark/SQL where applicable.
• Support cloud-based data architectures and hybrid data environments.
• Data Modelling & Warehousing: Design and maintain relational and dimensional data models.
• Implement Slowly Changing Dimensions (SCD) and other data warehousing patterns.
• Support ETL/ELT processes and collaborate with data engineering teams.
• Collaboration & Leadership: Partner with application developers, data engineers, BI teams, and stakeholders to understand data requirements.
• Provide guidance and mentoring to junior developers.
• Participate in code reviews and enforce database development standards.
• Troubleshoot production issues and provide root cause analysis.

Skills

Data Engineering

SQL

Spark

PySpark

ADF

Databricks

Tools

Azure SQL

SQL Server

Job description

Conquest Tech Solutions Inc is seeking a Senior Data Engineer with deep expertise in SQL Server, Azure SQL and Databricks to design, optimize, and deliver scalable cloud-based data solutions.

Role emphasizes database development, data modelling, and collaboration with data engineers and BI teams in Eden Prairie, MN within a hybrid work model (3 days in office). 8+ years experience required with leadership responsibilities and production support.