Data Engineer

WIS International; Plano (TX); Hybrid; USD 120,000 - 160,000; Full time

Job summary

WIS International is seeking a Senior Data Engineer to design, build, and maintain scalable SQL Server databases in Azure, with emphasis on T-SQL performance and data integration. The role focuses on creating robust data pipelines supporting critical runtime applications and analytics.

You will collaborate with cross-functional teams to ensure data availability, reliability, and low-latency data access, while applying DevOps practices and governance across cloud platforms.

Qualifications

• 5+ years of experience in data engineering or related field.
• Bachelor’s in Computer Science, Information Systems, or related field.
• Strong proficiency in T-SQL and query optimization.
• Experience with Azure Data Factory, Logic Apps, and Azure Functions.
• Familiarity with DevOps practices and tools (e.g., Azure DevOps, Git).
• Expertise in SQL and experience with relational and NoSQL databases.
• Strong experience with big data technologies (e.g., Hadoop, Spark, Flink) and cloud platforms (AWS, GCP, Azure).
• Familiarity with data orchestration tools (Airflow, Dagster) and data modeling techniques.
• Knowledge of data streaming technologies (Kafka, Azure Event Hubs) and real-time processing.

Responsibilities

• Design, develop, and optimize complex T-SQL queries, stored procedures, views, and functions.
• Design, develop, and optimize robust, scalable data pipelines to process structured and unstructured data at scale.
• Optimize data systems for performance, cost-efficiency, and scalability for low-latency analytics.
• Troubleshoot database performance and availability issues.
• Ensure data security, integrity, and compliance with standards.
• Collaborate with software engineers, project managers, and stakeholders to deliver low-latency, highly available data solutions.
• Implement data validation, monitoring, and governance frameworks.
• Leverage tooling (Spark, Kafka, Airflow, or equivalents) to automate workflows.
• Provide technical guidance and mentorship to junior data engineers.

Skills

T-SQL

Azure SQL Database

Data pipeline design

SQL performance tuning

DevOps practices

Big data technologies

Data orchestration

Data streaming

Education

Bachelor's in Computer Science or related field

Tools

Azure Data Factory

Azure Functions

Azure DevOps

Git

Apache Spark

Kafka

Airflow

Dagster

Job description

Data Engineer

Full Time - Office Hybrid - Plano, TX Location

Position Overview

We are seeking a highly skilled Senior Data Engineer to join our team; In this role, you will design, develop, and maintain robust and scalable SQL Server databases in Azure. The ideal candidate will have deep expertise in T-SQL, Azure SQL Database, performance tuning, and data integration, with a strong understanding of cloud-based data architecture and DevOps practices. Additionally, you will need to design, build, and maintain scalable data pipelines and infrastructure to support mission-critical runtime applications, including data ingest, consumption, and ETL. You will collaborate with cross-functional teams to ensure data availability, reliability, and performance, driving insights that power critical business operations.

Essential Responsibilities

• Expertise in T-SQL: Design, develop, and optimize complex T-SQL queries, stored procedures, views, and functions.
• Data Pipeline Development: Design, develop, and optimize robust, scalable, and fault-tolerant data pipelines to process structured and unstructured data at scale.
• Performance Optimization: Optimize data systems for performance, cost-efficiency, and scalability, ensuring low-latency access to data for analytics and applications.
• Diagnostics: Troubleshoot database performance and availability issues.
• Compliance: Ensure data security, integrity, and compliance with organizational and regulatory standards.
• Collaboration: Partner with software engineers, project managers, and other stakeholders to understand data needs and deliver solutions that enable low-latency, high availability, eventually consistent consumption patterns.
• Data Quality: Implement data validation, monitoring, and governance frameworks to ensure data accuracy, consistency, and compliance with privacy and security standards.
• Tooling and Automation: Leverage modern tools and frameworks (e.g., Apache Spark, Kafka, Airflow, or equivalent) to automate data workflows and improve operational efficiency.
• Mentorship: Provide technical guidance and mentorship to junior data engineers, fostering a culture of innovation and continuous improvement.

Preferred Qualifications & Skills

• Experience: 5+ years of experience in data engineering or a related field, with a proven track record of building large-scale data systems.
• Bachelor’s in Computer Science, Information Systems, or related field.
• Technical Skills:
  • Strong proficiency in T-SQL and query optimization.
  • Experience with Azure Data Factory, Logic Apps, and Azure Functions.
  • Familiarity with DevOps practices and tools (e.g., Azure DevOps, Git).
  • Expertise in SQL and experience with relational and NoSQL databases (e.g., MSSQL Server, PostgreSQL, MongoDB, Cassandra).
  • Strong experience with big data technologies (e.g., Hadoop, Spark, Flink) and cloud platforms (e.g., AWS, GCP, Azure).
  • Familiarity with data orchestration tools (e.g., Airflow, Dagster) and data modeling techniques.
  • Knowledge of data streaming technologies (e.g., Kafka, Azure Event Hubs) and real-time processing.
• Problem-Solving: Strong analytical and problem-solving skills, with the ability to tackle complex data challenges and deliver efficient solutions.
• Collaboration: Excellent communication and teamwork skills, with experience working in cross-functional environments.

Preferred Qualifications

• Experience with machine learning pipelines or MLOps frameworks.
• Microsoft Certified: Azure Data Engineer Associate or similar certification.
• Experience with tableau, Power BI, Synapse Analytics, or Databricks.
• Knowledge of Python or C# for data-related scripting.
• Experience in Agile/Scrum environments.
• Familiarity with data governance, compliance, and privacy regulations (e.g., SOC, NIST, GDPR, CCPA).
• Contributions to open-source data projects or relevant certifications.

Working Conditions

Work is primarily sedentary: must be able to sit for extended periods of time and use a computer, keyboard, and mouse, frequently.

Please note that this Job Description is not designed to cover or contain a comprehensive listing of activities, duties, or responsibilities that are required of the employee for this job. Duties, responsibilities, and activities may change at any time with or without notice.

For more information on WIS, visit our website at www.wisusa.com

WIS is an Equal Opportunity Employer, committed to a diverse and inclusive work environment.

Salary Starting at