Data Engineer II

Lewis Energy Group; San Antonio (TX); On-site; USD 100,000 - 140,000; Full time

Benefits offered by this job

Medical/Dental/Vision

401K with match

Annual Bonus

Paid Time Off

Employee Assistance Program

Wellness programs

Job summary

Lewis Energy Group seeks a Data Engineer II to design and maintain its data platform on Microsoft Fabric, building pipelines with Data Factory, Dataflows Gen2, and PySpark notebooks. You will optimize T-SQL, develop semantic models for Power BI, and support migration from on-prem SQL Server environments.

You will collaborate with business users and stakeholders to deliver reliable data for reporting and decision making, while upholding data governance and deployment discipline.

Qualifications

• Bachelor's degree from a four-year college or university with at least two years of related experience.
• Strong T-SQL skills for complex joins, transformations, and performance tuning.
• Hands-on experience building integrations across databases, APIs, or file sources with version control.
• Ability to translate business requirements into documented data models and dashboards.

Responsibilities

• Design, build, and maintain data pipelines in Microsoft Fabric using Data Factory and Gen2 notebooks.
• Develop transforms in Python/PySpark and optimize data models for Power BI reporting.
• Migrate on-premises SQL Server ETL/ELT to Fabric-native pipelines and PySpark notebooks.
• Ensure data quality, governance, and staging with source control and deployment workflows.

Skills

Python

PySpark

T-SQL

Data Modeling

Data Pipelines

Education

Bachelor's degree in a related field

Tools

Microsoft Fabric

Azure Data Factory

Power BI

Delta Lake

Git/Azure DevOps

Job description

About Us

At Lewis Energy Group, we are a vertically integrated exploration and production (E&P) company and a leading natural gas producer in South Texas and across the nation. With operations in South Texas and Mexico, we take pride in our long-standing commitment to excellence, innovation, and community engagement.

WE ARE HIRING!

Data Engineer II

About Us

At Lewis Energy Group, we are a vertically integrated exploration and production (E&P) company and a leading natural gas producer in South Texas and across the nation. With operations in South Texas and Mexico, we take pride in our long-standing commitment to excellence, innovation, and community engagement.

What sets us apart is our family-oriented work culture, built over decades of dedication and teamwork. This culture drives the passion we bring to our work and the positive impact we strive to make in the communities where we operate.

The Data Engineer II will be responsible for designing, building, and maintaining the organization’s data platform on Microsoft Fabric. This includes developing data pipelines using Data Factory, Dataflows Gen2, and PySpark notebooks; writing and optimizing T-SQL. Assists with the migration of on-premises SQL Server databases and ETL/ELT processes to Fabric. Build semantic models that support Power BI reporting, ensuring data quality and governance, and managing changes through source control and deployment pipelines. Works closely with business users and stakeholders, communicating technical information in a clear and accessible way.

Data Pipeline Development

• Design, build, and maintain data pielines in Microsoft Fabric using Data Factory pipelines, Dataflows Gen2, and notebooks to move data from source systems into Lakehouses and Warehouses.
• Develop data transformation and processing logic in Python and Pyspark within Fabric notebooks, including working with Delta tables and handling large or complex datasets.
• Develop and optimize T-SQL code, including stored procedures, views, and transformation logic, to support data processing and reporting needs.
• Apply data modeling best practice, such as medallion architecture and star schema design, to organize data in OneLake for performance and ease of use.
• Monitor pipeline runs, troubleshoot failures, and put alerting and error handling in place so that data is delivered on time and accurately.

SQL Server to Fabric Migration

• Assess existing on-premises SQL Server databases, SSIS packages, and scheduled jobs to plan their migration to Microsoft Fabric.
• Rebuild or refactor legacy ETL processes as Fabric-native pipelines and PySpark notebooks, improving performance and maintainability.
• Coordinate with the team and stakeholders on migration timelines to minimize disruption to reporting and operations.

Semantic Model Support

• Build and maintain semantic models that serve as the foundation for PowerBI reports, including relationships, measures, ontology, and Direct Lake or Import configurations.
• Partner with report developers and business users to understand reporting requirements and turn them into well-structured datasets.
• Tune data models and queries to improve report performance and refresh reliability.
• Communicate technical concepts, data limitations, and project status clearly to non-technical stakeholders, helping them understand and make effective use of available data.

Data Quality, Governance, and Operations

• Implement data quality checks and validation rules to catch issues before they reach end users.
• Manage workspace organization, access permissions, and security settings in Fabric in line with company data governance standards.
• Use source control (Azure DevOps/Git) and deployment pipelines to manage changes across development, test, and production environments.
• Create and maintain clear documentation of data sources, pipelines, models, dictionaries, and business logic.

Education and Experience

Bachelor's degree from a four-year college or university; minimum two years of related experience and/or training; or an equivalent combination of education and experience.

Work Location

Onsite - Candidates must be able to work full-time from our San Antonio office.

Required Technical Skills

• Demonstrated ability to design relational and dimensional data models, including fact and dimension tables, keys, relationships, referential integrity, and historical changes.
• Strong T-SQL skills for complex joins, transformations, query tuning, and troubleshooting.
• Hands-on experience building and supporting integrations across databases, APIs, or file-based sources, including scheduling, incremental processing, and recovery.
• Ability to validate data completeness and accuracy, reconcile source and target results, and investigate duplicates and broken relationships.
• Experience using Python or a comparable scripting language for data processing or automation, and version control for maintainable development.
• Ability to translate business requirements into documented models and explain technical decisions clearly; willingness to learn unfamiliar platforms.

Preferred Experience (Preferred)

• Power BI semantic models, Power Query, DAX, or comparable business intelligence tools.
• Microsoft SQL Server, SSIS, SSAS, or comparable database and integration technologies.
• Microsoft Fabric, Azure Data Factory, Azure Data Lake Storage, Azure SQL, Synapse Analytics, Databricks, or Azure DevOps.
• Oil and gas production data, SCADA, telemetry, time-series data, IoT or Streaming data.

Your Benefits

• Insurance Medical/Dental/Vision/ Basic Life and AD&D/and other benefit options to meet your personal needs
• Retirement 401K with immediate matching contribution
• Annual Discretionary Bonus
• Generous Paid Time Off and Paid Holidays
• Employee Assistance Program (EAP) - Free, confidential support for you and your dependents
• Wellness & Company Events throughout the year

Equal Opportunity Employer

Lewis Energy Group is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, age, sexual orientation, gender identity, national origin, citizenship status, protected veteran status, genetic information, or physical or mental disability.