Lead Data Engineer

Jobot; Houston (TX); Remote; USD 150,000 - 190,000; Full time

Job summary

An innovative firm is seeking a Lead Data Engineer to join their dynamic team, driving impactful data solutions in the financial services sector. This full-time, remote position offers a competitive salary and the chance to work with cutting-edge technologies. You'll be responsible for designing robust data architectures, implementing efficient data pipelines, and collaborating with cross-functional teams to meet business needs. If you're passionate about data engineering and want to make a difference, this is the perfect opportunity for you.

Qualifications

• 5+ years in data engineering with proven pipeline development.
• Strong skills in SQL and Python for data orchestration.

Responsibilities

• Design and implement end-to-end data pipelines using various tools.
• Collaborate with teams to translate business needs into technical solutions.

Skills

Data Engineering

SQL

Python

Data Modeling

Data Orchestration Tools

Cloud Platforms (Azure, AWS)

Big Data Technologies (Hadoop, Spark)

Tools

Apache Airflow

Docker

Snowflake

DBT

SSIS

Fabric

pyodbc

TSQL

Job description

This job description provides detailed information about the role, responsibilities, qualifications, and benefits. However, it could be improved in terms of formatting and conciseness to enhance readability and focus.

Here's a refined version with improved structure:

Remote - Lead Data Engineer - Up to $190K Base

Join a team building systems to make data-driven business decisions. This full-time, remote role offers a base salary of $150,000 to $190,000 plus benefits, depending on experience. Hosted by Chuck Wirtz at Jobot.

About Us

Our client, in the financial services industry, seeks a Lead Data Engineer to drive innovative data solutions and architecture.

Why Join Us?

Ideal for those who thrive in dynamic environments, enjoy solving complex data challenges, and want to impact the financial landscape with cutting-edge data solutions.

Responsibilities

• Design and implement end-to-end data pipelines (API, scraping, pyodbc, Python, TSQL).
• Develop robust data architectures supporting efficient querying and analytics.
• Collaborate with data scientists, developers, and stakeholders.
• Translate business needs into technical solutions.
• Develop data models and schemas optimized for relational and dimensional architectures.
• Leverage cloud platforms (Azure) and containerization (Docker).
• Utilize data platforms like Snowflake and Fabric.
• Manage data pipelines with tools like Apache Airflow, Prefect, DBT, SSIS.
• Ensure testing, monitoring, and validation of systems.
• Promote best practices and continuous improvement in data engineering.

Qualifications

• 5+ years in data engineering roles with proven pipeline and architecture development.
• Experience with large-scale data platforms and cloud environments.
• Strong relational database and data modeling skills.
• Proficiency in SQL, Python, and data orchestration tools.
• Knowledge of cloud platforms (Azure, AWS) and big data technologies (Hadoop, Spark).

Additional Information

Interested? Apply now! Jobot is an Equal Opportunity Employer. We value diversity and inclusivity. Background checks may be performed.