Lead Data Engineer

Jobot; Houston (TX); Remote; USD 150,000 - 190,000; Full time

Job summary

Jobot is seeking a Lead Data Engineer to join a dynamic team in the financial services industry. This remote role offers a competitive salary of up to $190K and involves leading the design of data pipelines, collaborating on data solutions, and fostering innovation in data engineering. Ideal candidates will have strong experience in SQL, Python, and cloud platforms, and a passion for solving complex data challenges.

Qualifications

• 5+ years of experience in data engineering roles.
• Strong background in relational databases and cloud-native solutions.
• Expertise in Python for data engineering tasks.

Responsibilities

• Lead the design and implementation of end-to-end data pipelines.
• Oversee the development of robust data architectures.
• Collaborate with data scientists and stakeholders to develop data solutions.

Skills

Data pipeline design

SQL

Python

Cloud platforms

Data modeling

Tools

Apache Airflow

Docker

Snowflake

Azure

Job description

This range is provided by Jobot. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$150,000.00/yr - $190,000.00/yr

Want to learn more about this role and Jobot? Click our Jobot logo and follow our LinkedIn page!

Job details

Remote - Lead Data Engineer - up to $190K base - join a team building systems to make data driven business decisions

This Jobot Job is hosted by Chuck Wirtz

Are you a fit? Easy Apply now by clicking the "Easy Apply" button and sending us your resume.

Salary $150,000 - $190,000 per year

A Bit About Us

Our client, in the financial services industry, is seeking a Lead Data Engineer to join their team. This is a full-time, direct hire, remote role that can pay $150-190K base salary plus benefits, depending on experience.



Why join us?


This role is ideal for someone who thrives in a dynamic, fast-paced environment, enjoys solving complex data problems, and is passionate about driving innovation in data engineering. If you're looking to make an impact on the financial landscape with cutting-edge data solutions this could be for you!

Job Details

Core Responsibilities

• Lead the design and implementation of end-to-end data pipelines, from extraction (API, scraping, pyodbc) to cleansing/transformation (Python, TSQL) and loading into SQL databases or data lakes.
• Oversee the development of robust data architectures that support efficient querying and analytics, ensuring high-performance and scalable data workflows.
• Collaborate with data scientists, software developers, business intelligence teams, and stakeholders to develop and deploy data solutions that meet business needs.
• Ensure smooth coordination between engineering and other teams to translate business requirements into technical solutions.
• Guide the development of data models and business schemas, ensuring that they are optimized for both relational (3NF) and dimensional (Kimball) architectures.
• Lead the creation of scalable, reliable data models and optimize them for performance and usability.
• Develop and maintain the infrastructure for large-scale data solutions, leveraging cloud platforms (e.g., Azure) and containerization technologies (e.g., Docker).
• Lead the use of modern data platforms such as Snowflake and Fabric, ensuring their effective use in large-scale data solutions.
• Manage and optimize data pipelines using tools such as Apache Airflow, Prefect, DBT, and SSIS, ensuring that all stages of the pipeline (ETL) are efficient, scalable, and reliable.
• Ensure robust testing, monitoring, and validation of all data systems and pipelines.
• Drive continuous improvement in data engineering processes and practices, ensuring they remain cutting-edge, efficient, and aligned with industry best practices.
• Foster a culture of clean code, best practices, and rigorous testing across the team.
• Strong experience with data pipeline design and implementation, including data extraction, transformation, and loading (ETL) processes.
• Proficiency in SQL (Postgres, SQL Server) and experience with modern data warehouse solutions (e.g., Snowflake, Fabric).
• Expertise in Python for data engineering tasks, including data manipulation (Pandas, NumPy) and workflow management (Dask, PySpark, FastAPI).
• Solid knowledge of cloud platforms (Azure, AWS) and big data technologies (Hadoop, Spark).
• Hands-on experience with Docker, Kubernetes, and containerized environments.
• Strong understanding of dimensional modeling (Kimball), relational database design (3NF), and best practices in data architecture.
• Experience with API development, including building and managing API integrations.
• Proficiency with orchestration tools like Prefect or Airflow for workflow management.
• Strong focus on testing and validation, ensuring that all data systems meet reliability and performance standards.
  
  

Experience & Qualifications

• 5+ years of experience in data engineering roles, with a proven track record of developing and maintaining data pipelines and architectures.
• Experience working with large-scale data platforms and cloud environments.
• Strong background in relational databases, dimensional data modeling, and cloud-native solutions.
• Familiarity with data engineering tools such as Apache Airflow, Prefect, and cloud storage platforms.
• Excellent problem-solving skills, with the ability to navigate complex technical challenges.
  
  

Interested in hearing more? Easy Apply now by clicking the "Easy Apply" button.

Jobot is an Equal Opportunity Employer. We provide an inclusive work environment that celebrates diversity and all qualified candidates receive consideration for employment without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

Sometimes Jobot is required to perform background checks with your authorization. Jobot will consider qualified candidates with criminal histories in a manner consistent with any applicable federal, state, or local law regarding criminal backgrounds, including but not limited to the Los Angeles Fair Chance Initiative for Hiring and the San Francisco Fair Chance Ordinance.

Want to learn more about this role and Jobot?

Click our Jobot logo and follow our LinkedIn page!

Seniority level

• Seniority level

  Not Applicable

Employment type

• Employment type

  Full-time

Job function

• Job function

  Information Technology

• Industries

  IT Services and IT Consulting and Software Development

Referrals increase your chances of interviewing at Jobot by 2x

Get notified about new Data Engineer jobs in Houston, TX.

Full Stack Data Engineer (Python / Streamlit / Snowflake)

Python and Kubernetes Software Engineer - Data, AI/ML & Analytics

Senior Staff Data Engineer - AI Solutions

Houston, TX $80,000.00-$96,750.00 3 days ago

Houston, TX $82,320.00-$172,200.00 2 weeks ago

Software Engineer II (Merchant Risk Intelligence & Platform)

Senior Software Engineer, Backend (ML Platform)

Staff Software Engineer (Batch Infrastructure)

Senior Software Engineer (Identity Decisioning)

Houston, TX $150,000.00-$250,000.00 2 weeks ago

Senior Software Engineer - SRE, Backend (Reliability Engineering)

Houston, TX $180,000.00-$220,000.00 1 week ago

Senior Software Engineer- Observability and Reliability Platform Engineering (REMOTE)

Staff Software Engineer - SRE, Backend (Reliability Engineering)

Analyst, Data Warehouse (Architecture) - Information Technology (IT)

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.