Lead Data Engineer

Jobot; Grand Prairie (TX); Remote; USD 150,000 - 190,000; Full time

Job summary

Join a forward-thinking company as a Lead Data Engineer, where you'll spearhead the design and implementation of cutting-edge data pipelines. This remote role is perfect for those who thrive in dynamic environments and are passionate about solving complex data challenges. You will collaborate with diverse teams to create innovative data solutions that drive business decisions in the financial services sector. With a competitive salary and a focus on continuous improvement, this position offers the chance to make a significant impact in the data engineering landscape. If you're ready to elevate your career and contribute to transformative projects, this opportunity is for you.

Qualifications

• 5+ years of experience in data engineering roles with a strong track record.
• Expertise in designing and implementing ETL processes and data pipelines.
• Proficient in SQL and Python for data manipulation and workflow management.

Responsibilities

• Lead the design and implementation of end-to-end data pipelines.
• Collaborate with teams to develop and deploy data solutions.
• Ensure robust testing, monitoring, and validation of data systems.

Skills

Data Pipeline Design

Python

SQL

Cloud Platforms (Azure, AWS)

Data Architecture

ETL Processes

API Development

Dimensional Modeling

Containerization (Docker, Kubernetes)

Data Validation

Education

Bachelor's Degree in Computer Science or related field

Master's Degree (preferred)

Tools

Apache Airflow

Snowflake

Fabric

Docker

Kubernetes

Job description

Get AI-powered advice on this job and more exclusive features.

This range is provided by Jobot. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$150,000.00/yr - $190,000.00/yr

Want to learn more about this role and Jobot? Click our Jobot logo and follow our LinkedIn page!

Job details

Remote - Lead Data Engineer - up to $190K base - join a team building systems to make data driven business decisions

This Jobot Job is hosted by Chuck Wirtz

Are you a fit? Easy Apply now by clicking the "Easy Apply" button and sending us your resume.

Salary $150,000 - $190,000 per year

A Bit About Us

Our client, in the financial services industry, is seeking a Lead Data Engineer to join their team. This is a full-time, direct hire, remote role that can pay $150-190K base salary plus benefits, depending on experience.



Why join us?


This role is ideal for someone who thrives in a dynamic, fast-paced environment, enjoys solving complex data problems, and is passionate about driving innovation in data engineering. If you're looking to make an impact on the financial landscape with cutting-edge data solutions this could be for you!

Job Details

Core Responsibilities

• Lead the design and implementation of end-to-end data pipelines, from extraction (API, scraping, pyodbc) to cleansing/transformation (Python, TSQL) and loading into SQL databases or data lakes.
• Oversee the development of robust data architectures that support efficient querying and analytics, ensuring high-performance and scalable data workflows.
• Collaborate with data scientists, software developers, business intelligence teams, and stakeholders to develop and deploy data solutions that meet business needs.
• Ensure smooth coordination between engineering and other teams to translate business requirements into technical solutions.
• Guide the development of data models and business schemas, ensuring that they are optimized for both relational (3NF) and dimensional (Kimball) architectures.
• Lead the creation of scalable, reliable data models and optimize them for performance and usability.
• Develop and maintain the infrastructure for large-scale data solutions, leveraging cloud platforms (e.g., Azure) and containerization technologies (e.g., Docker).
• Lead the use of modern data platforms such as Snowflake and Fabric, ensuring their effective use in large-scale data solutions.
• Manage and optimize data pipelines using tools such as Apache Airflow, Prefect, DBT, and SSIS, ensuring that all stages of the pipeline (ETL) are efficient, scalable, and reliable.
• Ensure robust testing, monitoring, and validation of all data systems and pipelines.
• Drive continuous improvement in data engineering processes and practices, ensuring they remain cutting-edge, efficient, and aligned with industry best practices.
• Foster a culture of clean code, best practices, and rigorous testing across the team.
• Strong experience with data pipeline design and implementation, including data extraction, transformation, and loading (ETL) processes.
• Proficiency in SQL (Postgres, SQL Server) and experience with modern data warehouse solutions (e.g., Snowflake, Fabric).
• Expertise in Python for data engineering tasks, including data manipulation (Pandas, NumPy) and workflow management (Dask, PySpark, FastAPI).
• Solid knowledge of cloud platforms (Azure, AWS) and big data technologies (Hadoop, Spark).
• Hands-on experience with Docker, Kubernetes, and containerized environments.
• Strong understanding of dimensional modeling (Kimball), relational database design (3NF), and best practices in data architecture.
• Experience with API development, including building and managing API integrations.
• Proficiency with orchestration tools like Prefect or Airflow for workflow management.
• Strong focus on testing and validation, ensuring that all data systems meet reliability and performance standards.
  
  

Experience & Qualifications

• 5+ years of experience in data engineering roles, with a proven track record of developing and maintaining data pipelines and architectures.
• Experience working with large-scale data platforms and cloud environments.
• Strong background in relational databases, dimensional data modeling, and cloud-native solutions.
• Familiarity with data engineering tools such as Apache Airflow, Prefect, and cloud storage platforms.
• Excellent problem-solving skills, with the ability to navigate complex technical challenges.
  
  

Interested in hearing more? Easy Apply now by clicking the "Easy Apply" button.

Jobot is an Equal Opportunity Employer. We provide an inclusive work environment that celebrates diversity and all qualified candidates receive consideration for employment without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

Sometimes Jobot is required to perform background checks with your authorization. Jobot will consider qualified candidates with criminal histories in a manner consistent with any applicable federal, state, or local law regarding criminal backgrounds, including but not limited to the Los Angeles Fair Chance Initiative for Hiring and the San Francisco Fair Chance Ordinance.

Want to learn more about this role and Jobot?

Click our Jobot logo and follow our LinkedIn page!

Seniority level

• Seniority level

  Not Applicable

Employment type

• Employment type

  Full-time

Job function

• Job function

  Information Technology

• Industries

  IT Services and IT Consulting and Software Development

Referrals increase your chances of interviewing at Jobot by 2x

Get notified about new Data Engineer jobs in Grand Prairie, TX.

Engineer 2 -Data and Analytics ( MicroStrategy)

Dallas, TX $185,000.00-$200,000.00 7 months ago

Irving, TX $120,000.00-$140,000.00 6 days ago

Python and Kubernetes Software Engineer - Data, AI/ML & Analytics

Dallas, TX $150,000.00-$200,000.00 5 months ago

Grand Prairie, TX $150,000.00-$190,000.00 1 day ago

Dallas, TX $160,000.00-$200,000.00 7 months ago

Dallas-Fort Worth Metroplex $100,000.00-$140,000.00 2 weeks ago

Sr. Software Engineer-BI Solutions - Remote (2022)

Clinical Informatics Analyst (Data Analyst Experience) - REMOTE

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.