Senior Data Engineer, AI/ML Platforms

Baldwin (Baldwin)

United States

Remote

USD 110,000 - 170,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

The Baldwin Group is seeking a Sr Data Engineer in the United States to design and manage data pipelines, tools, and storage systems. You will lead junior engineers, define data models, and drive projects involving large data volumes from diverse sources across platforms.

You will design, build, document, test, and maintain critical pipelines; implement data governance and quality checks; and collaborate with stakeholders to translate business needs into technical solutions.

Qualifications

  • 5-7 years of relevant experience required.
  • BA/BS in relevant discipline is required.
  • Experience with building large, cross-platform data pipelines and multiple development methodologies.
  • Experience with relational databases and SQL scripting.
  • Experience with cloud platforms (AWS/Azure/GCP) and ETL tools/techniques.
  • Programming experience in Python, Spark and similar languages.
  • Understanding of data governance, security and compliance.

Responsibilities

  • Collaborate with data architects, analysts and stakeholders to document needs for data pipelines and automation.
  • Design, develop, test and maintain data pipelines using best practices.
  • Perform ETL/ELT operations in line with governance and security standards.
  • Develop data quality and governance processes to ensure data accuracy and consistency.

Skills

Data pipelines design
ETL/ELT operations
SQL scripting
Python
Spark
Cloud platforms
Data governance
Mentoring
Cross-functional collaboration
Communication

Education

BA/BS in relevant discipline

Tools

SQL Server
Oracle
AWS
Azure
GCP

Job description

The Sr Data Engineer will design and manage data systems, pipelines, and management tools. They will oversee junior data engineers, recommend and deploy data models, and lead projects involving data collection and storage systems. This role will design, build, document, test, and maintain critical data pipelines from large volumes of data from internal and external data sources cross different platforms.

PRIMARY RESPONSIBILITIES
  • Collaborate with data architect, analysts, and stakeholders to identify and document needs/requirements for data pipelines and process automation
  • Design, build, document, test, and maintain data pipelines using industry best practices
  • Performs ETL, ELT operations in accordance with enterprise data governance and security standards
  • Develop data quality and governance process to ensure the accuracy and quality of the data through inspection, validation, processing, anomaly detection
KNOWLEDGE, SKILLS & ABILITIES
  • Detail oriented and proactive in taking measures to avoid or mitigate issues.
  • Excellent understanding of computer systems, integrations, databases, and data storage systems.
  • Understanding of agile data engineering concepts and processes
  • Ability to capture and document business processes and requirements and work with colleagues to create functional requirements.
  • Ability to work with clients to translate business needs to technical solutions
  • Ability to provide guidance, mentoring, and training for peers
  • Exceptional interpersonal skills and ability to effectively communicate with teams across the entire organization.
  • Demonstrates the organization’s core values, exuding behavior that is aligned with the firm’s culture
  • Proficiency in Microsoft Office Suite (Word, Excel, PowerPoint, Outlook)
  • Ability to learn any other appropriate program or software system used by the firm as necessary
EDUCATION & EXPERIENCE
  • 5-7 years of relevant experience required.
  • BA/BS in relevant discipline required.
  • Vast experience with multiple development methodologies.
  • Experience of building large, complicated data pipelines cross different platforms, data sources, data structures.
  • Experience of working with relational databases such as SQL Server, Oracle, etc., and SQL scripting.
  • Experience of cloud platforms (like AWS, Azure, GCP) and its ETL tools and techniques of sourcing, maintaining, and updating data, data warehousing, data cleansing & transformation, etc.
  • Programming experience in Python, Spark, and other similar languages.
  • Advanced programming knowledge and experience with large-scale processing engines are required, as well as a deeper understanding of database security and compliance tools.
IMPORTANT NOTICE

This position description is intended to describe the level of work required of the person performing in the role and is not a contract. The essential responsibilities are outlined; other duties may be assigned as needs arise or as required to support the organization. All requirements may be subject to reasonable accommodation to applicants and colleagues who need them for medical or religious reasons.

The Baldwin Group will not accept unsolicited resumes from any source other than directly from a candidate who applies on our career site. Any unsolicited resumes sent to The Baldwin Group, including unsolicited resumes sent via any source from an Agency, will not be considered and are not subject to any fees for any placement resulting from the receipt of an unsolicited resume.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer, AI/ML Platforms
Senior Data Engineer, AI/ML Platforms

Founder Shield • Tampa (FL), Charlotte (NC), Boston (MA)

Hybrid
USD 120,000 - 170,000
Senior Data Engineer, AI/ML Platforms (Remote)
Senior Data Engineer, AI/ML Platforms (Remote)

The Baldwin Group • United States

Remote
USD 120,000 - 180,000
Remote work
Senior Data Engineer - AI/ML Platform Pipelines
Senior Data Engineer - AI/ML Platform Pipelines

Baldwin (Baldwin) • United States

Remote
USD 110,000 - 170,000
Senior Data Engineer, AI/ML Platforms
Senior Data Engineer, AI/ML Platforms

Baldwin Group Colleague, Inc. • Tampa (FL)

On-site
USD 120,000 - 160,000
null
Senior Data Engineer, AI/ML Platforms
Senior Data Engineer, AI/ML Platforms

The Baldwin Group • United States

Remote
USD 120,000 - 180,000
Remote work
Senior Data Engineer
Senior Data Engineer

Intercontinental Exchange (ICE) • Atlanta (GA)

On-site
USD 150,000 - 190,000
Senior Data Engineer – AI/ML Data Pipelines
Senior Data Engineer – AI/ML Data Pipelines

Baldwin Group Colleague, Inc. • Tampa (FL)

On-site
USD 120,000 - 160,000
null
Senior Data Engineer
Senior Data Engineer

ICE • Atlanta (GA)

On-site
USD 100,000 - 130,000
Senior Data Engineer
Senior Data Engineer

Intercontinental Exchange Holdings, Inc. • Atlanta (GA)

On-site
USD 125,000 - 180,000
Senior Data Engineer
Senior Data Engineer

Insomniac Design • United States

On-site
USD 120,000 - 160,000