Big Data Architect

Precodata; Washington (District of Columbia); On-site; USD 140,000 - 190,000; Full time

Benefits offered by this job

MacBook Pro

Preco Mojo: diverse and easy to work

Preco Courses: learning program

Preco Lunch: weekly team meals

Annual kickoff in Europe

Job summary

Precodata is seeking a Big Data Architect to design platforms enabling data scientists and analysts to gain insights through data-driven services and infrastructures. You will lead data ingestion, processing engagements and stakeholder management, with a strong emphasis on cloud platforms and big data tooling.

You will oversee technical output, drive scalable architectures, and collaborate with business and technical teams to deliver value from large, complex datasets using AWS, Azure, GCP and

Qualifications

• Experience building scalable, end-to-end data pipelines across cloud environments.
• Strong understanding of data governance, privacy, and regulatory requirements.

Responsibilities

• Design and implement data ingestion and processing architectures for diverse data sources.
• Provide technical leadership for data ingestion and processing engagements.
• Collaborate with data scientists, analysts and DevOps to deliver data engineering solutions.
• Ensure scalability, reliability and security of data pipelines across multi-cloud platforms.

Skills

Big data design

Data ingestion

Cloud platforms

Spark / Flink / Hadoop

Python / Java

Stakeholder management

Tools

Hadoop

Spark

Flink

Hive

Casandra

Job description

The purpose of a Big Data Architect is to design solutions, platforms that enable data scientists and analysts to gain insights into data using data-driven services and infrastructures. You will be responsible for the stakeholder management and technical leadership for data ingestion and processing engagements. A good understanding of cloud platforms and prior experience working with big data tooling and frameworks is required.

Demonstrable Working Experience

• A successful history of manipulating, processing and extracting value from large disconnected datasets
• Delivering production scale data engineering solutions leveraging one or more cloud services
• Confidently taking responsibility for the technical output of a project
• Ability to quickly pick up new skills and learn on the job
• Comfortably working with various stakeholders such as data scientists, architects and devop

Technical Skills

• Experience in building scalable end-to-end data ingestion and processing solutions
• Good understanding of data infrastructure and distributed computing principles
• Proficient at implementing data processing workflows using Hadoop and frameworks such as Spark and Flink, Storm along with solutions like Hive, Casandra and RGBD solutions.
• Good understanding of data governance and how regulations can impact data storage and processing solutions such as GDPR and PCI
• Experience with object-oriented and/or functional programming languages, such as Python, Java, Scala, Go and Python.

Your main goal will be to build technical solutions required for optimal ingestion, transformation, and loading of data from a wide variety of data sources using open source, multi cloud solutions (AWS, Azure or GCP, etc.) and big data frameworks and services. Understand and formulate processing pipelines of large, complex data sets that meet functional / non-functional customers business requirements. You will design and create and maintain optimal data pipeline architecture.

You will work alongside with Business Analyst, Data Analyst, Data Scientist and Devops to implement Data Engineering solutions that answers customer’s business needs and collaborating with customer’s data department during workshop sessions to uncover more detailed business requirements related to data engineering. Having the ability to have a micro & macro vision of transversal architecture always related to clients needs.

If your philosophy basis start with Infrastructure As A Code and pursue with Serverless Architecture as first Axiom, what are you waiting for joining us.

Preco Preks

• MacBook Pro, and a smartphone (you will have to choose between a Galaxy or iPhone – make the right choice!).
• Preco Mojo: our people are diverse, passionate and easy to work with.
• Preco Courses: our continuous learning program that will provide training and career development opportunities.
• Preco Lunch : where every Thursday we take over a local restaurant. Enjoy, it’s on us!
• We kick-off every new financial year by getting together in a cool secret location in Europe