Big Data Architect

Precodata; Town of Vermont (WI); On-site; USD 120,000 - 170,000; Full time

Benefits offered by this job

MacBook Pro

Smartphone option

Preco Mojo

Preco Courses

Preco Lunch

Annual retreat in Europe

Job summary

Precodata is seeking a Big Data Architect to design platforms enabling data scientists and analysts to gain insights from data using data-driven services and infrastructures. You will lead data ingestion and processing engagements and manage stakeholders, with a strong emphasis on cloud platforms and big data tooling.

You will collaborate with Business Analysts, Data Analysts, Data Scientists and DevOps to implement robust data engineering solutions, focusing on scalable, compliant data

Qualifications

• A successful history of manipulating, processing and extracting value from large disconnected datasets.
• Delivering production scale data engineering solutions leveraging one or more cloud services.
• Confidently taking responsibility for the technical output of a project.
• Ability to quickly pick up new skills and learn on the job.
• Comfortably working with various stakeholders such as data scientists, architects and devop

Responsibilities

• Build technical solutions for ingestion, transformation, and loading of data from diverse sources using open source, multi-cloud solutions (AWS, Azure, GCP) and big data frameworks.
• Design, create and maintain optimal data pipeline architecture.
• Collaborate with Business Analysts, Data Analysts, Data Scientists and DevOps to implement data engineering solutions that meet customer needs.
• Maintain a macro and micro view of transversal architecture aligned with client requirements.

Skills

End-to-end data ingestion

Distributed computing

Hadoop/Spark/Flink

Data governance (GDPR/PCI)

Programming (Python/Java/Scala/Go)

Tools

Hive

Cassandra

Job description

The purpose of a Big Data Architect is to design solutions, platforms that enable data scientists and analysts to gain insights into data using data-driven services and infrastructures. You will be responsible for the stakeholder management and technical leadership for data ingestion and processing engagements. A good understanding of cloud platforms and prior experience working with big data tooling and frameworks is required.

Demonstrable Working Experience

• A successful history of manipulating, processing and extracting value from large disconnected datasets
• Delivering production scale data engineering solutions leveraging one or more cloud services
• Confidently taking responsibility for the technical output of a project
• Ability to quickly pick up new skills and learn on the job
• Comfortably working with various stakeholders such as data scientists, architects and devop

Technical Skills

• Experience in building scalable end-to-end data ingestion and processing solutions
• Good understanding of data infrastructure and distributed computing principles
• Proficient at implementing data processing workflows using Hadoop and frameworks such as Spark and Flink, Storm along with solutions like Hive, Casandra and RGBD solutions.
• Good understanding of data governance and how regulations can impact data storage and processing solutions such as GDPR and PCI
• Experience with object-oriented and/or functional programming languages, such as Python, Java, Scala, Go and Python.

Your main goal will be to build technical solutions required for optimal ingestion, transformation, and loading of data from a wide variety of data sources using open source, multi cloud solutions (AWS, Azure or GCP, etc.) and big data frameworks and services. Understand and formulate processing pipelines of large, complex data sets that meet functional / non-functional customers business requirements. You will design and create and maintain optimal data pipeline architecture.

You will work alongside with Business Analyst, Data Analyst, Data Scientist and Devops to implement Data Engineering solutions that answers customer's business needs and collaborating with customer's data department during workshop sessions to uncover more detailed business requirements related to data engineering. Having the ability to have a micro & macro vision of transversal architecture always related to clients needs.

If your philosophy basis start with Infrastructure As A Code and pursue with Serverless Architecture as first Axiom, what are you waiting for joining us.

Preco Preks

• MacBook Pro, and a smartphone (you will have to choose between a Galaxy or iPhone - make the right choice!).
• Preco Mojo: our people are diverse, passionate and easy to work with.
• Preco Courses: our continuous learning program that will provide training and career development opportunities.
• Preco Lunch : where every Thursday we take over a local restaurant. Enjoy, it's on us!
• We kick-off every new financial year by getting together in a cool secret location in Europe