Devops Engineer

Precodata; Oregon (WI); On-site; USD 120,000 - 180,000; Full time

Benefits offered by this job

MacBook Pro

Preco Mojo

Preco Courses

Preco Lunch

Job summary

Precodata is seeking a Big Data Architect to design and lead data ingestion and processing platforms, enabling data scientists and analysts to derive insights. You will own stakeholder management and provide technical leadership across data ingestion and processing engagements using cloud platforms and open-source big data tools.

You will work with Business Analysts, Data Analysts, Data Scientists, and DevOps to deliver data engineering solutions, ensuring scalable, compliant data pipelines

Qualifications

• Experience building scalable end-to-end data ingestion and processing solutions.
• Good understanding of data infrastructure and distributed computing principles.
• Knowledge of big data tooling and cloud platforms (AWS, Azure, GCP).
• Experience with governance and regulatory considerations (GDPR, PCI).

Responsibilities

• Design and implement data ingestion, transformation and loading pipelines for diverse sources.
• Collaborate with Business Analysts, Data Analysts, Data Scientists and DevOps to meet business requirements.
• Lead technical delivery and stakeholder alignment for data engineering engagements.

Skills

Data ingestion

Distributed computing

Cloud platforms

Big data frameworks

Python/Java/Scala/Go

Tools

Hadoop

Spark

Flink

Storm

Hive

Cassandra

Job description

The purpose of a Big Data Architect is to design solutions, platforms that enable data scientists and analysts to gain insights into data using data-driven services and infrastructures. You will be responsible for the stakeholder management and technical leadership for data ingestion and processing engagements. A good understanding of cloud platforms and prior experience working with big data tooling and frameworks is required.

Demonstrable Working Experience

• A successful history of manipulating, processing and extracting value from large disconnected datasets
• Delivering production scale data engineering solutions leveraging one or more cloud services
• Confidently taking responsibility for the technical output of a project
• Ability to quickly pick up new skills and learn on the job
• Comfortably working with various stakeholders such as data scientists, architects and devop

Technical Skills

• Experience in building scalable end-to-end data ingestion and processing solutions
• Good understanding of data infrastructure and distributed computing principles
• Proficient at implementing data processing workflows using Hadoop and frameworks such as Spark and Flink, Storm along with solutions like Hive, Casandra and RGBD solutions.
• Good understanding of data governance and how regulations can impact data storage and processing solutions such as GDPR and PCI
• Experience with object-oriented and/or functional programming languages, such as Python, Java, Scala, Go and Python.

Your main goal will be to build technical solutions required for optimal ingestion, transformation, and loading of data from a wide variety of data sources using open source, multi cloud solutions (AWS, Azure or GCP, etc.) and big data frameworks and services. Understand and formulate processing pipelines of large, complex data sets that meet functional / non-functional customers business requirements. You will design and create and maintain optimal data pipeline architecture.

You will work alongside with Business Analyst, Data Analyst, Data Scientist and Devops to implement Data Engineering solutions that answers customer's business needs and collaborating with customer's data department during workshop sessions to uncover more detailed business requirements related to data engineering. Having the ability to have a micro & macro vision of transversal architecture always related to clients needs.

If your philosophy basis start with Infrastructure As A Code and pursue with Serverless Architecture as first Axiom, what are you waiting for joining us.

Preco Preks

• MacBook Pro, and a smartphone (you will have to choose between a Galaxy or iPhone - make the right choice!).
• Preco Mojo: our people are diverse, passionate and easy to work with.
• Preco Courses: our continuous learning program that will provide training and career development opportunities.
• Preco Lunch : where every Thursday we take over a local restaurant. Enjoy, it's on us!
• We kick-off every new financial year by getting together in a cool secret location in Europe