Big Data Architect

Roberts Recruiting; Framingham (MA); On-site; USD 120,000 - 150,000; Full time

Job summary

A leading data solutions provider is seeking an experienced Big Data Architect to develop and optimize their Data Platform. The ideal candidate will have extensive knowledge of data management, architecture, and a minimum of 8-10 years of experience in the field, including hands-on work with Big Data technologies. This position demands strong leadership and technical skills to enhance decision-making processes through data insights.

Qualifications

• 8-10 years in information management and application development.
• 3-5 years of hands-on experience with Big Data technologies.

Responsibilities

• Develop architecture for Big Data & Analytics Platform.
• Define analytic architecture using the Big Data Platform.
• Participate in end-to-end delivery of business use-cases.
• Design efficient Big Data applications.
• Deliver ongoing platform architecture as part of an agile team.
• Architect data security and compliance methodologies.
• Provide leadership in data management and governance.
• Evaluate architectures for optimal performance.
• Stay updated on relevant technologies and trends.

Skills

Deep expertise in data types

Hands-on with Cloudera Hadoop Administration

Experience with AWS, Google Cloud, Azure

Lifecycle management of Hadoop Solutions

Proficient in Hadoop and big data tools

Understanding of programming languages (Java, Python, R)

Extensive knowledge of UNIX/Linux

Strong SQL knowledge

Experience with ETL tools (Informatica, Talend)

Design solutions for data warehouses

Hadoop Platform Security experience

Experience in technical computing

Familiarity with Tableau

Education

BS in Computer Science or similar field

Job description

The emergence of big data is creating opportunities to develop data platforms that turn big data into big insights with tremendous value. This role is critical in enabling these capabilities and providing business partners with the tools to make their decision making process more efficient and with greater speed. This role will develop long-term technology and data strategies and shorter-term development and delivery plans to enable us to Insight. The candidate must be extremely results driven, customer focused, technologically savvy, and skilled at working in an agile development environment.

Job Responsibilities

• Develop the architecture for our Big Data & Analytics Platform to optimize the ingestion and management of varied sources of high volume data
• Define analytic architecture that leverages the Big Data Platform to enable advanced analysis capabilities
• Participate in the end to end delivery of business use-cases including data architecture to deliver results
• Design and build efficient yet cost-effective Big Data applications to help business partners answer their business questions
• Deliver as part of an agile team the ongoing platform architecture, build and maintenance
• Architect the data security, compliance and privacy methodology
• Provide leadership to data management and governance methodologies for the team
• Evaluate and present proposed architectures to enable platform with highest level of performance, garner leadership support and enable implementation
• Stay up to date on the relevant technologies, plug into user groups, understand trends and opportunities

Required Demonstrable Skills

• Deep expertise is working with data – all kinds, clean, dirty, unstructured, semi-structured
• Have hands-on experience with Cloudera Hadoop Administration (e.g. configuration management, monitoring, debugging, and performance tuning)
• Strong experience with large cloud-compute infrastructure solutions such as Amazon Web Services, Google, Azure
• Experience managing the full lifecycle of a Hadoop Solution
• Experience creating the requirements analysis, the platform selection, design of the technical architecture, design of the application design and development, testing, and deployment of the proposed solution
• Experience with the major big data solutions like Hadoop, MapReduce, Hive, HBASE, MongoDB, Cassandra, Spark, Impala, Oozie, Mahout, Flume, ZooKeeper, Sqoop, etc.
• Firm understanding of major programming/scripting languages like Java, Python, R, etc.
• Extensive knowledge of UNIX/Linux
• Strong knowledge of SQL
• Experience in working with ETL tools such as Informatica, Talend and/or Pentaho.
• Experience in designing solutions for multiple large data warehouses with a good understanding of cluster and parallel architecture as well as high-scale or distributed RDBMS and/or knowledge on NoSQL platforms
• Experience in Hadoop Platform Security and Hadoop Data Governance topics
• Experience in technical computing (optimization, statistics and machine learning)
• Experience with analytics visualization software such as Tableau

Qualifications

• Minimum of BS in Computer Science or similar field
• Must have at least 8-10 years’ experience in information management and application development
• Must have a minimum of 3-5 years working hands on with Big Data technologies