First Thoughts on a Data Lake Architecture for an Open Search Infrastructure
Martin, Leon; Henrich, Andreas (2020): First Thoughts on a Data Lake Architecture for an Open Search Infrastructure, in: Zenodo, doi: 10.5281/ZENODO.4593427.
Details
- Faculty/Chair
- Faculty/Professorship
- Author
- Martin, Leon
- Corporate Body
- Open Search Symposium 2020, 12-14 October 2020, CERN, Geneva, Switzerland.Open Search Foundation Zenodo Community
- Publisher Information
- Zenodo
- Year of publication
- 2020
- Pages
- 6
- Language
- English
- DOI
- URL
- Abstract
The goal of the Open Search Foundation is to establish a decentralized open search infrastructure for navigating, searching, and analyzing the internet. Due to the variety of requirements, the need for a robust and extensible architecture arises. This paper gives first thoughts on an architecture for such an infrastructure. As a starting point, a basic architecture for a Data-Lake-based document-centric search engine is proposed. Afterwards, components are added and extended to meet further requirements of the envisaged search infrastructure.
- GND Keywords
- Data lakeSoftwarearchitekturSuchmaschineTechnische Infrastruktur
- Keywords
- Data Lake Architecture
- DDC Classification
- 004 Computer science
- RVK Classification
- ST 265
- Type
- Conferenceobject
- URI
- Activation date
- 2021-03-29