GitHub - vespa-engine/vespa: Vespa - the open big data serving engine
source link: https://github.com/vespa-engine/vespa
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
The open big data serving engine - Store, search, organize and make machine-learned inferences over big data at serving time.
This is the primary repository for Vespa where all development is happening. New production releases from this repository's master branch are made each weekday from Monday to Thursday.
Vespa build status:
Table of contents
Background
Use cases such as search, recommendation and personalization need to select a subset of data in a large corpus, evaluate machine-learned models over the selected data, organize and aggregate it and return it, typically in less than 100 milliseconds, all while the data corpus is continuously changing.
This is hard to do, especially with large data sets that needs to be distributed over multiple nodes and evaluated in parallel. Vespa is a platform which performs these operations for you with high availability and performance. It has been in development for many years and is used on a number of large internet services and apps which serve hundreds of thousands of queries from Vespa per second.
Install
Run your own Vespa instance: https://docs.vespa.ai/en/getting-started.html
Or deploy your Vespa applications to the cloud service: https://cloud.vespa.ai
Usage
- The application created in the getting started guide is fully functional and production ready, but you may want to add more nodes for redundancy.
- See developing applications on adding your own Java components to your Vespa application.
- Vespa APIs is useful to understand how to interface with Vespa
- Explore the sample applications
- Follow the Vespa Blog for feature updates / use cases
Full documentation is available on https://docs.vespa.ai.
Contribute
We welcome contributions! See CONTRIBUTING.md to learn how to contribute.
If you want to contribute to the documentation, see https://github.com/vespa-engine/documentation
Building
You do not need to build Vespa to use it, but if you want to contribute you need to be able to build the code. This section explains how to build and test Vespa. To understand where to make changes, see Code-map.md. Some suggested improvements with pointers to code are in TODO.md.
Development environment
C++ and Java building is supported on CentOS 7. The Java source can also be built on any platform having Java 11 and Maven installed. Use the following guide to set up a complete development environment using Docker for building Vespa, running unit tests and running system tests: Vespa development on CentOS 7.
Build Java modules
export MAVEN_OPTS="-Xms128m -Xmx1024m"
./bootstrap.sh java
mvn install --threads 1C
Use this if you only need to build the Java modules, otherwise follow the complete development guide above.
Build RPM packages
See Building Vespa RPM for details.
License
Code licensed under the Apache 2.0 license. See LICENSE for terms.
Recommend
-
141
By Jon Bratseth, Distinguished Architect, VespaEver since we open sourced Hadoop in 2006, Yahoo – and now, Oath – has been committed to opening up its big data infrastructure to the la...
-
139
雅虎开源其搜索引擎 Vespa
-
24
Vespa.ai and the CORD-19 public API A taste of what you can do with Vespa The Vespa team has been working non-stop to put together the cord19.vespa.ai search app...
-
144
雅虎或Oath宣布开源其大数据处理和服务引擎Vespa,源代码托管在GitHub上。雅虎/Oath的杰出架构师JonBratseth在新闻稿中指出,Vespa被用于Yahoo.com、YahooNews、YahooSports、YahooFinance、YahooGemini、Flickr等众多产品,每天处理和服务数十亿次的文档访问请求...
-
2
POSTED ON MARCH 15, 2022 TO DevInfra, ML Applications VESPA: Static profiling for...
-
113
AI in Depth: serving a Keras text classifier with preprocessing using Cloud...
-
3
Vinted Engineering These are the voyages of code tailors that help create Vinted Adopting the Vespa search engine for s...
-
5
Query Serving Systems:An Emerging Category of Data Systems These days, peo...
-
88
README.md
-
45
README.md ghp A simple web server for serving static GitHub Pages locally, to test before deploying. This can be useful compared to browsing loc...
About Joyk
Aggregate valuable and interesting links.
Joyk means Joy of geeK