Skip to content
forked from nuclia/nucliadb

NucliaDB is a cloud-native database for unstructured data and vector, text, paragraphs and relations indexing

License

Notifications You must be signed in to change notification settings

swallez/nucliadb

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

nucliadb_one nucliadb_writer nucliadb_reader nucliadb_ingest nucliadb_node nucliadb_search codecov Contributor Covenant License: AGPL V3 Twitter Follow Discord Rust Python

Nuclia

Searchable database for unstructured data

Check out our blog post to grasp what we have been doing for the last months.

NucliaDB is a distributed search engine built from the ground up to offer high accuracy and semantic search on unstructured data. By mere mortals for mere mortals, NucliaDB's architecture is as simple as possible to be scalable and deliver what an NLP Database requires

NucliaDB is written in Rust and Python and built on top of the mighty tantivy library. We designed it to index big datasets and provide multi-teanant suport.

Features

  • Store original data, extracting and understanding data on object and blob storage
  • Index fields, paragraphs, and semantic sentences on index storage
  • Cloud extraction and understanding with Nuclia Understanding API™
  • Cloud connection to train ML models with Nuclia Learning API™
  • Container security based with Reader, Manager, Writer Roles
  • Resources with multiple fields and metadata
  • Text/HTML/Markdown plain fields support
  • File field support with direct upload and TUS upload
  • Link field support
  • Conversation field support
  • Blocks/Layout field support
  • Eventual consistency transactions based on Nats.io
  • Distributed source of truth with TiKV and Redis support
  • Blob support with S3-compatible API and GCS
  • Replication of index storage
  • Distributed search
  • Cloud-native: Kubernetes only

Upcomming Features

  • Blob support with Azure Blob storage
  • Index relations on index storage

Architecture

Architecture

Quickstart

Trying NucliaDB is super easy! You can extend your knowledge with the following readings:

API Tutorials

💬 Community

🙋 FAQ

How is NucliaDB different from traditional search engines like Elasticsearch or Solr?

The core difference and advantage of NucliaDB is its architecture built from the ground up for cloud and unstructured data. Its vector index plus standard keyword and fuzzy search provide an API to use all extracted and learned information from Nuclia, understanding API and provide super NLP powers to any application with low code and peace of mind.

What license does NucliaDB use?

NucliaDB is open-source under the GNU Affero General Public License Version 3 - AGPLv3. Fundamentally, this means that you are free to use Quickwit for your project, as long as you don't modify NucliaDB. If you do, you have to make the modifications public.

What is Nuclia's business model?

Our business model relies on our normalization API, this one is based on Nuclia Learning API and Nuclia Understanding API. This two APIs offers transformation of unstructured data to NucliaDB compatible data with AI. We also offer NucliaDB as a service at our multi-cloud provider infrastructure: https://nuclia.cloud.

🤝 Contribute and spread the word

We are always super happy to have contributions: code, documentation, issues, feedback, or even saying hello on discord! Here is how you can get started:

✨ And to thank you for your contributions, claim your swag by emailing us at info at nuclia.com.

Reference

Meta

About

NucliaDB is a cloud-native database for unstructured data and vector, text, paragraphs and relations indexing

Resources

License

Code of conduct

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 63.3%
  • Rust 27.1%
  • PureBasic 9.1%
  • Makefile 0.3%
  • Smarty 0.1%
  • HTML 0.1%