近似最近傍探索における新しいビット量子化手法、RaBitQとBBQ
Elasticsearch 8.16 で Better Binary Quantization (BBQ) という、新しい密ベクトルのフィールドタイプが追加されました。 Dense vector field type | Elasticsearch Guide | Elastic Elasticsearch version 8.16.0 New features | Elasticsearch Guide | Elastic Adding new experimental bbq index types by benwtrent · Pull Request #114439 · elastic/elasticsearch · GitHub Elasticsearch ではベクトルの各次元の int8 や int4 への量子化をサポートしていますが、BBQ ではビットにまで量子化することで、
How we keep Search relevant and useful
When you come to Google Search, our goal is to connect you with useful information as quickly as possible. That information can take many forms, and over the years the search results page has evolved to include not only a list of blue links to pages across the web, but also useful features to help you find what you’re looking for even faster. Some examples include featured snippets, which highligh
Automata Invasion
Presented by Robert Muir and Michael Mccandless, Lucid,IBM - See conference video - http://www.lucidimagination.com/devzone/events/conferences/lucene-revolution-2012 Finite-state technology, including automata and weighted finite state transducers (wFSTs), are compact data structures well suited to text processing and searching applications. Low level support for both automata and wFSTs is now ava
Explore career opportunities at Pinterest
Contractor roles While our Careers site currently focuses on direct employment roles with Pinterest, we also offer temporary (contractor) assignments through our trusted third-party staffing firms. Job postings for contractor assignments on some of the most popular professional networking sites and job boards will clearly indicate the assignment duration, the staffing firm that will be the direct
Bing検索の裏側―BitFunnelのアルゴリズム - Hatena Developer Blog
はてなアプリケーションエンジニアの id:takuya-a です。 この記事では、Microsoft の検索エンジン Bing で採用された BitFunnel アルゴリズムを紹介します。 昨年のエンジニアアドベントカレンダーでは、文字列検索のアルゴリズム全般について紹介しました（文字列アルゴリズムの学びかた - Hatena Developer Blog）。今年はそのなかでも、インデックス（索引）を使った全文検索アルゴリズムについてのお話になります。 この記事の前半は全文検索の入門にもなっていますので、検索技術になじみがない方にも楽しんでいただけるのではないでしょうか。 逆に、「そんなのもう知ってるよ！」という方は、本題である「BitFunnel アルゴリズムの詳細」から目を通していただければと思います。 この記事は、はてなエンジニア Advent Calendar 2017の21日目の
論文 "BitFunnel: Revisiting Signatures for Search" を読んだメモ - stop-the-world
まとめると 気になりポイント 1. Introduction 2. Background and prior work 2.1 Inverted Indexes 2.2 Bit-String Signatures 2.3 Bit-Sliced Signatures 2.4 Bit-Sliced Blocked Signatures 3. THE BITFUNNEL SYSTEM 3.1 Architectural Overview 3.2 The Cost of False Positives 4. BITFUNNEL INNOVATIONS 4.1 Higher Rank Rows 4.2 Frequency Conscious Signatures 4.3 Sharding by Document Length 5. PERFORMANCE MODEL AND OPTIMIZATION
Index 1,600,000,000 Keys with Automata and Rust - Andrew Gallant's Blog
It turns out that finite state machines are useful for things other than expressing computation. Finite state machines can also be used to compactly represent ordered sets or maps of strings that can be searched very quickly. In this article, I will teach you about finite state machines as a data structure for representing ordered sets and maps. This includes introducing an implementation written
1
リリース、障害情報などのサービスのお知らせ
最新の人気エントリーの配信
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く
犬でもわかる Minimal Acyclic Subsequential Transducer / Introduction to Minimal Acyclic Subsequential Transducer