GitHub - ashvardanian/StringZilla: Up to 10x faster strings for C, C++, Python, Rust, and Swift, leveraging SWAR and SIMD on Arm Neon and x86 AVX2 & AVX-512-capable chips to accelerate search, sort, edit distances, alignment scores, etc 🦖

The world wastes a minimum of $100M annually due to inefficient string operations. A typical codebase processes strings character by character, resulting in too many branches and data-dependencies, neglecting 90% of modern CPU's potential. LibC is different. It attempts to leverage SIMD instructions to boost some operations, and is often used by higher-level languages, runtimes, and databases. But

[misshiki]

“StringZilla は文字列ライブラリのゴジラで、大規模なテキスト データセットを「東京タワー」と言うよりも速く分割、並べ替え、シャッフルします ”

[tmatsuu]

長大な文字列に対する操作をSIMDなどを使って超高速に処理するためのライブラリ。C++/Python向け実装。JavaScript、Java、Rustでの利用もできるよう絶賛開発中。