タグ

LanguageModelとC++に関するefclのブックマーク (1)

  • ggml.ai

    GGML - AI at the edge ggml is a tensor library for machine learning to enable large models and high performance on commodity hardware. It is used by llama.cpp and whisper.cpp Low-level cross-platform implementation Integer quantization support Broad hardware support Automatic differentiation ADAM and L-BFGS optimizers No third-party dependencies Zero memory allocations during runtime The ggml way

    efcl
    efcl 2024/01/11
    Apple Siliconに最適化されたLLMを扱うライブラリのプロジェクト。CPU上で実行できるため、色々なデバイスで動かせる。 Whisper.cppやLlama.cppの人
  • 1