rinna/llama-3-youko-8b · Hugging Face
","eos_token":"<|end_of_text|>"}},"createdAt":"2024-05-01T07:53:45.000Z","discussionsDisabled":false,"downloads":1359,"downloadsAllTime":1359,"id":"rinna/llama-3-youko-8b","isLikedByUser":false,"isWatchedByUser":false,"inference":"ExplicitOptOut","lastModified":"2024-05-07T01:59:47.000Z","likes":28,"pipeline_tag":"text-generation","library_name":"transformers","librariesOther":[],"model-index":nul
kunishou/databricks-dolly-15k-ja · Datasets at Hugging Face
This dataset was created by automatically translating "databricks-dolly-15k" into Japanese. This dataset is licensed under CC-BY-SA-3.0 Last Update : 2023-05-11 databricks-dolly-15k-ja https://github.com/kunishou/databricks-dolly-15k-ja databricks-dolly-15k https://github.com/databrickslabs/dolly/tree/master/data
mlabonne/Meta-Llama-3-120B-Instruct · Hugging Face
","chat_template":"{% set loop_messages = messages %}{% for message in loop_messages %}{% set content = '<|start_header_id|>' + message['role'] + '<|end_header_id|>\n\n'+ message['content'] | trim + '<|eot_id|>' %}{% if loop.index0 == 0 %}{% set content = bos_token + content %}{% endif %}{{ content }}{% endfor %}{% if add_generation_prompt %}{{ '<|start_header_id|>assistant<|end_header_id|>\n\n' }
LMSys Chatbot Arena Leaderboard - a Hugging Face Space by lmsys
Discover amazing ML apps made by the community
MTEB Leaderboard - a Hugging Face Space by mteb
Discover amazing ML apps made by the community
GAIA Leaderboard - a Hugging Face Space by gaia-benchmark
Discover amazing ML apps made by the community
stabilityai/japanese-stablelm-base-gamma-7b · Hugging Face
Japanese Stable LM Base Gamma 7B Model Description This is a 7B-parameter decoder-only language model with a focus on maximizing Japanese language modeling performance and Japanese downstream task performance. We conducted continued pretraining using Japanese data on the English language model, Mistral-7B-v0.1, to transfer the model's knowledge and capabilities to Japanese. If you are looking for
The Technology Behind BLOOM Training
Please note that both Megatron-LM and DeepSpeed have Pipeline Parallelism and BF16 Optimizer implementations, but we used the ones from DeepSpeed as they are integrated with ZeRO. Megatron-DeepSpeed implements 3D Parallelism to allow huge models to train in a very efficient way. Let’s briefly discuss the 3D components. DataParallel (DP) - the same setup is replicated multiple times, and each being
イントロダクション - Hugging Face NLP Course
🤗 コースへようこそ! このコースでは、Hugging Faceのエコシステムを形成するライブラリである🤗 Transformers、🤗 Datasets、🤗 Tokenizers、🤗 Accelerate、そしてHugging Face Hubを使って自然言語処理（NLP）について学習することができます。このコースは、完全に無料で取り組むことができ、広告もありません。 何を学ぶことができるのか？ こちらがこのコースの概要になります: 第１章から第４章では、🤗 Transformersライブラリのメインコンセプトを紹介します。このパートを終える頃には、Transformerモデルがどのように機能するかを理解し、Hugging Face Hubにあるモデルを利用し、データセットでfine-tuningを行い、その成果をHub上で共有する方法を身につけることができるでしょう！ 第５
1
リリース、障害情報などのサービスのお知らせ
最新の人気エントリーの配信
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く
nvidia/Nemotron-4-340B-Instruct · Hugging Face
Qwen/Qwen2-72B-Instruct · Hugging Face
HODACHI/glm-4-9b-chat-FT-ja-v0.3 · Hugging Face
Qwen/Qwen2-7B-Instruct · Hugging Face
https://huggingface.co/datasets/togethercomputer/RedPajama-Data-1T
microsoft/deberta-v3-base · Hugging Face
Preference Tuning LLMs with Direct Preference Optimization Methods
tokyotech-llm/Swallow-7b-hf · Hugging Face
rinna/youri-7b · Hugging Face
izumi-lab/llm-japanese-dataset · Datasets at Hugging Face
Fine-tune Llama 2 with DPO