ymcui/Chinese-LLaMA-Alpaca-2 - GitHub
2023年7月19日 · 通过投机采样方法并借助Chinese-LLaMA-2-1.3B和Chinese-Alpaca-2-1.3B，可以分别加速7B、13B的LLaMA和Alpaca模型的推理速度。以下是使用投机采样脚本在1*A40-48G上解码生成效果评测中的问题测得的平均速度（速度以ms/token计，模型均为fp16精度），供用户参 …
ymcui/Chinese-LLaMA-Alpaca - GitHub
这些模型 在原版LLaMA的基础上扩充了中文词表 并使用了中文数据进行二次预训练，进一步提升了中文基础语义理解能力。. 同时，中文Alpaca模型进一步使用了中文指令数据进行精调，显著提升了模型对指令的理解和执行能力。. 技术报告（V2）： [Cui, Yang, and Yao ...
Stanford Alpaca: An Instruction-following LLaMA Model
2023年3月13日 · This is the repo for the Stanford Alpaca project, which aims to build and share an instruction-following LLaMA model. The repo contains: The 52K data used for fine-tuning the model.
ggerganov/llama.cpp: LLM inference in C/C++ - GitHub
llama.cpp web server is a lightweight OpenAI API compatible HTTP server that can be used to serve local models and easily connect them to existing clients. Example usage: ./llama-server -m your_model.gguf --port 8080 # Basic web UI can be accessed via browser: http://localhost:8080# Chat completion endpoint: http://localhost:8080/v1/chat ...
ymcui/Chinese-LLaMA-Alpaca-3 - GitHub
本项目基于Meta最新发布的新一代开源大模型Llama-3开发，是Chinese-LLaMA-Alpaca开源大模型相关系列项目（一期、二期）的第三期。本项目开源了中文Llama-3基座模型和中文Llama-3-Instruct指令精调大模型。这些模型在原版Llama-3的基础上使用了大规模中文数据进行增量预 ...
GitHub - Beomi/KoAlpaca: KoAlpaca: 한국어 명령어를 이해하는 …
2023年3月22日 · This is the repo for the Stanford Alpaca project, which aims to build and share an instruction-following LLaMA model. The repo contains: A web demo to interact with our Alpaca model
meta-llama/llama: Inference code for Llama models - GitHub
This release includes model weights and starting code for pre-trained and fine-tuned Llama language models — ranging from 7B to 70B parameters. This repository is intended as a minimal example to load Llama 2 models and run inference. For more detailed examples leveraging Hugging Face, see llama-recipes.
Chinese-LLaMA-Alpaca/README_EN.md at main - GitHub
To promote open research of large models in the Chinese NLP community, this project has open-sourced the Chinese LLaMA model and the Alpaca large model with instruction fine-tuning. These models expand the Chinese vocabulary based on the original LLaMA and use Chinese data for secondary pre-training, further enhancing Chinese basic semantic ...
GitHub - meta-llama/llama-recipes: Scripts for fine-tuning Meta …
Scripts for fine-tuning Meta Llama with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions …
训练细节 · ymcui/Chinese-LLaMA-Alpaca Wiki - GitHub
2023年7月4日 · 训练细节. yaoxin edited this page on Jul 4, 2023 · 18 revisions. 整个训练流程包括词表扩充、预训练和指令精调三部分，其中词表扩充的代码参见 merge_tokenizers.py；预训练和指令精调代码参考了🤗transformers中的 run_clm.py 和 Stanford Alpaca 项目中数据集处理的相关部 …