사용자 도구

사이트 도구


topic:tiny_llm

차이

문서의 선택한 두 판 사이의 차이를 보여줍니다.

차이 보기로 링크

양쪽 이전 판이전 판
다음 판
이전 판
topic:tiny_llm [2024/01/22 04:24] rex8312topic:tiny_llm [2024/03/23 02:42] (현재) – 바깥 편집 127.0.0.1
줄 1: 줄 1:
 ====== Tiny LLM ====== ====== Tiny LLM ======
  
-  * https://jaykmody.com/blog/gpt-from-scratch/+  * pico-GPT 
 +    * https://jaykmody.com/blog/gpt-from-scratch/ 
 +    * https://github.com/jaymody/picoGPT
     * https://www.dipkumar.dev/becoming-the-unbeatable/posts/gpt-kvcache/     * https://www.dipkumar.dev/becoming-the-unbeatable/posts/gpt-kvcache/
-  * https://github.com/karpathy/nanoGPT +  * minGPT/nanoGPT 
-  * https://github.com/PiotrNawrot/nanoT5/tree/main+    * https://github.com/karpathy/mingpt 
 +    * https://github.com/karpathy/nanoGPT 
 +  * pemtoGPT 
 +    * https://github.com/keyvank/femtoGPT 
 +  * nanoT5 
 +    * https://github.com/PiotrNawrot/nanoT5/tree/main
   * tiny vicuna 1B   * tiny vicuna 1B
     * https://blog.stackademic.com/tiny-vicuna-1b-is-the-lightweight-champion-of-the-tiny-models-f05e459b8018     * https://blog.stackademic.com/tiny-vicuna-1b-is-the-lightweight-champion-of-the-tiny-models-f05e459b8018
 +  * nanoRWKV
 +    * https://github.com/BlinkDL/nanoRWKV
 +    * https://github.com/BlinkDL/ChatRWKV/blob/main/RWKV_in_150_lines.py
 +    * https://github.com/BlinkDL/ChatRWKV/blob/main/RWKV_v5_demo.py
 +  * T5
 +    * https://medium.com/mlearning-ai/past-present-perfect-flan-t5-stands-the-test-of-time-e1db93ff7846
 +  * LaMini
 +    * https://medium.com/@fabio.matricardi/lamini-power-when-a-small-guy-can-beat-the-giants-b176d0f7558a
  
 {{topic>tiny_llm &rsort&simplelist}} {{topic>tiny_llm &rsort&simplelist}}
topic/tiny_llm.1705897473.txt.gz · 마지막으로 수정됨: (바깥 편집)