A RetroSearch Logo

Home - News ( United States | United Kingdom | Italy | Germany ) - Football scores

Search Query:

Showing content from https://github.com/epicure/llama2.js below:

epicure/llama2.js: Inference Llama 2 in one file of pure JavaScript(HTML)

Skip to content Navigation Menu Search code, repositories, users, issues, pull requests...

Saved searches Use saved searches to filter your results more quickly

Sign up You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert epicure/llama2.js

A pure JavaScript port of Karpathy's llama2.c with a simple UI.

  1. Download Karpathy's Llama2 (Orig instructions) parameters pretrained on TinyStories dataset

    wget https://huggingface.co/karpathy/tinyllamas/resolve/main/stories15M.bin
wget https://huggingface.co/karpathy/tinyllamas/resolve/main/stories42M.bin
wget https://huggingface.co/karpathy/tinyllamas/resolve/main/stories110M.bin

  2. Open run.html via a WebServer

     python -m http.server 8080
 open http://localhost:8080/run.html

Tokens/sec measurement on Apple M1

tok/s 15M 42M 110M 🐢 ~30 ~13 ~5

MIT

About

Inference Llama 2 in one file of pure JavaScript(HTML)

Resources License Stars Watchers Forks Languages

You can’t perform that action at this time.

RetroSearch is an open source project built by @garambo | Open a GitHub Issue

Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo

HTML: 3.2 | Encoding: UTF-8 | Version: 0.7.4