Home - News ( United States | United Kingdom | Italy | Germany ) - Football scores

Showing content from https://github.com/saracen/llama2.go below:

saracen/llama2.go: Inference Llama 2 in Go

./llama2go --help
llama2go: <checkpoint>
  -cpuprofile string
         write cpu profile to file
  -prompt string
         prompt
  -steps int
         max number of steps to run for, 0: use seq_len (default 256)
  -temperature float
         temperature for sampling (default 0.9)

./llama2go -prompt "Cute llamas are" -steps 38 --temperature 0 stories110M.bin
<s>
Cute llamas are two friends who love to play together. They have a special game that they play every day. They pretend to be superheroes and save the world.
achieved tok/s: 43.268528

RetroSearch is an open source project built by @garambo | Open a GitHub Issue

Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo

HTML: 3.2 | Encoding: UTF-8 | Version: 0.7.4