RWKV
The RWKV Language Model
Training RWKV (and latest developments) RWKV App for Android / iOS / PC / Mac / Linux Very efficient inference (7B fp16 bsz960 = 10250+ tps on 5090) RWKV pip reference (slower) package Finetuning RWKV (9GB VRAM can finetune 7B) WebGPU inference (NVIDIA/AMD/Intel), nf4/int8/fp16 with history of RWKV from v1 to v7 (note: AI-written)
Nous Research
The AI Accelerator Company
Nous Research is a leader in the American open source AI movement. We train world-class open source language models and build infrastructure to coordinate distributed, unbiased training. ARTIFICIAL INTELLIGENCE MADE HUMAN
RWKV
Nous Research
RWKV
Nous Research
RWKV
Nous Research