Commit 13465a7
committed
Add EdgeRunner to AI category
Fast, local LLM inference for Apple Silicon built in Swift/Metal.
Supports GGUF models (Qwen3, etc.) with Metal-optimized kernels
and ~230+ tok/s decode on M3 Max.1 parent 9fd541d commit 13465a7
1 file changed
Lines changed: 14 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1061 | 1061 | | |
1062 | 1062 | | |
1063 | 1063 | | |
| 1064 | + | |
| 1065 | + | |
| 1066 | + | |
| 1067 | + | |
| 1068 | + | |
| 1069 | + | |
| 1070 | + | |
| 1071 | + | |
| 1072 | + | |
| 1073 | + | |
| 1074 | + | |
| 1075 | + | |
| 1076 | + | |
| 1077 | + | |
1064 | 1078 | | |
1065 | 1079 | | |
1066 | 1080 | | |
| |||
0 commit comments