Developer guide
Implementation and performance notes for contributors. End users configuring the server want
,
, or
instead.
Contents
- check_backend_coverage, catching silent CPU fallbacks on a new backend.
- exact-shape neural microbatching and indexed streaming-state arenas.
- the project-specific ggml patches and how they are applied at build setup.
- the in-tree drop-in cuBLAS replacement under kernels/ and where the custom GPU kernels live.