Skip to content

naive_speculate.config.registry

Registry for available implementation types.

InferencerType

Bases: StrEnum

Implemented Inferencer types.

KVCacheType

Bases: StrEnum

Implemented KVCache types.

LanguageModelType

Bases: StrEnum

Implemented LanguageModel types.

Each type corresponds to a specific model family. (Currently only Qwen is supported.)