Breaking02 / IT
Hugging Face unifies generation cache names in Transformers
Support for the old cache argument names ends at different versions for `forward` and `generate`.
Hugging Face announced on 21 Nov 2026 that its Transformers library would use a single argument name for the cache used in generation. The release notes said the old names would still work for a limited time and trigger a deprecation warning.
The release notes named cache as the replacement for past_key_values and cache_params. Passing an old name alongside cache raises an error.
According to the release notes, the old cache argument names varied by model type. Hybrid models had to handle the names separately.
The v5.24.0 release notes also reported a fix for delayed output when TextStreamer streamed Korean text without spaces.
Hugging Face said forward would accept the old names until v5.40.0. For generate, the cutoff is v6.0.0.