dsh-llm-bounded-retry
其他 活跃维护

dsh-llm-bounded-retry

911218sky/dsh-llm-bounded-retry

轻量级LLM调用错误重试插件,支持为所有类型接口错误配置最大重试次数,避免无限制重试浪费资源,接入配置简单,可有效降低偶发错误带来的请求失败概率。

0
Stars 标星
0
Forks 分支
0
Watchers 关注
0
Open Issues
TypeScript
主要语言
NOASSERTION
开源协议
24 KB
仓库大小
1 个月前
最后推送
一键安装扩展 / 插件指令
dsh plugin --profile web add github:911218sky/dsh-llm-bounded-retry
git clone https://github.com/911218sky/dsh-llm-bounded-retry.git
git clone git@github.com:911218sky/dsh-llm-bounded-retry.git
README.md main

dsh-llm-bounded-retry

A bounded, provider-neutral retry plugin for DeepSeek Harness.

The official @deepseek-ai/dsh-llm-retry plugin retries selected transient failures or retries every failure without a finite limit. This plugin fills the gap between those modes: it retries every structured model-request failure up to a fixed budget, five retries by default.

Behavior

  • Default: five retries after the initial request (maxRetries: 5).
  • Retries all structured LLM failures except ABORTED and cancelled requests.
  • Uses durable llm/retry and llm/retry-started events, so each retry is a new agent turn.
  • Uses bounded exponential backoff with symmetric jitter.
  • Honors a positive provider Retry-After delay up to maxDelayMs.
  • Does not wrap ctx.llm.stream() and cannot duplicate partial output or committed tool effects.
  • Direct stream consumers are outside the agent request-error boundary.

Authentication, quota, invalid-request, and context-window failures are intentionally retried by default because the plugin implements the requested all-error policy. Use retryableCodes: default or an explicit array when permanent errors should be excluded.

Install

dsh plugin --profile web add github:911218sky/dsh-llm-bounded-retry

The package is a DSH bundle. Installation registers its cordis.patch.yml automatically, disables the official llm-retry executor, and loads the bounded executor with the default five-retry policy. Restart the DSH profile after installation.

To override the default, add a later entry to the profile's cordis.patch.yml:

- id: llm-bounded-retry
  config:
    maxRetries: 5
    retryableCodes: all
    initialDelayMs: 500
    maxDelayMs: 10000
    jitterRatio: 0.1

Configuration

Key Default Description
maxRetries 5 Retries after the initial attempt. 0 disables retry.
retryableCodes all all, default, or an array of exact failure codes.
initialDelayMs 500 Initial local backoff.
maxDelayMs 10000 Maximum local backoff and accepted provider delay.
jitterRatio 0.1 Symmetric jitter from 0 to 100 percent.

Development

The source, tests, and declaration output use TypeScript. npm test runs the ESM build, strict type check, and Node test suite.

npm install
npm test
npm pack --dry-run

License

This project and its documentation are licensed under CC BY-ND 4.0. See LICENSE for the license notice.