dsh-live-perf-gauges
文件与数据 活跃维护

dsh-live-perf-gauges

TnzGit/dsh-live-perf-gauges

可实时采集并展示解码吞吐、首Token延迟、预填充吞吐等核心大模型推理指标,部署轻量,无需复杂配置即可直观查看模型运行性能状态。

0
Stars 标星
0
Forks 分支
0
Watchers 关注
0
Open Issues
JavaScript
主要语言
MIT
开源协议
9 KB
仓库大小
28 天前
最后推送
一键安装扩展 / 插件指令
dsh plugin --profile web add github:TnzGit/dsh-live-perf-gauges
git clone https://github.com/TnzGit/dsh-live-perf-gauges.git
git clone git@github.com:TnzGit/dsh-live-perf-gauges.git
README.md main

dsh-live-perf-gauges

中文

An automotive-style live performance strip for DeepSeek Harness Web: decode throughput, TTFT, prefill throughput, and output-token progress under the composer.

What it measures

  • Decode tok/s refreshes every 250 ms during generation. It is explicitly marked ~ while it is inferred from streamed characters; it switches to exact provider output tokens when the step finishes.
  • TTFT is the elapsed time from step/start to the first streamed text, reasoning, or tool-argument delta.
  • Prefill tok/s is prompt tokens divided by TTFT. It is estimated from DSH's context-pressure projection while a request is live, then corrected with provider-reported prompt tokens (input + cache read + cache write) at completion.
  • Output follows the same estimate-then-exact rule.

The plugin never contacts a network service and never stores message text, prompts, tools, or credentials. It only projects timestamps, counts, and final token usage already present in the session event stream.

Install

dsh plugin --profile web add github:TnzGit/dsh-live-perf-gauges

Restart the running dsh web service, then hard-refresh the browser. The strip appears below the composer after the next model step begins.

Compatibility

Designed for the DSH 0.1.x Web profile and its standard conversation.composer.dock, sessionProjections, and contextPressure interfaces.

Development

npm test

This repository ships prebuilt dependency-free host and client entries, so users do not need an install-time build step.

License

MIT