Inference optimisation skill

Agent skill for hill-climbing local LLM serving speed (decode, speculative decoding, prefill, KV, startup, TTFT) on any…

About Inference optimisation skill

Agent skill for hill-climbing local LLM serving speed (decode, speculative decoding, prefill, KV, startup, TTFT) on any hardware and quantization - sybil-solutions/inference-optimisation-skill

Agent skill for hill-climbing local LLM serving speed (decode, speculative decoding, prefill, KV, startup, TTFT) on any hardware and quantization

Ratings & reviews

–0 ratings
5★0
4★0
3★0
2★0
1★0

Log in to rate and review Inference optimisation skill.

Discussion (0)

Log in to join the discussion.