Loading...
Loading...
Compare original and translation side by side
tools/token_bench.pytools/token_bench.pypython3 -m venv /tmp/vectors
/tmp/vectors/bin/pip install evoc model2vec matplotlib
/tmp/vectors/bin/python check/build-context-token-vectors/scripts/vectors.py --serve--serve--port8932--out <file>matplotlibevocevoc.label_propagationimport evoc--root~/.agents/skills--modelminishlab/potion-base-8M-kpython3 -m venv /tmp/vectors
/tmp/vectors/bin/pip install evoc model2vec matplotlib
/tmp/vectors/bin/python check/build-context-token-vectors/scripts/vectors.py --serve--serve--port--out <file>matplotlibevocevoc.label_propagationimport evoc--root~/.agents/skills--modelminishlab/potion-base-8M-kEVoC defaults| Flag | Turns |
|---|---|
| How many points make a cluster. Lower splits, higher merges. |
| The kNN graph's width. Lower sees local structure, higher sees global. |
| The density estimate. |
| How readily a point is called noise. |
| The node embedding, and where layers separate. |
EVoC defaults 8 clusters, 49 noise
--base-min-cluster-size 3 --n-neighbors 10 9 clusters, 53 noise
--noise-level 0.2 7 clusters, 39 noiseEVoC defaults| 标志 | 作用 |
|---|---|
| 构成一个聚类所需的点数。值越小聚类越分散,值越大聚类越集中。 |
| kNN图的宽度。值越小越关注局部结构,值越大越关注全局结构。 |
| 密度估计值。 |
| 判定点为噪声的阈值。 |
| 节点嵌入参数,以及层分隔的阈值。 |
EVoC defaults 8 clusters, 49 noise
--base-min-cluster-size 3 --n-neighbors 10 9 clusters, 53 noise
--noise-level 0.2 7 clusters, 39 noisefirstbuildlandcheckkitfixc4firstbuildlandcheckkitfixc4| Output | Means |
|---|---|
| Cosine similarity | How close two skills' doctrine sits. Roughly: above 0.80 a real peer, 0.65 to 0.80 a loose one, below 0.65 no peer at all. |
| A cluster tag | The skill was placed, and the other members of that cluster are its neighbourhood. |
| It was placed nowhere. |
| The scatter plot | Two principal components, for orientation only. Clustering ran in full dimensionality, so two points that look adjacent may not be. The neighbour table carries the real numbers. |
noiseSKILL.md| 输出项 | 含义 |
|---|---|
| Cosine similarity | 衡量两个skill的规则(doctrine)相近程度。大致标准:0.80以上为真正的同类skill,0.65至0.80为松散同类,0.65以下则无同类skill。 |
| 聚类标签 | 该skill被归入某一聚类,该聚类的其他成员为其同类群体。 |
| 该skill未被归入任何聚类。 |
| 散点图 | 两个主成分,仅用于定位参考。聚类是在全维度空间中运行的,因此看起来相邻的两个点实际可能并不相近。邻居表格中的数据才是真实的相似度数值。 |
noiseSKILL.mdrandom_stateSEEDrandom_stateSEED--out--flowtoken_bench.pyfirst/aesthetic/scripts/tools/--out--flowtoken_bench.pyfirst/aesthetic/scripts/tools/