Java 类名：com.alibaba.alink.operator.batch.similarity.VectorNearestNeighborTrainBatchOp
Python 类名：VectorNearestNeighborTrainBatchOp

功能介绍

该组件为向量最近邻的训练过程，在计算时与 VectorNearestNeighborPredictBatchOp 配合使用。
支持的距离计算方式包含EUCLIDEAN，COSINE，INNERPRODUCT（内积），CITYBLOCK（曼哈顿距离），JACCARD，PEARSON
默认距离EUCLIDEAN

参数说明

| 名称 | 中文名称 | 描述 | 类型 | 是否必须？ | 取值范围 | 默认值 | | —- | —- | —- | —- | —- | —- | —- |

| idCol | id列名 | id列名 | String | ✓ | | |

| selectedCol | 选中的列名 | 计算列对应的列名 | String | ✓ | 所选列类型为 [DENSE_VECTOR, SPARSE_VECTOR, STRING, VECTOR] | |

| metric | 距离度量方式 | 聚类使用的距离类型 | String | | “EUCLIDEAN”, “COSINE”, “INNERPRODUCT”, “CITYBLOCK”, “JACCARD”, “PEARSON” | “EUCLIDEAN” |

代码示例

Python 代码

  1. from pyalink.alink import *
  3. import pandas as pd
  5. useLocalEnv(1)
  7. df = pd.DataFrame([
  8.     [0, "0 0 0"],
  9.     [1, "1 1 1"],
  10.     [2, "2 2 2"]
  11. ])
  13. inOp = BatchOperator.fromDataframe(df, schemaStr='id int, vec string')
  14. train = VectorNearestNeighborTrainBatchOp().setIdCol("id").setSelectedCol("vec").linkFrom(inOp)
  15. predict = VectorNearestNeighborPredictBatchOp().setSelectedCol("vec").setTopN(3).linkFrom(train, inOp)
  16. predict.print()

Java 代码

  1. import org.apache.flink.types.Row;
  3. import com.alibaba.alink.operator.batch.BatchOperator;
  4. import com.alibaba.alink.operator.batch.similarity.VectorNearestNeighborPredictBatchOp;
  5. import com.alibaba.alink.operator.batch.similarity.VectorNearestNeighborTrainBatchOp;
  6. import com.alibaba.alink.operator.batch.source.MemSourceBatchOp;
  7. import org.junit.Test;
  9. import java.util.Arrays;
  10. import java.util.List;
  12. public class VectorNearestNeighborTrainBatchOpTest {
  13.     @Test
  14.     public void testVectorNearestNeighborTrainBatchOp() throws Exception {
  15.         List <Row> df = Arrays.asList(
  16.             Row.of(0, "0 0 0"),
  17.             Row.of(1, "1 1 1"),
  18.             Row.of(2, "2 2 2")
  19.         );
  20.         BatchOperator <?> inOp = new MemSourceBatchOp(df, "id int, vec string");
  21.         BatchOperator <?> train =
  22.             new VectorNearestNeighborTrainBatchOp().setIdCol("id").setSelectedCol("vec").linkFrom(
  23.             inOp);
  24.         BatchOperator <?> predict =
  25.             new VectorNearestNeighborPredictBatchOp().setSelectedCol("vec").setTopN(3).linkFrom(
  26.             train, inOp);
  27.         predict.print();
  28.     }
  29. }

运行结果

| id | vec | | —- | —- |

| 0 | {“ID”:”[0,1,2]”,”METRIC”:”[0.0,1.7320508075688772,3.4641016151377544]”} |

| 1 | {“ID”:”[1,2,0]”,”METRIC”:”[0.0,1.7320508075688772,1.7320508075688772]”} |

| 2 | {“ID”:”[2,1,0]”,”METRIC”:”[0.0,1.7320508075688772,3.4641016151377544]”} |