Java 类名：com.alibaba.alink.operator.stream.clustering.BisectingKMeansPredictStreamOp
Python 类名：BisectingKMeansPredictStreamOp

功能介绍

二分k均值算法是k-means聚类算法的一个变体，主要是为了改进k-means算法随机选择初始质心的随机性造成聚类结果不确定性的问题.
Alink上算法包括二分K均值聚类训练，二分K均值聚类预测, 二分K均值聚类流式预测。

参数说明

训练

| 名称 | 中文名称 | 描述 | 类型 | 是否必须？ | 取值范围 | 默认值 | | —- | —- | —- | —- | —- | —- | —- |

| predictionCol | 预测结果列名 | 预测结果列名 | String | ✓ | | |

| modelFilePath | 模型的文件路径 | 模型的文件路径 | String | | | null |

| predictionDetailCol | 预测详细信息列名 | 预测详细信息列名 | String | | | |

| reservedCols | 算法保留列名 | 算法保留列 | String[] | | | null |

| numThreads | 组件多线程线程个数 | 组件多线程线程个数 | Integer | | | 1 |

| modelStreamFilePath | 模型流的文件路径 | 模型流的文件路径 | String | | | null |

| modelStreamScanInterval | 扫描模型路径的时间间隔 | 描模型路径的时间间隔，单位秒 | Integer | | | 10 |

| modelStreamStartTime | 模型流的起始时间 | 模型流的起始时间。默认从当前时刻开始读。使用yyyy-mm-dd hh:mm:ss.fffffffff格式，详见Timestamp.valueOf(String s) | String | | | null |

代码示例

Python 代码

  1. from pyalink.alink import *
  3. import pandas as pd
  5. useLocalEnv(1)
  7. df = pd.DataFrame([
  8.     [0, "0 0 0"],
  9.     [1, "0.1,0.1,0.1"],
  10.     [2, "0.2,0.2,0.2"],
  11.     [3, "9 9 9"],
  12.     [4, "9.1 9.1 9.1"],
  13.     [5, "9.2 9.2 9.2"]
  14. ])
  16. inBatch = BatchOperator.fromDataframe(df, schemaStr='id int, vec string')
  17. inStream = StreamOperator.fromDataframe(df, schemaStr='id int, vec string')
  19. kmeansTrain = BisectingKMeansTrainBatchOp()\
  20.     .setVectorCol("vec")\
  21.     .setK(2)\
  22.     .linkFrom(inBatch)
  23. kmeansTrain.lazyPrint(10)
  25. predictBatch = BisectingKMeansPredictBatchOp()\
  26.     .setPredictionCol("pred")\
  27.     .linkFrom(kmeansTrain, inBatch)
  28. predictBatch.print()
  30. predictStream = BisectingKMeansPredictStreamOp(kmeansTrain)\
  31.     .setPredictionCol("pred")\
  32.     .linkFrom(inStream)
  33. predictStream.print()
  35. StreamOperator.execute()

Java 代码

  1. import org.apache.flink.types.Row;
  3. import com.alibaba.alink.operator.batch.BatchOperator;
  4. import com.alibaba.alink.operator.batch.clustering.BisectingKMeansPredictBatchOp;
  5. import com.alibaba.alink.operator.batch.clustering.BisectingKMeansTrainBatchOp;
  6. import com.alibaba.alink.operator.batch.source.MemSourceBatchOp;
  7. import com.alibaba.alink.operator.stream.StreamOperator;
  8. import com.alibaba.alink.operator.stream.clustering.BisectingKMeansPredictStreamOp;
  9. import com.alibaba.alink.operator.stream.source.MemSourceStreamOp;
  10. import org.junit.Test;
  12. import java.util.Arrays;
  13. import java.util.List;
  15. public class BisectingKMeansPredictStreamOpTest {
  16.     @Test
  17.     public void testBisectingKMeansPredictStreamOp() throws Exception {
  18.         List <Row> df = Arrays.asList(
  19.             Row.of(0, "0 0 0"),
  20.             Row.of(1, "0.1,0.1,0.1"),
  21.             Row.of(2, "0.2,0.2,0.2"),
  22.             Row.of(3, "9 9 9"),
  23.             Row.of(4, "9.1 9.1 9.1"),
  24.             Row.of(5, "9.2 9.2 9.2")
  25.         );
  26.         BatchOperator <?> inBatch = new MemSourceBatchOp(df, "id int, vec string");
  27.         StreamOperator <?> inStream = new MemSourceStreamOp(df, "id int, vec string");
  28.         BatchOperator <?> kmeansTrain = new BisectingKMeansTrainBatchOp()
  29.             .setVectorCol("vec")
  30.             .setK(2)
  31.             .linkFrom(inBatch);
  32.         kmeansTrain.lazyPrint(10);
  34.         BatchOperator <?> predictBatch = new BisectingKMeansPredictBatchOp()
  35.             .setPredictionCol("pred")
  36.             .linkFrom(kmeansTrain, inBatch);
  37.         predictBatch.print();
  39.         StreamOperator <?> predictStream = new BisectingKMeansPredictStreamOp(kmeansTrain)
  40.             .setPredictionCol("pred")
  41.             .linkFrom(inStream);
  42.         predictStream.print();
  43.         StreamOperator.execute();
  44.     }
  45. }

运行结果

模型结果

| model_id | model_info | | —- | —- |

| 0 | {“vectorCol”:””vec””,”distanceType”:””EUCLIDEAN””,”k”:”2”,”vectorSize”:”3”} |

| 1048576 | {“clusterId”:1,”size”:6,”center”:{“data”:[4.6,4.6,4.6]},”cost”:364.61999999999995} |

| 2097152 | {“clusterId”:2,”size”:3,”center”:{“data”:[0.1,0.1,0.1]},”cost”:0.06} |

| 3145728 | {“clusterId”:3,”size”:3,”center”:{“data”:[9.099999999999998,9.099999999999998,9.099999999999998]},”cost”:0.060000000000172804} |

预测结果

| id | vec | pred | | —- | —- | —- |

| 0 | 0 0 0 | 0 |

| 1 | 0.1,0.1,0.1 | 0 |

| 2 | 0.2,0.2,0.2 | 0 |

| 3 | 9 9 9 | 1 |

| 4 | 9.1 9.1 9.1 | 1 |

| 5 | 9.2 9.2 9.2 | 1 |