Java 类名：com.alibaba.alink.operator.stream.source.TsvSourceStreamOp
Python 类名：TsvSourceStreamOp

功能介绍

按行读取以tab为分隔符的Tsv文件。

参数说明

| 名称 | 中文名称 | 描述 | 类型 | 是否必须？ | 取值范围 | 默认值 | | —- | —- | —- | —- | —- | —- | —- |

| filePath | 文件路径 | 文件路径 | String | ✓ | | |

| schemaStr | Schema | Schema。格式为”colname coltype[, colname2, coltype2[, …]]”，例如”f0 string, f1 bigint, f2 double” | String | ✓ | | |

| ignoreFirstLine | 是否忽略第一行数据 | 是否忽略第一行数据 | Boolean | | | false |

| skipBlankLine | 是否忽略空行 | 是否忽略空行 | Boolean | | | true |

代码示例

Python 代码

  1. from pyalink.alink import *
  3. import pandas as pd
  5. useLocalEnv(1)
  7. df = pd.DataFrame([
  8.                 ["0L", "1L", 0.6],
  9.                 ["2L", "2L", 0.8],
  10.                 ["2L", "4L", 0.6],
  11.                 ["3L", "1L", 0.6],
  12.                 ["3L", "2L", 0.3],
  13.                 ["3L", "4L", 0.4]
  14.         ])
  16. source = StreamOperator.fromDataframe(df, schemaStr='uid string, iid string, label double')
  18. filepath = "/tmp/abc.tsv"
  19. tsvSink = TsvSinkStreamOp()\
  20.     .setFilePath(filepath)\
  21.     .setOverwriteSink(True)
  23. source.link(tsvSink)
  25. StreamOperator.execute()
  27. tsvSource = TsvSourceStreamOp().setFilePath(filepath).setSchemaStr("f string");
  28. tsvSource.print()
  30. StreamOperator.execute()

Java 代码

  1. import org.apache.flink.types.Row;
  3. import com.alibaba.alink.operator.stream.StreamOperator;
  4. import com.alibaba.alink.operator.stream.sink.TsvSinkStreamOp;
  5. import com.alibaba.alink.operator.stream.source.MemSourceStreamOp;
  6. import com.alibaba.alink.operator.stream.source.TsvSourceStreamOp;
  7. import org.junit.Test;
  9. import java.util.Arrays;
  10. import java.util.List;
  12. public class TsvSourceStreamOpTest {
  13.     @Test
  14.     public void testTsvSourceStreamOp() throws Exception {
  15.         List <Row> df = Arrays.asList(
  16.             Row.of("0L", "1L", 0.6),
  17.             Row.of("2L", "2L", 0.8),
  18.             Row.of("2L", "4L", 0.6),
  19.             Row.of("3L", "1L", 0.6),
  20.             Row.of("3L", "2L", 0.3),
  21.             Row.of("3L", "4L", 0.4)
  22.         );
  23.         StreamOperator <?> source = new MemSourceStreamOp(df, "uid string, iid string, label double");
  24.         String filepath = "/tmp/abc.tsv";
  25.         StreamOperator <?> tsvSink = new TsvSinkStreamOp()
  26.             .setFilePath(filepath)
  27.             .setOverwriteSink(true);
  28.         source.link(tsvSink);
  29.         StreamOperator.execute();
  30.         StreamOperator <?> tsvSource = new TsvSourceStreamOp().setFilePath(filepath).setSchemaStr("f string");
  31.         tsvSource.print();
  32.         StreamOperator.execute();
  33.     }
  34. }

运行结果

| f | | —- |

| 3L |

| 0L |

| 3L |

| 3L |

| 2L |

| 2L |