ml.dmlc.xgboost4j.java.spark.rapids

Interface PartitionReader<T>

All Superinterfaces:

AutoCloseable, Closeable

public interface PartitionReader<T>
extends Closeable

A partition reader returned by { PartitionReaderFactory#createReader(InputPartition)} or { PartitionReaderFactory#createColumnarReader(InputPartition)}. It's responsible for outputting data for a RDD partition. Note that, Currently the type `T` can only be GpuColumnBatch for normal data sources, or { org.apache.spark.sql.vectorized.ColumnarBatch} for columnar data sources(whose { PartitionReaderFactory#supportColumnarReads(InputPartition)} returns true).

Method Summary

Modifier and Type	Method and Description
T	get() Return the current record.
boolean	next() Proceed to next record, returns false if there is no more records.

Methods inherited from interface java.io.Closeable

close

Method Detail

next

boolean next()
      throws IOException

Proceed to next record, returns false if there is no more records.

Throws:

IOException - if failure happens during disk/network IO like reading files.

get

T get()

Return the current record. This method should return same value until `next` is called.