load_from_snap_format

pai4sk.sml_io.load_from_snap_format(filename, num_chunks=None)

Data loading from Snap formatted data file. It supports both local and distributed(MPI) method of loading data. For MPI execution this can be used for distributed SnapML training and inference.

Parameters

• filename (str) – The file where the data resides in snap format.

• num_chunks (int) – Number of chunks per partition

Returns

data partition – Returns a data partition in sparse, dense or compressed sparse format which will be used for distributed _snap_ml training and inference. The type of data format (sparse, dense, compressed) is automatically detected from the input file header. To dump data in snap format, one should use the dump_to_snap_format function from _snap_ml.Utils.

Return type

_snap_ml.Partition