Skip to content

DatasetVersionProps

Properties for defining a DatasetVersion.

See https://www.alibabacloud.com/help/ros/developer-reference/aliyun-pai-datasetversion

Initializer 

import ros_cdk_pai
ros_cdk_pai.DatasetVersionProps(
  dataset_id: typing.Union[str, IResolvable],
  data_source_type: typing.Union[str, IResolvable],
  property: typing.Union[str, IResolvable],
  uri: typing.Union[str, IResolvable],
  data_count: typing.Union[typing.Union[int, float], IResolvable] = None,
  data_size: typing.Union[typing.Union[int, float], IResolvable] = None,
  description: typing.Union[str, IResolvable] = None,
  labels: typing.Union[IResolvable, typing.List[typing.Union[IResolvable, LabelsProperty]]] = None,
  options: typing.Union[str, IResolvable] = None,
  source_id: typing.Union[str, IResolvable] = None,
  source_type: typing.Union[str, IResolvable] = None
)

Properties

Name Type Description
dataset_id typing.Union[str, ros_cdk_core.IResolvable] Property datasetId: The ID of the dataset.
data_source_type typing.Union[str, ros_cdk_core.IResolvable] Property dataSourceType: The data source type.
property typing.Union[str, ros_cdk_core.IResolvable] Property property: The properties of the dataset.
uri typing.Union[str, ros_cdk_core.IResolvable] Property uri: The Uri configuration sample is as follows: - The data source type is OSS:'oss:\/\/bucket.endpoint\/object' - The data source type is NAS: The general NAS format is: 'nas:\/\/.region\/subpath\/to\/dir\/'; CPFS1.0:'nas:\/\/.region\/subpath\/to\/dir \/'; CPFS2.0:'nas:\/\/.region\/\/'. CPFS1.0 and CPFS2.0 are distinguished by the format of fsid: CPFS1.0 is cpfs-<8-bit ascii characters>;CPFS2.0 is cpfs-<16 ascii characters>.
data_count typing.Union[typing.Union[int, float], ros_cdk_core.IResolvable] Property dataCount: The number of dataset files, in units of pieces.
data_size typing.Union[typing.Union[int, float], ros_cdk_core.IResolvable] Property dataSize: The size of the dataset file in bytes.
description typing.Union[str, ros_cdk_core.IResolvable] Property description: To create a custom description for dataset versions in order to distinguish between different versions of the dataset.
labels typing.Union[ros_cdk_core.IResolvable, typing.List[typing.Union[ros_cdk_core.IResolvable, LabelsProperty]]] Property labels: Dataset version tag list.
options typing.Union[str, ros_cdk_core.IResolvable] Property options: The extended field, which is of the JsonString type.
source_id typing.Union[str, ros_cdk_core.IResolvable] Property sourceId: The data source ID.
source_type typing.Union[str, ros_cdk_core.IResolvable] Property sourceType: The data source type.

dataset_idRequired 

dataset_id: typing.Union[str, IResolvable]
  • Type: typing.Union[str, ros_cdk_core.IResolvable]

Property datasetId: The ID of the dataset.

data_source_typeRequired 

data_source_type: typing.Union[str, IResolvable]
  • Type: typing.Union[str, ros_cdk_core.IResolvable]

Property dataSourceType: The data source type.

The following values are supported:

  • OSS: Alibaba Cloud Object Storage (OSS).
  • NAS: Alibaba cloud file storage (NAS).
  • CPFS

propertyRequired 

property: typing.Union[str, IResolvable]
  • Type: typing.Union[str, ros_cdk_core.IResolvable]

Property property: The properties of the dataset.

The following values are supported:

  • FILE: FILE.
  • DIRECTORY: folder.

uriRequired 

uri: typing.Union[str, IResolvable]
  • Type: typing.Union[str, ros_cdk_core.IResolvable]

Property uri: The Uri configuration sample is as follows: - The data source type is OSS:'oss:\/\/bucket.endpoint\/object' - The data source type is NAS: The general NAS format is: 'nas:\/\/.region\/subpath\/to\/dir\/'; CPFS1.0:'nas:\/\/.region\/subpath\/to\/dir \/'; CPFS2.0:'nas:\/\/.region\/\/'. CPFS1.0 and CPFS2.0 are distinguished by the format of fsid: CPFS1.0 is cpfs-<8-bit ascii characters>;CPFS2.0 is cpfs-<16 ascii characters>.

data_countOptional 

data_count: typing.Union[typing.Union[int, float], IResolvable]
  • Type: typing.Union[typing.Union[int, float], ros_cdk_core.IResolvable]

Property dataCount: The number of dataset files, in units of pieces.

data_sizeOptional 

data_size: typing.Union[typing.Union[int, float], IResolvable]
  • Type: typing.Union[typing.Union[int, float], ros_cdk_core.IResolvable]

Property dataSize: The size of the dataset file in bytes.

descriptionOptional 

description: typing.Union[str, IResolvable]
  • Type: typing.Union[str, ros_cdk_core.IResolvable]

Property description: To create a custom description for dataset versions in order to distinguish between different versions of the dataset.

labelsOptional 

labels: typing.Union[IResolvable, typing.List[typing.Union[IResolvable, LabelsProperty]]]
  • Type: typing.Union[ros_cdk_core.IResolvable, typing.List[typing.Union[ros_cdk_core.IResolvable, LabelsProperty]]]

Property labels: Dataset version tag list.

optionsOptional 

options: typing.Union[str, IResolvable]
  • Type: typing.Union[str, ros_cdk_core.IResolvable]

Property options: The extended field, which is of the JsonString type.

When DLC uses a dataset, you can specify the default Mount path for the dataset by configuring the mountPath field.

source_idOptional 

source_id: typing.Union[str, IResolvable]
  • Type: typing.Union[str, ros_cdk_core.IResolvable]

Property sourceId: The data source ID.

  • When the SourceType is USER, SourceId can be customized.
  • When SourceType is ITAG, that is, when the iTAG module labels the data set generated by the result, SourceId is the task ID of ITAG.
  • When SourceType is PAI_PUBLIC_DATASET, that is, a dataset created using PAI public datasets, SourceId is empty by default.

source_typeOptional 

source_type: typing.Union[str, IResolvable]
  • Type: typing.Union[str, ros_cdk_core.IResolvable]

Property sourceType: The data source type.

The default value is USER. The following values are supported:

  • PAI-PUBLIC-DATASET:PAI public dataset.
  • ITAG: The dataset generated by the iTAG module annotation result.
  • USER: The data set registered by the USER.