Skip to main content

module aixplain.utils.validation_utils

Global Variables​

  • FunctionInputOutput

function dataset_onboarding_validation​

dataset_onboarding_validation(
    input_schema: List[Union[Dict, MetaData]],
    output_schema: List[Union[Dict, MetaData]],
    function: Function,
    input_ref_data: Dict[str, Any] = {},
    metadata_schema: List[Union[Dict, MetaData]] = [],
    content_path: Union[str, Path, List[Union[str, Path]]] = [],
    split_labels: Optional[List[str]] = None,
    split_rate: Optional[List[float]] = None,
    s3_link: Optional[str] = None
) → None

Dataset Onboard Validation

Args:

  • input_schema (List[Union[Dict, MetaData]]): metadata of inputs
  • output_schema (List[Union[Dict, MetaData]]): metadata of outputs
  • function (Function): dataset function
  • input_ref_data (Dict[Text, Any], optional): reference to input data which is already in the platform. Defaults to .
  • metadata_schema (List[Union[Dict, MetaData]], optional): metadata of metadata information of the dataset. Defaults to [].
  • content_path (Union[Union[Text, Path], List[Union[Text, Path]]]): path to files which contain the data content
  • split_labels: (Optional[List[Text]]): The delimiters according which to split the dataset
  • split_rate: (Optional[List[float]]): the rate of spliting the dataset
  • s3_link (Optional[str]): s3 url to files or directories