roboto.upload_agent.files#
Module Contents#
- roboto.upload_agent.files.UPLOAD_COMPLETE_FILENAME = '.roboto_upload_complete.json'#
- roboto.upload_agent.files.UPLOAD_IN_PROGRESS_FILENAME = '.roboto_upload_in_progress.json'#
- class roboto.upload_agent.files.UploadAgentConfig(/, **data)#
Bases:
pydantic.BaseModelUpload agent configuration
- Parameters:
data (Any)
- default_org_id: str | None = None#
The org ID to use when creating datasets via –merge-uploads, or other operations which may have an ambiguous org.
- delete_empty_directories: bool = False#
If set to true, directories which are empty (or only contain a .roboto_upload_complete.json) after being uploaded will be automatically deleted. This is most useful if combined with delete_upload_files=True
- delete_uploaded_files: bool = False#
If set to true, will delete files from disk after they’ve been successfully uploaded to Roboto.
- search_paths: list[pathlib.Path]#
Directories to recursively scan for files to upload.
- upload_config_filename: str = '.roboto_upload.json'#
The name of the upload marker file to look for.
- version: Literal['v1'] = 'v1'#
- class roboto.upload_agent.files.UploadCompleteFile(/, **data)#
Bases:
pydantic.BaseModelUpload agent complete file
- Parameters:
data (Any)
- completed: datetime.datetime#
- dataset_id: str#
- version: Literal['v1'] = 'v1'#
- class roboto.upload_agent.files.UploadConfigFile(/, **data)#
Bases:
pydantic.BaseModelUpload agent config file
- Parameters:
data (Any)
- dataset: UploadConfigFileDatasetSection = None#
- upload: UploadConfigFileUploadSection = None#
- version: Literal['v1'] = 'v1'#
- class roboto.upload_agent.files.UploadConfigFileDatasetSection(**data)#
Bases:
roboto.domain.datasets.CreateDatasetRequestUpload agent config file dataset section
- add_to_collections: List[str] | None = None#
An optional list of collection IDs to attempt to add this dataset to.
- org_id: str | None = None#