# utils

Python API: `luxonis_ml.data.utils`

Utility helpers shared by the data package.

This package collects public helper APIs used by dataset creation, parsing, loading, exporting, validation, and visualization. The
utilities are grouped by the part of the data workflow they support:

Utility groups

| Group | Public APIs |
| --- | --- |
| Task keys |
[task_is_metadata](https://docs.luxonis.com/software-v3/ai-inference/model-source/training/luxonis-ml/luxonis-ml-api-reference/data/utils/task_utils.md),
[split_task](https://docs.luxonis.com/software-v3/ai-inference/model-source/training/luxonis-ml/luxonis-ml-api-reference/data/utils/task_utils.md),
[get_task_name](https://docs.luxonis.com/software-v3/ai-inference/model-source/training/luxonis-ml/luxonis-ml-api-reference/data/utils/task_utils.md),
[get_task_type](https://docs.luxonis.com/software-v3/ai-inference/model-source/training/luxonis-ml/luxonis-ml-api-reference/data/utils/task_utils.md),
and
[task_type_iterator](https://docs.luxonis.com/software-v3/ai-inference/model-source/training/luxonis-ml/luxonis-ml-api-reference/data/utils/task_utils.md)
parse and filter `"task_name/task_type"` labels. |
| Storage and parser enums |
[BucketStorage](https://docs.luxonis.com/software-v3/ai-inference/model-source/training/luxonis-ml/luxonis-ml-api-reference/data/utils/enums.md),
[BucketType](https://docs.luxonis.com/software-v3/ai-inference/model-source/training/luxonis-ml/luxonis-ml-api-reference/data/utils/enums.md),
[MediaType](https://docs.luxonis.com/software-v3/ai-inference/model-source/training/luxonis-ml/luxonis-ml-api-reference/data/utils/enums.md),
[ImageType](https://docs.luxonis.com/software-v3/ai-inference/model-source/training/luxonis-ml/luxonis-ml-api-reference/data/utils/enums.md),
[UpdateMode](https://docs.luxonis.com/software-v3/ai-inference/model-source/training/luxonis-ml/luxonis-ml-api-reference/data/utils/enums.md),
[ParserIssue](https://docs.luxonis.com/software-v3/ai-inference/model-source/training/luxonis-ml/luxonis-ml-api-reference/data/utils/enums.md),
and
[ParserIssueMessage](https://docs.luxonis.com/software-v3/ai-inference/model-source/training/luxonis-ml/luxonis-ml-api-reference/data/utils/enums.md).
|
| Dataframe and parquet helpers |
[ParquetFileManager](https://docs.luxonis.com/software-v3/ai-inference/model-source/training/luxonis-ml/luxonis-ml-api-reference/data/utils/parquet.md),
[ParquetRecord](https://docs.luxonis.com/software-v3/ai-inference/model-source/training/luxonis-ml/luxonis-ml-api-reference/data/utils/parquet.md),
duplicate detection, class distributions, missing-annotation summaries, heatmaps, and UUID merging. |
| Remote media |
[RemoteFileDownloader](https://docs.luxonis.com/software-v3/ai-inference/model-source/training/luxonis-ml/luxonis-ml-api-reference/data/utils/remote_file_downloader.md)
and
[download_remote_file](https://docs.luxonis.com/software-v3/ai-inference/model-source/training/luxonis-ml/luxonis-ml-api-reference/data/utils/remote_file_downloader.md)
copy supported remote files to local paths and validate image inputs. |
| Visualization |
[visualize](https://docs.luxonis.com/software-v3/ai-inference/model-source/training/luxonis-ml/luxonis-ml-api-reference/data/utils/visualizations.md),
color-map helpers, image concatenation, augmentation footers, and dataset-statistic plots. |
| Equivalence and augmentation inspection | LDF equivalence checks and
[AugmentationsCollector](https://docs.luxonis.com/software-v3/ai-inference/model-source/training/luxonis-ml/luxonis-ml-api-reference/data/utils/augmentations_collector.md)
summaries for configured augmentation pipelines. |

The task-key helpers follow the same convention as
[LuxonisLoader](https://docs.luxonis.com/software-v3/ai-inference/model-source/training/luxonis-ml/luxonis-ml-api-reference/data/loaders/luxonis_loader.md):
labels are addressed by `"task_name/task_type"` and metadata labels use `"task_name/metadata/key"` or `"metadata/key"` when no
task name is present.

## Child Pages

 * [augmentations_collector](https://docs.luxonis.com/software-v3/ai-inference/model-source/training/luxonis-ml/luxonis-ml-api-reference/data/utils/augmentations_collector.md)
 * [cli_utils](https://docs.luxonis.com/software-v3/ai-inference/model-source/training/luxonis-ml/luxonis-ml-api-reference/data/utils/cli_utils.md)
 * [constants](https://docs.luxonis.com/software-v3/ai-inference/model-source/training/luxonis-ml/luxonis-ml-api-reference/data/utils/constants.md)
 * [data_utils](https://docs.luxonis.com/software-v3/ai-inference/model-source/training/luxonis-ml/luxonis-ml-api-reference/data/utils/data_utils.md)
 * [enums](https://docs.luxonis.com/software-v3/ai-inference/model-source/training/luxonis-ml/luxonis-ml-api-reference/data/utils/enums.md)
 * [ldf_equivalence](https://docs.luxonis.com/software-v3/ai-inference/model-source/training/luxonis-ml/luxonis-ml-api-reference/data/utils/ldf_equivalence.md)
 * [parquet](https://docs.luxonis.com/software-v3/ai-inference/model-source/training/luxonis-ml/luxonis-ml-api-reference/data/utils/parquet.md)
 * [plot_utils](https://docs.luxonis.com/software-v3/ai-inference/model-source/training/luxonis-ml/luxonis-ml-api-reference/data/utils/plot_utils.md)
 * [remote_file_downloader](https://docs.luxonis.com/software-v3/ai-inference/model-source/training/luxonis-ml/luxonis-ml-api-reference/data/utils/remote_file_downloader.md)
 * [task_utils](https://docs.luxonis.com/software-v3/ai-inference/model-source/training/luxonis-ml/luxonis-ml-api-reference/data/utils/task_utils.md)
 * [visualizations](https://docs.luxonis.com/software-v3/ai-inference/model-source/training/luxonis-ml/luxonis-ml-api-reference/data/utils/visualizations.md)