Coverage for packages / dqm-ml-job / src / dqm_ml_job / dataloaders / __init__.py: 100%

1"""Data loaders module for DQM ML Job. 

2 

3This module contains classes for loading data from various sources 

4and protocols. It provides the DataLoader and DataSelection protocols 

5along with concrete implementations for different file formats. 

6 

7Classes: 

8 DataLoader: Protocol for data loader factories. 

9 DataSelection: Protocol for data subsets. 

10 ParquetDataLoader: Loader for Parquet files. 

11 PandasDataLoader: Loader for CSV files using Pandas. 

12""" 

13 

14from dqm_ml_job.dataloaders.pandas import PandasDataLoader 

15from dqm_ml_job.dataloaders.parquet import ParquetDataLoader 

16from dqm_ml_job.dataloaders.proto import DataLoader, DataSelection 

17 

18# Registry of supported data loaders 

19dqml_dataloaders_registry = {"parquet": ParquetDataLoader, "csv": PandasDataLoader} 

20 

21__all__ = [ 

22 "DataLoader", 

23 "DataSelection", 

24 "PandasDataLoader", 

25 "ParquetDataLoader", 

26 "dqml_dataloaders_registry", 

27]