Inheritance diagram for external_memory.Iterator:
Public Member Functions | |
| __init__ (self, List[Tuple[str, str]] file_paths) | |
| Tuple[np.ndarray, np.ndarray] | load_file (self) |
| int | next (self, Callable input_data) |
| None | reset (self) |
 Public Member Functions inherited from xgboost.core.DataIter | |
| Tuple[Callable, Callable] | get_callbacks (self, bool allow_host, bool enable_categorical) |
| "_ProxyDMatrix" | proxy (self) |
| None | reraise (self) |
| None | __del__ (self) |
Protected Attributes | |
| _file_paths | |
| _it | |
| Protected Attributes inherited from xgboost.core.DataIter | |
| _handle | |
| _enable_categorical | |
| _allow_host | |
| _release | |
| _reset_callback | |
| _next_callback | |
| _next_wrapper | |
| _exception | |
| _temporary_data | |
| _data_ref | |
Additional Inherited Members | |
| Data Fields inherited from xgboost.core.DataIter | |
| cache_prefix | |
| proxy | |
| Protected Member Functions inherited from xgboost.core.DataIter | |
| _T | _handle_exception (self, Callable fn, _T dft_ret) |
| None | _reset_wrapper (self, None this) |
| int | _next_wrapper (self, None this) |
Detailed Description
A custom iterator for loading files in batches.
Constructor & Destructor Documentation
◆ __init__()
| external_memory.Iterator.__init__ | ( | self, | |
| List[Tuple[str, str]] | file_paths | ||
| ) |
Reimplemented from xgboost.core.DataIter.
Member Function Documentation
◆ next()
| int external_memory.Iterator.next | ( | self, | |
| Callable | input_data | ||
| ) |
Advance the iterator by 1 step and pass the data to XGBoost. This function is called by XGBoost during the construction of ``DMatrix``
Reimplemented from xgboost.core.DataIter.
◆ reset()
| None external_memory.Iterator.reset | ( | self | ) |
Reset the iterator to its beginning
Reimplemented from xgboost.core.DataIter.
The documentation for this class was generated from the following file:
- External/xgboost/demo/guide-python/external_memory.py
