autorag.data.utils package

Submodules

autorag.data.utils.util module

autorag.data.utils.util.add_essential_metadata(metadata: Dict) → Dict[source]
autorag.data.utils.util.add_essential_metadata_llama_text_node(metadata: Dict, relationships: Dict) → Dict[source]
autorag.data.utils.util.corpus_df_to_langchain_documents(corpus_df: DataFrame) → List[Document][source]
autorag.data.utils.util.get_file_metadata(file_path: str) → Dict[source]

Get some handy metadate from filesystem.

Args:

file_path: str: file path in str

autorag.data.utils.util.get_param_combinations(modules: List[Dict]) → Tuple[List[Callable], List[Dict]][source]
autorag.data.utils.util.get_start_end_idx(original_text: str, search_str: str) → Tuple[int, int][source]
autorag.data.utils.util.load_yaml(yaml_path: str)[source]

Module contents