16 lines
2.1 KiB
Plaintext
16 lines
2.1 KiB
Plaintext
|
§
|
|||
|
|
ç?±f™ ã ó^ — d dl mZ d dlmZ d„ Z e¦ « Zefd„Zd d„Zedfd„Zd d „Z d
|
|||
|
|
S )
|
|||
|
|
é ©ÚHuggingFaceBgeEmbeddings)ÚFAISSc ó> — d} ddi}ddi}t | ||¬¦ « }|S )NzBAAI/bge-small-enÚdeviceÚcudaÚnormalize_embeddingsT)Ú
|
|||
|
|
model_nameÚ model_kwargsÚ
|
|||
|
|
encode_kwargsr )r
|
|||
|
|
r r Ú
|
|||
|
|
embeddingss úWc:\Users\timmy_3aupohg\Downloads\Manaknight Projects\ds_aiindex\data_ingestion\utils.pyÚload_embedding_modelr s? € Ø$€JØ ˜fÐ%€LØ+¨TÐ2€MÝ)Ø%°LÐP]ðñ ô €Jð Ðó c ó0 — t j | |¦ « }|S )N)r Úfrom_documents)Údocumentr
|
|||
|
|
Úembed_dbs r Úcreate_vector_storer s € Ý
|
|||
|
|
Ô
|
|||
|
|
! (¨JÑ
|
|||
|
|
7Ô
|
|||
|
|
7€(Ø €/r Úpdfc óT — | d|› �¦ « t d¦ « d S )Núvec-db/index/faiss_index_zEmbeddings saved)Ú
|
|||
|
|
save_localÚprint)ÚdocsÚkeys r Úsave_embedded_datar s2 € ؇/‚/Ð3¨cÐ3Ð3Ñ4Ô4Ð4ÝÐÑÔÐÐÐr c ó: — t j d|› �| d¬¦ « }|S )Nr T)Ú allow_dangerous_deserialization)r Ú
|
|||
|
|
load_local)r
|
|||
|
|
r r s r Úload_embedded_datar! s( € Ý
|