LlamaIndex Embeddings\u3068\u306f\uff08OpenAI\u30fbHuggingFace\u30fbOllama\uff09<\/h2>\n\n\n\n![\"\u898b\u51fa\u3057\u753b\u50cf\"](\"https:\/\/highreso.jp\/edgehub\/wp-content\/uploads\/2024\/10\/24_anime_midashi.jpg\")
<\/figure>\n\n\n\n\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\uff08Embeddings\uff09\u3068\u306f\u3001\u30c6\u30ad\u30b9\u30c8\u3084\u753b\u50cf\u7b49\u306e\u30c7\u30fc\u30bf\u3092\u6570\u5024\u30d9\u30af\u30c8\u30eb\u3068\u3057\u3066\u8868\u73fe\u3059\u308b\u624b\u6cd5\u3067\u3059\u3002<\/p>\n\n\n\n
\u3053\u308c\u306b\u3088\u308a\u3001\u5358\u8a9e\u3084\u6587\u7ae0\u306e\u610f\u5473\u7684\u306a\u985e\u4f3c\u6027\u3092\u6570\u5024\u5316\u3057\u3066\u3001RAG\u3067\u306e\u691c\u7d22\u3084\u5206\u985e\u3001\u985e\u4f3c\u5ea6\u8a08\u7b97\u304c\u884c\u3048\u308b\u3088\u3046\u306b\u306a\u308a\u307e\u3059\u3002<\/span><\/p>\n\n\n\n\u3053\u306e\u8a18\u4e8b\u3067\u306f\u3001LlamaIndex\u306b\u304a\u3051\u308bOpenAI\u3001HuggingFace\u3001Ollama\u306e3\u7a2e\u985e\u306e\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\u306e\u4f7f\u3044\u65b9\u3092\u7d39\u4ecb\u3057\u307e\u3059\u3002<\/p>\n\n\n\n
\n\n- \u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\u306b\u3088\u308aRAG\u3067\u306e\u691c\u7d22\u3084\u5206\u985e\u3001\u985e\u4f3c\u5ea6\u8a08\u7b97\u304c\u884c\u3048\u308b\u3088\u3046\u306b\u306a\u308b<\/li>\n\n\n\n
- LlamaIndex\u3067\u4f7f\u3048\u308bOpenAI\u3001HuggingFace\u3001Ollama\u306e3\u7a2e\u985e\u306e\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\u3092\u7d39\u4ecb<\/li>\n<\/ul>\n<\/div><\/div>\n\n\n\n1\u6642\u959350\u5186\u304b\u3089\u4f7f\u3048\u308bGPU\u30af\u30e9\u30a6\u30c9\u300cGPUSOROBAN\u300d<\/div>
![\"GPUSOROBAN\"](\"https:\/\/highreso.jp\/edgehub\/wp-content\/uploads\/2024\/06\/gpusorobanlllm_banner.jpg\")
<\/a><\/div><\/div><\/i><\/i><\/i><\/i><\/i><\/div>GPU\u306e\u30b3\u30b9\u30c8\u3067\u304a\u60a9\u307f\u306e\u65b9\u306b\uff01<\/div>\u751f\u6210AI\u30fbLLM\u5411\u3051\u306e\u9ad8\u901fGPU\u3092\u696d\u754c\u6700\u5b89\u7d1a\u306e1\u6642\u959350\u5186\u304b\u3089\u5229\u7528\u3067\u304d\u307e\u3059\u3002\r\n\u30a4\u30f3\u30bf\u30fc\u30cd\u30c3\u30c8\u74b0\u5883\u3055\u3048\u3042\u308c\u3070\u3001GPU\u30b5\u30fc\u30d0\u30fc\u3092\u3059\u3050\u306b\u4f7f\u3048\u307e\u3059\u3002\u30a4\u30f3\u30b9\u30bf\u30f3\u30b9\u3092\u8d77\u52d5\u3057\u3066\u3044\u308b\u3068\u304d\u306e\u307f\u306e\u8ab2\u91d1\u3067\u3001\u30b3\u30b9\u30c8\u3092\u6700\u5c0f\u5316\u3067\u304d\u307e\u3059\u3002\r\n<\/div><\/div><\/div>\u516c\u5f0f\u30b5\u30a4\u30c8\u3092\u898b\u308b<\/a>\u8cc7\u6599\u30c0\u30a6\u30f3\u30ed\u30fc\u30c9<\/a><\/div><\/div><\/p>\n<\/div>\n\n\n\nOpenAI Embeddings\u306e\u4f7f\u3044\u65b9<\/h2>\n\n\n\n![\"\u898b\u51fa\u3057\u753b\u50cf\"](\"https:\/\/highreso.jp\/edgehub\/wp-content\/uploads\/2024\/08\/koara7_midashi.jpg\")
<\/figure>\n\n\n\nOpenAI\u306e\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\u306e\u4f7f\u3044\u65b9\u3092\u7d39\u4ecb\u3057\u307e\u3059\u3002<\/span><\/p>\n\n\n\nOpenAI\u306e\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\u3092\u4f7f\u7528\u3059\u308b\u306b\u306f\u3001API\u30ad\u30fc\u306e\u767a\u884c\u304c\u5fc5\u8981\u306b\u306a\u308a\u3001OpenAI\u306e\u516c\u5f0f\u30b5\u30a4\u30c8<\/a>\u304b\u3089\u767a\u884c\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n\nSTEP<\/span><\/div>\u30d1\u30c3\u30b1\u30fc\u30b8\u306e\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb<\/div>\n\u5fc5\u8981\u306a\u30d1\u30c3\u30b1\u30fc\u30b8\u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3057\u307e\u3059\u3002<\/p>\n\n\n\n
pip install llama-index llama-index-embeddings-openai<\/code><\/pre>\n<\/div><\/div>\n\n\n\nSTEP<\/span><\/div>OpenAI\u306eAPI\u30ad\u30fc\u3092\u8a2d\u5b9a<\/div>\nOpenAI\u306eAPI\u30ad\u30fc\u3092\u74b0\u5883\u5909\u6570\u306b\u8a2d\u5b9a\u3057\u307e\u3059\u3002<\/p>\n\n\n\n
API\u30ad\u30fc\u306fOpenAI\u306e\u516c\u5f0f\u30b5\u30a4\u30c8<\/a>\u304b\u3089\u767a\u884c\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\nimport os\n\nos.environ[\"OPENAI_API_KEY\"] = \"***************\"<\/code><\/pre>\n<\/div><\/div>\n\n\n\nSTEP<\/span><\/div>OpenAI\u306e\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\u3092\u8aad\u307f\u8fbc\u3080<\/div>\nOpenAI\u306e\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\u3092\u8aad\u307f\u8fbc\u307f\u307e\u3059\u3002<\/p>\n\n\n\n
from llama_index.embeddings.openai import OpenAIEmbedding\n\nembed_model = OpenAIEmbedding(model=\"text-embedding-3-small\")<\/code><\/pre>\n\n\n\n\u30b3\u30fc\u30c9\u306e\u8aac\u660e<\/span><\/div>\nembed_model = OpenAIEmbedding(model=”text-embedding-3-small”)<\/span><\/p>\n\n\n\nOpenAIEmbedding<\/code>\uff1aOpenAI\u306e\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30ebtext-embedding-3-small<\/code>\u3092\u8aad\u307f\u8fbc\u3093\u3067\u3044\u307e\u3059\u3002<\/p>\n\n\n\ntext-embedding-3-small<\/code>\u306f\u30b3\u30b9\u30c8\u3068\u30ea\u30bd\u30fc\u30b9\u52b9\u7387\u306b\u512a\u308c\u308b\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\u3067\u3059\u3002Large\u30e2\u30c7\u30eb\u306etext-embedding-3-large<\/code>\u3092\u6307\u5b9a\u3057\u305f\u5834\u5408\u3001\u6027\u80fd\u304c\u5411\u4e0a\u3057\u307e\u3059\u304c\u3001\u305d\u306e\u5206\u30b3\u30b9\u30c8\u3068\u5fdc\u7b54\u6642\u9593\u304c\u304b\u304b\u308a\u307e\u3059\u3002<\/p>\n<\/div><\/div>\n<\/div><\/div>\n\n\n\nSTEP<\/span><\/div>OpenAI\u306e\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\u3092\u30c6\u30b9\u30c8<\/div>\n\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\u3092\u4f7f\u7528\u3057\u3066\u3001\u30c6\u30ad\u30b9\u30c8\u3092\u6570\u5024\u30d9\u30af\u30c8\u30eb\u306b\u5909\u63db\u3057\u307e\u3059\u3002<\/p>\n\n\n\n
text = \"\u3053\u308c\u306f\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\u306e\u30c6\u30b9\u30c8\u3067\u3059\u3002\"\nembeddings = embed_model.get_text_embedding(text)\nprint(embeddings[:10])<\/code><\/pre>\n\n\n\n[0.021757090464234352, 0.03871193900704384, -0.00824466347694397, -0.05321666598320007, 0.0003585218801163137, 2.6869998691836372e-05, -0.0034026079811155796, 0.018241163343191147, 0.0114543242380023, -0.02156108058989048]<\/code><\/pre>\n\n\n\n\u30b3\u30fc\u30c9\u306e\u8aac\u660e<\/span><\/div>\nembed_model.get_text_embedding(text) <\/span><\/p>\n\n\n\n\u6307\u5b9a\u3057\u305f\u30c6\u30ad\u30b9\u30c8\u3092\u6570\u5024\u30d9\u30af\u30c8\u30eb\uff08\u57cb\u3081\u8fbc\u307f\u30d9\u30af\u30c8\u30eb\uff09\u306b\u5909\u63db\u3057\u307e\u3059\u3002<\/p>\n<\/div><\/div>\n<\/div><\/div>\n<\/div>\n\n\n\n
HuggingFace Embeddings\u306e\u4f7f\u3044\u65b9<\/h2>\n\n\n\n![\"\u898b\u51fa\u3057\u753b\u50cf\"](\"https:\/\/highreso.jp\/edgehub\/wp-content\/uploads\/2024\/08\/cat40_midashi.jpg\")
<\/figure>\n\n\n\nHuggingFace\u306e\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\u306e\u4f7f\u3044\u65b9\u3092\u7d39\u4ecb\u3057\u307e\u3059\u3002<\/span><\/p>\n\n\n\nHuggingFace\u306e\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\u306b\u306fGPU\u74b0\u5883\u304c\u5fc5\u8981\u306b\u306a\u308a\u307e\u3059\u3002<\/p>\n\n\n\n
GPU\u74b0\u5883\u306e\u69cb\u7bc9\u65b9\u6cd5\u306f\u5225\u306e\u8a18\u4e8b\u3067\u89e3\u8aac\u3057\u3066\u3044\u307e\u3059\u3002<\/p>\n\n\n
\t\t\t\n\t\t\t\t\n\t\t\t\t\t\u3042\u308f\u305b\u3066\u8aad\u307f\u305f\u3044<\/span>\n\t\t\t\t\t![\"\"](\"https:\/\/highreso.jp\/edgehub\/wp-content\/uploads\/2024\/06\/ubuntudocker-eyecatch-300x158.jpg\")
<\/figure><\/div>\t\t\t\t\t\n\t\t\t\t\t\tUbuntu\u306bDocker\u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\uff01GPU\u3092\u30b3\u30f3\u30c6\u30ca\u304b\u3089\u4f7f\u3046\u65b9\u6cd5<\/a>\n\t\t\t\t\t\tGPU\u306e\u74b0\u5883\u69cb\u7bc9\u3067\u306f\u3001\u30bd\u30d5\u30c8\u30a6\u30a7\u30a2\u306e\u30d0\u30fc\u30b8\u30e7\u30f3\u4e0d\u4e00\u81f4\u306b\u3088\u308b\u30a8\u30e9\u30fc\u304c\u983b\u767a\u3057\u307e\u3059\u3002 Docker\u3092\u4f7f\u3046\u3053\u3068\u3067\u3001\u3053\u306e\u3088\u3046\u306a\u4f9d\u5b58\u95a2\u4fc2\u306e\u30a8\u30e9\u30fc\u3092\u56de\u907f\u3057\u3084\u3059\u304f\u306a\u308a\u307e\u3059\u3002 \u3053\u306e\u8a18\u4e8b\u3067…<\/span>\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t<\/div>\n\t\t<\/div>\n\n\n\nSTEP<\/span><\/div>\u30d1\u30c3\u30b1\u30fc\u30b8\u306e\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb<\/div>\n\u5fc5\u8981\u306a\u30d1\u30c3\u30b1\u30fc\u30b8\u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3057\u307e\u3059\u3002<\/p>\n\n\n\n
pip install llama-index llama-index-embeddings-huggingface<\/code><\/pre>\n<\/div><\/div>\n\n\n\nSTEP<\/span><\/div>HuggingFace\u306e\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\u3092\u8aad\u307f\u8fbc\u3080<\/div>\nHuggingFace\u306e\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\u3092\u8aad\u307f\u8fbc\u307f\u307e\u3059\u3002<\/p>\n\n\n\n
from llama_index.embeddings.huggingface import HuggingFaceEmbedding\n\nembed_model = HuggingFaceEmbedding(model_name=\"intfloat\/multilingual-e5-large\")<\/code><\/pre>\n\n\n\n\u30b3\u30fc\u30c9\u306e\u8aac\u660e<\/span><\/div>\nHuggingFaceEmbedding(model_name=”intfloat\/multilingual-e5-large”)<\/span><\/p>\n\n\n\nHuggingFace\u306e\u30e2\u30c7\u30eb intfloat\/multilingual-e5-large<\/code> \u3092\u4f7f\u3063\u3066\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\u3092\u8aad\u307f\u8fbc\u3093\u3067\u3044\u307e\u3059\u3002\u3053\u306e\u30e2\u30c7\u30eb\u306f\u65e5\u672c\u8a9e\u6027\u80fd\u304c\u9ad8\u304f\u3001\u7121\u6599\u3067\u4f7f\u3048\u308b\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\u3067\u3059\u3002<\/p>\n<\/div><\/div>\n<\/div><\/div>\n\n\n\nSTEP<\/span><\/div>HuggingFace\u306e\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\u3092\u30c6\u30b9\u30c8<\/div>\n\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\u3092\u4f7f\u7528\u3057\u3066\u3001\u30c6\u30ad\u30b9\u30c8\u3092\u6570\u5024\u30d9\u30af\u30c8\u30eb\u306b\u5909\u63db\u3057\u307e\u3059\u3002<\/p>\n\n\n\n
text = \"\u3053\u308c\u306f\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\u306e\u30c6\u30b9\u30c8\u3067\u3059\u3002\"\nembeddings = embed_model.get_text_embedding(text)\nprint(embeddings[:10])<\/code><\/pre>\n\n\n\n[0.02069464884698391, -0.014187865890562534, -0.02731310948729515, -0.06284146755933762, 0.027987537905573845, -0.026079582050442696, 0.014470797032117844, 0.07950162887573242, 0.05525951832532883, -0.02208035998046398]<\/code><\/pre>\n\n\n\n\u30b3\u30fc\u30c9\u306e\u8aac\u660e<\/span><\/div>\nembed_model.get_text_embedding(text) <\/span><\/p>\n\n\n\n\u6307\u5b9a\u3057\u305f\u30c6\u30ad\u30b9\u30c8\u3092\u6570\u5024\u30d9\u30af\u30c8\u30eb\uff08\u57cb\u3081\u8fbc\u307f\u30d9\u30af\u30c8\u30eb\uff09\u306b\u5909\u63db\u3057\u307e\u3059\u3002<\/p>\n<\/div><\/div>\n<\/div><\/div>\n<\/div>\n\n\n\n
Ollama Embeddings\u306e\u4f7f\u3044\u65b9<\/h2>\n\n\n\n![\"\u898b\u51fa\u3057\u753b\u50cf\"](\"https:\/\/highreso.jp\/edgehub\/wp-content\/uploads\/2024\/09\/4_midashi_sf0923.jpg\")
<\/figure>\n\n\n\nOllama\u306e\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\u306e\u4f7f\u3044\u65b9\u3092\u7d39\u4ecb\u3057\u307e\u3059\u3002<\/span><\/p>\n\n\n\nOllama\u306e\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\u306b\u306follama-python\u306e\u74b0\u5883\u69cb\u7bc9\u304c\u5fc5\u8981\u306b\u306a\u308a\u307e\u3059\u3002<\/p>\n\n\n\n
ollama-python\u306e\u74b0\u5883\u69cb\u7bc9\u306f\u5225\u306e\u8a18\u4e8b\u3067\u89e3\u8aac\u3057\u3066\u3044\u307e\u3059\u3002<\/p>\n\n\n
<\/figure>\n\n\n\n\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\uff08Embeddings\uff09\u3068\u306f\u3001\u30c6\u30ad\u30b9\u30c8\u3084\u753b\u50cf\u7b49\u306e\u30c7\u30fc\u30bf\u3092\u6570\u5024\u30d9\u30af\u30c8\u30eb\u3068\u3057\u3066\u8868\u73fe\u3059\u308b\u624b\u6cd5\u3067\u3059\u3002<\/p>\n\n\n\n
\u3053\u308c\u306b\u3088\u308a\u3001\u5358\u8a9e\u3084\u6587\u7ae0\u306e\u610f\u5473\u7684\u306a\u985e\u4f3c\u6027\u3092\u6570\u5024\u5316\u3057\u3066\u3001RAG\u3067\u306e\u691c\u7d22\u3084\u5206\u985e\u3001\u985e\u4f3c\u5ea6\u8a08\u7b97\u304c\u884c\u3048\u308b\u3088\u3046\u306b\u306a\u308a\u307e\u3059\u3002<\/span><\/p>\n\n\n\n \u3053\u306e\u8a18\u4e8b\u3067\u306f\u3001LlamaIndex\u306b\u304a\u3051\u308bOpenAI\u3001HuggingFace\u3001Ollama\u306e3\u7a2e\u985e\u306e\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\u306e\u4f7f\u3044\u65b9\u3092\u7d39\u4ecb\u3057\u307e\u3059\u3002<\/p>\n\n\n\n OpenAI\u306e\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\u306e\u4f7f\u3044\u65b9\u3092\u7d39\u4ecb\u3057\u307e\u3059\u3002<\/span><\/p>\n\n\n\n OpenAI\u306e\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\u3092\u4f7f\u7528\u3059\u308b\u306b\u306f\u3001API\u30ad\u30fc\u306e\u767a\u884c\u304c\u5fc5\u8981\u306b\u306a\u308a\u3001OpenAI\u306e\u516c\u5f0f\u30b5\u30a4\u30c8<\/a>\u304b\u3089\u767a\u884c\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n \u5fc5\u8981\u306a\u30d1\u30c3\u30b1\u30fc\u30b8\u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3057\u307e\u3059\u3002<\/p>\n\n\n\n OpenAI\u306eAPI\u30ad\u30fc\u3092\u74b0\u5883\u5909\u6570\u306b\u8a2d\u5b9a\u3057\u307e\u3059\u3002<\/p>\n\n\n\n API\u30ad\u30fc\u306fOpenAI\u306e\u516c\u5f0f\u30b5\u30a4\u30c8<\/a>\u304b\u3089\u767a\u884c\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n OpenAI\u306e\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\u3092\u8aad\u307f\u8fbc\u307f\u307e\u3059\u3002<\/p>\n\n\n\n embed_model = OpenAIEmbedding(model=”text-embedding-3-small”)<\/span><\/p>\n\n\n\n \u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\u3092\u4f7f\u7528\u3057\u3066\u3001\u30c6\u30ad\u30b9\u30c8\u3092\u6570\u5024\u30d9\u30af\u30c8\u30eb\u306b\u5909\u63db\u3057\u307e\u3059\u3002<\/p>\n\n\n\n embed_model.get_text_embedding(text) <\/span><\/p>\n\n\n\n \u6307\u5b9a\u3057\u305f\u30c6\u30ad\u30b9\u30c8\u3092\u6570\u5024\u30d9\u30af\u30c8\u30eb\uff08\u57cb\u3081\u8fbc\u307f\u30d9\u30af\u30c8\u30eb\uff09\u306b\u5909\u63db\u3057\u307e\u3059\u3002<\/p>\n<\/div><\/div>\n<\/div><\/div>\n<\/div>\n\n\n\n HuggingFace\u306e\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\u306e\u4f7f\u3044\u65b9\u3092\u7d39\u4ecb\u3057\u307e\u3059\u3002<\/span><\/p>\n\n\n\n HuggingFace\u306e\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\u306b\u306fGPU\u74b0\u5883\u304c\u5fc5\u8981\u306b\u306a\u308a\u307e\u3059\u3002<\/p>\n\n\n\n GPU\u74b0\u5883\u306e\u69cb\u7bc9\u65b9\u6cd5\u306f\u5225\u306e\u8a18\u4e8b\u3067\u89e3\u8aac\u3057\u3066\u3044\u307e\u3059\u3002<\/p>\n\n\n \u5fc5\u8981\u306a\u30d1\u30c3\u30b1\u30fc\u30b8\u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3057\u307e\u3059\u3002<\/p>\n\n\n\n HuggingFace\u306e\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\u3092\u8aad\u307f\u8fbc\u307f\u307e\u3059\u3002<\/p>\n\n\n\n HuggingFaceEmbedding(model_name=”intfloat\/multilingual-e5-large”)<\/span><\/p>\n\n\n\n HuggingFace\u306e\u30e2\u30c7\u30eb \u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\u3092\u4f7f\u7528\u3057\u3066\u3001\u30c6\u30ad\u30b9\u30c8\u3092\u6570\u5024\u30d9\u30af\u30c8\u30eb\u306b\u5909\u63db\u3057\u307e\u3059\u3002<\/p>\n\n\n\n embed_model.get_text_embedding(text) <\/span><\/p>\n\n\n\n \u6307\u5b9a\u3057\u305f\u30c6\u30ad\u30b9\u30c8\u3092\u6570\u5024\u30d9\u30af\u30c8\u30eb\uff08\u57cb\u3081\u8fbc\u307f\u30d9\u30af\u30c8\u30eb\uff09\u306b\u5909\u63db\u3057\u307e\u3059\u3002<\/p>\n<\/div><\/div>\n<\/div><\/div>\n<\/div>\n\n\n\n Ollama\u306e\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\u306e\u4f7f\u3044\u65b9\u3092\u7d39\u4ecb\u3057\u307e\u3059\u3002<\/span><\/p>\n\n\n\n Ollama\u306e\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\u306b\u306follama-python\u306e\u74b0\u5883\u69cb\u7bc9\u304c\u5fc5\u8981\u306b\u306a\u308a\u307e\u3059\u3002<\/p>\n\n\n\n ollama-python\u306e\u74b0\u5883\u69cb\u7bc9\u306f\u5225\u306e\u8a18\u4e8b\u3067\u89e3\u8aac\u3057\u3066\u3044\u307e\u3059\u3002<\/p>\n\n\n\n
<\/a><\/div><\/div>OpenAI Embeddings\u306e\u4f7f\u3044\u65b9<\/h2>\n\n\n\n
<\/figure>\n\n\n\npip install llama-index llama-index-embeddings-openai<\/code><\/pre>\n<\/div><\/div>\n\n\n\nimport os\n\nos.environ[\"OPENAI_API_KEY\"] = \"***************\"<\/code><\/pre>\n<\/div><\/div>\n\n\n\nfrom llama_index.embeddings.openai import OpenAIEmbedding\n\nembed_model = OpenAIEmbedding(model=\"text-embedding-3-small\")<\/code><\/pre>\n\n\n\nOpenAIEmbedding<\/code>\uff1aOpenAI\u306e\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30ebtext-embedding-3-small<\/code>\u3092\u8aad\u307f\u8fbc\u3093\u3067\u3044\u307e\u3059\u3002<\/p>\n\n\n\ntext-embedding-3-small<\/code>\u306f\u30b3\u30b9\u30c8\u3068\u30ea\u30bd\u30fc\u30b9\u52b9\u7387\u306b\u512a\u308c\u308b\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\u3067\u3059\u3002Large\u30e2\u30c7\u30eb\u306etext-embedding-3-large<\/code>\u3092\u6307\u5b9a\u3057\u305f\u5834\u5408\u3001\u6027\u80fd\u304c\u5411\u4e0a\u3057\u307e\u3059\u304c\u3001\u305d\u306e\u5206\u30b3\u30b9\u30c8\u3068\u5fdc\u7b54\u6642\u9593\u304c\u304b\u304b\u308a\u307e\u3059\u3002<\/p>\n<\/div><\/div>\n<\/div><\/div>\n\n\n\ntext = \"\u3053\u308c\u306f\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\u306e\u30c6\u30b9\u30c8\u3067\u3059\u3002\"\nembeddings = embed_model.get_text_embedding(text)\nprint(embeddings[:10])<\/code><\/pre>\n\n\n\n[0.021757090464234352, 0.03871193900704384, -0.00824466347694397, -0.05321666598320007, 0.0003585218801163137, 2.6869998691836372e-05, -0.0034026079811155796, 0.018241163343191147, 0.0114543242380023, -0.02156108058989048]<\/code><\/pre>\n\n\n\nHuggingFace Embeddings\u306e\u4f7f\u3044\u65b9<\/h2>\n\n\n\n
<\/figure>\n\n\n\n<\/figure><\/div>\t\t\t\t\tpip install llama-index llama-index-embeddings-huggingface<\/code><\/pre>\n<\/div><\/div>\n\n\n\nfrom llama_index.embeddings.huggingface import HuggingFaceEmbedding\n\nembed_model = HuggingFaceEmbedding(model_name=\"intfloat\/multilingual-e5-large\")<\/code><\/pre>\n\n\n\nintfloat\/multilingual-e5-large<\/code> \u3092\u4f7f\u3063\u3066\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\u3092\u8aad\u307f\u8fbc\u3093\u3067\u3044\u307e\u3059\u3002\u3053\u306e\u30e2\u30c7\u30eb\u306f\u65e5\u672c\u8a9e\u6027\u80fd\u304c\u9ad8\u304f\u3001\u7121\u6599\u3067\u4f7f\u3048\u308b\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\u3067\u3059\u3002<\/p>\n<\/div><\/div>\n<\/div><\/div>\n\n\n\ntext = \"\u3053\u308c\u306f\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\u306e\u30c6\u30b9\u30c8\u3067\u3059\u3002\"\nembeddings = embed_model.get_text_embedding(text)\nprint(embeddings[:10])<\/code><\/pre>\n\n\n\n[0.02069464884698391, -0.014187865890562534, -0.02731310948729515, -0.06284146755933762, 0.027987537905573845, -0.026079582050442696, 0.014470797032117844, 0.07950162887573242, 0.05525951832532883, -0.02208035998046398]<\/code><\/pre>\n\n\n\nOllama Embeddings\u306e\u4f7f\u3044\u65b9<\/h2>\n\n\n\n
<\/figure>\n\n\n\n
![\"\"](\"https:\/\/highreso.jp\/edgehub\/wp-content\/uploads\/2024\/08\/ollamapython-eyecatch-300x158.jpg\")
<\/figure><\/div>\t\t\t\t\t![\"\"](\"https:\/\/ollama.com\/public\/og.png\")
<\/figure><\/div>\t\t\t\t\t![\"GPUSOROBAN\"](\"https:\/\/highreso.jp\/edgehub\/wp-content\/uploads\/2024\/06\/h100_banner.jpg\")
<\/figure>\n\n\n\n