Wikipedia는 Wikipedians로 알려진 자원봉사자 커뮤니티가 개방형 협업과 MediaWiki라는 위키 기반 편집 시스템을 통해 작성하고 유지 관리하는 다국어 무료 온라인 백과사전입니다. Wikipedia는 역사상 가장 크고 가장 많이 읽히는 참고 자료입니다.
이 노트북은 wikipedia.org에서 wiki 페이지를 다운스트림에서 사용하는 Document 형식으로 로드하는 방법을 보여줍니다.

​
Installation

먼저 langchain_community와 wikipedia 패키지를 설치해야 합니다. 
pip install -qU langchain_community wikipedia

​
Parameters

WikipediaLoader는 다음과 같은 인자를 가집니다:
  • query: Wikipedia에서 문서를 찾는 데 사용되는 자유 텍스트
  • lang (선택사항): default=“en”. Wikipedia의 특정 언어 부분에서 검색하는 데 사용합니다
  • load_max_docs (선택사항): default=100. 다운로드할 문서 수를 제한하는 데 사용합니다. 100개의 문서를 모두 다운로드하는 데 시간이 걸리므로 실험에는 작은 숫자를 사용하세요. 현재 최대 300개로 제한되어 있습니다.
  • load_all_available_meta (선택사항): default=False. 기본적으로 가장 중요한 필드만 다운로드됩니다: title과 summary. True로 설정하면 사용 가능한 모든 필드가 다운로드됩니다.
  • doc_content_chars_max (선택사항): default=4000. 문서 콘텐츠의 최대 문자 수입니다.

​
Example

from langchain_community.document_loaders import WikipediaLoader

docs = WikipediaLoader(query="HUNTER X HUNTER", load_max_docs=2).load()
len(docs)

2

docs[0].metadata  # metadata of the first document

{'title': 'Hunter × Hunter',
 'summary': 'Hunter × Hunter (pronounced "hunter hunter") is a Japanese manga series written and illustrated by Yoshihiro Togashi. It has been serialized in Shueisha\'s shōnen manga magazine Weekly Shōnen Jump since March 1998, although the manga has frequently gone on extended hiatuses since 2006. Its chapters have been collected in 37 tankōbon volumes as of November 2022. The story focuses on a young boy named Gon Freecss who discovers that his father, who left him at a young age, is actually a world-renowned Hunter, a licensed professional who specializes in fantastical pursuits such as locating rare or unidentified animal species, treasure hunting, surveying unexplored enclaves, or hunting down lawless individuals. Gon departs on a journey to become a Hunter and eventually find his father. Along the way, Gon meets various other Hunters and encounters the paranormal.\nHunter × Hunter was adapted into a 62-episode anime television series by Nippon Animation and directed by Kazuhiro Furuhashi, which ran on Fuji Television from October 1999 to March 2001. Three separate original video animations (OVAs) totaling 30 episodes were subsequently produced by Nippon Animation and released in Japan from 2002 to 2004. A second anime television series by Madhouse aired on Nippon Television from October 2011 to September 2014, totaling 148 episodes, with two animated theatrical films released in 2013. There are also numerous audio albums, video games, musicals, and other media based on Hunter × Hunter.\nThe manga has been licensed for English release in North America by Viz Media since April 2005. Both television series have been also licensed by Viz Media, with the first series having aired on the Funimation Channel in 2009 and the second series broadcast on Adult Swim\'s Toonami programming block from April 2016 to June 2019.\nHunter × Hunter has been a huge critical and financial success and has become one of the best-selling manga series of all time, having over 84 million copies in circulation by July 2022.',
 'source': 'https://en.wikipedia.org/wiki/Hunter_%C3%97_Hunter'}

docs[0].page_content[:400]  # a part of the page content

'Hunter × Hunter (pronounced "hunter hunter") is a Japanese manga series written and illustrated by Yoshihiro Togashi. It has been serialized in Shueisha\'s shōnen manga magazine Weekly Shōnen Jump since March 1998, although the manga has frequently gone on extended hiatuses since 2006. Its chapters have been collected in 37 tankōbon volumes as of November 2022. The story focuses on a young boy name'
Edit the source of this page on GitHub.
Connect these docs programmatically to Claude, VSCode, and more via MCP for real-time answers.
⌘I