Class HNLoader

caller

timeout

webPath

Optional selector

Optional textDecoder

loadAndSplit

• loadAndSplit(splitter?): Promise<Document[]>

• Loads the documents and splits them using a specified text splitter.

  Parameters

  • splitter: TextSplitter = ...

  Returns Promise<Document[]>

  A Promise that resolves with an array of Document instances, each split according to the provided TextSplitter.

scrape

• scrape(): Promise<CheerioAPI>

• Fetches the web document from the webPath and loads it using Cheerio. It returns a CheerioAPI instance.

  Returns Promise<CheerioAPI>

  A Promise that resolves to a CheerioAPI instance.

Static imports

• imports(): Promise<{
      load: ((content, options?, isDocument?) => CheerioAPI);
  }>

• A static method that dynamically imports the Cheerio library and returns the load function. If the import fails, it throws an error.

  Returns Promise<{
      load: ((content, options?, isDocument?) => CheerioAPI);
  }>

  A Promise that resolves to an object containing the load function from the Cheerio library.