Class: AWSCDK::Kendra::CfnDataSource::WebCrawlerSeedURLConfigurationProperty

Inherits:
Jsii::Struct
  • Object
show all
Defined in:
kendra/cfn_data_source.rb

Overview

Provides the configuration information of the seed or starting point URLs to crawl.

When selecting websites to index, you must adhere to the Amazon Acceptable Use Policy and all other Amazon terms. Remember that you must only use the Amazon Kendra web crawler to index your own webpages, or webpages that you have authorization to index.

Instance Attribute Summary collapse

Class Method Summary collapse

Instance Method Summary collapse

Constructor Details

#initialize(seed_urls:, web_crawler_mode: nil) ⇒ WebCrawlerSeedURLConfigurationProperty

Returns a new instance of WebCrawlerSeedURLConfigurationProperty.

Parameters:

  • seed_urls (Array<String>)

    The list of seed or starting point URLs of the websites you want to crawl.

  • web_crawler_mode (String, nil) (defaults to: nil)

    You can choose one of the following modes:.



3946
3947
3948
3949
3950
3951
# File 'kendra/cfn_data_source.rb', line 3946

def initialize(seed_urls:, web_crawler_mode: nil)
  @seed_urls = seed_urls
  Jsii::Type.check_type(@seed_urls, JSON.parse(Base64.strict_decode64("eyJjb2xsZWN0aW9uIjp7ImVsZW1lbnR0eXBlIjp7InByaW1pdGl2ZSI6InN0cmluZyJ9LCJraW5kIjoiYXJyYXkifX0=")), "seedUrls")
  @web_crawler_mode = web_crawler_mode
  Jsii::Type.check_type(@web_crawler_mode, JSON.parse(Base64.strict_decode64("eyJwcmltaXRpdmUiOiJzdHJpbmcifQ==")), "webCrawlerMode") unless @web_crawler_mode.nil?
end

Instance Attribute Details

#seed_urlsArray<String> (readonly)

The list of seed or starting point URLs of the websites you want to crawl.

The list can include a maximum of 100 seed URLs.



3959
3960
3961
# File 'kendra/cfn_data_source.rb', line 3959

def seed_urls
  @seed_urls
end

#web_crawler_modeString? (readonly)

You can choose one of the following modes:.

  • HOST_ONLY —crawl only the website host names. For example, if the seed URL is "abc.example.com", then only URLs with host name "abc.example.com" are crawled.
  • SUBDOMAINS —crawl the website host names with subdomains. For example, if the seed URL is "abc.example.com", then "a.abc.example.com" and "b.abc.example.com" are also crawled.
  • EVERYTHING —crawl the website host names with subdomains and other domains that the web pages link to.

The default mode is set to HOST_ONLY .



3970
3971
3972
# File 'kendra/cfn_data_source.rb', line 3970

def web_crawler_mode
  @web_crawler_mode
end

Class Method Details

.jsii_propertiesObject



3972
3973
3974
3975
3976
3977
# File 'kendra/cfn_data_source.rb', line 3972

def self.jsii_properties
  {
    :seed_urls => "seedUrls",
    :web_crawler_mode => "webCrawlerMode",
  }
end

Instance Method Details

#to_jsiiObject



3979
3980
3981
3982
3983
3984
3985
3986
# File 'kendra/cfn_data_source.rb', line 3979

def to_jsii
  result = {}
  result.merge!({
    "seedUrls" => @seed_urls,
    "webCrawlerMode" => @web_crawler_mode,
  })
  result.compact
end