Class: AWSCDK::Kendra::CfnDataSource::WebCrawlerSeedURLConfigurationProperty
- Inherits:
-
Jsii::Struct
- Object
- Jsii::Struct
- AWSCDK::Kendra::CfnDataSource::WebCrawlerSeedURLConfigurationProperty
- Defined in:
- kendra/cfn_data_source.rb
Overview
Provides the configuration information of the seed or starting point URLs to crawl.
When selecting websites to index, you must adhere to the Amazon Acceptable Use Policy and all other Amazon terms. Remember that you must only use the Amazon Kendra web crawler to index your own webpages, or webpages that you have authorization to index.
Instance Attribute Summary collapse
-
#seed_urls ⇒ Array<String>
readonly
The list of seed or starting point URLs of the websites you want to crawl.
-
#web_crawler_mode ⇒ String?
readonly
You can choose one of the following modes:.
Class Method Summary collapse
Instance Method Summary collapse
-
#initialize(seed_urls:, web_crawler_mode: nil) ⇒ WebCrawlerSeedURLConfigurationProperty
constructor
A new instance of WebCrawlerSeedURLConfigurationProperty.
- #to_jsii ⇒ Object
Constructor Details
#initialize(seed_urls:, web_crawler_mode: nil) ⇒ WebCrawlerSeedURLConfigurationProperty
Returns a new instance of WebCrawlerSeedURLConfigurationProperty.
3946 3947 3948 3949 3950 3951 |
# File 'kendra/cfn_data_source.rb', line 3946 def initialize(seed_urls:, web_crawler_mode: nil) @seed_urls = seed_urls Jsii::Type.check_type(@seed_urls, JSON.parse(Base64.strict_decode64("eyJjb2xsZWN0aW9uIjp7ImVsZW1lbnR0eXBlIjp7InByaW1pdGl2ZSI6InN0cmluZyJ9LCJraW5kIjoiYXJyYXkifX0=")), "seedUrls") @web_crawler_mode = web_crawler_mode Jsii::Type.check_type(@web_crawler_mode, JSON.parse(Base64.strict_decode64("eyJwcmltaXRpdmUiOiJzdHJpbmcifQ==")), "webCrawlerMode") unless @web_crawler_mode.nil? end |
Instance Attribute Details
#seed_urls ⇒ Array<String> (readonly)
The list of seed or starting point URLs of the websites you want to crawl.
The list can include a maximum of 100 seed URLs.
3959 3960 3961 |
# File 'kendra/cfn_data_source.rb', line 3959 def seed_urls @seed_urls end |
#web_crawler_mode ⇒ String? (readonly)
You can choose one of the following modes:.
HOST_ONLY—crawl only the website host names. For example, if the seed URL is "abc.example.com", then only URLs with host name "abc.example.com" are crawled.SUBDOMAINS—crawl the website host names with subdomains. For example, if the seed URL is "abc.example.com", then "a.abc.example.com" and "b.abc.example.com" are also crawled.EVERYTHING—crawl the website host names with subdomains and other domains that the web pages link to.
The default mode is set to HOST_ONLY .
3970 3971 3972 |
# File 'kendra/cfn_data_source.rb', line 3970 def web_crawler_mode @web_crawler_mode end |
Class Method Details
.jsii_properties ⇒ Object
3972 3973 3974 3975 3976 3977 |
# File 'kendra/cfn_data_source.rb', line 3972 def self.jsii_properties { :seed_urls => "seedUrls", :web_crawler_mode => "webCrawlerMode", } end |
Instance Method Details
#to_jsii ⇒ Object
3979 3980 3981 3982 3983 3984 3985 3986 |
# File 'kendra/cfn_data_source.rb', line 3979 def to_jsii result = {} result.merge!({ "seedUrls" => @seed_urls, "webCrawlerMode" => @web_crawler_mode, }) result.compact end |