Class: AWSCDK::Bedrock::CfnDataSource::WebCrawlerLimitsProperty
- Inherits:
-
Jsii::Struct
- Object
- Jsii::Struct
- AWSCDK::Bedrock::CfnDataSource::WebCrawlerLimitsProperty
- Defined in:
- bedrock/cfn_data_source.rb
Overview
The rate limits for the URLs that you want to crawl.
You should be authorized to crawl the URLs.
Instance Attribute Summary collapse
-
#max_pages ⇒ Numeric?
readonly
The max number of web pages crawled from your source URLs, up to 25,000 pages.
-
#rate_limit ⇒ Numeric?
readonly
The max rate at which pages are crawled, up to 300 per minute per host.
Class Method Summary collapse
Instance Method Summary collapse
-
#initialize(max_pages: nil, rate_limit: nil) ⇒ WebCrawlerLimitsProperty
constructor
A new instance of WebCrawlerLimitsProperty.
- #to_jsii ⇒ Object
Constructor Details
#initialize(max_pages: nil, rate_limit: nil) ⇒ WebCrawlerLimitsProperty
Returns a new instance of WebCrawlerLimitsProperty.
2687 2688 2689 2690 2691 2692 |
# File 'bedrock/cfn_data_source.rb', line 2687 def initialize(max_pages: nil, rate_limit: nil) @max_pages = max_pages Jsii::Type.check_type(@max_pages, JSON.parse(Base64.strict_decode64("eyJwcmltaXRpdmUiOiJudW1iZXIifQ==")), "maxPages") unless @max_pages.nil? @rate_limit = rate_limit Jsii::Type.check_type(@rate_limit, JSON.parse(Base64.strict_decode64("eyJwcmltaXRpdmUiOiJudW1iZXIifQ==")), "rateLimit") unless @rate_limit.nil? end |
Instance Attribute Details
#max_pages ⇒ Numeric? (readonly)
The max number of web pages crawled from your source URLs, up to 25,000 pages.
If the web pages exceed this limit, the data source sync will fail and no web pages will be ingested.
2700 2701 2702 |
# File 'bedrock/cfn_data_source.rb', line 2700 def max_pages @max_pages end |
#rate_limit ⇒ Numeric? (readonly)
The max rate at which pages are crawled, up to 300 per minute per host.
2705 2706 2707 |
# File 'bedrock/cfn_data_source.rb', line 2705 def rate_limit @rate_limit end |
Class Method Details
.jsii_properties ⇒ Object
2707 2708 2709 2710 2711 2712 |
# File 'bedrock/cfn_data_source.rb', line 2707 def self.jsii_properties { :max_pages => "maxPages", :rate_limit => "rateLimit", } end |
Instance Method Details
#to_jsii ⇒ Object
2714 2715 2716 2717 2718 2719 2720 2721 |
# File 'bedrock/cfn_data_source.rb', line 2714 def to_jsii result = {} result.merge!({ "maxPages" => @max_pages, "rateLimit" => @rate_limit, }) result.compact end |