Class: AWSCDK::Bedrock::CfnDataSource::WebCrawlerLimitsProperty

Inherits:
Jsii::Struct
  • Object
show all
Defined in:
bedrock/cfn_data_source.rb

Overview

The rate limits for the URLs that you want to crawl.

You should be authorized to crawl the URLs.

Instance Attribute Summary collapse

Class Method Summary collapse

Instance Method Summary collapse

Constructor Details

#initialize(max_pages: nil, rate_limit: nil) ⇒ WebCrawlerLimitsProperty

Returns a new instance of WebCrawlerLimitsProperty.

Parameters:

  • max_pages (Numeric, nil) (defaults to: nil)

    The max number of web pages crawled from your source URLs, up to 25,000 pages.

  • rate_limit (Numeric, nil) (defaults to: nil)

    The max rate at which pages are crawled, up to 300 per minute per host.



2687
2688
2689
2690
2691
2692
# File 'bedrock/cfn_data_source.rb', line 2687

def initialize(max_pages: nil, rate_limit: nil)
  @max_pages = max_pages
  Jsii::Type.check_type(@max_pages, JSON.parse(Base64.strict_decode64("eyJwcmltaXRpdmUiOiJudW1iZXIifQ==")), "maxPages") unless @max_pages.nil?
  @rate_limit = rate_limit
  Jsii::Type.check_type(@rate_limit, JSON.parse(Base64.strict_decode64("eyJwcmltaXRpdmUiOiJudW1iZXIifQ==")), "rateLimit") unless @rate_limit.nil?
end

Instance Attribute Details

#max_pagesNumeric? (readonly)

The max number of web pages crawled from your source URLs, up to 25,000 pages.

If the web pages exceed this limit, the data source sync will fail and no web pages will be ingested.



2700
2701
2702
# File 'bedrock/cfn_data_source.rb', line 2700

def max_pages
  @max_pages
end

#rate_limitNumeric? (readonly)

The max rate at which pages are crawled, up to 300 per minute per host.



2705
2706
2707
# File 'bedrock/cfn_data_source.rb', line 2705

def rate_limit
  @rate_limit
end

Class Method Details

.jsii_propertiesObject



2707
2708
2709
2710
2711
2712
# File 'bedrock/cfn_data_source.rb', line 2707

def self.jsii_properties
  {
    :max_pages => "maxPages",
    :rate_limit => "rateLimit",
  }
end

Instance Method Details

#to_jsiiObject



2714
2715
2716
2717
2718
2719
2720
2721
# File 'bedrock/cfn_data_source.rb', line 2714

def to_jsii
  result = {}
  result.merge!({
    "maxPages" => @max_pages,
    "rateLimit" => @rate_limit,
  })
  result.compact
end