Class: AWSCDK::Sagemaker::CfnModel::MultiModelConfigProperty

Inherits:
Jsii::Struct
  • Object
show all
Defined in:
sagemaker/cfn_model.rb

Overview

Specifies additional configuration for hosting multi-model endpoints.

Instance Attribute Summary collapse

Class Method Summary collapse

Instance Method Summary collapse

Constructor Details

#initialize(model_cache_setting: nil) ⇒ MultiModelConfigProperty

Returns a new instance of MultiModelConfigProperty.

Parameters:

  • model_cache_setting (String, nil) (defaults to: nil)

    Whether to cache models for a multi-model endpoint.



962
963
964
965
# File 'sagemaker/cfn_model.rb', line 962

def initialize(model_cache_setting: nil)
  @model_cache_setting = model_cache_setting
  Jsii::Type.check_type(@model_cache_setting, JSON.parse(Base64.strict_decode64("eyJwcmltaXRpdmUiOiJzdHJpbmcifQ==")), "modelCacheSetting") unless @model_cache_setting.nil?
end

Instance Attribute Details

#model_cache_settingString? (readonly)

Whether to cache models for a multi-model endpoint.

By default, multi-model endpoints cache models so that a model does not have to be loaded into memory each time it is invoked. Some use cases do not benefit from model caching. For example, if an endpoint hosts a large number of models that are each invoked infrequently, the endpoint might perform better if you disable model caching. To disable model caching, set the value of this parameter to Disabled.



973
974
975
# File 'sagemaker/cfn_model.rb', line 973

def model_cache_setting
  @model_cache_setting
end

Class Method Details

.jsii_propertiesObject



975
976
977
978
979
# File 'sagemaker/cfn_model.rb', line 975

def self.jsii_properties
  {
    :model_cache_setting => "modelCacheSetting",
  }
end

Instance Method Details

#to_jsiiObject



981
982
983
984
985
986
987
# File 'sagemaker/cfn_model.rb', line 981

def to_jsii
  result = {}
  result.merge!({
    "modelCacheSetting" => @model_cache_setting,
  })
  result.compact
end