Class: AWSCDK::Glue::CfnCrawler::DeltaTargetProperty

Inherits:
Jsii::Struct
  • Object
show all
Defined in:
glue/cfn_crawler.rb

Overview

Specifies a Delta data store to crawl one or more Delta tables.

See Also:

Instance Attribute Summary collapse

Class Method Summary collapse

Instance Method Summary collapse

Constructor Details

#initialize(connection_name: nil, create_native_delta_table: nil, delta_tables: nil, write_manifest: nil) ⇒ DeltaTargetProperty

Returns a new instance of DeltaTargetProperty.

Parameters:

  • connection_name (String, nil) (defaults to: nil) —

    The name of the connection to use to connect to the Delta table target.

  • create_native_delta_table (Boolean, AWSCDK::IResolvable, nil) (defaults to: nil) —

    Specifies whether the crawler will create native tables, to allow integration with query engines that support querying of the Delta transaction log directly.

  • delta_tables (Array<String>, nil) (defaults to: nil) —

    A list of the Amazon S3 paths to the Delta tables.

  • write_manifest (Boolean, AWSCDK::IResolvable, nil) (defaults to: nil) —

    Specifies whether to write the manifest files to the Delta table path.



777
778
779
780
781
782
783
784
785
786
 
# File 'glue/cfn_crawler.rb', line 777

def initialize(connection_name: nil, create_native_delta_table: nil, delta_tables: nil, write_manifest: nil)
  @connection_name = connection_name
  Jsii::Type.check_type(@connection_name, JSON.parse(Base64.strict_decode64("eyJwcmltaXRpdmUiOiJzdHJpbmcifQ==")), "connectionName") unless @connection_name.nil?
  @create_native_delta_table = create_native_delta_table
  Jsii::Type.check_type(@create_native_delta_table, JSON.parse(Base64.strict_decode64("eyJ1bmlvbiI6eyJ0eXBlcyI6W3sicHJpbWl0aXZlIjoiYm9vbGVhbiJ9LHsiZnFuIjoiYXdzLWNkay1saWIuSVJlc29sdmFibGUifV19fQ==")), "createNativeDeltaTable") unless @create_native_delta_table.nil?
  @delta_tables = delta_tables
  Jsii::Type.check_type(@delta_tables, JSON.parse(Base64.strict_decode64("eyJjb2xsZWN0aW9uIjp7ImVsZW1lbnR0eXBlIjp7InByaW1pdGl2ZSI6InN0cmluZyJ9LCJraW5kIjoiYXJyYXkifX0=")), "deltaTables") unless @delta_tables.nil?
  @write_manifest = write_manifest
  Jsii::Type.check_type(@write_manifest, JSON.parse(Base64.strict_decode64("eyJ1bmlvbiI6eyJ0eXBlcyI6W3sicHJpbWl0aXZlIjoiYm9vbGVhbiJ9LHsiZnFuIjoiYXdzLWNkay1saWIuSVJlc29sdmFibGUifV19fQ==")), "writeManifest") unless @write_manifest.nil?
end

Instance Attribute Details

#connection_name ⇒ String? (readonly)

The name of the connection to use to connect to the Delta table target.

Returns:

  • (String, nil)

See Also:



792
793
794
 
# File 'glue/cfn_crawler.rb', line 792

def connection_name
  @connection_name
end

#create_native_delta_table ⇒ Boolean, ... (readonly)

Specifies whether the crawler will create native tables, to allow integration with query engines that support querying of the Delta transaction log directly.

Returns:

See Also:



797
798
799
 
# File 'glue/cfn_crawler.rb', line 797

def create_native_delta_table
  @create_native_delta_table
end

#delta_tables ⇒ Array<String>? (readonly)

A list of the Amazon S3 paths to the Delta tables.

Returns:

  • (Array<String>, nil)

See Also:



802
803
804
 
# File 'glue/cfn_crawler.rb', line 802

def delta_tables
  @delta_tables
end

#write_manifest ⇒ Boolean, ... (readonly)

Specifies whether to write the manifest files to the Delta table path.

Returns:

See Also:



807
808
809
 
# File 'glue/cfn_crawler.rb', line 807

def write_manifest
  @write_manifest
end

Class Method Details

.jsii_properties ⇒ Object 



809
810
811
812
813
814
815
816
 
# File 'glue/cfn_crawler.rb', line 809

def self.jsii_properties
  {
    :connection_name => "connectionName",
    :create_native_delta_table => "createNativeDeltaTable",
    :delta_tables => "deltaTables",
    :write_manifest => "writeManifest",
  }
end

Instance Method Details

#to_jsii ⇒ Object 



818
819
820
821
822
823
824
825
826
827
 
# File 'glue/cfn_crawler.rb', line 818

def to_jsii
  result = {}
  result.merge!({
    "connectionName" => @connection_name,
    "createNativeDeltaTable" => @create_native_delta_table,
    "deltaTables" => @delta_tables,
    "writeManifest" => @write_manifest,
  })
  result.compact
end