Class: AWSCDK::StepFunctionsTasks::SparkSubmitJobDriver

Inherits:
Jsii::Struct
  • Object
show all
Defined in:
step_functions_tasks/spark_submit_job_driver.rb

Overview

The information about job driver for Spark submit.

Instance Attribute Summary collapse

Class Method Summary collapse

Instance Method Summary collapse

Constructor Details

#initialize(entry_point:, entry_point_arguments: nil, spark_submit_parameters: nil) ⇒ SparkSubmitJobDriver

Returns a new instance of SparkSubmitJobDriver.

Parameters:

  • entry_point (AWSCDK::StepFunctions::TaskInput) —

    The entry point of job application.

  • entry_point_arguments (AWSCDK::StepFunctions::TaskInput, nil) (defaults to: nil) —

    The arguments for a job application in a task input object containing an array of strings.

  • spark_submit_parameters (String, nil) (defaults to: nil) —

    The Spark submit parameters that are used for job runs.



10
11
12
13
14
15
16
17
 
# File 'step_functions_tasks/spark_submit_job_driver.rb', line 10

def initialize(entry_point:, entry_point_arguments: nil, spark_submit_parameters: nil)
  @entry_point = entry_point
  Jsii::Type.check_type(@entry_point, JSON.parse(Base64.strict_decode64("eyJmcW4iOiJhd3MtY2RrLWxpYi5hd3Nfc3RlcGZ1bmN0aW9ucy5UYXNrSW5wdXQifQ==")), "entryPoint")
  @entry_point_arguments = entry_point_arguments
  Jsii::Type.check_type(@entry_point_arguments, JSON.parse(Base64.strict_decode64("eyJmcW4iOiJhd3MtY2RrLWxpYi5hd3Nfc3RlcGZ1bmN0aW9ucy5UYXNrSW5wdXQifQ==")), "entryPointArguments") unless @entry_point_arguments.nil?
  @spark_submit_parameters = spark_submit_parameters
  Jsii::Type.check_type(@spark_submit_parameters, JSON.parse(Base64.strict_decode64("eyJwcmltaXRpdmUiOiJzdHJpbmcifQ==")), "sparkSubmitParameters") unless @spark_submit_parameters.nil?
end

Instance Attribute Details

#entry_point ⇒ AWSCDK::StepFunctions::TaskInput (readonly)

The entry point of job application.

Length Constraints: Minimum length of 1. Maximum length of 256.

Returns:



24
25
26
 
# File 'step_functions_tasks/spark_submit_job_driver.rb', line 24

def entry_point
  @entry_point
end

#entry_point_arguments ⇒ AWSCDK::StepFunctions::TaskInput? (readonly)

Note:

Default: - No arguments defined

The arguments for a job application in a task input object containing an array of strings.

Length Constraints: Minimum length of 1. Maximum length of 10280.

Returns:



31
32
33
 
# File 'step_functions_tasks/spark_submit_job_driver.rb', line 31

def entry_point_arguments
  @entry_point_arguments
end

#spark_submit_parameters ⇒ String? (readonly)

Note:

Default: - No spark submit parameters

The Spark submit parameters that are used for job runs.

Length Constraints: Minimum length of 1. Maximum length of 102400.

Returns:

  • (String, nil) 


38
39
40
 
# File 'step_functions_tasks/spark_submit_job_driver.rb', line 38

def spark_submit_parameters
  @spark_submit_parameters
end

Class Method Details

.jsii_properties ⇒ Object 



40
41
42
43
44
45
46
 
# File 'step_functions_tasks/spark_submit_job_driver.rb', line 40

def self.jsii_properties
  {
    :entry_point => "entryPoint",
    :entry_point_arguments => "entryPointArguments",
    :spark_submit_parameters => "sparkSubmitParameters",
  }
end

Instance Method Details

#to_jsii ⇒ Object 



48
49
50
51
52
53
54
55
56
 
# File 'step_functions_tasks/spark_submit_job_driver.rb', line 48

def to_jsii
  result = {}
  result.merge!({
    "entryPoint" => @entry_point,
    "entryPointArguments" => @entry_point_arguments,
    "sparkSubmitParameters" => @spark_submit_parameters,
  })
  result.compact
end