Packages

google_api_dataproc

0.0.1
0.59.0 0.58.1 0.58.0 0.57.0 0.56.0 0.55.0 0.54.0 0.53.0 0.52.0 0.51.1 0.51.0 0.50.0 0.49.1 0.49.0 0.48.0 0.47.0 0.46.0 0.45.1 0.45.0 0.44.0 0.43.0 0.42.1 0.42.0 0.41.1 0.41.0 0.40.1 0.40.0 0.39.1 0.39.0 0.38.0 0.37.0 0.36.0 0.35.0 0.34.0 0.33.0 0.32.1 0.32.0 0.31.2 0.31.1 0.31.0 0.30.0 0.29.0 0.28.0 0.27.0 0.26.0 0.25.0 0.24.0 0.23.0 0.22.0 0.21.0 0.20.0 0.19.0 0.18.0 0.17.0 0.16.0 0.15.0 0.14.0 0.13.0 0.12.0 0.10.1 0.10.0 0.9.0 0.8.0 0.7.0 0.6.0 0.5.0 0.4.0 0.3.0 0.2.0 0.1.0 0.0.1

Cloud Dataproc API client library. Manages Hadoop-based clusters and jobs on Google Cloud Platform.

HexDocs

Current section

Files

Jump to
Readme
71 Versions
2 Dependencies
Dependants
Files
Activity
google_api_dataproc lib google_api dataproc v1 model spark_job.ex
Raw

lib/google_api/dataproc/v1/model/spark_job.ex 

# Copyright 2017 Google Inc.

#

# Licensed under the Apache License, Version 2.0 (the "License");

# you may not use this file except in compliance with the License.

# You may obtain a copy of the License at

#

#     http://www.apache.org/licenses/LICENSE-2.0

#

# Unless required by applicable law or agreed to in writing, software

# distributed under the License is distributed on an "AS IS" BASIS,

# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.

# See the License for the specific language governing permissions and

# limitations under the License.





# NOTE: This class is auto generated by the swagger code generator program.

# https://github.com/swagger-api/swagger-codegen.git

# Do not edit the class manually.



defmodule GoogleApi.Dataproc.V1.Model.SparkJob do

  @moduledoc """

  A Cloud Dataproc job for running Apache Spark (http://spark.apache.org/) applications on YARN.



  ## Attributes



  - archiveUris (List[String]): Optional. HCFS URIs of archives to be extracted in the working directory of Spark drivers and tasks. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip. Defaults to: `null`.

  - args (List[String]): Optional. The arguments to pass to the driver. Do not include arguments, such as --conf, that can be set as job properties, since a collision may occur that causes an incorrect job submission. Defaults to: `null`.

  - fileUris (List[String]): Optional. HCFS URIs of files to be copied to the working directory of Spark drivers and distributed tasks. Useful for naively parallel tasks. Defaults to: `null`.

  - jarFileUris (List[String]): Optional. HCFS URIs of jar files to add to the CLASSPATHs of the Spark driver and tasks. Defaults to: `null`.

  - loggingConfig (LoggingConfig): Optional. The runtime log config for job execution. Defaults to: `null`.

  - mainClass (String): The name of the driver's main class. The jar file that contains the class must be in the default CLASSPATH or specified in jar_file_uris. Defaults to: `null`.

  - mainJarFileUri (String): The HCFS URI of the jar file that contains the main class. Defaults to: `null`.

  - properties (Map[String, String]): Optional. A mapping of property names to values, used to configure Spark. Properties that conflict with values set by the Cloud Dataproc API may be overwritten. Can include properties set in /etc/spark/conf/spark-defaults.conf and classes in user code. Defaults to: `null`.

  """



  defstruct [

    :"archiveUris",

    :"args",

    :"fileUris",

    :"jarFileUris",

    :"loggingConfig",

    :"mainClass",

    :"mainJarFileUri",

    :"properties"

  ]

end



defimpl Poison.Decoder, for: GoogleApi.Dataproc.V1.Model.SparkJob do

  import GoogleApi.Dataproc.V1.Deserializer

  def decode(value, options) do

    value

    |> deserialize(:"loggingConfig", :struct, GoogleApi.Dataproc.V1.Model.LoggingConfig, options)

  end

end



defimpl Poison.Encoder, for: GoogleApi.Dataproc.V1.Model.SparkJob do

  def encode(value, options) do

    GoogleApi.Dataproc.V1.Deserializer.serialize_non_nil(value, options)

  end

end