happygapi.dataproc.projects — happygapi 0.4.2

Cloud Dataproc API: projects. Manages Hadoop-based clusters and jobs on Google Cloud Platform. See: https://cloud.google.com/dataproc/api/reference/rest/v1/projects

locations-autoscalingPolicies-create$ clj

(locations-autoscalingPolicies-create$ auth parameters body)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/locations/autoscalingPolicies/create

Required parameters: parent

Optional parameters: none

Body:

{:name string, :secondaryWorkerConfig {:weight integer, :maxInstances integer, :minInstances integer}, :basicAlgorithm {:cooldownPeriod string, :yarnConfig BasicYarnAutoscalingConfig}, :id string, :workerConfig {:weight integer, :maxInstances integer, :minInstances integer}}

Creates new autoscaling policy.

locations-autoscalingPolicies-delete$ clj

(locations-autoscalingPolicies-delete$ auth parameters)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/locations/autoscalingPolicies/delete

Required parameters: name

Optional parameters: none

Deletes an autoscaling policy. It is an error to delete an autoscaling policy that is in use by one or more clusters.

locations-autoscalingPolicies-get$ clj

(locations-autoscalingPolicies-get$ auth parameters)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/locations/autoscalingPolicies/get

Required parameters: name

Optional parameters: none

Retrieves autoscaling policy.

locations-autoscalingPolicies-getIamPolicy$ clj

(locations-autoscalingPolicies-getIamPolicy$ auth parameters body)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/locations/autoscalingPolicies/getIamPolicy

Required parameters: resource

Optional parameters: none

Body:

{:options {:requestedPolicyVersion integer}}

Gets the access control policy for a resource. Returns an empty policy if the resource exists and does not have a policy set.

locations-autoscalingPolicies-list$ clj

(locations-autoscalingPolicies-list$ auth parameters)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/locations/autoscalingPolicies/list

Required parameters: parent

Optional parameters: pageToken, pageSize

Lists autoscaling policies in the project.

locations-autoscalingPolicies-setIamPolicy$ clj

(locations-autoscalingPolicies-setIamPolicy$ auth parameters body)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/locations/autoscalingPolicies/setIamPolicy

Required parameters: resource

Optional parameters: none

Body:

{:policy {:version integer, :bindings [Binding], :etag string}}

Sets the access control policy on the specified resource. Replaces any existing policy.Can return Public Errors: NOT_FOUND, INVALID_ARGUMENT and PERMISSION_DENIED

locations-autoscalingPolicies-testIamPermissions$ clj

(locations-autoscalingPolicies-testIamPermissions$ auth parameters body)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/locations/autoscalingPolicies/testIamPermissions

Required parameters: resource

Optional parameters: none

Body:

{:permissions [string]}

Returns permissions that a caller has on the specified resource. If the resource does not exist, this will return an empty set of permissions, not a NOT_FOUND error.Note: This operation is designed to be used for building permission-aware UIs and command-line tools, not for authorization checking. This operation may "fail open" without warning.

locations-autoscalingPolicies-update$ clj

(locations-autoscalingPolicies-update$ auth parameters body)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/locations/autoscalingPolicies/update

Required parameters: name

Optional parameters: none

Body:

{:name string, :secondaryWorkerConfig {:weight integer, :maxInstances integer, :minInstances integer}, :basicAlgorithm {:cooldownPeriod string, :yarnConfig BasicYarnAutoscalingConfig}, :id string, :workerConfig {:weight integer, :maxInstances integer, :minInstances integer}}

Updates (replaces) autoscaling policy.Disabled check for update_mask, because all updates will be full replacements.

locations-workflowTemplates-create$ clj

(locations-workflowTemplates-create$ auth parameters body)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/locations/workflowTemplates/create

Required parameters: parent

Optional parameters: none

Body:

{:labels {}, :name string, :createTime string, :updateTime string, :jobs [{:labels {}, :prerequisiteStepIds [string], :sparkSqlJob SparkSqlJob, :scheduling JobScheduling, :pigJob PigJob, :hiveJob HiveJob, :sparkJob SparkJob, :stepId string, :pysparkJob PySparkJob, :hadoopJob HadoopJob}], :id string, :version integer, :placement {:clusterSelector ClusterSelector, :managedCluster ManagedCluster}, :parameters [{:fields [string], :name string, :description string, :validation ParameterValidation}]}

Creates new workflow template.

locations-workflowTemplates-delete$ clj

(locations-workflowTemplates-delete$ auth parameters)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/locations/workflowTemplates/delete

Required parameters: name

Optional parameters: version

Deletes a workflow template. It does not cancel in-progress workflows.

locations-workflowTemplates-get$ clj

(locations-workflowTemplates-get$ auth parameters)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/locations/workflowTemplates/get

Required parameters: name

Optional parameters: version

Retrieves the latest workflow template.Can retrieve previously instantiated template by specifying optional version parameter.

locations-workflowTemplates-getIamPolicy$ clj

(locations-workflowTemplates-getIamPolicy$ auth parameters body)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/locations/workflowTemplates/getIamPolicy

Required parameters: resource

Optional parameters: none

Body:

{:options {:requestedPolicyVersion integer}}

Gets the access control policy for a resource. Returns an empty policy if the resource exists and does not have a policy set.

locations-workflowTemplates-instantiate$ clj

(locations-workflowTemplates-instantiate$ auth parameters body)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/locations/workflowTemplates/instantiate

Required parameters: name

Optional parameters: none

Body:

{:requestId string, :version integer, :parameters {}}

Instantiates a template and begins execution.The returned Operation can be used to track execution of workflow by polling operations.get. The Operation will complete when entire workflow is finished.The running workflow can be aborted via operations.cancel. This will cause any inflight jobs to be cancelled and workflow-owned clusters to be deleted.The Operation.metadata will be WorkflowMetadata (https://cloud.google.com/dataproc/docs/reference/rpc/google.cloud.dataproc.v1#workflowmetadata). Also see Using WorkflowMetadata (https://cloud.google.com/dataproc/docs/concepts/workflows/debugging#using_workflowmetadata).On successful completion, Operation.response will be Empty.

locations-workflowTemplates-instantiateInline$ clj

(locations-workflowTemplates-instantiateInline$ auth parameters body)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/locations/workflowTemplates/instantiateInline

Required parameters: parent

Optional parameters: requestId

Body:

{:labels {}, :name string, :createTime string, :updateTime string, :jobs [{:labels {}, :prerequisiteStepIds [string], :sparkSqlJob SparkSqlJob, :scheduling JobScheduling, :pigJob PigJob, :hiveJob HiveJob, :sparkJob SparkJob, :stepId string, :pysparkJob PySparkJob, :hadoopJob HadoopJob}], :id string, :version integer, :placement {:clusterSelector ClusterSelector, :managedCluster ManagedCluster}, :parameters [{:fields [string], :name string, :description string, :validation ParameterValidation}]}

Instantiates a template and begins execution.This method is equivalent to executing the sequence CreateWorkflowTemplate, InstantiateWorkflowTemplate, DeleteWorkflowTemplate.The returned Operation can be used to track execution of workflow by polling operations.get. The Operation will complete when entire workflow is finished.The running workflow can be aborted via operations.cancel. This will cause any inflight jobs to be cancelled and workflow-owned clusters to be deleted.The Operation.metadata will be WorkflowMetadata (https://cloud.google.com/dataproc/docs/reference/rpc/google.cloud.dataproc.v1#workflowmetadata). Also see Using WorkflowMetadata (https://cloud.google.com/dataproc/docs/concepts/workflows/debugging#using_workflowmetadata).On successful completion, Operation.response will be Empty.

locations-workflowTemplates-list$ clj

(locations-workflowTemplates-list$ auth parameters)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/locations/workflowTemplates/list

Required parameters: parent

Optional parameters: pageToken, pageSize

Lists workflows that match the specified filter in the request.

locations-workflowTemplates-setIamPolicy$ clj

(locations-workflowTemplates-setIamPolicy$ auth parameters body)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/locations/workflowTemplates/setIamPolicy

Required parameters: resource

Optional parameters: none

Body:

{:policy {:version integer, :bindings [Binding], :etag string}}

Sets the access control policy on the specified resource. Replaces any existing policy.Can return Public Errors: NOT_FOUND, INVALID_ARGUMENT and PERMISSION_DENIED

locations-workflowTemplates-testIamPermissions$ clj

(locations-workflowTemplates-testIamPermissions$ auth parameters body)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/locations/workflowTemplates/testIamPermissions

Required parameters: resource

Optional parameters: none

Body:

{:permissions [string]}

Returns permissions that a caller has on the specified resource. If the resource does not exist, this will return an empty set of permissions, not a NOT_FOUND error.Note: This operation is designed to be used for building permission-aware UIs and command-line tools, not for authorization checking. This operation may "fail open" without warning.

locations-workflowTemplates-update$ clj

(locations-workflowTemplates-update$ auth parameters body)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/locations/workflowTemplates/update

Required parameters: name

Optional parameters: none

Body:

{:labels {}, :name string, :createTime string, :updateTime string, :jobs [{:labels {}, :prerequisiteStepIds [string], :sparkSqlJob SparkSqlJob, :scheduling JobScheduling, :pigJob PigJob, :hiveJob HiveJob, :sparkJob SparkJob, :stepId string, :pysparkJob PySparkJob, :hadoopJob HadoopJob}], :id string, :version integer, :placement {:clusterSelector ClusterSelector, :managedCluster ManagedCluster}, :parameters [{:fields [string], :name string, :description string, :validation ParameterValidation}]}

Updates (replaces) workflow template. The updated template must contain version that matches the current server version.

regions-autoscalingPolicies-create$ clj

(regions-autoscalingPolicies-create$ auth parameters body)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/autoscalingPolicies/create

Required parameters: parent

Optional parameters: none

Body:

{:name string, :secondaryWorkerConfig {:weight integer, :maxInstances integer, :minInstances integer}, :basicAlgorithm {:cooldownPeriod string, :yarnConfig BasicYarnAutoscalingConfig}, :id string, :workerConfig {:weight integer, :maxInstances integer, :minInstances integer}}

Creates new autoscaling policy.

regions-autoscalingPolicies-delete$ clj

(regions-autoscalingPolicies-delete$ auth parameters)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/autoscalingPolicies/delete

Required parameters: name

Optional parameters: none

Deletes an autoscaling policy. It is an error to delete an autoscaling policy that is in use by one or more clusters.

regions-autoscalingPolicies-get$ clj

(regions-autoscalingPolicies-get$ auth parameters)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/autoscalingPolicies/get

Required parameters: name

Optional parameters: none

Retrieves autoscaling policy.

regions-autoscalingPolicies-getIamPolicy$ clj

(regions-autoscalingPolicies-getIamPolicy$ auth parameters body)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/autoscalingPolicies/getIamPolicy

Required parameters: resource

Optional parameters: none

Body:

{:options {:requestedPolicyVersion integer}}

Gets the access control policy for a resource. Returns an empty policy if the resource exists and does not have a policy set.

regions-autoscalingPolicies-list$ clj

(regions-autoscalingPolicies-list$ auth parameters)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/autoscalingPolicies/list

Required parameters: parent

Optional parameters: pageToken, pageSize

Lists autoscaling policies in the project.

regions-autoscalingPolicies-setIamPolicy$ clj

(regions-autoscalingPolicies-setIamPolicy$ auth parameters body)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/autoscalingPolicies/setIamPolicy

Required parameters: resource

Optional parameters: none

Body:

{:policy {:version integer, :bindings [Binding], :etag string}}

Sets the access control policy on the specified resource. Replaces any existing policy.Can return Public Errors: NOT_FOUND, INVALID_ARGUMENT and PERMISSION_DENIED

regions-autoscalingPolicies-testIamPermissions$ clj

(regions-autoscalingPolicies-testIamPermissions$ auth parameters body)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/autoscalingPolicies/testIamPermissions

Required parameters: resource

Optional parameters: none

Body:

{:permissions [string]}

Returns permissions that a caller has on the specified resource. If the resource does not exist, this will return an empty set of permissions, not a NOT_FOUND error.Note: This operation is designed to be used for building permission-aware UIs and command-line tools, not for authorization checking. This operation may "fail open" without warning.

regions-autoscalingPolicies-update$ clj

(regions-autoscalingPolicies-update$ auth parameters body)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/autoscalingPolicies/update

Required parameters: name

Optional parameters: none

Body:

{:name string, :secondaryWorkerConfig {:weight integer, :maxInstances integer, :minInstances integer}, :basicAlgorithm {:cooldownPeriod string, :yarnConfig BasicYarnAutoscalingConfig}, :id string, :workerConfig {:weight integer, :maxInstances integer, :minInstances integer}}

Updates (replaces) autoscaling policy.Disabled check for update_mask, because all updates will be full replacements.

regions-clusters-create$ clj

(regions-clusters-create$ auth parameters body)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/clusters/create

Required parameters: projectId, region

Optional parameters: requestId

Body:

{:metrics {:hdfsMetrics {}, :yarnMetrics {}}, :status {:stateStartTime string, :substate string, :detail string, :state string}, :statusHistory [{:stateStartTime string, :substate string, :detail string, :state string}], :config {:configBucket string, :gceClusterConfig GceClusterConfig, :softwareConfig SoftwareConfig, :workerConfig InstanceGroupConfig, :initializationActions [NodeInitializationAction], :securityConfig SecurityConfig, :masterConfig InstanceGroupConfig, :lifecycleConfig LifecycleConfig, :secondaryWorkerConfig InstanceGroupConfig, :encryptionConfig EncryptionConfig, :autoscalingConfig AutoscalingConfig}, :clusterName string, :clusterUuid string, :projectId string, :labels {}}

Creates a cluster in a project. The returned Operation.metadata will be ClusterOperationMetadata (https://cloud.google.com/dataproc/docs/reference/rpc/google.cloud.dataproc.v1#clusteroperationmetadata).

regions-clusters-delete$ clj

(regions-clusters-delete$ auth parameters)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/clusters/delete

Required parameters: clusterName, projectId, region

Optional parameters: clusterUuid, requestId

Deletes a cluster in a project. The returned Operation.metadata will be ClusterOperationMetadata (https://cloud.google.com/dataproc/docs/reference/rpc/google.cloud.dataproc.v1#clusteroperationmetadata).

regions-clusters-diagnose$ clj

(regions-clusters-diagnose$ auth parameters body)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/clusters/diagnose

Required parameters: clusterName, projectId, region

Optional parameters: none

Body:

{}

Gets cluster diagnostic information. The returned Operation.metadata will be ClusterOperationMetadata (https://cloud.google.com/dataproc/docs/reference/rpc/google.cloud.dataproc.v1#clusteroperationmetadata). After the operation completes, Operation.response contains DiagnoseClusterResults (https://cloud.google.com/dataproc/docs/reference/rpc/google.cloud.dataproc.v1#diagnoseclusterresults).

regions-clusters-get$ clj

(regions-clusters-get$ auth parameters)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/clusters/get

Required parameters: clusterName, projectId, region

Optional parameters: none

Gets the resource representation for a cluster in a project.

regions-clusters-getIamPolicy$ clj

(regions-clusters-getIamPolicy$ auth parameters body)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/clusters/getIamPolicy

Required parameters: resource

Optional parameters: none

Body:

{:options {:requestedPolicyVersion integer}}

Gets the access control policy for a resource. Returns an empty policy if the resource exists and does not have a policy set.

regions-clusters-list$ clj

(regions-clusters-list$ auth parameters)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/clusters/list

Required parameters: projectId, region

Optional parameters: pageToken, pageSize, filter

Lists all regions/{region}/clusters in a project alphabetically.

regions-clusters-patch$ clj

(regions-clusters-patch$ auth parameters body)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/clusters/patch

Required parameters: region, clusterName, projectId

Optional parameters: requestId, updateMask, gracefulDecommissionTimeout

Body:

{:metrics {:hdfsMetrics {}, :yarnMetrics {}}, :status {:stateStartTime string, :substate string, :detail string, :state string}, :statusHistory [{:stateStartTime string, :substate string, :detail string, :state string}], :config {:configBucket string, :gceClusterConfig GceClusterConfig, :softwareConfig SoftwareConfig, :workerConfig InstanceGroupConfig, :initializationActions [NodeInitializationAction], :securityConfig SecurityConfig, :masterConfig InstanceGroupConfig, :lifecycleConfig LifecycleConfig, :secondaryWorkerConfig InstanceGroupConfig, :encryptionConfig EncryptionConfig, :autoscalingConfig AutoscalingConfig}, :clusterName string, :clusterUuid string, :projectId string, :labels {}}

Updates a cluster in a project. The returned Operation.metadata will be ClusterOperationMetadata (https://cloud.google.com/dataproc/docs/reference/rpc/google.cloud.dataproc.v1#clusteroperationmetadata).

regions-clusters-setIamPolicy$ clj

(regions-clusters-setIamPolicy$ auth parameters body)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/clusters/setIamPolicy

Required parameters: resource

Optional parameters: none

Body:

{:policy {:version integer, :bindings [Binding], :etag string}}

Sets the access control policy on the specified resource. Replaces any existing policy.Can return Public Errors: NOT_FOUND, INVALID_ARGUMENT and PERMISSION_DENIED

regions-clusters-testIamPermissions$ clj

(regions-clusters-testIamPermissions$ auth parameters body)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/clusters/testIamPermissions

Required parameters: resource

Optional parameters: none

Body:

{:permissions [string]}

Returns permissions that a caller has on the specified resource. If the resource does not exist, this will return an empty set of permissions, not a NOT_FOUND error.Note: This operation is designed to be used for building permission-aware UIs and command-line tools, not for authorization checking. This operation may "fail open" without warning.

regions-jobs-cancel$ clj

(regions-jobs-cancel$ auth parameters body)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/jobs/cancel

Required parameters: region, projectId, jobId

Optional parameters: none

Body:

{}

Starts a job cancellation request. To access the job resource after cancellation, call regions/{region}/jobs.list (https://cloud.google.com/dataproc/docs/reference/rest/v1/projects.regions.jobs/list) or regions/{region}/jobs.get (https://cloud.google.com/dataproc/docs/reference/rest/v1/projects.regions.jobs/get).

regions-jobs-delete$ clj

(regions-jobs-delete$ auth parameters)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/jobs/delete

Required parameters: projectId, jobId, region

Optional parameters: none

Deletes the job from the project. If the job is active, the delete fails, and the response returns FAILED_PRECONDITION.

regions-jobs-get$ clj

(regions-jobs-get$ auth parameters)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/jobs/get

Required parameters: projectId, jobId, region

Optional parameters: none

Gets the resource representation for a job in a project.

regions-jobs-getIamPolicy$ clj

(regions-jobs-getIamPolicy$ auth parameters body)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/jobs/getIamPolicy

Required parameters: resource

Optional parameters: none

Body:

{:options {:requestedPolicyVersion integer}}

Gets the access control policy for a resource. Returns an empty policy if the resource exists and does not have a policy set.

regions-jobs-list$ clj

(regions-jobs-list$ auth parameters)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/jobs/list

Required parameters: region, projectId

Optional parameters: jobStateMatcher, pageToken, pageSize, clusterName, filter

Lists regions/{region}/jobs in a project.

regions-jobs-patch$ clj

(regions-jobs-patch$ auth parameters body)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/jobs/patch

Required parameters: projectId, jobId, region

Optional parameters: updateMask

Body:

{:labels {}, :sparkSqlJob {:queryFileUri string, :queryList QueryList, :jarFileUris [string], :scriptVariables {}, :loggingConfig LoggingConfig, :properties {}}, :prestoJob {:loggingConfig LoggingConfig, :properties {}, :outputFormat string, :continueOnFailure boolean, :queryFileUri string, :queryList QueryList, :clientTags [string]}, :scheduling {:maxFailuresPerHour integer}, :done boolean, :driverOutputResourceUri string, :pigJob {:continueOnFailure boolean, :queryFileUri string, :queryList QueryList, :scriptVariables {}, :jarFileUris [string], :loggingConfig LoggingConfig, :properties {}}, :yarnApplications [{:state string, :name string, :trackingUrl string, :progress number}], :hiveJob {:properties {}, :continueOnFailure boolean, :queryList QueryList, :queryFileUri string, :jarFileUris [string], :scriptVariables {}}, :sparkJob {:jarFileUris [string], :loggingConfig LoggingConfig, :properties {}, :args [string], :fileUris [string], :mainClass string, :archiveUris [string], :mainJarFileUri string}, :reference {:projectId string, :jobId string}, :status {:state string, :details string, :stateStartTime string, :substate string}, :pysparkJob {:jarFileUris [string], :loggingConfig LoggingConfig, :properties {}, :args [string], :fileUris [string], :pythonFileUris [string], :mainPythonFileUri string, :archiveUris [string]}, :sparkRJob {:loggingConfig LoggingConfig, :properties {}, :mainRFileUri string, :args [string], :fileUris [string], :archiveUris [string]}, :jobUuid string, :placement {:clusterName string, :clusterUuid string}, :hadoopJob {:archiveUris [string], :mainJarFileUri string, :jarFileUris [string], :loggingConfig LoggingConfig, :properties {}, :args [string], :fileUris [string], :mainClass string}, :driverControlFilesUri string, :statusHistory [{:state string, :details string, :stateStartTime string, :substate string}]}

Updates a job in a project.

regions-jobs-setIamPolicy$ clj

(regions-jobs-setIamPolicy$ auth parameters body)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/jobs/setIamPolicy

Required parameters: resource

Optional parameters: none

Body:

{:policy {:version integer, :bindings [Binding], :etag string}}

Sets the access control policy on the specified resource. Replaces any existing policy.Can return Public Errors: NOT_FOUND, INVALID_ARGUMENT and PERMISSION_DENIED

regions-jobs-submit$ clj

(regions-jobs-submit$ auth parameters body)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/jobs/submit

Required parameters: projectId, region

Optional parameters: none

Body:

{:job {:labels {}, :sparkSqlJob SparkSqlJob, :prestoJob PrestoJob, :scheduling JobScheduling, :done boolean, :driverOutputResourceUri string, :pigJob PigJob, :yarnApplications [YarnApplication], :hiveJob HiveJob, :sparkJob SparkJob, :reference JobReference, :status JobStatus, :pysparkJob PySparkJob, :sparkRJob SparkRJob, :jobUuid string, :placement JobPlacement, :hadoopJob HadoopJob, :driverControlFilesUri string, :statusHistory [JobStatus]}, :requestId string}

Submits a job to a cluster.

regions-jobs-submitAsOperation$ clj

(regions-jobs-submitAsOperation$ auth parameters body)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/jobs/submitAsOperation

Required parameters: projectId, region

Optional parameters: none

Body:

{:job {:labels {}, :sparkSqlJob SparkSqlJob, :prestoJob PrestoJob, :scheduling JobScheduling, :done boolean, :driverOutputResourceUri string, :pigJob PigJob, :yarnApplications [YarnApplication], :hiveJob HiveJob, :sparkJob SparkJob, :reference JobReference, :status JobStatus, :pysparkJob PySparkJob, :sparkRJob SparkRJob, :jobUuid string, :placement JobPlacement, :hadoopJob HadoopJob, :driverControlFilesUri string, :statusHistory [JobStatus]}, :requestId string}

Submits job to a cluster.

regions-jobs-testIamPermissions$ clj

(regions-jobs-testIamPermissions$ auth parameters body)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/jobs/testIamPermissions

Required parameters: resource

Optional parameters: none

Body:

{:permissions [string]}

Returns permissions that a caller has on the specified resource. If the resource does not exist, this will return an empty set of permissions, not a NOT_FOUND error.Note: This operation is designed to be used for building permission-aware UIs and command-line tools, not for authorization checking. This operation may "fail open" without warning.

regions-operations-cancel$ clj

(regions-operations-cancel$ auth parameters)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/operations/cancel

Required parameters: name

Optional parameters: none

Starts asynchronous cancellation on a long-running operation. The server makes a best effort to cancel the operation, but success is not guaranteed. If the server doesn't support this method, it returns google.rpc.Code.UNIMPLEMENTED. Clients can use Operations.GetOperation or other methods to check whether the cancellation succeeded or whether the operation completed despite cancellation. On successful cancellation, the operation is not deleted; instead, it becomes an operation with an Operation.error value with a google.rpc.Status.code of 1, corresponding to Code.CANCELLED.

regions-operations-delete$ clj

(regions-operations-delete$ auth parameters)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/operations/delete

Required parameters: name

Optional parameters: none

Deletes a long-running operation. This method indicates that the client is no longer interested in the operation result. It does not cancel the operation. If the server doesn't support this method, it returns google.rpc.Code.UNIMPLEMENTED.

regions-operations-get$ clj

(regions-operations-get$ auth parameters)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/operations/get

Required parameters: name

Optional parameters: none

Gets the latest state of a long-running operation. Clients can use this method to poll the operation result at intervals as recommended by the API service.

regions-operations-getIamPolicy$ clj

(regions-operations-getIamPolicy$ auth parameters body)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/operations/getIamPolicy

Required parameters: resource

Optional parameters: none

Body:

{:options {:requestedPolicyVersion integer}}

Gets the access control policy for a resource. Returns an empty policy if the resource exists and does not have a policy set.

regions-operations-list$ clj

(regions-operations-list$ auth parameters)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/operations/list

Required parameters: name

Optional parameters: pageToken, pageSize, filter

Lists operations that match the specified filter in the request. If the server doesn't support this method, it returns UNIMPLEMENTED.NOTE: the name binding allows API services to override the binding to use different resource name schemes, such as users//operations. To override the binding, API services can add a binding such as "/v1/{name=users/}/operations" to their service configuration. For backwards compatibility, the default name includes the operations collection id, however overriding users must ensure the name binding is the parent resource, without the operations collection id.

regions-operations-setIamPolicy$ clj

(regions-operations-setIamPolicy$ auth parameters body)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/operations/setIamPolicy

Required parameters: resource

Optional parameters: none

Body:

{:policy {:version integer, :bindings [Binding], :etag string}}

Sets the access control policy on the specified resource. Replaces any existing policy.Can return Public Errors: NOT_FOUND, INVALID_ARGUMENT and PERMISSION_DENIED

regions-operations-testIamPermissions$ clj

(regions-operations-testIamPermissions$ auth parameters body)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/operations/testIamPermissions

Required parameters: resource

Optional parameters: none

Body:

{:permissions [string]}

Returns permissions that a caller has on the specified resource. If the resource does not exist, this will return an empty set of permissions, not a NOT_FOUND error.Note: This operation is designed to be used for building permission-aware UIs and command-line tools, not for authorization checking. This operation may "fail open" without warning.

regions-workflowTemplates-create$ clj

(regions-workflowTemplates-create$ auth parameters body)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/workflowTemplates/create

Required parameters: parent

Optional parameters: none

Body:

{:labels {}, :name string, :createTime string, :updateTime string, :jobs [{:labels {}, :prerequisiteStepIds [string], :sparkSqlJob SparkSqlJob, :scheduling JobScheduling, :pigJob PigJob, :hiveJob HiveJob, :sparkJob SparkJob, :stepId string, :pysparkJob PySparkJob, :hadoopJob HadoopJob}], :id string, :version integer, :placement {:clusterSelector ClusterSelector, :managedCluster ManagedCluster}, :parameters [{:fields [string], :name string, :description string, :validation ParameterValidation}]}

Creates new workflow template.

regions-workflowTemplates-delete$ clj

(regions-workflowTemplates-delete$ auth parameters)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/workflowTemplates/delete

Required parameters: name

Optional parameters: version

Deletes a workflow template. It does not cancel in-progress workflows.

regions-workflowTemplates-get$ clj

(regions-workflowTemplates-get$ auth parameters)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/workflowTemplates/get

Required parameters: name

Optional parameters: version

Retrieves the latest workflow template.Can retrieve previously instantiated template by specifying optional version parameter.

regions-workflowTemplates-getIamPolicy$ clj

(regions-workflowTemplates-getIamPolicy$ auth parameters body)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/workflowTemplates/getIamPolicy

Required parameters: resource

Optional parameters: none

Body:

{:options {:requestedPolicyVersion integer}}

Gets the access control policy for a resource. Returns an empty policy if the resource exists and does not have a policy set.

regions-workflowTemplates-instantiate$ clj

(regions-workflowTemplates-instantiate$ auth parameters body)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/workflowTemplates/instantiate

Required parameters: name

Optional parameters: none

Body:

{:requestId string, :version integer, :parameters {}}

Instantiates a template and begins execution.The returned Operation can be used to track execution of workflow by polling operations.get. The Operation will complete when entire workflow is finished.The running workflow can be aborted via operations.cancel. This will cause any inflight jobs to be cancelled and workflow-owned clusters to be deleted.The Operation.metadata will be WorkflowMetadata (https://cloud.google.com/dataproc/docs/reference/rpc/google.cloud.dataproc.v1#workflowmetadata). Also see Using WorkflowMetadata (https://cloud.google.com/dataproc/docs/concepts/workflows/debugging#using_workflowmetadata).On successful completion, Operation.response will be Empty.

regions-workflowTemplates-instantiateInline$ clj

(regions-workflowTemplates-instantiateInline$ auth parameters body)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/workflowTemplates/instantiateInline

Required parameters: parent

Optional parameters: requestId

Body:

{:labels {}, :name string, :createTime string, :updateTime string, :jobs [{:labels {}, :prerequisiteStepIds [string], :sparkSqlJob SparkSqlJob, :scheduling JobScheduling, :pigJob PigJob, :hiveJob HiveJob, :sparkJob SparkJob, :stepId string, :pysparkJob PySparkJob, :hadoopJob HadoopJob}], :id string, :version integer, :placement {:clusterSelector ClusterSelector, :managedCluster ManagedCluster}, :parameters [{:fields [string], :name string, :description string, :validation ParameterValidation}]}

Instantiates a template and begins execution.This method is equivalent to executing the sequence CreateWorkflowTemplate, InstantiateWorkflowTemplate, DeleteWorkflowTemplate.The returned Operation can be used to track execution of workflow by polling operations.get. The Operation will complete when entire workflow is finished.The running workflow can be aborted via operations.cancel. This will cause any inflight jobs to be cancelled and workflow-owned clusters to be deleted.The Operation.metadata will be WorkflowMetadata (https://cloud.google.com/dataproc/docs/reference/rpc/google.cloud.dataproc.v1#workflowmetadata). Also see Using WorkflowMetadata (https://cloud.google.com/dataproc/docs/concepts/workflows/debugging#using_workflowmetadata).On successful completion, Operation.response will be Empty.

regions-workflowTemplates-list$ clj

(regions-workflowTemplates-list$ auth parameters)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/workflowTemplates/list

Required parameters: parent

Optional parameters: pageToken, pageSize

Lists workflows that match the specified filter in the request.

regions-workflowTemplates-setIamPolicy$ clj

(regions-workflowTemplates-setIamPolicy$ auth parameters body)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/workflowTemplates/setIamPolicy

Required parameters: resource

Optional parameters: none

Body:

{:policy {:version integer, :bindings [Binding], :etag string}}

Sets the access control policy on the specified resource. Replaces any existing policy.Can return Public Errors: NOT_FOUND, INVALID_ARGUMENT and PERMISSION_DENIED

regions-workflowTemplates-testIamPermissions$ clj

(regions-workflowTemplates-testIamPermissions$ auth parameters body)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/workflowTemplates/testIamPermissions

Required parameters: resource

Optional parameters: none

Body:

{:permissions [string]}

Returns permissions that a caller has on the specified resource. If the resource does not exist, this will return an empty set of permissions, not a NOT_FOUND error.Note: This operation is designed to be used for building permission-aware UIs and command-line tools, not for authorization checking. This operation may "fail open" without warning.

regions-workflowTemplates-update$ clj

(regions-workflowTemplates-update$ auth parameters body)

https://cloud.google.com/dataproc/api/reference/rest/v1/projects/regions/workflowTemplates/update

Required parameters: name

Optional parameters: none

Body:

{:labels {}, :name string, :createTime string, :updateTime string, :jobs [{:labels {}, :prerequisiteStepIds [string], :sparkSqlJob SparkSqlJob, :scheduling JobScheduling, :pigJob PigJob, :hiveJob HiveJob, :sparkJob SparkJob, :stepId string, :pysparkJob PySparkJob, :hadoopJob HadoopJob}], :id string, :version integer, :placement {:clusterSelector ClusterSelector, :managedCluster ManagedCluster}, :parameters [{:fields [string], :name string, :description string, :validation ParameterValidation}]}

Updates (replaces) workflow template. The updated template must contain version that matches the current server version.