Skip to content

Commit

Permalink
feat(dataflow): update the api
Browse files Browse the repository at this point in the history
#### dataflow:v1b3

The following keys were deleted:
- resources.projects.resources.locations.resources.sql.methods.validate (Total Keys: 15)
- schemas.QueryInfo (Total Keys: 4)
- schemas.ValidateResponse (Total Keys: 4)
  • Loading branch information
yoshi-automation committed Jan 31, 2023
1 parent 512fa51 commit ab7a6d7
Show file tree
Hide file tree
Showing 6 changed files with 84 additions and 167 deletions.
2 changes: 1 addition & 1 deletion docs/dyn/dataflow_v1b3.projects.jobs.html
Expand Up @@ -1450,7 +1450,7 @@ <h3>Method Details</h3>
Returns:
An object of the form:

{ # JobMetrics contains a collection of metrics describing the detailed progress of a Dataflow job. Metrics correspond to user-defined and system-defined metrics in the job. This resource captures only the most recent values of each metric; time-series data can be queried for them (under the same metric names) from Cloud Monitoring.
{ # JobMetrics contains a collection of metrics describing the detailed progress of a Dataflow job. Metrics correspond to user-defined and system-defined metrics in the job. For more information, see [Dataflow job metrics] (https://cloud.google.com/dataflow/docs/guides/using-monitoring-intf). This resource captures only the most recent values of each metric; time-series data can be queried for them (under the same metric names) from Cloud Monitoring.
&quot;metricTime&quot;: &quot;A String&quot;, # Timestamp as of which metric values are current.
&quot;metrics&quot;: [ # All metrics for this job.
{ # Describes the state of a metric.
Expand Down
5 changes: 0 additions & 5 deletions docs/dyn/dataflow_v1b3.projects.locations.html
Expand Up @@ -89,11 +89,6 @@ <h2>Instance Methods</h2>
</p>
<p class="firstline">Returns the snapshots Resource.</p>

<p class="toc_element">
<code><a href="dataflow_v1b3.projects.locations.sql.html">sql()</a></code>
</p>
<p class="firstline">Returns the sql Resource.</p>

<p class="toc_element">
<code><a href="dataflow_v1b3.projects.locations.templates.html">templates()</a></code>
</p>
Expand Down
2 changes: 1 addition & 1 deletion docs/dyn/dataflow_v1b3.projects.locations.jobs.html
Expand Up @@ -1212,7 +1212,7 @@ <h3>Method Details</h3>
Returns:
An object of the form:

{ # JobMetrics contains a collection of metrics describing the detailed progress of a Dataflow job. Metrics correspond to user-defined and system-defined metrics in the job. This resource captures only the most recent values of each metric; time-series data can be queried for them (under the same metric names) from Cloud Monitoring.
{ # JobMetrics contains a collection of metrics describing the detailed progress of a Dataflow job. Metrics correspond to user-defined and system-defined metrics in the job. For more information, see [Dataflow job metrics] (https://cloud.google.com/dataflow/docs/guides/using-monitoring-intf). This resource captures only the most recent values of each metric; time-series data can be queried for them (under the same metric names) from Cloud Monitoring.
&quot;metricTime&quot;: &quot;A String&quot;, # Timestamp as of which metric values are current.
&quot;metrics&quot;: [ # All metrics for this job.
{ # Describes the state of a metric.
Expand Down
64 changes: 32 additions & 32 deletions docs/dyn/dataflow_v1b3.projects.locations.templates.html
Expand Up @@ -104,26 +104,26 @@ <h3>Method Details</h3>

{ # A request to create a Cloud Dataflow job from a template.
&quot;environment&quot;: { # The environment values to set at runtime. # The runtime environment for the job.
&quot;additionalExperiments&quot;: [ # Additional experiment flags for the job, specified with the `--experiments` option.
&quot;additionalExperiments&quot;: [ # Optional. Additional experiment flags for the job, specified with the `--experiments` option.
&quot;A String&quot;,
],
&quot;additionalUserLabels&quot;: { # Additional user labels to be specified for the job. Keys and values should follow the restrictions specified in the [labeling restrictions](https://cloud.google.com/compute/docs/labeling-resources#restrictions) page. An object containing a list of &quot;key&quot;: value pairs. Example: { &quot;name&quot;: &quot;wrench&quot;, &quot;mass&quot;: &quot;1kg&quot;, &quot;count&quot;: &quot;3&quot; }.
&quot;additionalUserLabels&quot;: { # Optional. Additional user labels to be specified for the job. Keys and values should follow the restrictions specified in the [labeling restrictions](https://cloud.google.com/compute/docs/labeling-resources#restrictions) page. An object containing a list of &quot;key&quot;: value pairs. Example: { &quot;name&quot;: &quot;wrench&quot;, &quot;mass&quot;: &quot;1kg&quot;, &quot;count&quot;: &quot;3&quot; }.
&quot;a_key&quot;: &quot;A String&quot;,
},
&quot;bypassTempDirValidation&quot;: True or False, # Whether to bypass the safety checks for the job&#x27;s temporary directory. Use with caution.
&quot;enableStreamingEngine&quot;: True or False, # Whether to enable Streaming Engine for the job.
&quot;ipConfiguration&quot;: &quot;A String&quot;, # Configuration for VM IPs.
&quot;kmsKeyName&quot;: &quot;A String&quot;, # Name for the Cloud KMS key for the job. Key format is: projects//locations//keyRings//cryptoKeys/
&quot;machineType&quot;: &quot;A String&quot;, # The machine type to use for the job. Defaults to the value from the template if not specified.
&quot;maxWorkers&quot;: 42, # The maximum number of Google Compute Engine instances to be made available to your pipeline during execution, from 1 to 1000.
&quot;network&quot;: &quot;A String&quot;, # Network to which VMs will be assigned. If empty or unspecified, the service will use the network &quot;default&quot;.
&quot;numWorkers&quot;: 42, # The initial number of Google Compute Engine instances for the job.
&quot;serviceAccountEmail&quot;: &quot;A String&quot;, # The email address of the service account to run the job as.
&quot;subnetwork&quot;: &quot;A String&quot;, # Subnetwork to which VMs will be assigned, if desired. You can specify a subnetwork using either a complete URL or an abbreviated path. Expected to be of the form &quot;https://www.googleapis.com/compute/v1/projects/HOST_PROJECT_ID/regions/REGION/subnetworks/SUBNETWORK&quot; or &quot;regions/REGION/subnetworks/SUBNETWORK&quot;. If the subnetwork is located in a Shared VPC network, you must use the complete URL.
&quot;tempLocation&quot;: &quot;A String&quot;, # The Cloud Storage path to use for temporary files. Must be a valid Cloud Storage URL, beginning with `gs://`.
&quot;workerRegion&quot;: &quot;A String&quot;, # The Compute Engine region (https://cloud.google.com/compute/docs/regions-zones/regions-zones) in which worker processing should occur, e.g. &quot;us-west1&quot;. Mutually exclusive with worker_zone. If neither worker_region nor worker_zone is specified, default to the control plane&#x27;s region.
&quot;workerZone&quot;: &quot;A String&quot;, # The Compute Engine zone (https://cloud.google.com/compute/docs/regions-zones/regions-zones) in which worker processing should occur, e.g. &quot;us-west1-a&quot;. Mutually exclusive with worker_region. If neither worker_region nor worker_zone is specified, a zone in the control plane&#x27;s region is chosen based on available capacity. If both `worker_zone` and `zone` are set, `worker_zone` takes precedence.
&quot;zone&quot;: &quot;A String&quot;, # The Compute Engine [availability zone](https://cloud.google.com/compute/docs/regions-zones/regions-zones) for launching worker instances to run your pipeline. In the future, worker_zone will take precedence.
&quot;bypassTempDirValidation&quot;: True or False, # Optional. Whether to bypass the safety checks for the job&#x27;s temporary directory. Use with caution.
&quot;enableStreamingEngine&quot;: True or False, # Optional. Whether to enable Streaming Engine for the job.
&quot;ipConfiguration&quot;: &quot;A String&quot;, # Optional. Configuration for VM IPs.
&quot;kmsKeyName&quot;: &quot;A String&quot;, # Optional. Name for the Cloud KMS key for the job. Key format is: projects//locations//keyRings//cryptoKeys/
&quot;machineType&quot;: &quot;A String&quot;, # Optional. The machine type to use for the job. Defaults to the value from the template if not specified.
&quot;maxWorkers&quot;: 42, # Optional. The maximum number of Google Compute Engine instances to be made available to your pipeline during execution, from 1 to 1000. The default value is 1.
&quot;network&quot;: &quot;A String&quot;, # Optional. Network to which VMs will be assigned. If empty or unspecified, the service will use the network &quot;default&quot;.
&quot;numWorkers&quot;: 42, # Optional. The initial number of Google Compute Engine instances for the job. The default value is 11.
&quot;serviceAccountEmail&quot;: &quot;A String&quot;, # Optional. The email address of the service account to run the job as.
&quot;subnetwork&quot;: &quot;A String&quot;, # Optional. Subnetwork to which VMs will be assigned, if desired. You can specify a subnetwork using either a complete URL or an abbreviated path. Expected to be of the form &quot;https://www.googleapis.com/compute/v1/projects/HOST_PROJECT_ID/regions/REGION/subnetworks/SUBNETWORK&quot; or &quot;regions/REGION/subnetworks/SUBNETWORK&quot;. If the subnetwork is located in a Shared VPC network, you must use the complete URL.
&quot;tempLocation&quot;: &quot;A String&quot;, # Required. The Cloud Storage path to use for temporary files. Must be a valid Cloud Storage URL, beginning with `gs://`.
&quot;workerRegion&quot;: &quot;A String&quot;, # Required. The Compute Engine region (https://cloud.google.com/compute/docs/regions-zones/regions-zones) in which worker processing should occur, e.g. &quot;us-west1&quot;. Mutually exclusive with worker_zone. If neither worker_region nor worker_zone is specified, default to the control plane&#x27;s region.
&quot;workerZone&quot;: &quot;A String&quot;, # Optional. The Compute Engine zone (https://cloud.google.com/compute/docs/regions-zones/regions-zones) in which worker processing should occur, e.g. &quot;us-west1-a&quot;. Mutually exclusive with worker_region. If neither worker_region nor worker_zone is specified, a zone in the control plane&#x27;s region is chosen based on available capacity. If both `worker_zone` and `zone` are set, `worker_zone` takes precedence.
&quot;zone&quot;: &quot;A String&quot;, # Optional. The Compute Engine [availability zone](https://cloud.google.com/compute/docs/regions-zones/regions-zones) for launching worker instances to run your pipeline. In the future, worker_zone will take precedence.
},
&quot;gcsPath&quot;: &quot;A String&quot;, # Required. A Cloud Storage path to the template from which to create the job. Must be a valid Cloud Storage URL, beginning with `gs://`.
&quot;jobName&quot;: &quot;A String&quot;, # Required. The job name to use for the created job.
Expand Down Expand Up @@ -528,26 +528,26 @@ <h3>Method Details</h3>

{ # Parameters to provide to the template being launched. Note that the [metadata in the pipeline code] (https://cloud.google.com/dataflow/docs/guides/templates/creating-templates#metadata) determines which runtime parameters are valid.
&quot;environment&quot;: { # The environment values to set at runtime. # The runtime environment for the job.
&quot;additionalExperiments&quot;: [ # Additional experiment flags for the job, specified with the `--experiments` option.
&quot;additionalExperiments&quot;: [ # Optional. Additional experiment flags for the job, specified with the `--experiments` option.
&quot;A String&quot;,
],
&quot;additionalUserLabels&quot;: { # Additional user labels to be specified for the job. Keys and values should follow the restrictions specified in the [labeling restrictions](https://cloud.google.com/compute/docs/labeling-resources#restrictions) page. An object containing a list of &quot;key&quot;: value pairs. Example: { &quot;name&quot;: &quot;wrench&quot;, &quot;mass&quot;: &quot;1kg&quot;, &quot;count&quot;: &quot;3&quot; }.
&quot;additionalUserLabels&quot;: { # Optional. Additional user labels to be specified for the job. Keys and values should follow the restrictions specified in the [labeling restrictions](https://cloud.google.com/compute/docs/labeling-resources#restrictions) page. An object containing a list of &quot;key&quot;: value pairs. Example: { &quot;name&quot;: &quot;wrench&quot;, &quot;mass&quot;: &quot;1kg&quot;, &quot;count&quot;: &quot;3&quot; }.
&quot;a_key&quot;: &quot;A String&quot;,
},
&quot;bypassTempDirValidation&quot;: True or False, # Whether to bypass the safety checks for the job&#x27;s temporary directory. Use with caution.
&quot;enableStreamingEngine&quot;: True or False, # Whether to enable Streaming Engine for the job.
&quot;ipConfiguration&quot;: &quot;A String&quot;, # Configuration for VM IPs.
&quot;kmsKeyName&quot;: &quot;A String&quot;, # Name for the Cloud KMS key for the job. Key format is: projects//locations//keyRings//cryptoKeys/
&quot;machineType&quot;: &quot;A String&quot;, # The machine type to use for the job. Defaults to the value from the template if not specified.
&quot;maxWorkers&quot;: 42, # The maximum number of Google Compute Engine instances to be made available to your pipeline during execution, from 1 to 1000.
&quot;network&quot;: &quot;A String&quot;, # Network to which VMs will be assigned. If empty or unspecified, the service will use the network &quot;default&quot;.
&quot;numWorkers&quot;: 42, # The initial number of Google Compute Engine instances for the job.
&quot;serviceAccountEmail&quot;: &quot;A String&quot;, # The email address of the service account to run the job as.
&quot;subnetwork&quot;: &quot;A String&quot;, # Subnetwork to which VMs will be assigned, if desired. You can specify a subnetwork using either a complete URL or an abbreviated path. Expected to be of the form &quot;https://www.googleapis.com/compute/v1/projects/HOST_PROJECT_ID/regions/REGION/subnetworks/SUBNETWORK&quot; or &quot;regions/REGION/subnetworks/SUBNETWORK&quot;. If the subnetwork is located in a Shared VPC network, you must use the complete URL.
&quot;tempLocation&quot;: &quot;A String&quot;, # The Cloud Storage path to use for temporary files. Must be a valid Cloud Storage URL, beginning with `gs://`.
&quot;workerRegion&quot;: &quot;A String&quot;, # The Compute Engine region (https://cloud.google.com/compute/docs/regions-zones/regions-zones) in which worker processing should occur, e.g. &quot;us-west1&quot;. Mutually exclusive with worker_zone. If neither worker_region nor worker_zone is specified, default to the control plane&#x27;s region.
&quot;workerZone&quot;: &quot;A String&quot;, # The Compute Engine zone (https://cloud.google.com/compute/docs/regions-zones/regions-zones) in which worker processing should occur, e.g. &quot;us-west1-a&quot;. Mutually exclusive with worker_region. If neither worker_region nor worker_zone is specified, a zone in the control plane&#x27;s region is chosen based on available capacity. If both `worker_zone` and `zone` are set, `worker_zone` takes precedence.
&quot;zone&quot;: &quot;A String&quot;, # The Compute Engine [availability zone](https://cloud.google.com/compute/docs/regions-zones/regions-zones) for launching worker instances to run your pipeline. In the future, worker_zone will take precedence.
&quot;bypassTempDirValidation&quot;: True or False, # Optional. Whether to bypass the safety checks for the job&#x27;s temporary directory. Use with caution.
&quot;enableStreamingEngine&quot;: True or False, # Optional. Whether to enable Streaming Engine for the job.
&quot;ipConfiguration&quot;: &quot;A String&quot;, # Optional. Configuration for VM IPs.
&quot;kmsKeyName&quot;: &quot;A String&quot;, # Optional. Name for the Cloud KMS key for the job. Key format is: projects//locations//keyRings//cryptoKeys/
&quot;machineType&quot;: &quot;A String&quot;, # Optional. The machine type to use for the job. Defaults to the value from the template if not specified.
&quot;maxWorkers&quot;: 42, # Optional. The maximum number of Google Compute Engine instances to be made available to your pipeline during execution, from 1 to 1000. The default value is 1.
&quot;network&quot;: &quot;A String&quot;, # Optional. Network to which VMs will be assigned. If empty or unspecified, the service will use the network &quot;default&quot;.
&quot;numWorkers&quot;: 42, # Optional. The initial number of Google Compute Engine instances for the job. The default value is 11.
&quot;serviceAccountEmail&quot;: &quot;A String&quot;, # Optional. The email address of the service account to run the job as.
&quot;subnetwork&quot;: &quot;A String&quot;, # Optional. Subnetwork to which VMs will be assigned, if desired. You can specify a subnetwork using either a complete URL or an abbreviated path. Expected to be of the form &quot;https://www.googleapis.com/compute/v1/projects/HOST_PROJECT_ID/regions/REGION/subnetworks/SUBNETWORK&quot; or &quot;regions/REGION/subnetworks/SUBNETWORK&quot;. If the subnetwork is located in a Shared VPC network, you must use the complete URL.
&quot;tempLocation&quot;: &quot;A String&quot;, # Required. The Cloud Storage path to use for temporary files. Must be a valid Cloud Storage URL, beginning with `gs://`.
&quot;workerRegion&quot;: &quot;A String&quot;, # Required. The Compute Engine region (https://cloud.google.com/compute/docs/regions-zones/regions-zones) in which worker processing should occur, e.g. &quot;us-west1&quot;. Mutually exclusive with worker_zone. If neither worker_region nor worker_zone is specified, default to the control plane&#x27;s region.
&quot;workerZone&quot;: &quot;A String&quot;, # Optional. The Compute Engine zone (https://cloud.google.com/compute/docs/regions-zones/regions-zones) in which worker processing should occur, e.g. &quot;us-west1-a&quot;. Mutually exclusive with worker_region. If neither worker_region nor worker_zone is specified, a zone in the control plane&#x27;s region is chosen based on available capacity. If both `worker_zone` and `zone` are set, `worker_zone` takes precedence.
&quot;zone&quot;: &quot;A String&quot;, # Optional. The Compute Engine [availability zone](https://cloud.google.com/compute/docs/regions-zones/regions-zones) for launching worker instances to run your pipeline. In the future, worker_zone will take precedence.
},
&quot;jobName&quot;: &quot;A String&quot;, # Required. The job name to use for the created job. The name must match the regular expression `[a-z]([-a-z0-9]{0,1022}[a-z0-9])?`
&quot;parameters&quot;: { # The runtime parameters to pass to the job.
Expand Down

0 comments on commit ab7a6d7

Please sign in to comment.