fix!: An existing field response_recall_input is removed from messa…

…ge `.google.cloud.aiplatform.v1beta1.EvaluateInstancesRequest`

fix!: An existing field `rag_context_recall_input` is removed from message `.google.cloud.aiplatform.v1beta1.EvaluateInstancesRequest`
fix!: An existing field `response_recall_result` is removed from message `.google.cloud.aiplatform.v1beta1.EvaluateInstancesResponse`
fix!: An existing field `rag_context_recall_result` is removed from message `.google.cloud.aiplatform.v1beta1.EvaluateInstancesResponse`
fix!: An existing message `ResponseRecallInput` is removed
fix!: An existing message `ResponseRecallInstance` is removed
fix!: An existing message `ResponseRecallSpec` is removed
fix!: An existing message `ResponseRecallResult` is removed
fix!: Changed field behavior for an existing field `context` in message `.google.cloud.aiplatform.v1beta1.QuestionAnsweringQualityInstance`
fix!: Changed field behavior for an existing field `context` in message `.google.cloud.aiplatform.v1beta1.PairwiseQuestionAnsweringQualityInstance`
fix!: An existing message `RagContextRecallInput` is removed
fix!: An existing message `RagContextRecallInstance` is removed
fix!: An existing message `RagContextRecallSpec` is removed
fix!: An existing message `RagContextRecallResult` is removed
fix!: An existing message `NoAuth` is removed
feat: A new field `presence_penalty` is added to message `.google.cloud.aiplatform.v1beta1.GenerationConfig`
feat: A new field `frequency_penalty` is added to message `.google.cloud.aiplatform.v1beta1.GenerationConfig`
feat: A new field `response_mime_type` is added to message `.google.cloud.aiplatform.v1beta1.GenerationConfig`
feat: A new enum `HarmBlockMethod` is added
feat: A new field `method` is added to message `.google.cloud.aiplatform.v1beta1.SafetySetting`
feat: A new message `RetrievedContext` is added
feat: A new field `retrieved_context` is added to message `.google.cloud.aiplatform.v1beta1.GroundingAttribution`
feat: A new field `retrieval_queries` is added to message `.google.cloud.aiplatform.v1beta1.GroundingMetadata`
feat: A new message `IndexConfig` is added
feat: A new field `index_config` is added to message `.google.cloud.aiplatform.v1beta1.FeatureView`
feat: A new message `GoogleDriveSource` is added
feat: A new message `DirectUploadSource` is added
feat: A new field `title` is added to message `.google.cloud.aiplatform.v1beta1.Schema`
feat: A new field `default` is added to message `.google.cloud.aiplatform.v1beta1.Schema`
feat: A new field `min_items` is added to message `.google.cloud.aiplatform.v1beta1.Schema`
feat: A new field `max_items` is added to message `.google.cloud.aiplatform.v1beta1.Schema`
feat: A new field `min_properties` is added to message `.google.cloud.aiplatform.v1beta1.Schema`
feat: A new field `max_properties` is added to message `.google.cloud.aiplatform.v1beta1.Schema`
feat: A new field `minimum` is added to message `.google.cloud.aiplatform.v1beta1.Schema`
feat: A new field `maximum` is added to message `.google.cloud.aiplatform.v1beta1.Schema`
feat: A new field `min_length` is added to message `.google.cloud.aiplatform.v1beta1.Schema`
feat: A new field `max_length` is added to message `.google.cloud.aiplatform.v1beta1.Schema`
feat: A new field `pattern` is added to message `.google.cloud.aiplatform.v1beta1.Schema`
feat: A new method `ChatCompletions` is added to service `PredictionService`
feat: A new field `system_instruction` is added to message `.google.cloud.aiplatform.v1beta1.GenerateContentRequest`
feat: A new value `BLOCKLIST` is added to enum `BlockedReason`
feat: A new value `PROHIBITED_CONTENT` is added to enum `BlockedReason`
feat: A new message `ChatCompletionsRequest` is added
feat: A new field `vertex_rag_store` is added to message `.google.cloud.aiplatform.v1beta1.Retrieval`
feat: A new message `VertexRagStore` is added
feat: A new message `RagCorpus` is added
feat: A new resource_definition `aiplatform.googleapis.com/RagCorpus` is added
feat: A new message `RagFile` is added
feat: A new resource_definition `aiplatform.googleapis.com/RagFile` is added
feat: A new message `RagFileChunkingConfig` is added
feat: A new message `UploadRagFileConfig` is added
feat: A new message `ImportRagFilesConfig` is added
feat: A new service `VertexRagDataService` is added
feat: A new message `CreateRagCorpusRequest` is added
feat: A new message `GetRagCorpusRequest` is added
feat: A new message `ListRagCorporaRequest` is added
feat: A new message `ListRagCorporaResponse` is added
feat: A new message `DeleteRagCorpusRequest` is added
feat: A new message `UploadRagFileRequest` is added
feat: A new message `UploadRagFileResponse` is added
feat: A new message `ImportRagFilesRequest` is added
feat: A new message `ImportRagFilesResponse` is added
feat: A new message `GetRagFileRequest` is added
feat: A new message `ListRagFilesRequest` is added
feat: A new message `ListRagFilesResponse` is added
feat: A new message `DeleteRagFileRequest` is added
feat: A new message `CreateRagCorpusOperationMetadata` is added
feat: A new message `ImportRagFilesOperationMetadata` is added
feat: A new service `VertexRagService` is added
feat: A new message `RagQuery` is added
feat: A new message `RetrieveContextsRequest` is added
feat: A new message `RagContexts` is added
feat: A new message `RetrieveContextsResponse` is added
docs: Documentation updates

PiperOrigin-RevId: 620417091

google/cloud/aiplatform/v1beta1/BUILD.bazel

@@ -131,6 +131,9 @@ proto_library(
         "unmanaged_container_model.proto",
         "user_action_reference.proto",
         "value.proto",
+        "vertex_rag_data.proto",
+        "vertex_rag_data_service.proto",
+        "vertex_rag_service.proto",
         "vizier_service.proto",
     ],
     deps = [

google/cloud/aiplatform/v1beta1/aiplatform_grpc_service_config.json

@@ -46,7 +46,7 @@
       "timeout": "5s"
     },
     {
-      "name":[
+      "name": [
         {
           "service": "google.cloud.aiplatform.v1beta1.EndpointService",
           "method": "CreateEndpoint"
@@ -79,7 +79,7 @@
       "timeout": "5s"
     },
     {
-      "name":[
+      "name": [
         {
           "service": "google.cloud.aiplatform.v1beta1.IndexService",
           "method": "CreateIndex"
@@ -104,7 +104,7 @@
       "timeout": "5s"
     },
     {
-      "name":[
+      "name": [
         {
           "service": "google.cloud.aiplatform.v1beta1.IndexEndpointService",
           "method": "CreateIndexEndpoint"
@@ -137,7 +137,7 @@
       "timeout": "5s"
     },
     {
-      "name":[
+      "name": [
         {
           "service": "google.cloud.aiplatform.v1beta1.JobService",
           "method": "CreateCustomJob"
@@ -250,7 +250,7 @@
       "timeout": "5s"
     },
     {
-      "name":[
+      "name": [
         {
           "service": "google.cloud.aiplatform.v1beta1.JobService",
           "method": "CreateModelDeploymentMonitoringJob"
@@ -259,7 +259,7 @@
       "timeout": "60s"
     },
     {
-      "name":[
+      "name": [
         {
           "service": "google.cloud.aiplatform.v1beta1.MetadataService",
           "method": "AddContextArtifactsAndExecutions"
@@ -364,7 +364,7 @@
       "timeout": "5s"
     },
     {
-      "name":[
+      "name": [
         {
           "service": "google.cloud.aiplatform.v1beta1.ModelService",
           "method": "UploadModel"
@@ -417,7 +417,7 @@
       "timeout": "5s"
     },
     {
-      "name":[
+      "name": [
         {
           "service": "google.cloud.aiplatform.v1beta1.PipelineService",
           "method": "CreateTrainingPipeline"
@@ -442,7 +442,7 @@
       "timeout": "5s"
     },
     {
-      "name":[
+      "name": [
         {
           "service": "google.cloud.aiplatform.v1beta1.PredictionService",
           "method": "Predict"
@@ -455,7 +455,7 @@
       "timeout": "5s"
     },
     {
-      "name":[
+      "name": [
         {
           "service": "google.cloud.aiplatform.v1beta1.SpecialistPoolService",
           "method": "CreateSpecialistPool"
@@ -480,7 +480,7 @@
       "timeout": "5s"
     },
     {
-      "name":[
+      "name": [
         {
           "service": "google.cloud.aiplatform.v1beta1.VizierService",
           "method": "CreateStudy"
@@ -694,6 +694,36 @@
         }
       ],
       "timeout": "5s"
+    },
+    {
+      "name": [
+        {
+          "service": "google.cloud.aiplatform.v1beta1.EvaluationService",
+          "method": "EvaluateInstances"
+        }
+      ],
+      "timeout": "60s"
+    },
+    {
+      "name": [
+        {
+          "service": "google.cloud.aiplatform.v1beta1.EvaluationTaskService",
+          "method": "CreateEvaluationTask"
+        },
+        {
+          "service": "google.cloud.aiplatform.v1beta1.EvaluationTaskService",
+          "method": "GetEvaluationTask"
+        },
+        {
+          "service": "google.cloud.aiplatform.v1beta1.EvaluationTaskService",
+          "method": "ListEvaluationTasks"
+        },
+        {
+          "service": "google.cloud.aiplatform.v1beta1.EvaluationTaskService",
+          "method": "DeleteEvaluationTask"
+        }
+      ],
+      "timeout": "5s"
     }
   ]
 }

google/cloud/aiplatform/v1beta1/aiplatform_v1beta1.yaml

@@ -33,6 +33,8 @@ apis:
 - name: google.cloud.aiplatform.v1beta1.ScheduleService
 - name: google.cloud.aiplatform.v1beta1.SpecialistPoolService
 - name: google.cloud.aiplatform.v1beta1.TensorboardService
+- name: google.cloud.aiplatform.v1beta1.VertexRagDataService
+- name: google.cloud.aiplatform.v1beta1.VertexRagService
 - name: google.cloud.aiplatform.v1beta1.VizierService
 - name: google.cloud.location.Locations
 - name: google.iam.v1.IAMPolicy
@@ -103,6 +105,7 @@ types:
 - name: google.cloud.aiplatform.v1beta1.PurgeContextsResponse
 - name: google.cloud.aiplatform.v1beta1.PurgeExecutionsMetadata
 - name: google.cloud.aiplatform.v1beta1.PurgeExecutionsResponse
+- name: google.cloud.aiplatform.v1beta1.RebootPersistentResourceOperationMetadata
 - name: google.cloud.aiplatform.v1beta1.RestoreDatasetVersionOperationMetadata
 - name: google.cloud.aiplatform.v1beta1.SpecialistPool
 - name: google.cloud.aiplatform.v1beta1.StartNotebookRuntimeOperationMetadata
@@ -273,6 +276,7 @@ http:
     - post: '/ui/{name=projects/*/locations/*/migratableResources/*/operations/*}:cancel'
     - post: '/ui/{name=projects/*/locations/*/models/*/operations/*}:cancel'
     - post: '/ui/{name=projects/*/locations/*/models/*/evaluations/*/operations/*}:cancel'
+    - post: '/ui/{name=projects/*/locations/*/persistentResources/*/operations/*}:cancel'
     - post: '/ui/{name=projects/*/locations/*/studies/*/operations/*}:cancel'
     - post: '/ui/{name=projects/*/locations/*/studies/*/trials/*/operations/*}:cancel'
     - post: '/ui/{name=projects/*/locations/*/trainingPipelines/*/operations/*}:cancel'
@@ -357,6 +361,7 @@ http:
     - delete: '/ui/{name=projects/*/locations/*/migratableResources/*/operations/*}'
     - delete: '/ui/{name=projects/*/locations/*/models/*/operations/*}'
     - delete: '/ui/{name=projects/*/locations/*/models/*/evaluations/*/operations/*}'
+    - delete: '/ui/{name=projects/*/locations/*/persistentResources/*/operations/*}'
     - delete: '/ui/{name=projects/*/locations/*/studies/*/operations/*}'
     - delete: '/ui/{name=projects/*/locations/*/studies/*/trials/*/operations/*}'
     - delete: '/ui/{name=projects/*/locations/*/trainingPipelines/*/operations/*}'
@@ -453,6 +458,7 @@ http:
     - get: '/ui/{name=projects/*/locations/*/migratableResources/*/operations/*}'
     - get: '/ui/{name=projects/*/locations/*/models/*/operations/*}'
     - get: '/ui/{name=projects/*/locations/*/models/*/evaluations/*/operations/*}'
+    - get: '/ui/{name=projects/*/locations/*/persistentResources/*/operations/*}'
     - get: '/ui/{name=projects/*/locations/*/studies/*/operations/*}'
     - get: '/ui/{name=projects/*/locations/*/studies/*/trials/*/operations/*}'
     - get: '/ui/{name=projects/*/locations/*/trainingPipelines/*/operations/*}'
@@ -551,6 +557,7 @@ http:
     - get: '/ui/{name=projects/*/locations/*/studies/*}/operations'
     - get: '/ui/{name=projects/*/locations/*/studies/*/trials/*}/operations'
     - get: '/ui/{name=projects/*/locations/*/trainingPipelines/*}/operations'
+    - get: '/ui/{name=projects/*/locations/*/persistentResources/*}/operations'
     - get: '/ui/{name=projects/*/locations/*/pipelineJobs/*}/operations'
     - get: '/ui/{name=projects/*/locations/*/schedules/*}/operations'
     - get: '/ui/{name=projects/*/locations/*/specialistPools/*}/operations'
@@ -612,7 +619,6 @@ http:
     - get: '/v1beta1/{name=projects/*/locations/*/featureOnlineStores/*/featureViews/*}/operations'
     - get: '/v1beta1/{name=projects/*/locations/*/featureGroups/*}/operations'
     - get: '/v1beta1/{name=projects/*/locations/*/featureGroups/*/features/*}/operations'
-    - get: '/ui/{name=projects/*/locations/*/tuningJobs/*}/operations'
   - selector: google.longrunning.Operations.WaitOperation
     post: '/ui/{name=projects/*/locations/*/operations/*}:wait'
     additional_bindings:
@@ -647,6 +653,7 @@ http:
     - post: '/ui/{name=projects/*/locations/*/studies/*/operations/*}:wait'
     - post: '/ui/{name=projects/*/locations/*/studies/*/trials/*/operations/*}:wait'
     - post: '/ui/{name=projects/*/locations/*/trainingPipelines/*/operations/*}:wait'
+    - post: '/ui/{name=projects/*/locations/*/persistentResources/*/operations/*}:wait'
     - post: '/ui/{name=projects/*/locations/*/pipelineJobs/*/operations/*}:wait'
     - post: '/ui/{name=projects/*/locations/*/schedules/*/operations/*}:wait'
     - post: '/ui/{name=projects/*/locations/*/specialistPools/*/operations/*}:wait'
@@ -847,6 +854,14 @@ authentication:
     oauth:
       canonical_scopes: |-
         https://www.googleapis.com/auth/cloud-platform
+  - selector: 'google.cloud.aiplatform.v1beta1.VertexRagDataService.*'
+    oauth:
+      canonical_scopes: |-
+        https://www.googleapis.com/auth/cloud-platform
+  - selector: google.cloud.aiplatform.v1beta1.VertexRagService.RetrieveContexts
+    oauth:
+      canonical_scopes: |-
+        https://www.googleapis.com/auth/cloud-platform
   - selector: 'google.cloud.aiplatform.v1beta1.VizierService.*'
     oauth:
       canonical_scopes: |-
@@ -869,8 +884,8 @@ authentication:
         https://www.googleapis.com/auth/cloud-platform
 
 publishing:
-  documentation_uri: https://cloud.google.com/ai-platform/docs
   new_issue_uri: https://issuetracker.google.com/issues/new?component=1130925&template=1637248
+  documentation_uri: https://cloud.google.com/ai-platform/docs
   github_label: 'api: aiplatform'
   organization: CLOUD
   library_settings:

google/cloud/aiplatform/v1beta1/content.proto

@@ -102,14 +102,15 @@ message Part {
   }
 }
 
-// Raw media bytes.
+// Content blob.
 //
-// Text should not be sent as raw bytes, use the 'text' field.
+// It's preferred to send as [text][google.cloud.aiplatform.v1beta1.Part.text]
+// directly rather than raw bytes.
 message Blob {
   // Required. The IANA standard MIME type of the source data.
   string mime_type = 1 [(google.api.field_behavior) = REQUIRED];
 
-  // Required. Raw bytes for media formats.
+  // Required. Raw bytes.
   bytes data = 2 [(google.api.field_behavior) = REQUIRED];
 }
 
@@ -152,6 +153,21 @@ message GenerationConfig {
 
   // Optional. Stop sequences.
   repeated string stop_sequences = 6 [(google.api.field_behavior) = OPTIONAL];
+
+  // Optional. Positive penalties.
+  optional float presence_penalty = 8 [(google.api.field_behavior) = OPTIONAL];
+
+  // Optional. Frequency penalties.
+  optional float frequency_penalty = 9 [(google.api.field_behavior) = OPTIONAL];
+
+  // Optional. Output response mimetype of the generated candidate text.
+  // Supported mimetype:
+  // - `text/plain`: (default) Text output.
+  // - `application/json`: JSON response in the candidates.
+  // The model needs to be prompted to output the appropriate response type,
+  // otherwise the behavior is undefined.
+  // This is a preview feature.
+  string response_mime_type = 13 [(google.api.field_behavior) = OPTIONAL];
 }
 
 // Safety settings.
@@ -174,11 +190,27 @@ message SafetySetting {
     BLOCK_NONE = 4;
   }
 
+  // Probability vs severity.
+  enum HarmBlockMethod {
+    // The harm block method is unspecified.
+    HARM_BLOCK_METHOD_UNSPECIFIED = 0;
+
+    // The harm block method uses both probability and severity scores.
+    SEVERITY = 1;
+
+    // The harm block method uses the probability score.
+    PROBABILITY = 2;
+  }
+
   // Required. Harm category.
   HarmCategory category = 1 [(google.api.field_behavior) = REQUIRED];
 
   // Required. The harm block threshold.
   HarmBlockThreshold threshold = 2 [(google.api.field_behavior) = REQUIRED];
+
+  // Optional. Specify if the threshold is used for probability or severity
+  // score. If not specified, the threshold is used for probability score.
+  HarmBlockMethod method = 4 [(google.api.field_behavior) = OPTIONAL];
 }
 
 // Safety rating corresponding to the generated content.
@@ -361,9 +393,22 @@ message GroundingAttribution {
     string title = 2 [(google.api.field_behavior) = OUTPUT_ONLY];
   }
 
+  // Attribution from context retrieved by the retrieval tools.
+  message RetrievedContext {
+    // Output only. URI reference of the attribution.
+    string uri = 1 [(google.api.field_behavior) = OUTPUT_ONLY];
+
+    // Output only. Title of the attribution.
+    string title = 2 [(google.api.field_behavior) = OUTPUT_ONLY];
+  }
+
   oneof reference {
     // Optional. Attribution from the web.
     Web web = 3 [(google.api.field_behavior) = OPTIONAL];
+
+    // Optional. Attribution from context retrieved by the retrieval tools.
+    RetrievedContext retrieved_context = 4
+        [(google.api.field_behavior) = OPTIONAL];
   }
 
   // Output only. Segment of the content this attribution belongs to.
@@ -383,6 +428,10 @@ message GroundingMetadata {
   repeated string web_search_queries = 1
       [(google.api.field_behavior) = OPTIONAL];
 
+  // Optional. Queries executed by the retrieval tools.
+  repeated string retrieval_queries = 3
+      [(google.api.field_behavior) = OPTIONAL];
+
   // Optional. List of grounding attributions.
   repeated GroundingAttribution grounding_attributions = 2
       [(google.api.field_behavior) = OPTIONAL];

google/cloud/aiplatform/v1beta1/endpoint_service.proto

@@ -210,15 +210,15 @@ message ListEndpointsRequest {
   // Optional. An expression for filtering the results of the request. For field
   // names both snake_case and camelCase are supported.
   //
-  //   * `endpoint` supports = and !=. `endpoint` represents the Endpoint ID,
-  //     i.e. the last segment of the Endpoint's [resource
-  //     name][google.cloud.aiplatform.v1beta1.Endpoint.name].
-  //   * `display_name` supports = and, !=
+  //   * `endpoint` supports `=` and `!=`. `endpoint` represents the Endpoint
+  //     ID, i.e. the last segment of the Endpoint's
+  //     [resource name][google.cloud.aiplatform.v1beta1.Endpoint.name].
+  //   * `display_name` supports `=` and `!=`.
   //   * `labels` supports general map functions that is:
   //     * `labels.key=value` - key:value equality
-  //     * `labels.key:* or labels:key - key existence
+  //     * `labels.key:*` or `labels:key` - key existence
   //     * A key including a space must be quoted. `labels."a key"`.
-  //   * `base_model_name` only supports =
+  //   * `base_model_name` only supports `=`.
   //
   // Some examples:
   //