Eventarc API Firestore Triggers in european region not working?

[blaueeiner]

What I want to achieve

I am trying to setup an Eventarc trigger. A specific Firestore action (deletion of a document) should trigger a Cloud Run service instance.

My problem

The service should be provided in europe but...

Eventarc is only supported in the following regions:

europe-north1
europe-west1
europe-west4
(https://cloud.google.com/eventarc/docs/locations#europe)

Firestore is only supported in the following regions:

europe-west2
europe-west3
europe-west6
europe-central12
(https://firebase.google.com/docs/firestore/locations)

When I tried setting up the trigger on the Cloud Run Service, it prompted me to select a region from where (i.e. the region) the trigger should originate and receive events from. My Firestore region is set to europe-west3. Since Eventarc is not supported in this region I was trying to find our if I can get Firestore into a supported Eventarc region in Europe but there is literally none. Does that theoretically mean that Eventarc does not support Firestore in Europe at all?

There is the option to select all regions but I assume that this just means receiving events from all the supported regions, right?

Is there any way I can get this working or any official plans from Google about when to support this?

[nickmeinhold]

Hi @blaueeiner!

It is my (unconfirmed) understanding that, regardless of region, deletion of a document is not currently one of the Events supported by Eventarc.

I know that doesn't answer your query in regards to the zones but I thought it may be useful info. I hope we get Firestore document events via Eventarc soon!

[blaueeiner]

@nickmeinhold Thank you very much for the information. I will try it out and share my experience using it 💪

[nickmeinhold]

Hi again, just passing on - the same person pointed out that the docs have now changed to say: "Audit logs for the following operations will become available soon." 🤷‍♂️

[and3rson]

Any information on when will EventArc natively support Firestore? It's been several years, and writing boilerplate Cloud Functions that proxy the data to PubSub or Cloud Run is a pain, especially with local emulator.

[kevmoo]

I'm asking around a bit internally...

[and3rson]

@kevmoo Thanks! Any news by any chance?..

[jimmyff]

It looks like you can now create Event Arc triggers for:

• google.firestore.v1.Firestore.CreateDocument
• google.firestore.v1.Firestore.UpdateDocument
• google.firestore.v1.Firestore.DeleteDocument
• google.firestore.v1.Firestore.Write

See:

Problem is the triggers don't see to be working for me, I'm trying to get the CreateDocument one working. Ideally I'd like to limit it to my account collection and I'm unclear what Resource Name that would require. Right now I'm just trying to get it trigger for anything.

I've posted on stackoverflow to try and get an answer. If anyone has any luck please share

[nickmeinhold]

fwiw data access still seems to be under "Upcoming audit logs" for now

[jimmyff]

Ah, maybe they've put the endpoints live a little early. Looks like they must be just around the corner at least.

[jimmyff]

Looks like the docs are now listing them as a 'preview' also I noticed there a load of new endpoints under the namespace: google.firestore.v1beta1.$operation.

I've not tested them yet but will have play soon

[jimmyff]

So the only endpoint I'm having any success with is: google.firestore.v1.Firestore.Write I have an event arc trigger firing up my Cloud Run instance successfully. Insert, update, delete all seem to trigger this Write event. I am however unclear on how I should filter this to a specific collection.

When creating the trigger you can specify a Resource, however the resource for all my Write events are the same: projects/$appName/databases/(default).

The resource field in the json payload looks like the following:

resource: {
  labels: {
    method: "google.firestore.v1.Firestore.Write",
    project_id: "$appName",
    service: "firestore.googleapis.com"
  },
  type: "audited_resource"
}

Feels like this is so close, we can almost replicate the functionality of Firestore Functions. If anyone figures out how to filter this to specific collections, and possibly different types of writes (insert, delete etc) please share details!

[kevmoo]

Please see https://cloud.google.com/firestore/docs/eventarc !!!