[Support]: retain issues

[Areckee]

Describe the problem you are having

Hi all,

until recently everything was fine with my Frigate configuration. I have it as a docker container on dedicated Debian based PC. It has 1TB HDD which was 100% populated with recordings.
Some time ago i updated and re-deployed new version of container and since around then I see that recordings use around 600-700GB and they are only from last 2-3 days. That's weird 'cause I've set retain: days: 7 and events: retain: days: 14. I don't understand why Frigate won't store more recordings provided it has still some space left on HDD.
After PC reboot there're even less recordings - only from today and not even the whole day.

Version

0.13.2-6476F8A

Frigate config file

mqtt:
  host: 10.10.20.3
  user: mqtt-user
  password: xxxxxxxx
  topic_prefix: frigate
  client_id: frigate
  stats_interval: 60
detectors:
  coral:
    type: edgetpu
    device: usb
record:
  enabled: true
  retain:
    days: 7
    mode: all
  events:
    retain:
      default: 14
      mode: active_objects
snapshots:
  enabled: true
  timestamp: true
  retain:
    default: 30
timestamp_style:
  position: br
  format: '%Y-%m-%d %H:%M:%S'
  color:
    red: 255
    green: 255
    blue: 255
  thickness: 2
go2rtc:
  streams:
    1_main:
    - rtsp://10.10.10.11:554/user=admin&password=&channel=1&stream=0.sdp
    1_sub:
    - rtsp://10.10.10.11:554/user=admin&password=&channel=1&stream=1.sdp
    2_main:
    - rtsp://10.10.10.12:554/user=admin&password=&channel=1&stream=0.sdp
    2_sub:
    - rtsp://10.10.10.12:554/user=admin&password=&channel=1&stream=1.sdp
    3_main:
    - rtsp://10.10.10.13:554/user=admin&password=&channel=1&stream=0.sdp
    3_sub:
    - rtsp://10.10.10.13:554/user=admin&password=&channel=1&stream=1.sdp
    4_main:
    - rtsp://10.10.10.14:554/user=admin&password=&channel=1&stream=0.sdp
    4_sub:
    - rtsp://10.10.10.14:554/user=admin&password=&channel=1&stream=1.sdp
    5_main:
    - rtsp://10.10.10.15:554/user=admin&password=&channel=1&stream=0.sdp
    5_sub:
    - rtsp://10.10.10.15:554/user=admin&password=&channel=1&stream=1.sdp
    6_main:
    - rtsp://10.10.10.16:554/user=admin&password=&channel=1&stream=0.sdp
    6_sub:
    - rtsp://10.10.10.16:554/user=admin&password=&channel=1&stream=1.sdp
    7_main:
    - rtsp://10.10.10.17:554/user=admin&password=&channel=1&stream=0.sdp
    7_sub:
    - rtsp://10.10.10.17:554/user=admin&password=&channel=1&stream=1.sdp
    8_main:
    - rtsp://admin:xxxxxxxxxx@10.10.10.18:554/1/1
    8_sub:
    - rtsp://admin:xxxxxxxxxx@10.10.10.18:554/1/2
objects:
  track:
  - person
  - car
cameras:
  1_na_ulice:
    ffmpeg:
      inputs:
      - path: rtsp://127.0.0.1:8554/1_main
        roles:
        - record
      - path: rtsp://127.0.0.1:8554/1_sub
        roles:
        - detect
      hwaccel_args: preset-vaapi
    detect:
      enabled: true
      width: 704
      height: 396
      fps: 5
    objects:
      track:
      - person
      - car
      filters:
        person:
          min_area: 5000
          max_area: 100000
    zones:
      1_ulica:
        inertia: 1
        coordinates: 0,134,258,0,351,57,0,284
        objects:
          - person
          - car
      1_ogrod:
        coordinates: 704,576,704,181,345,75,169,170,0,292,0,437,0,576
        objects:
          - person
  2_na_wejscie:
    ffmpeg:
      inputs:
      - path: rtsp://127.0.0.1:8554/2_main
        roles:
        - record
      - path: rtsp://127.0.0.1:8554/2_sub
        roles:
        - detect
      hwaccel_args: preset-vaapi
    detect:
      enabled: true
      width: 704
      height: 396
      fps: 5
    objects:
      track:
      - person
      - car
      filters:
        person:
          min_area: 5000
          max_area: 100000
    zones:
      2_ulica:
        inertia: 1
        coordinates: 704,191,704,79,534,0,405,37,584,121
        objects:
          - person
          - car
      2_ogrod:
        coordinates: 0,576,0,0,318,0,543,101,704,202,704,576
        objects:
          - person
  3_na_pd-wsch:
    ffmpeg:
      inputs:
      - path: rtsp://127.0.0.1:8554/3_main
        roles:
        - record
      - path: rtsp://127.0.0.1:8554/3_sub
        roles:
        - detect
      hwaccel_args: preset-vaapi
    detect:
      enabled: true
      width: 704
      height: 396
      fps: 5
    objects:
      track:
      - person
      filters:
        person:
          min_area: 5000
          max_area: 100000
  4_na_tyl:
    ffmpeg:
      inputs:
      - path: rtsp://127.0.0.1:8554/4_main
        roles:
        - record
      - path: rtsp://127.0.0.1:8554/4_sub
        roles:
        - detect
      hwaccel_args: preset-vaapi
    detect:
      enabled: true
      width: 704
      height: 396
      fps: 5
    objects:
      track:
      - person
      filters:
        person:
          min_area: 5000
          max_area: 100000
  5_pn_na_garaz:
    ffmpeg:
      inputs:
      - path: rtsp://127.0.0.1:8554/5_main
        roles:
        - record
      - path: rtsp://127.0.0.1:8554/5_sub
        roles:
        - detect
      hwaccel_args: preset-vaapi
    detect:
      enabled: true
      width: 704
      height: 396
      fps: 5
    objects:
      track:
      - person
      filters:
        person:
          min_area: 5000
          max_area: 100000
  6_pn_na_tyl:
    ffmpeg:
      inputs:
      - path: rtsp://127.0.0.1:8554/6_main
        roles:
        - record
      - path: rtsp://127.0.0.1:8554/6_sub
        roles:
        - detect
      hwaccel_args: preset-vaapi
    detect:
      enabled: true
      width: 704
      height: 396
      fps: 5
    objects:
      track:
      - person
      filters:
        person:
          min_area: 5000
          max_area: 100000
  7_na_taras:
    ffmpeg:
      inputs:
      - path: rtsp://127.0.0.1:8554/7_main
        roles:
        - record
      - path: rtsp://127.0.0.1:8554/7_sub
        roles:
        - detect
      hwaccel_args: preset-vaapi
    detect:
      enabled: true
      width: 704
      height: 396
      fps: 5
    objects:
      track:
      - person
      filters:
        person:
          min_area: 5000
          max_area: 100000
  8_ptz:
    ffmpeg:
      inputs:
      - path: rtsp://127.0.0.1:8554/8_main
        roles:
        - record
      - path: rtsp://127.0.0.1:8554/8_sub
        roles:
        - detect
      hwaccel_args: preset-vaapi
    onvif:
      host: 10.10.10.18
      port: 80
      user: admin
      password: xxxxxxxxxxxxxx
    detect:
      enabled: true
      width: 704
      height: 396
      fps: 10
    objects:
      track:
      - person
      filters:
        person:
          min_area: 5000
          max_area: 100000

Relevant log output

2024-05-08 22:51:15.075265914  [INFO] Preparing Frigate...
2024-05-08 22:51:15.084699358  [INFO] Starting Frigate...
2024-05-08 22:51:16.212068451  [2024-05-08 22:51:16] frigate.app                    INFO    : Starting Frigate (0.13.2-6476f8a)
2024-05-08 22:51:16.297317516  [2024-05-08 22:51:16] peewee_migrate.logs            INFO    : Starting migrations
2024-05-08 22:51:16.301662919  [2024-05-08 22:51:16] peewee_migrate.logs            INFO    : There is nothing to migrate
2024-05-08 22:51:16.522330669  [2024-05-08 22:51:16] frigate.app                    INFO    : Recording process started: 297
2024-05-08 22:51:16.525553367  [2024-05-08 22:51:16] frigate.app                    INFO    : go2rtc process pid: 89
2024-05-08 22:51:16.550744904  [2024-05-08 22:51:16] detector.coral                 INFO    : Starting detection process: 306
2024-05-08 22:51:19.202738846  [2024-05-08 22:51:16] frigate.app                    INFO    : Output process started: 308
2024-05-08 22:51:19.203075321  [2024-05-08 22:51:16] frigate.app                    INFO    : Camera processor started for 1_na_ulice: 324
2024-05-08 22:51:19.203151829  [2024-05-08 22:51:16] frigate.app                    INFO    : Camera processor started for 2_na_wejscie: 325
2024-05-08 22:51:19.203369001  [2024-05-08 22:51:16] frigate.detectors.plugins.edgetpu_tfl INFO    : Attempting to load TPU as usb
2024-05-08 22:51:19.203465737  [2024-05-08 22:51:16] frigate.app                    INFO    : Camera processor started for 3_na_pd-wsch: 327
2024-05-08 22:51:19.203521014  [2024-05-08 22:51:16] frigate.app                    INFO    : Camera processor started for 4_na_tyl: 329
2024-05-08 22:51:19.203616590  [2024-05-08 22:51:16] frigate.app                    INFO    : Camera processor started for 5_pn_na_garaz: 331
2024-05-08 22:51:19.203667861  [2024-05-08 22:51:16] frigate.app                    INFO    : Camera processor started for 6_pn_na_tyl: 333
2024-05-08 22:51:19.203724048  [2024-05-08 22:51:16] frigate.app                    INFO    : Camera processor started for 7_na_taras: 335
2024-05-08 22:51:19.203778408  [2024-05-08 22:51:16] frigate.app                    INFO    : Camera processor started for 8_ptz: 338
2024-05-08 22:51:19.203837551  [2024-05-08 22:51:16] frigate.app                    INFO    : Capture process started for 1_na_ulice: 340
2024-05-08 22:51:19.203891473  [2024-05-08 22:51:16] frigate.app                    INFO    : Capture process started for 2_na_wejscie: 352
2024-05-08 22:51:19.203946411  [2024-05-08 22:51:16] frigate.app                    INFO    : Capture process started for 3_na_pd-wsch: 366
2024-05-08 22:51:19.203999840  [2024-05-08 22:51:16] frigate.app                    INFO    : Capture process started for 4_na_tyl: 370
2024-05-08 22:51:19.204056218  [2024-05-08 22:51:16] frigate.app                    INFO    : Capture process started for 5_pn_na_garaz: 374
2024-05-08 22:51:19.204109527  [2024-05-08 22:51:16] frigate.app                    INFO    : Capture process started for 6_pn_na_tyl: 378
2024-05-08 22:51:19.204164885  [2024-05-08 22:51:16] frigate.app                    INFO    : Capture process started for 7_na_taras: 382
2024-05-08 22:51:19.204244429  [2024-05-08 22:51:16] frigate.app                    INFO    : Capture process started for 8_ptz: 396
2024-05-08 22:51:19.223680921  [2024-05-08 22:51:19] frigate.detectors.plugins.edgetpu_tfl INFO    : TPU found
2024-05-08 22:56:16.881135016  [2024-05-08 22:56:16] frigate.storage                INFO    : Less than 1 hour of recording space left, running storage maintenance...
2024-05-08 22:56:25.348078909  [2024-05-08 22:56:25] frigate.storage                INFO    : Cleaned up 402141.50000001624 MB of recordings

FFprobe output from your camera

ffprobe version 4.3.6-0+deb11u1 Copyright (c) 2007-2023 the FFmpeg developers
  built with gcc 10 (Debian 10.2.1-6)
  configuration: --prefix=/usr --extra-version=0+deb11u1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-avresample --disable-filter=resample --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librsvg --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-pocketsphinx --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared
  libavutil      56. 51.100 / 56. 51.100
  libavcodec     58. 91.100 / 58. 91.100
  libavformat    58. 45.100 / 58. 45.100
  libavdevice    58. 10.100 / 58. 10.100
  libavfilter     7. 85.100 /  7. 85.100
  libavresample   4.  0.  0 /  4.  0.  0
  libswscale      5.  7.100 /  5.  7.100
  libswresample   3.  7.100 /  3.  7.100
  libpostproc    55.  7.100 / 55.  7.100
10.10.10.11: No such file or directory

Frigate stats

cd /

Operating system

Debian

Install method

Docker Compose

Coral version

USB

Network connection

Wired

Camera make and model

EVOS multiple models

Any other information that may be helpful

No response

[NickM-27]

Cleaned up 402141.50000001624 MB of recordings

the logs show that there is not enough space, it is needing to clear out recordings. Would be good to see a screenshot of the storage page

[NickM-27]

it means most likely that camera is having some issues causing the recording segments to be very short or take up a lot of space causing the storage calculation to be higher

[Areckee]

Do you think that if I disconnect this camera from my LAN and remove its entries in Frigate config, everything should be back to normal?

[NickM-27]

No idea, you might want to check the files directly for that camera and see what the size / duration is

[Areckee]

It's 5.3MB each. Other cameras single file size is 6MB

[NickM-27]

right but we need to know what the duration shows as, we are talking about storage / time