Uncontrollable memory usage

[rileyai-dev]

Context

I have a NodeJS app which uses puppeteer to scrape an infinite page. While scrolling, I remove the DOM loaded in order to reduce the memory used by puppeteer. When I run the app with puppeteer on my MacOS, it uses 500MB to 800MB but when I run it on zenika/alpine-chrome:89-with-node, it goes up to 2.7GB.

I have the following arguments for the MacOS application:
'--js-flags=--expose-gc', '--single-process', '--no-zygote', '--no-sandbox', '--ignore-certificate-errors'

and the ones for the alpine:
'--js-flags=--expose-gc', '--single-process', '--no-zygote', '--no-sandbox', '--headless', '--disable-gpu', '--ignore-certificate-errors'

For information, the alpine docker runs on Kubernetes which allows me to see in real time the memory used.

Alternatives

Why is it taking so much memory? Is there a way to reduce it? Is there anything I can do to gather enough information to understand what's going on?

[jlandure]

Hi @GrapevineAI 👋

Thanks for the issue 👍

I don't know so much why/how Chrome is using so much memory...
If you had limitations to your pod (to 800MB for example), does it work?

[rileyai-dev]

@jlandure My pod has a memory limit and when it is reached, the pod is evicted. The problem is how can I contain the memory usage of Chrome?

[jlandure]

Hi @GrapevineAI 👋

Sorry for the delay...
Any news about this issue? Did you succeed? 😊

[rileyai-dev]

@jlandure Unfortunately no... I tried with different distros but got the same issue. I'd be happy to give a https://issuehunt.io/ bounty for anyone who can solve this problem!