ERR_LOAD_PUBLIC_URL happens when <script src="/file-in-public.js"> exists

[sapphi-red]

Describe the bug

If the index.html includes <script src="/file-in-public.js"></script>, Vite outputs the following error.

Error: Failed to load url /config.js (resolved id: /config.js). This file is in /public and will be 
copied as-is during build without going through the plugin transforms, and therefore should not be imported from source code. It can only be referenced via HTML tags.
    at loadAndTransform (file:///C:/Users/green/Downloads/vitejs-vite-pruyw5/node_modules/vite/dist/node/chunks/dep-f997966e.js:40835:21) {
  code: 'ERR_LOAD_PUBLIC_URL'
}

The error is output after accessing the page.

This happens in main branch (8da04227d6f818a8ad9efc0056101968037c2e36) and not with 4.3.0-beta.0.

I guess #12599 is affecting this one. /cc @bluwy

Reproduction

https://stackblitz.com/edit/vitejs-vite-pruyw5?file=main.js&terminal=dev

Steps to reproduce

No response

System Info

System:
    OS: Windows 10 10.0.19044
    CPU: (24) x64 AMD Ryzen 9 5900X 12-Core Processor
    Memory: 11.04 GB / 31.92 GB
  Binaries:
    Node: 18.13.0 - C:\Program Files\nodejs\node.EXE
    Yarn: 1.22.19 - C:\Program Files\nodejs\yarn.CMD
    npm: 8.15.1 - C:\Program Files\nodejs\npm.CMD
  Browsers:
    Edge: Spartan (44.19041.1266.0), Chromium (111.0.1661.54)
    Internet Explorer: 11.0.19041.1566

Used Package Manager

npm

Logs

No response

Validations

• Follow our Code of Conduct
• Read the Contributing Guidelines.
• Read the docs.
• Check that there isn't already an issue that reports the same bug to avoid creating a duplicate.
• Make sure this is a Vite issue and not a framework-specific issue. For example, if it's a Vue SFC related bug, it should likely be reported to vuejs/core instead.
• Check that this is a concrete bug. For Q&A open a GitHub Discussion or join our Discord Chat Server.
• The provided reproduction is a minimal reproducible example of the bug.

[stackblitz]

Start a new pull request in StackBlitz Codeflow.

• vitejs-vite-pruyw5 (Open reproduction)

[patak-dev]

@bluwy let's release beta.1 after we close this issue.