poc: url-checker

[thiskevinwang]

Description

This adds a url-checker workflow to crawl links and images

This logs lines to stdout like:

...
[200] Referrer: https://dev-portal-git-staging-hashicorp.vercel.app/vagrant/docs/vagrantfile/machine_settings -> Result: https://dev-portal-git-staging-hashicorp.vercel.app/vagrant/docs/boxes
[200] Referrer: https://dev-portal-git-staging-hashicorp.vercel.app/vagrant/docs/boxes -> Result: https://dev-portal-git-staging-hashicorp.vercel.app/vagrant/docs/boxes/versioning
[200] Referrer: https://dev-portal-git-staging-hashicorp.vercel.app/vagrant/docs/boxes/versioning -> Result: https://dev-portal-git-staging-hashicorp.vercel.app/vagrant/docs/boxes/base
[200] Referrer: https://dev-portal-git-staging-hashicorp.vercel.app/vagrant/docs/boxes/base -> Result: https://dev-portal-git-staging-hashicorp.vercel.app/vagrant/docs/boxes/format
[200] Referrer: https://dev-portal-git-staging-hashicorp.vercel.app/vagrant/docs/boxes/format -> Result: https://dev-portal-git-staging-hashicorp.vercel.app/vagrant/docs/boxes/info
[404] Referrer: https://dev-portal-git-staging-hashicorp.vercel.app/vagrant/docs/boxes/format -> Result: https://dev-portal-git-staging-hashicorp.vercel.app/vagrant/docs/vagrant-cloud
[404] Referrer: https://dev-portal-git-staging-hashicorp.vercel.app/vagrant/docs/boxes/base -> Result: https://dev-portal-git-staging-hashicorp.vercel.app/vagrant/docs/docker/boxes
[404] Referrer: https://dev-portal-git-staging-hashicorp.vercel.app/vagrant/docs/boxes/base -> Result: https://dev-portal-git-staging-hashicorp.vercel.app/vagrant/docs/hyperv/boxes
[404] Referrer: https://dev-portal-git-staging-hashicorp.vercel.app/vagrant/docs/boxes/base -> Result: https://dev-portal-git-staging-hashicorp.vercel.app/vagrant/docs/vmware/boxes
[404] Referrer: https://dev-portal-git-staging-hashicorp.vercel.app/vagrant/docs/boxes/base -> Result: https://dev-portal-git-staging-hashicorp.vercel.app/vagrant/docs/virtualbox/boxes
[200] Referrer: https://dev-portal-git-staging-hashicorp.vercel.app/vagrant/docs/boxes/base -> Result: https://dev-portal-git-staging-hashicorp.vercel.app/packer/guides/packer-on-cicd/build-image-in-cicd
[200] Referrer: https://dev-portal-git-staging-hashicorp.vercel.app/packer/guides/packer-on-cicd/build-image-in-cicd -> Result: https://dev-portal-git-staging-hashicorp.vercel.app/packer/docs
...

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Updated
dev-portal	✅ Ready (Inspect)	Visit Preview	Oct 7, 2022 at 6:32PM (UTC)

[github-actions]

Some suggested prefixes and emojis that may help to write clear, actionable code review comments:

Praise 🙌	Question 🙋	Thought 💭	Blocker 🚧	Future 📌	Optional 🎨	Nitpick ⛏️

Expand for comment prefix descriptions

Prefix+Emoji	Description
Praise 🙌	Use to highlight something positive. It's nice to try to leave one per review, but don't leave false praise just to leave one of these comments.
Question 🙋	Use to gain clarity from the code author. The conversation could evolve into any one of these other categories. Only the reviewer should resolve these comment threads.
Thought 💭	Use to share context, leave a breadcrumb, or share an idea that came up while reviewing.
Blocker 🚧	Use to request changes that block merging the current PR. Only the reviewer should resolve these comment threads.
Future 📌	Use to request changes that the code author can choose to address in the current PR or a follow-up one.
Optional 🎨	Use to suggest optional changes that you feel strongly about but ultimately defer to the code author to make a decision on. These can be comments that turn into valuable conversation starters for adopting new code styles, guidelines, or team practices.
Nitpick ⛏️	Use to suggest changes based on loose opinions or personal preferences. The difference between this and Optional 🎨  is how strong the code reviewer's opinion is.

[github-actions]

📦 Next.js Bundle Analysis

This analysis was generated by the next.js bundle analysis action 🤖

This PR introduced no changes to the javascript bundle 🙌

[thiskevinwang]

Currently this visits about 1000 unique urls in 25mins, which is way too slow.