u2json

A Command-line utility to convert URL to JSON containing each parts.

$ u2json 'https://example.com:80/foo/bar'
{"host":"example.com","path":"/foo/bar","port":80,"scheme":"https"}

Usage

Full example

Pretty-print with jq.

$ u2json 'https://usr:pass@example.com:8080/foo/bar?q=v#fr' | jq '.'
{
  "fragment": "fr",
  "host": "example.com",
  "password": "pass",
  "path": "/foo/bar",
  "port": 8080,
  "query": {
    "q": "v"
  },
  "rawQuery": "q=v",
  "scheme": "https",
  "user": "usr"
}

As JSON streaming

u2json supports multiple arguments. This output format is known as JSON streaming.

$ cat url.txt
https://a.example.com/aaa
https://b.example.com/bbb
https://a.example.com/ccc
$ cat url.txt | xargs u2json
{"host":"a.example.com","path":"/aaa","scheme":"https"}
{"host":"b.example.com","path":"/bbb","scheme":"https"}
{"host":"a.example.com","path":"/ccc","scheme":"https"}

It works well with the other CLI commands.

$ cat url.txt | xargs u2json | jq -r '.host' | sort -u
a.example.com
b.example.com

Multiple values in query parameters

--query-array allows multiple values with a single field(see the difference).

$ u2json 'http://example.com?q=v1&q=v2' | jq '.'
{
  "host": "example.com",
  "query": {
    "q": "v2"
  },
  "rawQuery": "q=v1&q=v2",
  "scheme": "http"
}

$ u2json --query-array 'http://example.com?q=v1&q=v2' | jq '.'
{
  "host": "example.com",
  "query": {
    "q": [
      "v1",
      "v2"
    ]
  },
  "rawQuery": "q=v1&q=v2",
  "scheme": "http"
}

Use ParseRequestURI

u2json uses url.Parse() as default URL parser. It accepts fairly forgiving input. For example, "../aaa" is recognized as a valid URI.

But in some cases, we need more "strict" URL parsing. u2json with --use-ParseRequestURI switches parser to url.ParseRequestURI(), which forbidden some formats like a relative URL.

$ u2json --use-ParseRequestURI '../aaa'
u2json: parse "../aaa": invalid URI for request