Speed up analysis

[borkdude]

Two ideas:

• Allow processing of files in parallel (see for the same trick the clj-kondo code)
• Allow predicate hook on file and/or parsed sexpr to decide if it's worth to analyze at all. E.g. (not (str/includes? (pr-str form) "assoc"))

[borkdude]

It turns out with only grasping in parallel we can get a long way. This script demonstrates how that can be done:

https://gist.github.com/borkdude/e6f0b12f9352f3375e5f3277d2aba6c9

In 15 seconds I can grasp my entire .m2 folder (with 3348 jar files in it) in 15 seconds:

$ ~/Dropbox/temp/assoc_pairs.clj
Logged errors to /var/folders/2m/h3cvrr1x4296p315vbk7m32c0000gp/T/assoc_pairs_errors.txt
Total: 25629
 1: ********************************************************************************** (20911, 82%)
 2: ************ (3036, 12%)
 3: ***** (1085, 5%)
 4: ** (327, 2%)
 5: * (126, 1%)
 6: * (64, 1%)
 7: * (33, 1%)
10: * (23, 1%)
 8: * (11, 1%)
 9: * (6, 1%)
14: * (4, 1%)
 0: * (1, 1%)
12: * (1, 1%)
16: * (1, 1%)