Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

READ FIRST: status update #33

Open
ChALkeR opened this issue Jun 11, 2019 · 1 comment
Open

READ FIRST: status update #33

ChALkeR opened this issue Jun 11, 2019 · 1 comment

Comments

@ChALkeR
Copy link
Member

ChALkeR commented Jun 11, 2019

Some status updates:

  1. The latest dataset is uploaded to https://gzemnid.nodejs.org/datasets/out.2019-06-04/
  2. npm, Inc removed both byField view from the replicate host and shut down skimdb host completely, so gzemnid fetch is broken atm.
  3. that will be fixed with proper replication (Replace 'fetch' with an npm registry follower. #26), but I observed some inconsistencies there, still investigating.
  4. gzemnid sync now mirrors the whole replicate changes stream to ./pool/replicate, in lz4-packed chunks, and now uses all_docs instead of main_only. That would likely replace broken gzemnid fetch soon. Expected cache size for replicate stream is about 3-5 GiB.
@DanielRuf
Copy link

So gzemnid is not usable for now? Might be good because so far npmjs still provides 0 information like IoCs and so on when they remive a malicious package and you have no information what you have to look for.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants