Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Speed up ingestion of CT log data #166

Open
jschanck opened this issue Oct 18, 2021 · 0 comments
Open

Speed up ingestion of CT log data #166

jschanck opened this issue Oct 18, 2021 · 0 comments

Comments

@jschanck
Copy link
Collaborator

CT logs rate-limit our get-entries requests, and this limits how quickly we can "reboot" CRLite when we make a change that requires us to re-ingest CT log data. This issue tracks our progress on speeding up the ingestion of CT log data.

We're currently planning three changes:

  1. Use consistency proofs to verify that entries we downloaded (potentially from a third party) match the entries in a CT log.
  2. Download entries from CT logs in most-recent-first order. The idea here is that we can get entries {0, 1, ..., k} from a third party, so we should spend our get-entries requests on new entries.
  3. Check for log entries in a local disk cache before making a get-entries request.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant