Skip to content
View sebastian-nagel's full-sized avatar
Block or Report

Block or report sebastian-nagel

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Please don't include any personal information such as legal names or email addresses. Maximum 100 characters, markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse

Pinned

  1. apache/nutch apache/nutch Public

    Apache Nutch is an extensible and scalable web crawler

    Java 2.8k 1.3k

  2. crawler-commons/crawler-commons crawler-commons/crawler-commons Public

    A set of reusable Java components that implement functionality common to any web crawler

    Java 229 73

  3. commoncrawl/cc-pyspark commoncrawl/cc-pyspark Public

    Process Common Crawl data with Python and Spark

    Python 390 84

  4. commoncrawl/news-crawl commoncrawl/news-crawl Public

    News crawling with StormCrawler - stores content as WARC

    Java 303 33

  5. commoncrawl/cc-index-table commoncrawl/cc-index-table Public

    Index Common Crawl archives in tabular format

    Java 98 9

  6. commoncrawl/language-detection-cld2 commoncrawl/language-detection-cld2 Public

    Natural language detection, Java bindings for CLD2

    Java 14 2