Check it out: www.architall.com
Use pyspider as crawler.
Import dump/projectdb into your mongodb. It contains crawler code for most of the popular tech blogs, such as Google/Facebook/Linkedin/Twitter/Uber/AWS/Spotify/Pinterest/Docker/Kubernetes.
Pyspider will post the crawled updates automatically into your blog site backed by [https://ghost.org/].
