Skip to content

Node script that will use Selenium to scrape card information from NBA Topshot including card names, rarity, and lowest cost at the moment. Data is scraped once per day.

License

Notifications You must be signed in to change notification settings

kennymkchan/nba-topshot-scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

26 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Contributors Forks Stargazers Issues MIT License LinkedIn

NBA Topshot Data Scraper

Node script that will use Selenium to scrape card information from NBA Topshot including card names, rarity, and lowest cost at the moment.
Explore the docs »

View Demo · Report Bug · Request Feature

Table of Contents

  1. About The Project
  2. Getting Started
  3. Contributing
  4. License
  5. Contact

About The Project

Node script that will use Selenium to scrape card information from NBA Topshot including card names, rarity, and lowest cost at the moment. This project is a fun way to keep track of the value of NBA moments from NBA Topshot. It relies on the marketplace being available, and the script basically scans all the items that is on the marketplace using selenium to do an infinite scroll + capturing all the data once infinite scroll is completed. At the moment, the script should not take more than 1 hour to run. Optimizations are always welcome.

Data is scraped once per day and updated onto this repo. This data can be found in the data folder and follows the naming convention: topshot_data_${date in mmddyyyy format}.

Built With

Getting Started

To get a local copy up and running follow these simple steps.

Prerequisites

This is an example of how to list things you need to use the software and how to install them.

  • npm
    npm install npm@latest -g

Installation

  1. Clone the repo
    git clone https://github.com/kennymkchan/nba-topshot-scraper
  2. Install NPM packages
    npm install
  3. Run the script to start scraping
    node index.js

Contributing

Contributions are what make the open source community such an amazing place to be learn, inspire, and create. Any contributions you make are greatly appreciated.

  1. Fork the Project
  2. Create your Feature Branch (git checkout -b feature/AmazingFeature)
  3. Commit your Changes (git commit -m 'Add some AmazingFeature')
  4. Push to the Branch (git push origin feature/AmazingFeature)
  5. Open a Pull Request

License

Distributed under the MIT License. See LICENSE for more information.

Contact

Kenny Chan - @github

Project Link: https://github.com/kennymkchan/nba-topshot-scraper

About

Node script that will use Selenium to scrape card information from NBA Topshot including card names, rarity, and lowest cost at the moment. Data is scraped once per day.

Topics

Resources

License

Stars

Watchers

Forks