Just some notes and thoughts, most of them about programming probably...
Install them in the user directory:
gem install --user-install bundler jekyll
Create a local "vendor" directory for gems:
bundle config set --local path 'vendor/bundle'
bundle install
bundle exec jekyll serve