An accessibility-driven project to piggyback on the captions protocol for time specific events such as gaming rumble and musical rhythms. This method is patent-protected and called Beatcaps
A software platform that generating rhythms from music and videos. It is a project to allow video streaming platforms to easily add Beatcaps support
- Marketing site
- Elevator Pitch
- Deck Video
- Slide Deck
- Sample demo: source
- Beatcaps library: a library that analyzes music and video files for rhythms using Fourier and outputs the times of the rhythms in JSON
- Beatcaps server: a Docker server that runs the beatcaps library in a secure way and works best with Amazon Web Services
- Node-webvtt: a convertor from JSON to VTT captions format (major contributors)
- Dashboard: source
- Dolby Digital Audio integration
- Node-srt: a convertor from JSON to SRT captions format (WIP)
- Advanced embedded video player with Beatcaps pre-built
- Beatcaps file hosting
- Hapticast to Beatcaps file ingestion, i.e. saving Beatcaps in a file from a live Hapticast
- Midi to Beatcaps convertor
A system for allowing end users to stream Beatcaps, especially for gaming
- Haptic router: a driver that taps into computer games and channels it into OBS Studio, an open source program for video streaming to social media platforms like Twitch
- Slide Deck
- Deck Video
- Demo video
- Browser Extension
- Mobile Twitch demo page
- Haptics DJ player to stream haptics from multiple Beatcaps files such as for DJing
- Plugin for digital music production software
- Custom haptic device integration using Web Gamepad API
- Haptic intensity streaming
- Color Randomizer: an open source Javascript library to easily change the color of HTML elements on event. This could be an output effect of a rhythmic event
- Piez: an open source Javascript library to toggle the mobile browser haptic engine on event
- Closed Captions Listener: an open source Javascript library to listen for caption events on video players and triggers callback events
- Video shake: an open source Javascript library that creates a visual shaking effect on video players on receiving events
- Overleia: an open source Javascript library for generating picture-in-picture videos using ffmpeg
- PIP YouTube Viewer: an open source viewer for watching YouTube videos with sign language interpreters (see source)
- PIP Project: a curated resource on how to create picture-in-picture videos for sign language interpreters
- Transcript CC: an open source Javascript library to turn a transcript into a time-estimated captions file
- Watson JSON: an open source script to turn IBM Watson caption output into caption JSON to be used with other libraries like node-webvtt