Skip to content

This repository provides a Colab Notebook that shows how to use Spatial Transformer Networks inside CNNs in Keras.

License

Notifications You must be signed in to change notification settings

sayakpaul/Spatial-Transformer-Networks-with-Keras

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

17 Commits
 
 
 
 
 
 

Repository files navigation

Spatial-Transformer-Networks-with-Keras


This repository provides a Colab Notebook that shows how to use Spatial Transformer Networks (STN) inside CNNs build in Keras. I have used utility functions mostly from this repository to demonstrate an end-to-end example. STNs allow a (vision) network to learn the optimal spatial transformations for maximizing its performance. In other words, we can expect when STNs are incorporated inside a network, it would learn how much to rotate or crop (or any affine transformations) the given input images so as to make itself more invariant to these changes.

Here's a demonstration:

Demo.mov

Notice how the STN module is able to figure out transformations for the dataset that may be helpful to boost the end performance. Here are the original images for reference:

About

This repository provides a Colab Notebook that shows how to use Spatial Transformer Networks inside CNNs in Keras.

Topics

Resources

License

Stars

Watchers

Forks

Packages

No packages published