RESTful API and AI processing service that uses machine learning to analyse, process and gerate predictions for SpottedBot queries.
The following endpoints are mostly deprecated. If you want to use this API, set up a SpottedBot and then contact me
Once you have your account, POST:
POST https://spottedapi.herokuapp.com/get-token/
Form: username=<your-username>
password=<your-password>don't forget to use https
Access: https://spottedapi.herokuapp.com/spam-list/ or https://spottedapi.herokuapp.com/not-spam-list/
You can also perform HTTP calls:
GET https://spottedapi.herokuapp.com/spam-list/or
GET https://spottedapi.herokuapp.com/not-spam-list/Example:
curl -X GET https://spottedapi.herokuapp.com/spam-list/'
You can perform 1000 of those calls per day.
The response contains 4 objects, count which is the number of elements found, results, which contains the elements found, next, which is the next page and previous, the previous page
In results you have 2 sub objects, message which, surprisingly, is the Spotted itself and info, containing id, the Spotted ID, source, the Spotted source, likes, the number of likes and time, the time posted
The pages default to 100 items per page.
response
'
next (str)
'
previous (str)
'
count (int)
'
results
'
message (str)
'
info
'
id (int)
'
source (str)
'
likes (int)
'
time (str)
Once you have your token, do:
POST https://spottedapi.herokuapp.com/predict/
Header: Authorization
Value: Token <your-token>
Form: message=<Spotted-message-as-string>Example:
curl -X POST https://spottedapi.herokuapp.com/predict/ -F 'message=<spotted-message>' -H 'Authorization: Token <your-token>'
You can perform 100 of those calls per day.
The response contains 1 object, isSpam, a Boolean.
response
'
isSpam (bool)
Keep in mind that every message you submit for prediction is saved alongside your username. We do this so that your messages can be later added to our dataset for better predictions.
Only Admins have rights to submit entire datasets.
To do this,
POST https://spottedapi.herokuapp.com/submit-data/
Header: Authorization
Value: Token <your-admin-token>
Form: list=[ {"message": <spotted-as-str>, "spam": <isSpamBool>, "source": <source-as-str>, "time": <time-as-str>, "likes": <likes-as-int> },]You can submit as many Spotteds as necessary, but try to do it 1000 at a time, maximum. You may encounter server timeouts otherwise. Please take extra care when submitting, so that the labels are correct.
Example:
curl -X POST https://spottedapi.herokuapp.com/submit-data/ -F 'list=[{"message":<Spotted>, "spam": <bool>, "source": <source>, "time": <time>, "likes": <likes>}]' -H 'Authorization: Token <your-admin-token>'
The dataset should be a list of dicts containg 3 keys, message, spam and source.
message must be a string properly cleaned as described below.
spam must be a lowercase bool.
source must be a string containing the source name.
likes the number of likes
time the time the spotted was posted, following this format: 2015-06-29t23:41:00+0000
message must not contain punctuation, numbers, non alpha, extra spaces, tabs nor newlines.
Just letters and their accents, lowercase.
Please also remove stopwords like
['a', 'as', 'o', 'os', 'e', 'é', 'na', 'nas', 'no', 'nos', 'né', 'de', 'da', 'do', 'em', 'um', 'uma', 'uns', 'umas']
You may use the following code to clean your messages:
import re
stopwords = ['a', 'as', 'o', 'os', 'e', 'é', 'na', 'nas', 'no', 'nos', 'né', 'de', 'da', 'do', 'em', 'um', 'uma', 'uns', 'umas']
def remove_pon(str):
return re.sub(r'\W+', ' ', str)
def remove_stop(str):
return ' '.join(filter(lambda x: x.lower() not in stopwords, str.split()))
def remove_num(str):
return re.sub(r'\d+', ' ', str)
def remove_spaces(str):
return " ".join(str.split())
def clean(str):
return remove_spaces(remove_stop(remove_num(remove_pon(str)))).lower()
cleaned = clean("Foo! Bar?")