Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AllocineParser is starting over with less movies #139

Open
StegSchreck opened this issue Oct 17, 2020 · 1 comment
Open

AllocineParser is starting over with less movies #139

StegSchreck opened this issue Oct 17, 2020 · 1 comment

Comments

@StegSchreck
Copy link
Owner

Describe the bug
Allocine starts to parse a certain number of movies on a certain number of pages. Somewhere in the middle, it is starting over with a single page of movies and just 36 movies.

image

Expected behavior
Allocine parsing the initially found, complete set of available (rated) movies from Allocine

Desktop (please complete the following information):

  • Version: 23e7767
  • Platform OS: Manjaro Linux
  • Firefox version: 81.0 (64-bit)
  • Geckodriver version: 0.26.0
  • Python version: 3.8.5
  • PIP version: 20.2
  • Running in a virtualenv?: yes
  • Running in Docker?: no
  • Executed command: python3 transfer_ratings.py -s allocine

Geckodriver log

console.error: SearchCache: "_readCacheFile: Error reading cache file:" (new Error("", "(unknown module)"))
1602949509356	Marionette	WARN	TLS certificate errors will be ignored for this session
JavaScript warning: https://www.allocine.fr/, line 138: unreachable code after return statement
JavaScript warning: https://www.allocine.fr/film/fichefilm_gen_cfilm=198937.html, line 138: unreachable code after return statement
JavaScript warning: https://www.allocine.fr/film/fichefilm_gen_cfilm=232128.html, line 138: unreachable code after return statement
@StegSchreck StegSchreck added this to Backlog in RatS via automation Oct 17, 2020
@StegSchreck
Copy link
Owner Author

StegSchreck commented Oct 17, 2020

For some reason AllocineParser is restarting the parsing. This might be caused by an AttributeError, which is then handled by https://github.com/StegSchreck/RatS/blob/master/RatS/base/base_ratings_parser.py#L35
In my test runs it was always the same movie where this happens: https://www.allocine.fr/film/fichefilm_gen_cfilm=20010.html

@StegSchreck StegSchreck moved this from Backlog to To do in RatS Oct 18, 2020
@StegSchreck StegSchreck added this to the v0.13 milestone Oct 18, 2020
@StegSchreck StegSchreck moved this from To do to In progress in RatS Oct 18, 2020
@StegSchreck StegSchreck moved this from In progress to To do in RatS Oct 3, 2021
@StegSchreck StegSchreck removed this from the v0.13 milestone Oct 8, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
RatS
  
To do
Development

No branches or pull requests

1 participant