Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Empty results #4

Open
xloem opened this issue Oct 6, 2020 · 5 comments
Open

Empty results #4

xloem opened this issue Oct 6, 2020 · 5 comments

Comments

@xloem
Copy link

xloem commented Oct 6, 2020

Running the script without changes gives me an output.jsonl that looks like this:

{"name": null, "price": null, "short_description": null, "images": null, "rating": null, "number_of_reviews": null, "variants": null, "product_description": null, "sales_rank": null, "link_to_all_reviews": null}
{"name": null, "price": null, "short_description": null, "images": null, "rating": null, "number_of_reviews": null, "variants": null, "product_description": null, "sales_rank": null, "link_to_all_reviews": null}
{"name": null, "price": null, "short_description": null, "images": null, "rating": null, "number_of_reviews": null, "variants": null, "product_description": null, "sales_rank": null, "link_to_all_reviews": null}
@ramirezemerick88
Copy link

Verify your selectors yml, this css selectors for website

@xloem
Copy link
Author

xloem commented Nov 2, 2020

The example doesn't work out of the box?

@ramirezemerick88
Copy link

For search: products:
css: 'div[data-component-type="s-search-result"]'
xpath: null
multiple: true
type: Text
children:
title:
css: 'h2 a.a-link-normal.a-text-normal'
xpath: null
type: Text
url:
css: 'h2 a.a-link-normal.a-text-normal'
xpath: null
type: Link
rating:
css: 'div.a-row.a-size-small span:nth-of-type(1)'
xpath: null
type: Attribute
attribute: aria-label
reviews:
css: 'div.a-row.a-size-small span:nth-of-type(2)'
xpath: null
type: Attribute
attribute: aria-label
price:
css: 'span.a-price:nth-of-type(1) span.a-offscreen'
xpath: null
type: Text
image:
css: 'img.s-image'
xpath: null
type: Image

@xloem
Copy link
Author

xloem commented Nov 4, 2020

I'm sorry, I tried this project briefly some time ago and ended up finding other solutions to my purchasing situation.
Is this project intended to be a working open source amazon scraping tool?

@MojoMoe
Copy link

MojoMoe commented Jul 23, 2022

I am also getting similar results as xloem above:

{"name": "Automate the Boring Stuff with Python, 2nd Edition: Practical Programming for Total Beginners", "price": null, "short_description": null, "images": null, "rating": null, "number_of_reviews": null, "variants": null, "product_description": null, "sales_rank": null, "link_to_all_reviews": "/Automate-Boring-Stuff-Python-2nd-ebook/product-reviews/B07VSXS4NK?reviewerType=all_reviews"}
{"name": null, "price": null, "short_description": null, "images": null, "rating": null, "number_of_reviews": null, "variants": null, "product_description": null, "sales_rank": null, "link_to_all_reviews": null}
{"name": null, "price": null, "short_description": null, "images": null, "rating": null, "number_of_reviews": null, "variants": null, "product_description": null, "sales_rank": null, "link_to_all_reviews": null}

Is there a way to fix this?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants