API times out on upgrading from 0.0.9 #109

pmcgaley · 2022-07-20T22:21:22Z

I've been using 0.0.9 for ages with no issues, but today hit the issue of Extreme no longer working in the API, so I updated to the latest 0.2.0.

Now trying to download times out every time. Fetching the library seems to be fine. Adding -t 0 (or anything else) seems to make no difference.

I reverted to 0.0.9 and manually patched it for the Extreme issue and it worked fine. Then experimentally upgraded to 0.1.0 and the timeout came back, so looks like my issue started with that version. Is there anything I need to do to upgrade?

pmcgaley@Pauls-Mac-mini audible % audible download -a B00551W570 --aaxc
No new files downloaded.
Uncaught Exception
Traceback (most recent call last):
  File "/opt/homebrew/lib/python3.9/site-packages/httpx/_transports/default.py", line 62, in map_httpcore_exceptions
    yield
  File "/opt/homebrew/lib/python3.9/site-packages/httpx/_transports/default.py", line 276, in handle_async_request
    ) = await self._pool.handle_async_request(
  File "/opt/homebrew/lib/python3.9/site-packages/httpcore/_async/connection_pool.py", line 234, in handle_async_request
    response = await connection.handle_async_request(
  File "/opt/homebrew/lib/python3.9/site-packages/httpcore/_async/connection.py", line 148, in handle_async_request
    return await self.connection.handle_async_request(
  File "/opt/homebrew/lib/python3.9/site-packages/httpcore/_async/http11.py", line 128, in handle_async_request
    ) = await self._receive_response(timeout)
  File "/opt/homebrew/lib/python3.9/site-packages/httpcore/_async/http11.py", line 189, in _receive_response
    event = await self._receive_event(timeout)
  File "/opt/homebrew/lib/python3.9/site-packages/httpcore/_async/http11.py", line 225, in _receive_event
    data = await self.socket.read(self.READ_NUM_BYTES, timeout)
  File "/opt/homebrew/lib/python3.9/site-packages/httpcore/_backends/anyio.py", line 63, in read
    raise ReadTimeout from None
httpcore.ReadTimeout

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/opt/homebrew/lib/python3.9/site-packages/audible/client.py", line 254, in _request
    resp = await self.session.request(method, url, **kwargs)
  File "/opt/homebrew/lib/python3.9/site-packages/httpx/_client.py", line 1483, in request
    response = await self.send(
  File "/opt/homebrew/lib/python3.9/site-packages/httpx/_client.py", line 1571, in send
    response = await self._send_handling_auth(
  File "/opt/homebrew/lib/python3.9/site-packages/httpx/_client.py", line 1599, in _send_handling_auth
    response = await self._send_handling_redirects(
  File "/opt/homebrew/lib/python3.9/site-packages/httpx/_client.py", line 1636, in _send_handling_redirects
    response = await self._send_single_request(request)
  File "/opt/homebrew/lib/python3.9/site-packages/httpx/_client.py", line 1673, in _send_single_request
    response = await transport.handle_async_request(request)
  File "/opt/homebrew/lib/python3.9/site-packages/httpx/_transports/default.py", line 271, in handle_async_request
    (
  File "/opt/homebrew/Cellar/python@3.9/3.9.13_1/Frameworks/Python.framework/Versions/3.9/lib/python3.9/contextlib.py", line 137, in __exit__
    self.gen.throw(typ, value, traceback)
  File "/opt/homebrew/lib/python3.9/site-packages/httpx/_transports/default.py", line 79, in map_httpcore_exceptions
    raise mapped_exc(message) from exc
httpx.ReadTimeout

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/opt/homebrew/lib/python3.9/site-packages/audible_cli/cli.py", line 69, in main
    sys.exit(cli(*args, **kwargs))
  File "/opt/homebrew/lib/python3.9/site-packages/click/core.py", line 1128, in __call__
    return self.main(*args, **kwargs)
  File "/opt/homebrew/lib/python3.9/site-packages/click/core.py", line 1053, in main
    rv = self.invoke(ctx)
  File "/opt/homebrew/lib/python3.9/site-packages/click/core.py", line 1659, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/opt/homebrew/lib/python3.9/site-packages/click/core.py", line 1395, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/opt/homebrew/lib/python3.9/site-packages/click/core.py", line 754, in invoke
    return __callback(*args, **kwargs)
  File "/opt/homebrew/lib/python3.9/site-packages/click/decorators.py", line 84, in new_func
    return ctx.invoke(f, obj, *args, **kwargs)
  File "/opt/homebrew/lib/python3.9/site-packages/click/core.py", line 754, in invoke
    return __callback(*args, **kwargs)
  File "/opt/homebrew/lib/python3.9/site-packages/audible_cli/cmds/cmd_download.py", line 701, in cli
    loop.run_until_complete(main(config, auth, **params))
  File "/opt/homebrew/Cellar/python@3.9/3.9.13_1/Frameworks/Python.framework/Versions/3.9/lib/python3.9/asyncio/base_events.py", line 647, in run_until_complete
    return future.result()
  File "/opt/homebrew/lib/python3.9/site-packages/audible_cli/cmds/cmd_download.py", line 470, in main
    library = await Library.from_api_full_sync(
  File "/opt/homebrew/lib/python3.9/site-packages/audible_cli/models.py", line 351, in from_api_full_sync
    resp = await cls.from_api(api_client, params=request_params)
  File "/opt/homebrew/lib/python3.9/site-packages/audible_cli/models.py", line 336, in from_api
    resp = await api_client.get("library", **request_params)
  File "/opt/homebrew/lib/python3.9/site-packages/audible/client.py", line 273, in _request
    raise NotResponding
audible.exceptions.NotResponding: API request timed out, please be patient.

pmcgaley@Pauls-Mac-mini audible % python3 -m pip list
Package            Version
------------------ ---------
aiofiles           0.8.0
anyio              3.4.0
audible            0.7.2
audible-cli        0.1.0
beautifulsoup4     4.10.0
certifi            2021.10.8
charset-normalizer 2.0.7
click              8.0.3
colorama           0.4.4
h11                0.12.0
httpcore           0.13.7
httpx              0.20.0
idna               3.3
packaging          21.3
pbkdf2             1.3
Pillow             9.0.0
pip                22.1.1
prompt-toolkit     3.0.30
pyaes              1.6.1
pyasn1             0.4.8
PyCocoa            21.8.18
pylivestream       1.11.4
pyparsing          3.0.9
python-vlc         3.0.12118
questionary        1.10.0
requests           2.26.0
requests-toolbelt  0.9.1
rfc3986            1.5.0
rsa                4.8
setuptools         62.3.2
simple-http-server 0.14.10
sniffio            1.2.0
soupsieve          2.3.1
tabulate           0.8.9
termcolor          1.1.0
toml               0.10.2
tqdm               4.62.3
urllib3            1.26.7
wcwidth            0.2.5
wheel              0.37.1

The text was updated successfully, but these errors were encountered:

pmcgaley · 2022-07-20T22:35:03Z

and back to 0.2.0...

Package            Version
------------------ ---------
aiofiles           0.8.0
anyio              3.4.0
audible            0.8.2
audible-cli        0.2.0
beautifulsoup4     4.10.0
certifi            2021.10.8
charset-normalizer 2.0.7
click              8.0.3
colorama           0.4.4
h11                0.12.0
httpcore           0.13.7
httpx              0.20.0
idna               3.3
packaging          21.3
pbkdf2             1.3
Pillow             9.0.0
pip                22.1.1
prompt-toolkit     3.0.30
pyaes              1.6.1
pyasn1             0.4.8
PyCocoa            21.8.18
pylivestream       1.11.4
pyparsing          3.0.9
python-vlc         3.0.12118
questionary        1.10.0
requests           2.26.0
requests-toolbelt  0.9.1
rfc3986            1.5.0
rsa                4.8
setuptools         62.3.2
simple-http-server 0.14.10
sniffio            1.2.0
soupsieve          2.3.1
tabulate           0.8.9
termcolor          1.1.0
toml               0.10.2
tqdm               4.62.3
urllib3            1.26.7
wcwidth            0.2.5
wheel              0.37.1
pmcgaley@Pauls-Mac-mini audible % audible download -t 0 -a B00551W570 --aaxc
Uncaught Exception
Traceback (most recent call last):
  File "/opt/homebrew/lib/python3.9/site-packages/httpx/_transports/default.py", line 62, in map_httpcore_exceptions
    yield
  File "/opt/homebrew/lib/python3.9/site-packages/httpx/_transports/default.py", line 276, in handle_async_request
    ) = await self._pool.handle_async_request(
  File "/opt/homebrew/lib/python3.9/site-packages/httpcore/_async/connection_pool.py", line 234, in handle_async_request
    response = await connection.handle_async_request(
  File "/opt/homebrew/lib/python3.9/site-packages/httpcore/_async/connection.py", line 148, in handle_async_request
    return await self.connection.handle_async_request(
  File "/opt/homebrew/lib/python3.9/site-packages/httpcore/_async/http11.py", line 128, in handle_async_request
    ) = await self._receive_response(timeout)
  File "/opt/homebrew/lib/python3.9/site-packages/httpcore/_async/http11.py", line 189, in _receive_response
    event = await self._receive_event(timeout)
  File "/opt/homebrew/lib/python3.9/site-packages/httpcore/_async/http11.py", line 225, in _receive_event
    data = await self.socket.read(self.READ_NUM_BYTES, timeout)
  File "/opt/homebrew/lib/python3.9/site-packages/httpcore/_backends/anyio.py", line 63, in read
    raise ReadTimeout from None
httpcore.ReadTimeout

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/opt/homebrew/lib/python3.9/site-packages/audible/client.py", line 337, in _request
    resp = await self.session.request(method, url, **kwargs)
  File "/opt/homebrew/lib/python3.9/site-packages/httpx/_client.py", line 1483, in request
    response = await self.send(
  File "/opt/homebrew/lib/python3.9/site-packages/httpx/_client.py", line 1571, in send
    response = await self._send_handling_auth(
  File "/opt/homebrew/lib/python3.9/site-packages/httpx/_client.py", line 1599, in _send_handling_auth
    response = await self._send_handling_redirects(
  File "/opt/homebrew/lib/python3.9/site-packages/httpx/_client.py", line 1636, in _send_handling_redirects
    response = await self._send_single_request(request)
  File "/opt/homebrew/lib/python3.9/site-packages/httpx/_client.py", line 1673, in _send_single_request
    response = await transport.handle_async_request(request)
  File "/opt/homebrew/lib/python3.9/site-packages/httpx/_transports/default.py", line 271, in handle_async_request
    (
  File "/opt/homebrew/Cellar/python@3.9/3.9.13_1/Frameworks/Python.framework/Versions/3.9/lib/python3.9/contextlib.py", line 137, in __exit__
    self.gen.throw(typ, value, traceback)
  File "/opt/homebrew/lib/python3.9/site-packages/httpx/_transports/default.py", line 79, in map_httpcore_exceptions
    raise mapped_exc(message) from exc
httpx.ReadTimeout

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/opt/homebrew/lib/python3.9/site-packages/audible_cli/cli.py", line 60, in main
    sys.exit(cli(*args, **kwargs))
  File "/opt/homebrew/lib/python3.9/site-packages/click/core.py", line 1128, in __call__
    return self.main(*args, **kwargs)
  File "/opt/homebrew/lib/python3.9/site-packages/click/core.py", line 1053, in main
    rv = self.invoke(ctx)
  File "/opt/homebrew/lib/python3.9/site-packages/click/core.py", line 1659, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/opt/homebrew/lib/python3.9/site-packages/click/core.py", line 1395, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/opt/homebrew/lib/python3.9/site-packages/click/core.py", line 754, in invoke
    return __callback(*args, **kwargs)
  File "/opt/homebrew/lib/python3.9/site-packages/click/decorators.py", line 84, in new_func
    return ctx.invoke(f, obj, *args, **kwargs)
  File "/opt/homebrew/lib/python3.9/site-packages/click/core.py", line 754, in invoke
    return __callback(*args, **kwargs)
  File "/opt/homebrew/lib/python3.9/site-packages/click/decorators.py", line 84, in new_func
    return ctx.invoke(f, obj, *args, **kwargs)
  File "/opt/homebrew/lib/python3.9/site-packages/click/core.py", line 754, in invoke
    return __callback(*args, **kwargs)
  File "/opt/homebrew/lib/python3.9/site-packages/audible_cli/decorators.py", line 24, in wrapper
    return asyncio.run(f(*args, ** kwargs))
  File "/opt/homebrew/Cellar/python@3.9/3.9.13_1/Frameworks/Python.framework/Versions/3.9/lib/python3.9/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/opt/homebrew/Cellar/python@3.9/3.9.13_1/Frameworks/Python.framework/Versions/3.9/lib/python3.9/asyncio/base_events.py", line 647, in run_until_complete
    return future.result()
  File "/opt/homebrew/lib/python3.9/site-packages/audible_cli/decorators.py", line 62, in wrapper
    return await f(*args, client, **kwargs)
  File "/opt/homebrew/lib/python3.9/site-packages/audible_cli/cmds/cmd_download.py", line 621, in cli
    library = await Library.from_api_full_sync(
  File "/opt/homebrew/lib/python3.9/site-packages/audible_cli/models.py", line 437, in from_api_full_sync
    library, total_count = await cls.from_api(
  File "/opt/homebrew/lib/python3.9/site-packages/audible_cli/models.py", line 414, in from_api
    resp: httpx.Response = await api_client.get(
  File "/opt/homebrew/lib/python3.9/site-packages/audible/client.py", line 354, in _request
    raise NotResponding
audible.exceptions.NotResponding: API request timed out, please be patient.

mkb79 · 2022-07-21T04:13:23Z

My first thought is: Please update httpx to v0.23.*! This should solve the issue.

pmcgaley · 2022-07-21T08:19:35Z

Thanks for the suggestion - unfortunately, no change. Updated everything else outdated for good measure, still no change.

File "/opt/homebrew/lib/python3.9/site-packages/audible/client.py", line 354, in _request
    raise NotResponding
audible.exceptions.NotResponding: API request timed out, please be patient.

pmcgaley@Pauls-Mac-mini audible % python3 -m pip list
Package            Version
------------------ -----------
aiofiles           0.8.0
anyio              3.6.1
audible            0.8.2
audible-cli        0.2.0
beautifulsoup4     4.11.1
certifi            2022.6.15
charset-normalizer 2.1.0
click              8.1.3
colorama           0.4.5
h11                0.13.0
httpcore           0.15.0
httpx              0.23.0
idna               3.3
packaging          21.3
pbkdf2             1.3
Pillow             9.2.0
pip                22.1.2
prompt-toolkit     3.0.30
pyaes              1.6.1
pyasn1             0.4.8
PyCocoa            21.11.4
pylivestream       1.11.4
pyparsing          3.0.9
python-vlc         3.0.16120
questionary        1.10.0
requests           2.28.1
requests-toolbelt  0.9.1
rfc3986            2.0.0
rsa                4.9
setuptools         63.2.0
simple-http-server 0.18.3
sniffio            1.2.0
soupsieve          2.3.2.post1
tabulate           0.8.10
termcolor          1.1.0
toml               0.10.2
tqdm               4.64.0
urllib3            1.26.10
wcwidth            0.2.5
wheel              0.37.1

mkb79 · 2022-07-21T08:35:52Z

That's really strange. Do you downloading the files in aax or aaxc format? Can you try to set the timeout to 300 and/or set --jobs 1. Make these a difference?

pmcgaley · 2022-07-24T23:48:02Z

My fault. The clue was in

Adding -t 0 (or anything else) seems to make no difference.

Of course -t is not the timeout. Setting it with --timeout works. Apologies for the wild goose chase.

pmcgaley · 2022-07-24T23:50:24Z

(curious that it times out pretty much all the time though, and didn't before. Is the API taking longer? Is the default timeout shorter/new? I have a pretty solid 500Mbps down, so it's not network speed - might be worth upping the default timeout?)

mkb79 · 2022-07-25T04:19:44Z

Network speed is not everything. It is also due to the server location or latency. You can try to set --bunch-size 200. The default is 1,000.

pmcgaley · 2022-07-25T20:40:00Z

--bunch_size works around the issue too. I had a dig to see what changed (between 0.9 and now) that would account for the slower API call. It seems to be because now far more (all?) response_groups are requested (the default as none are specified in the call from cmd_download to Library.from_api_full_sync), whereas before it was restricted to product_desc, pdf_url, media, product_attrs, relationships.

This change increased that API response time for my library from 2.5 seconds to ~15 seconds. Do we need all of those response_groups when downloading?

mkb79 · 2022-07-26T05:54:39Z

This is a list with all known response groups and which values for which keys they are provide:

Always returned keys:

asin
is_ayce
library_status
purchase_date
sku_lite
status
is_removable_by_parent

#1
Requested response groups: contributors
Responsed response groups: contributors
Keys in the library:

authors
narrators
publisher_name
sku

#2
Requested response groups: customer_rights
Responsed response groups: customer_rights, origin, library_status
Keys in the library:

available_codecs
content_delivery_type
content_type
customer_rights
distribution_rights_region
format_type
has_children
is_adult_product
is_buyable
is_listenable
is_pending
is_preorderable
is_purchasability_suppressed
is_removable
is_returnable
is_visible
is_world_rights
issue_date
language
merchandising_summary
origin_id
origin_marketplace
origin_type
plans
preorder_release_date
program_participation
publication_name
release_date
runtime_length_min
sku
thesaurus_subject_keywords
voice_description

#3
Requested response groups: media
Responsed response groups: media
Keys in the library:

available_codecs
content_delivery_type
content_type
format_type
has_children
is_adult_product
is_listenable
is_purchasability_suppressed
issue_date
language
merchandising_summary
product_images
program_participation
publication_name
release_date
runtime_length_min
sku
social_media_images
subtitle
thesaurus_subject_keywords
title
voice_description

#4
Requested response groups: price
Responsed response groups: price
Keys in the library:

price

#5
Requested response groups: product_attrs
Responsed response groups: product_attrs
Keys in the library:

available_codecs
content_delivery_type
content_type
format_type
has_children
is_adult_product
is_listenable
is_purchasability_suppressed
issue_date
language
merchandising_summary
program_participation
publication_name
release_date
runtime_length_min
sku
thesaurus_subject_keywords
voice_description

#6
Requested response groups: product_desc
Responsed response groups: product_desc
Keys in the library:

sku
subtitle
title

#7
Requested response groups: product_extended_attrs
Responsed response groups: product_extended_attrs
Keys in the library:

audible_editors_summary
editorial_reviews
publisher_summary
sku

#8
Requested response groups: product_plan_details
Responsed response groups: product_plan_details
Keys in the library:

#9
Requested response groups: product_plans
Responsed response groups: product_plans
Keys in the library:

plans
sku

#10
Requested response groups: rating
Responsed response groups: rating
Keys in the library:

rating

#11
Requested response groups: sample
Responsed response groups: sample
Keys in the library:

sample_url
sku

#12
Requested response groups: sku
Responsed response groups: sku
Keys in the library:

sku

#13
Requested response groups: series
Responsed response groups: series
Keys in the library:

series
sku

#14
Requested response groups: reviews
Responsed response groups: reviews
Keys in the library:

customer_reviews

#15
Requested response groups: ws4v
Responsed response groups: ws4v
Keys in the library:

is_ws4v_companion_asin_owned
is_ws4v_enabled
ws4v_companion_asin

#16
Requested response groups: origin
Responsed response groups: origin
Keys in the library:

is_pending
origin_id
origin_marketplace
origin_type

#17
Requested response groups: relationships
Responsed response groups: relationships
Keys in the library:

relationships
sku

#18
Requested response groups: review_attrs
Responsed response groups:
Keys in the library:

#19
Requested response groups: categories
Responsed response groups: categories
Keys in the library:

#20
Requested response groups: badge_types
Responsed response groups: origin, badge_types
Keys in the library:

is_pending
origin_id
origin_marketplace
origin_type

#21
Requested response groups: category_ladders
Responsed response groups: category_ladders
Keys in the library:

category_ladders

#22
Requested response groups: claim_code_url
Responsed response groups: claim_code_url
Keys in the library:

sku

#23
Requested response groups: in_wishlist
Responsed response groups: in_wishlist
Keys in the library:

is_in_wishlist

#24
Requested response groups: is_archived
Responsed response groups: is_archived
Keys in the library:

is_archived
is_pending

#25
Requested response groups: is_downloaded
Responsed response groups: is_downloaded
Keys in the library:

is_downloaded

#26
Requested response groups: is_finished
Responsed response groups: is_finished
Keys in the library:

is_finished
is_pending

#27
Requested response groups: is_playable
Responsed response groups: customer_product_plans, is_playable, product_plans
Keys in the library:

plans
sku

#28
Requested response groups: is_removable
Responsed response groups: is_removable, origin
Keys in the library:

is_pending
is_removable
is_returnable
origin_id
origin_marketplace
origin_type

#29
Requested response groups: is_returnable
Responsed response groups: origin, is_returnable
Keys in the library:

is_pending
is_removable
is_returnable
origin_id
origin_marketplace
origin_type

#30
Requested response groups: is_visible
Responsed response groups: is_visible
Keys in the library:

is_visible

#31
Requested response groups: listening_status
Responsed response groups: listening_status
Keys in the library:

available_codecs
content_delivery_type
content_type
format_type
has_children
is_adult_product
is_listenable
is_purchasability_suppressed
issue_date
language
listening_status
merchandising_summary
plans
program_participation
publication_name
release_date
runtime_length_min
sku
thesaurus_subject_keywords
voice_description

#32
Requested response groups: order_details
Responsed response groups: order_details
Keys in the library:

is_pending
order_id
order_item_id

#33
Requested response groups: origin_asin
Responsed response groups: origin_asin, product_attrs
Keys in the library:

available_codecs
content_delivery_type
content_type
format_type
has_children
is_adult_product
is_listenable
is_pending
is_purchasability_suppressed
issue_date
language
merchandising_summary
origin_asin
origin_id
origin_marketplace
origin_type
program_participation
publication_name
release_date
runtime_length_min
sku
thesaurus_subject_keywords
voice_description

#34
Requested response groups: pdf_url
Responsed response groups: pdf_url
Keys in the library:

pdf_url

#35
Requested response groups: percent_complete
Responsed response groups: origin_asin, product_attrs, percent_complete
Keys in the library:

available_codecs
content_delivery_type
content_type
format_type
has_children
is_adult_product
is_listenable
is_pending
is_purchasability_suppressed
issue_date
language
merchandising_summary
origin_asin
origin_id
origin_marketplace
origin_type
percent_complete
program_participation
publication_name
release_date
runtime_length_min
sku
thesaurus_subject_keywords
voice_description

#36
Requested response groups: periodicals
Responsed response groups: periodicals
Keys in the library:

periodical_info
sku

#37
Requested response groups: provided_review
Responsed response groups:
Keys in the library:

#38
Requested response groups: product_details
Responsed response groups: product_details
Keys in the library:

copyright
date_first_available
extended_product_description
is_pdf_url_available
isbn
merchandising_description
platinum_keywords
product_site_launch_date
read_along_support
sku

mkb79 · 2022-07-26T05:55:29Z

So we/I can check, which response groups are really needed.

mkb79 · 2022-07-26T17:33:34Z

@pmcgaley
The timeout issue seams to be httpx related. I switched for testing purposes to aiohttp and I don’t get any timeout issues.
Maybe I rewrite Audible to use aiohttp instead of httpx. Or I make a new package.

pmcgaley · 2022-07-26T21:40:04Z

I commented on 8adeb17 - I think there's another issue that's stopping it from having any effect. Once I fix that locally, the call comes back a lot quicker and I don't get timeouts any more.

Not familiar enough with httpx vs aiohttp but sounds like it might be something to try, although just increasing the default timeout would probably work too - if the changes to response_groups aren't enough in themselves.

mkb79 · 2022-07-27T03:23:11Z

I commented on 8adeb17

Fixed this. Good catch

Not familiar enough with httpx vs aiohttp but sounds like it might be something to try, although just increasing the default timeout would probably work too

I've wrote a response group test script with nested asyncio.gather. Using httpx it gives me a NetworkDown or Timeout exception, no matter timeout is set to None on my iOS device and Linux server. Using aiohttp all is running fine. The problem seams to be the nested gather functions. The inner gather functions don’t complete in time because all connection slots are working for the outer gather functions. And audible-cli make use of nested gather functions already.

In fact, the script tested all 38 known response groups for the library endpoint and check which keys they are provide.
For each response group my full library are fetched (~130 items), in addition each item is requested two more times using the library/{asin} endpoint and using the parent_asin param. Total there are 38 * (130 * 2 + 1) = 783 requests.

pmcgaley closed this as completed Jul 24, 2022

pmcgaley reopened this Jul 25, 2022

mkb79 added a commit that referenced this issue Jul 26, 2022

reduce response_groups for the download command (#109)

8adeb17

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

API times out on upgrading from 0.0.9 #109

API times out on upgrading from 0.0.9 #109

pmcgaley commented Jul 20, 2022 •

edited

pmcgaley commented Jul 20, 2022 •

edited

mkb79 commented Jul 21, 2022

pmcgaley commented Jul 21, 2022

mkb79 commented Jul 21, 2022

pmcgaley commented Jul 24, 2022

pmcgaley commented Jul 24, 2022

mkb79 commented Jul 25, 2022

pmcgaley commented Jul 25, 2022 •

edited

mkb79 commented Jul 26, 2022

mkb79 commented Jul 26, 2022

mkb79 commented Jul 26, 2022

pmcgaley commented Jul 26, 2022 •

edited

mkb79 commented Jul 27, 2022

API times out on upgrading from 0.0.9 #109

API times out on upgrading from 0.0.9 #109

Comments

pmcgaley commented Jul 20, 2022 • edited

pmcgaley commented Jul 20, 2022 • edited

mkb79 commented Jul 21, 2022

pmcgaley commented Jul 21, 2022

mkb79 commented Jul 21, 2022

pmcgaley commented Jul 24, 2022

pmcgaley commented Jul 24, 2022

mkb79 commented Jul 25, 2022

pmcgaley commented Jul 25, 2022 • edited

mkb79 commented Jul 26, 2022

#8 Requested response groups: product_plan_details Responsed response groups: product_plan_details Keys in the library:

#18 Requested response groups: review_attrs Responsed response groups: Keys in the library:

#19 Requested response groups: categories Responsed response groups: categories Keys in the library:

#37 Requested response groups: provided_review Responsed response groups: Keys in the library:

mkb79 commented Jul 26, 2022

mkb79 commented Jul 26, 2022

pmcgaley commented Jul 26, 2022 • edited

mkb79 commented Jul 27, 2022

pmcgaley commented Jul 20, 2022 •

edited

pmcgaley commented Jul 20, 2022 •

edited

pmcgaley commented Jul 25, 2022 •

edited

#8
Requested response groups: product_plan_details
Responsed response groups: product_plan_details
Keys in the library:

#18
Requested response groups: review_attrs
Responsed response groups:
Keys in the library:

#19
Requested response groups: categories
Responsed response groups: categories
Keys in the library:

#37
Requested response groups: provided_review
Responsed response groups:
Keys in the library:

pmcgaley commented Jul 26, 2022 •

edited