1.7.0

Added

• Add a new way of generating the uniqueKey field of the request, aligning it with the Crawlee.

Fixed

• Improve error handling for to_apify_request serialization failures
• Scrapy's Request.dont_filter works.

1.6.0

Fixed

• Update of Scrapy integration, fixes in ApifyScheduler, to_apify_request and apply_apify_settings

Removed

• Removed ApifyRetryMiddleware and stay with the Scrapy's default one

1.5.5

Fixed

• Fix conversion of headers fields in Apify <--> Scrapy request translation

1.5.4

Fixed

• Fix conversion of userData and headers fields in Apify <--> Scrapy request translation

1.5.3

Added

• Add apply_apify_settings function to Scrapy subpackage

1.5.2

Internal changes

• Create a new subpackage for Scrapy pipelines
• Remove some noqas thanks to the new Ruff release
• Replace relative imports with absolute imports
• Replace asserts with custom checks in Scrapy subpackage

Fixed

• Add missing import check to ApifyHttpProxyMiddleware

1.5.1

Internal changes

• Allowed running integration tests from PRs from forks, after maintainer approval
• Do not close nested_event_loop in the Scheduler.__del__()

1.5.0

Added

• Added ApifyHttpProxyMiddleware

1.4.1

Fixed

• Resolved issue in ApifyRetryMiddleware.process_exception(), where requests were getting stuck in the request queue

Internal changes

• Fixed type hint problems for resource clients

1.4.0

Internal changes

• Migrate from Autopep8 and Flake8 to Ruff