Revisions of python-Scrapy
Matej Cepl (mcepl)
accepted
request 917688
from
Fusion Future (fusionfuture)
(revision 20)
- Remove h2 < 4.0 dependency version restriction. (boo#1190035) * remove-h2-version-restriction.patch - Add peak method to queues to fix build with queuelib 1.6.2. * add-peak-method-to-queues.patch - Drop support for Python 3.6 as python-uvloop does not support it. - Require testfixtures >= 6.0.0 (tests need LogCapture.check_present). (https://github.com/Simplistix/testfixtures/commit/2953bb4caadc1a462e5332ffb01591ba1fc3284f)
buildservice-autocommit
accepted
request 889037
from
Markéta Machová (mcalabkova)
(revision 19)
baserev update by copy to link target
Markéta Machová (mcalabkova)
accepted
request 889030
from
Benjamin Greiner (bnavigator)
(revision 18)
- Update to 2.5.0: * Official Python 3.9 support * Experimental HTTP/2 support * New get_retry_request() function to retry requests from spider callbacks * New headers_received signal that allows stopping downloads early * New Response.protocol attribute - Release 2.4.1: * Fixed feed exports overwrite support * Fixed the asyncio event loop handling, which could make code hang * Fixed the IPv6-capable DNS resolver CachingHostnameResolver for download handlers that call reactor.resolve * Fixed the output of the genspider command showing placeholders instead of the import part of the generated spider module (issue 4874) - Release 2.4.0: * Python 3.5 support has been dropped. * The file_path method of media pipelines can now access the source item. * This allows you to set a download file path based on item data. * The new item_export_kwargs key of the FEEDS setting allows to define keyword parameters to pass to item exporter classes. * You can now choose whether feed exports overwrite or append to the output file. * For example, when using the crawl or runspider commands, you can use the -O option instead of -o to overwrite the output file. * Zstd-compressed responses are now supported if zstandard is installed. * In settings, where the import path of a class is required, it is now possible to pass a class object instead. - Release 2.3.0: * Feed exports now support Google Cloud Storage as a storage backend * The new FEED_EXPORT_BATCH_ITEM_COUNT setting allows to deliver output items in batches of up to the specified number of items. * It also serves as a workaround for delayed file delivery, which causes Scrapy to only start item delivery after the crawl has finished when using certain storage backends (S3, FTP, and now GCS). * The base implementation of item loaders has been moved into a separate library, itemloaders, allowing usage from outside Scrapy and a separate release schedule - Release 2.2.1: * The startproject command no longer makes unintended changes to the permissions of files in the destination folder, such as removing execution permissions.
buildservice-autocommit
accepted
request 819355
from
Tomáš Chvátal (scarabeus_iv)
(revision 17)
baserev update by copy to link target
Tomáš Chvátal (scarabeus_iv)
accepted
request 818747
from
Jacob W (winski)
(revision 16)
Update Scrapy to 2.2.0. NOTICE: Scrapy now requires a new package, made by the Scrapy team, called itemadapter. I have already packaged itemadapter & have submitted the package for approval. See Request 818656. Please accept python-itemadapter prior to accepting this request (otherwise build will fail). Thank you! Changelog: * Python 3.5.2+ is required now * dataclass objects and attrs objects are now valid item types * New TextResponse.json method * New bytes_received signal that allows canceling response download * CookiesMiddleware fixes - Update to 2.1.0: * New FEEDS setting to export to multiple feeds * New Response.ip_address attribute - Remove zope-exception-test_crawler.patch - Add new required dependency python-itemadapter - Omit test that fails in OBS due to https / tls issues
buildservice-autocommit
accepted
request 807286
from
Tomáš Chvátal (scarabeus_iv)
(revision 15)
baserev update by copy to link target
Tomáš Chvátal (scarabeus_iv)
accepted
request 807242
from
Petr Gajdos (pgajdos)
(revision 14)
submit
buildservice-autocommit
accepted
request 790737
from
Steve Kowalik (StevenK)
(revision 13)
baserev update by copy to link target
Steve Kowalik (StevenK)
committed
(revision 12)
- Update to 2.0.1: * Python 2 support has been removed * Partial coroutine syntax support and experimental asyncio support * New Response.follow_all method * FTP support for media pipelines * New Response.certificate attribute * IPv6 support through DNS_RESOLVER * Response.follow_all now supports an empty URL iterable as input * Removed top-level reactor imports to prevent errors about the wrong Twisted reactor being installed when setting a different Twisted reactor using TWISTED_REACTOR - Add zope-exception-test_crawler.patch, rewriting one testcase to pass with our version of Zope. - Update BuildRequires based on test requirements.
buildservice-autocommit
accepted
request 765023
from
Tomáš Chvátal (scarabeus_iv)
(revision 11)
baserev update by copy to link target
Tomáš Chvátal (scarabeus_iv)
accepted
request 765007
from
Markéta Machová (mcalabkova)
(revision 10)
- update to 1.8.0 * Dropped Python 3.4 support and updated minimum requirements; made Python 3.8 support official * lots of new fixes and features
buildservice-autocommit
accepted
request 725773
from
Tomáš Chvátal (scarabeus_iv)
(revision 9)
baserev update by copy to link target
Tomáš Chvátal (scarabeus_iv)
accepted
request 725578
from
Paolo Stivanin (polslinux)
(revision 8)
- Update to 1.7.3 * Enforce lxml 4.3.5 or lower for Python 3.4 (issue 3912, issue 3918). * Fix Python 2 support (issue 3889, issue 3893, issue 3896).
buildservice-autocommit
accepted
request 718179
from
Tomáš Chvátal (scarabeus_iv)
(revision 7)
baserev update by copy to link target
Tomáš Chvátal (scarabeus_iv)
committed
(revision 6)
- Format with spec-cleaner - Use just python3 version of Sphinx
Tomáš Chvátal (scarabeus_iv)
accepted
request 718147
from
Petr Gajdos (pgajdos)
(revision 5)
- version update to 1.7.1 * Improvements for crawls targeting multiple domains * A cleaner way to pass arguments to callbacks * A new class for JSON requests * Improvements for rule-based spiders * New features for feed exports see news.rst for details
buildservice-autocommit
accepted
request 703535
from
Tomáš Chvátal (scarabeus_iv)
(revision 4)
baserev update by copy to link target
Tomáš Chvátal (scarabeus_iv)
accepted
request 703534
from
Ritesh Anand (anandrit)
(revision 3)
- Skip flaky CrawlerTestCase
Stephan Kulow (coolo)
accepted
request 677379
from
Tomáš Chvátal (scarabeus_iv)
(revision 2)
initialized devel package after accepting 677379
Tomáš Chvátal (scarabeus_iv)
accepted
request 677210
from
Hans-Peter Jansen (frispete)
(revision 1)
Now with requested mods...
Displaying revisions 21 - 40 of 40