File python-taskflow.changes of Package python-taskflow
------------------------------------------------------------------- Thu Mar 21 09:56:46 UTC 2019 - sjamgade@suse.com - added python-pydot networkx needs pydot during taskflow's tests there is an upstream change at https://review.openstack.org/645103 ------------------------------------------------------------------- Sat Sep 1 08:58:43 UTC 2018 - cloud-devel@suse.de - update to version 3.2.0 - add release notes to README.rst - don't let tox_install.sh error if there is nothing to do - set default python to python3 - fix tox python3 overrides - only run doc8 as part of pep8 test job - Update reno for stable/queens - Trivial: update pypi url to new url - Remove unused link target - Fix invalid json unit test - Update links in README - Fix code to support networkx > 1.0 - stop using tox_install.sh - Trivial: Update pypi url to new url - standardize indentation in tox.ini - give pep8 and docs environments all of the dependencies they need - Fix doc build - replace http with https - Drop py34 target in tox.ini - Updated from global requirements - add lower-constraints job - Uncap networkx - drop 0001-Fix-invalid-json-unit-test.patch: upstreamed ------------------------------------------------------------------- Fri Feb 23 13:45:45 UTC 2018 - tbechtold@suse.com - Switch to stable/queens spec template ------------------------------------------------------------------- Fri Feb 9 07:51:33 UTC 2018 - tbechtold@suse.com - Add 0001-Fix-invalid-json-unit-test.patch ------------------------------------------------------------------- Mon Jan 15 12:05:49 UTC 2018 - cloud-devel@suse.de - update to version 3.1.0 - Use doc/requirements.txt - Add doc8 to pep8 environment - Remove setting of version/release from releasenotes - Avoid log warning when closing is underway (on purpose) - Updated from global requirements - Remove class StopWatch from timing ------------------------------------------------------------------- Sun Nov 26 16:04:13 UTC 2017 - cloud-devel@suse.de - update to version 2.17.0 - Update reno for stable/pike - Remove method blather in log adapter - Update "indentify" to "identify" in comments - Updated from global requirements - Remove kwarg timeout in executor conductor ------------------------------------------------------------------- Fri Aug 25 06:41:15 UTC 2017 - tbechtold@suse.com - Requires cleanup ------------------------------------------------------------------- Mon Aug 7 14:25:07 UTC 2017 - cloud-devel@suse.de - update to version 2.14.0 - Fix py35 test failure - Fix process based executor task proxying-back events - do not allow redis job reclaim by same owner - Protect storage better against external concurrent access - switch from oslosphinx to openstackdocstheme - Replace assertRaisesRegexp with assertRaisesRegex - Prepare for using standard python tests - Use https instead of http for git.openstack.org - python3.0 has deprecated LOG.warn - Update reno for stable/ocata - rearrange existing documentation into the new standard layout - Fix html_last_updated_fmt for Python3 - Update URLs in documents according to document migration - Updated from global requirements - turn on warning-is-error in doc build - Stop using oslotest.mockpatch ------------------------------------------------------------------- Fri Feb 10 17:05:08 UTC 2017 - cloud-devel@suse.de - update to version 2.9.0: - Replace retrying with tenacity - Use assertIs(Not)None to check for None - Add Constraints support - Show team and repo badges on README - Update author and author-email - Using assertIsNone() instead of assertIs(None, ..) - Use method ensure_tree from oslo.utils - Some classes not define __ne__() built-in function - Rename engine analyzer to be named selector - Fix typo: remove redundant 'that' - Replaces uuid.uuid4 with uuidutils.generate_uuid() - Make failure formatter configurable for DynamicLoggingListener - Remove vim header from source files - Add reno for release notes management - Add logging around metadata, ignore tallying + history - Fix typo in tox.ini - Fix release notes gate job failure - Fix a typo in documentation - Fix broken link - Changed the home-page link - Remove dep on monotonic - Fix a typo in logging.py - Updated from global requirements ------------------------------------------------------------------- Tue Oct 4 10:09:10 UTC 2016 - tbechtold@suse.com - Adjust Requires ------------------------------------------------------------------- Mon May 23 11:20:23 UTC 2016 - tbechtold@suse.com - update to 1.32.0: * Attempt to cancel active futures when suspending is underway * Allow for specifying green threaded to parallel engine * Make conductor.stop stop the running engine gracefully * Updated from global requirements * Don't set html_last_updated_fmt without git * Updated from global requirements * Add the ability to skip resolving from activating * Fix export_to_dot for networkx package changes * Ensure upgrade for sqlalchemy is protected by a lock * Add periodic jobboard refreshing (incase of sync issues) * Fallback if git is absent * Allow for revert to have a different argument list from execute - adjust Requires ------------------------------------------------------------------- Thu Mar 3 15:46:35 UTC 2016 - tbechtold@suse.com - update to 1.30.0: * Updated from global requirements * Sqlalchemy-utils double entry (already in test-requirements.txt) * Updated from global requirements * Add missing direct dependency for sqlalchemy-utils * Add WBE worker expiry * Some WBE protocol/executor cleanups * Remove need for separate notify thread * Updated from global requirements * Don't bother scanning for workers if no new messages arrived * Updated from global requirements * Updated from global requirements * Updated from global requirements * Updated from global requirements * Fix for WBE sporadic timeout of tasks * Handle cases where exc_args can't be serialized as JSON in the WBE * Enable OS_LOG_CAPTURE so that logs can be seen (on error) * Retrieve the store from flowdetails as well, if it exists * Disable oslotest LOG capturing * Updated from global requirements * Updated from global requirements * Use helper function for post-atom-completion work * Add useful/helpful comment to retry scheduler * Updated from global requirements * Updated from global requirements * Remove stray LOG.blather * Some additional engine logging * Replace deprecated library function os.popen() with subprocess * Add comment as to why we continue when tallying edge decider nay voters * Allow for alterations in decider 'area of influence' * Fix wrong usage of iter_utils.unique_seen * Updated from global requirements * Updated from global requirements * Updated from global requirements * Use the retrying lib. to do basic sqlalchemy engine validation * For taskflow patterns don't show taskflow.patterns prefix * Rename '_emit' -> '_try_emit' since it is best-effort (not ensured) * Cache atom name -> actions and provide accessor function * Quote/standardize atom name output * Use shared util helper for driver name + config extraction * Fix currently broken and inactive mysql tests * Trap and expose exception any 'args' * Revert "Remove failure version number" * Move all internal blather usage/calls to trace usage/calls * Start rename of BLATHER -> TRACE * Add ability of job poster/job iterator to wait for jobs to complete * Updated from global requirements * Use 'match_type' utility function instead of staticmethod * Remove failure version number * Translate kazoo exceptions into job equivalents if register_entity fails * Change name of misc.ensure_dict to misc.safe_copy_dict * Avoid recreating notify details for each dispatch iteration * fix doc change caused by the change of tooz * Deprecated tox -downloadcache option removed * Updated from global requirements * Add some useful commentary on rebinding processes * Use small helper routine to fetch atom metadata entries * Remove 'MANIFEST.in' * Pass through run timeout in engine run() * Change engine 'self._check' into a decorator * Move validation of compiled unit out of compiler * Allow provided flow to be empty * Move engine options extraction to __init__ methods * Updated from global requirements * Updated from global requirements * Convert executor proxied engine options into their correct type * Enable conversion of the tree nodes into a digraph * Use the misc.ensure_dict helper in conductor engine options saving * Add optional 'defer_reverts' behavior * Add public property from storage to flowdetail.meta * Adding notification points for job completion * Remove python 2.6 and cleanup tox.ini * Correctly apply deciders across flow boundaries * Move 'convert_to_timeout' to timing type as a helper function * Use conductor entity class constant instead of raw string * Add a executor backed conductor and have existing impl. use it * Add flow durations to DurationListener * Update docstrings on entity type * Move 'fill_iter' to 'iter_utils.fill' * Updated from global requirements * Updated from global requirements * Register conductor information on jobboard * Add atom priority ability * Add validation of base exception type(s) in failure type * Fix order of assertEqual for unit.test_* * Fix order of assertEqual for unit.worker_based * Fix order of assertEqual for unit.persistence * Fix order of assertEqual for unit.patterns * Fix order of assertEqual for unit.jobs * Fix order of assertEqual for unit.action_engine * Updated from global requirements * feat: add max_dispatches arg to conductor's run * Ensure node 'remove' and 'disassociate' can not be called when frozen * Add in-memory backend delete() in recursive/non-recursive modes * Use batch 'get_atoms_states' where we can * Use automaton's converters/pydot * Make more of the WBE logging and '__repr__' message more useful * Fix bad sphinx module reference * Relabel internal engine 'event' -> 'outcome' * No need for Oslo Incubator Sync * Use the node built-in 'dfs_iter' instead of recursion * Simplify flow action engine compilation * Fix 'dependened upon' spelling error * docs - Set pbr warnerrors option for doc build * Rename 'history' -> 'Release notes' * Remove dummy/placeholder 'ChangeLog' as its not needed * Remove ./taskflow/openstack/common as it no longer exists * Remove quotes from subshell call in bash script * Refactor common parts of 'get_maybe_ready_for' methods * Fix the sphinx build path in .gitignore file * Change ignore-errors to ignore_errors * Use graphs as the underlying structure of patterns * Updated from global requirements * Fix '_cache_get' multiple keyword argument name overlap * Use the sqlalchemy-utils json type instead of our own * Updated from global requirements * Fix how the dir persistence backend was not listing logbooks * Explain that jobs arch. diagram is only for zookeeper * Updated from global requirements * iter_nodes method added to flows * Updated from global requirements * Use 'iter_utils.count' to determine how many unfinished nodes left * Fix flow states link * Avoid running this example if zookeeper is not found * Updated from global requirements - adjust Requires according to requirements.txt ------------------------------------------------------------------- Thu Sep 10 14:32:04 UTC 2015 - seife+obs@b1-systems.com - fix version in spec file so that it actually can build ------------------------------------------------------------------- Wed Sep 9 06:45:03 UTC 2015 - tbechtold@suse.com - update to 1.20.0: * Updated from global requirements * Add nicely made task structural diagram * Updated from global requirements * Fix busted stevedore doc(s) link * Improve docstrings in graph flow to denote exceptions raised * Enable testr OS_DEBUG to be TRACE(blather) by default * Updated from global requirements * Show intermediary compilation(s) when BLATHER is enabled * Give the GC more of a break with regard to cycles * Base class for deciders * Remove extra runner layer and just use use machine in engine * Updated from global requirements * .gitignore update * Avoid adding 1 to a failure (if it gets triggered) * Replace the tree 'pformat()' recursion with non-recursive variant * Fix seven typos and one readability on taskflow documentation - adjust Requires according to requirements.txt ------------------------------------------------------------------- Wed Jul 29 11:06:08 UTC 2015 - tbechtold@suse.com - Unify spec file. Use fedora compatible files macros ------------------------------------------------------------------- Tue Jul 28 12:50:09 UTC 2015 - tbechtold@suse.com - update to 1.17.0: * Modify listeners to handle the results now possible from revert() * Updated from global requirements * Fix lack of space between functions * Create and use a serial retry executor * Just link to the worker engine docs instead of including a TOC inline * Link to run() method in engines doc * Add ability to reset an engine via a `reset` method - adjust Requires according to requirements.txt ------------------------------------------------------------------- Tue Jul 21 05:58:11 UTC 2015 - tbechtold@suse.com - update to 1.16.0: * Updated from global requirements * Update 'make_client' kazoo docs and link to them * Move doc8 to being a normal test requirement in test-requirements.txt * Updated from global requirements * Found another removal_version=? that should be removal_version=2.0 * Add deprecated module(s) for prior FSM/table code-base * Replace internal fsm + table with automaton library * Remove direct usage of timeutils overrides and use fixture * Provide a deprecated alias for the now removed stop watch class * Update all removal_version from being ? to being 2.0 * Add deprecated and only alias modules for the moved types * Updated from global requirements * Run the '99_bottles.py' demo at a fast rate when activated * Retain atom 'revert' result (or failure) * Update the version on the old/deprecated logbook module * Add docs for u, v, decider on graph flow link method * Fix mock calls * Remove setup.cfg 'requires-python' incorrect entry * Compile lists of retry/task atoms at runtime compile time * Integrate futurist (and **remove** taskflow originating code) * Allow the 99_bottles.py demo to run in BLATHER mode * Add more useful `__str__` to redis job * Show job posted and goodbye in 99_bottles.py example * Rename logbook module -> models module * Notify on the individual engine steps ------------------------------------------------------------------- Wed Jul 8 15:22:13 UTC 2015 - dmueller@suse.com - update to 1.14.0: * Expose strategies so doc generation can easily pick them up * Denote mail subject should be '[Oslo][TaskFlow]' * Updated from global requirements * Add history.rst that uses generated 'ChangeLog' file * Add docstrings on runtime objects methods and link to them in docs ------------------------------------------------------------------- Wed Jun 24 07:14:26 UTC 2015 - tbechtold@suse.com - update to 0.12.0: * Updated from global requirements * Cache the individual atom schedulers at compile time * Split-off the additional retry states from the task states * Updated from global requirements * Updated from global requirements * Add `simple_linear_listening` example to generated docs * Switch badges from 'pypip.in' to 'shields.io' * Adding a revert_all option to retry controllers * Use a class constant for the default path based backend path * Updated from global requirements * Remove example not tested * Make the default file encoding a class constant with a docstring * Use a lru cache to limit the size of the internal file cache * Updated from global requirements * Use hash path lookup vs path finding * Remove all 'lock_utils' now that fasteners provides equivalents * Add a new `ls_r` method * Updated from global requirements * Refactor machine builder + runner into single unit * Replace lock_utils lock(s) with fasteners package * Updated from global requirements * Use shared '_check' function to check engine stages * Remove a couple more useless 'pass' keywords found * Add a test that checks for task result visibility * Remove testing using persistence sqlalchemy backend with 'mysqldb' * Remove customized pyX.Y tox requirements * Updated from global requirements * Allow same deps for requires and provides in task * Remove 'pass' usage not needed * Only show state transitions to logging when in BLATHER mode * Fix updated_at column of sqlalchemy tables * Remove script already nuked from oslo-incubator * Ensure path_based abstract base class is included in docs * Beef up docs on the logbook/flow detail/atom details models * Remove custom py26/py27 tox venvs no longer used * Use newer versions of futures that adds exception tracebacks * Ensure empty paths raise a value error * Remove listener stack and replace with exit stack * Expose action engine no reraising states constants * Chain a few more exception raises that were previously missed * Expose in memory backend split staticmethod * Updated from global requirements * Remove tox py33 environment no longer used * Avoid creating temporary removal lists * Avoid trying to copy tasks results when cloning/copying * Avoid re-normalizing paths when following links * Add a profiling context manager that can be easily enabled * Updated from global requirements * Remove validation of state on state read property access * Make the default path a constant and tweak class docstring * Avoid duplicating exception message * Add speed-test tools script * Speed up memory backend via a path -> node reverse mapping * Updated from global requirements * Fix a typo in taskflow docs * Small refactoring of 'merge_uri' utility function * Fix post coverage job option not recognized * Refactor/reduce shared 'ensure(task/retry)' code * Move implementations into there own sub-sections * Remove run_cross_tests.sh * Move zookeeper jobboard constants to class level * Retain chain of missing dependencies * Expose fake filesystem 'join' and 'normpath' * Add + use diagram explaining retry controller area of influence * Add openclipart.org conductor image to conductor docs * Use oslo_utils eventletutils to warn about eventlet patching * Test more engine types in argument passing unit test * Add a conductor running example * Replace more instance(s) of exception chaining with helper * Avoid attribute error by checking executor for being non-none * Validate correct exception subclass in 'raise_with_cause' * Remove link to kazoo eventlet handler * Add states generating venv and use pydot2 * Add strict job state transition checking * Uncap library requirements for liberty * Have reset state handlers go through a shared list * Add job states in docs + states in python * Expose r/o listener callback + details filter callback * Expose listener notification type + docs * Ensure listener args are always a tuple/immutable * Include the 'dump_memory_backend' example in the docs * Make resolution/retry strategies more clear and better * Rename notifier 'listeners' to 'topics' * Mention link to states doc in notify state transitions * Ensure we don't get stuck in formatting loops * Add note about thread safety of fake filesystem * Have the notification/listener docs match other sections * Put semantics preservation section into note block * Note that the traditional mode also avoids this truncation issue * Avoid going into causes of non-taskflow exceptions * Use the ability to chain exceptions correctly * Add a example showing how to share an executor * Shrink the bookshelf description * Remove link about implementing job garbage binning * Make the storage layer more resilent to failures * Put the examples/misc/considerations under a new section * Add a suspension engine section * Switch back to maxdepth 2 * Allow ls() to list recursively (using breadth-first) * Make an attempt at having taskflow exceptions print causes better * fix renamed class to call super correctly * Turn 'check_who' into a decorator * Use 'node' terminology instead of 'item' terminology * Remove 11635 bug reference * Allow providing a node stringify function to tree pformat * Add in memory filesystem clearing * Just unify having a single requirements.txt file * Fix a couple of spelling and grammar errors * Add memory backend get() support * Make the graph '_unsatisfied_requires' be a staticmethod * Add more comments to fake in-memory filesystem * Add a set of tests to the in memory fake filesystem * Adding test to improve CaptureListener coverage * Prefer posixpath to os.path * By default use a in memory backend (when none is provided) * Allow using shallow copy instead of deep copy * Move to the newer debtcollector provided functions * Move to using the oslo.utils stop watch * Updated from global requirements * Ensure thread-safety of persistence dir backend * Ensure we are really setup before being connected * Ensure docstring on storage properties * Expose the storage backend being used * Use iteration instead of list(s) when extracting scopes * Use binary/encode decode helper routines in dir backend * Rename memory backend filesystem -> fake filesystem * Just let the future executors handle the max workers * Always return scope walker instances from `fetch_scopes_for` * Give the GC a break * Use the class name instead of the TYPE property in __str__ * Just use the class name instead of TYPE constant * Ensure we have a 'coverage-package-name' * Attempt to extract traceback from exception * Use compatible map and update map/reduce task docs * Update engine docs with new validation stage * Ensure we register & deregister conductor listeners * Rename attribute '_graph' to '_execution_graph' * Add a log statement pre-validation that dumps graph info * Have this example exit non-zero if incorrect results * Use a collections.namedtuple for the request work unit * Some small wbe engine doc tweaks * Add newline to avoid sphinx warning * Allow passing 'many_handler' to fetch_all function * Ensure event time listener is in listeners docs * Add a in-memory backend dumping example * Added a map and a reduce task * Restructure the in-memory node usage * Switch to non-namespaced module imports * Allow the storage unit to use the right scoping strategy * Just use the local conf variable * Put underscore in-front of alchemist helper * lazy loading for logbooks and flowdetails * Allow backend connection config (via fetch) to be a string * Add + use failure json schema validation * Use ordered[set/dict] to retain ordering * Allow injected atom args to be persisted * add _listeners_from_job method to Conductor base * update uses of TimingListener to DurationListener * Added EventTimeListner to record when events occur * added update_flow_metadata method to Storage class * Retain nested causes where/when we can * Denote issue 17911 has been merged/accepted * Persistence backend refactor * Remove support for 3.3 * Writers can now claim a read lock in ReaderWriterLock * Add another probabilistic rw-lock test * Add + use read/write lock decorators * Add no double writers thread test * Use condition context manager instead of acquire/release * Remove condition acquiring for read-only ops * Set a no-op functor when none is provided * Ensure needed locks is used when reading/setting intention * Specialize checking for overlaps * Use links instead of raw block quotes * Rename the timing listeners to duration listeners * Add a bookshelf developer section * Ensure the thread bundle stops in last to first order * Add warning about transient arguments and worker-based-engines * Ensure ordered set is pickleable * Add node removal/disassociate functions * Add a fully functional orderedset * Make the worker banner template part of the worker class * Use compilation helper objects * Allow node finding to not do a deep search * Add a frozen checking decorator * Tweak functor used to find flatteners/storage routines * Add specific scoping documentation * add jobboard trash method * Provide more contextual information about invalid periodics * Fix lookup scoping multi-match ordering * Stick to one space after a period * Refactor parts of the periodic worker * Use oslo.utils encodeutils for encode/decode functions * Bring over pretty_tox.sh from nova/heat/others * Tweak some of the types thread safety docstrings * Add pypi link badges * Switch the note about process pool executor to warning * Chain exceptions correctly on py3.x * Updated from global requirements * Remove WBE experimental documentation note * Use the enum library for the retry strategy enumerations * Use debtcollector library to replace internal utility * add get_flow_details and get_atom_details to all backends * Tweaks to atom documentation * Update Flow::__str__ * Add todo note for kombu pull request * Move 'provides' and 'name' to instance attributes * Allow loading conductors via entrypoints * Revert "Add retries to fetching the zookeeper server version" * Allow turning off the version check * adding check for str/unicode type in requires * Make the dispatcher handler be an actual type * Add retries to fetching the zookeeper server version * Remove duplicate 'the' and link to worker engine section * Remove delayed decorator and replace with nicer method * Fix log statement * Make the atom class an abstract class * Improve multilock class and its associated unit test * Mark conductor 'stop' method deprecation kwarg with versions * Move to hacking 0.10 * catch NotFound errors when consuming or abandoning * Use the new table length constants * Improve upon/adjust/move around new optional example * Clarify documentation related to inputs * Docstrings should document parameters return values * Let the multi-lock convert the provided value to a tuple * Map optional arguments as well as required arguments * Add a BFS tree iterator * DFS in right order when not starting at the provided node * Rework the sqlalchemy backend * Modify stop and add wait on conductor to prevent lockups * Default to using a thread-safe storage unit * Add warning to sqlalchemy backend size limit docs * Updated from global requirements * Use a thread-identifier that can't easily be recycled * Use a notifier instead of a direct property assignment * Tweak the WBE diagram (and present it as an svg) * Remove duplicate code * Improved diagram for Taskflow * Bump up the env_builder.sh to 2.7.9 * Add a capturing listener (for test or other usage) * Add + use a staticmethod to fetch the immediate callables * Just directly access the callback attributes * Use class constants during pformatting a tree node * Abstract out the worker finding from the WBE engine * Add and use a nicer kombu message formatter * Remove duplicated 'do' in types documentation * Use the class defined constant instead of raw strings * Use kombu socket.timeout alias instead of socket.timeout * Stopwatch usage cleanup/tweak * Add note about publicly consumable types * Add docstring to wbe proxy to denote not for public use * Use monotonic time when/if available * Updated from global requirements * Link WBE docs together better (especially around arguments) * Emit a warning when no routing keys provided on publish() * Center SVG state diagrams * Use importutils.try_import for optional eventlet imports * Shrink the WBE request transition SVG image size * Add a thread bundle helper utility + tests * Make all/most usage of type errors follow a similar pattern * Leave use-cases out of WBE developer documentation * Allow just specifying 'workers' for WBE entrypoint * Add comments to runner state machine reaction functions * Fix coverage environment * Use explicit WBE worker object arguments (instead of kwargs) * WBE documentation tweaks/adjustments * Add a WBE request state diagram + explanation * Tidy up the WBE cache (now WBE types) module * Fix leftover/remaining 'oslo.utils' usage * Show the failure discarded (and the future intention) * Use a class provided logger before falling back to module * Use explicit WBE object arguments (instead of kwargs) * Fix persistence doc inheritance hierarchy * The gathered runtime is for failures/not failures * add clarification re parallel engine * Increase robustness of WBE producer/consumers * Move implementation(s) to there own sections * Move the jobboard/job bases to a jobboard/base module * Have the serial task executor shutdown/restart its executor * Mirror the task executor methods in the retry action * Add back a 'eventlet_utils' helper utility module * Use constants for runner state machine event names * Remove 'SaveOrderTask' and test state in class variables * Provide the stopwatch elapsed method a maximum * Fix unused and conflicting variables * Switch to using 'oslo_serialization' vs 'oslo.serialization' * Switch to using 'oslo_utils' vs 'oslo.utils' * Add executor statistics * Use oslo.utils reflection for class name * Add split time capturing to the stop watch * Use platform neutral line separator(s) * Create and use a multiprocessing sync manager subclass * Use a single sender * Updated from global requirements * Include the 'old_state' in all currently provided listeners * Update the README.rst with accurate requirements * Include docstrings for parallel engine types/strings supported * The taskflow logger module does not provide a logging adapter * Send in the prior atom state on notification of a state change * Pass a string as executor in the example instead of an executor * Updated from global requirements * Fix for job consumption example using wrong object - Adjust Requires according to requirements.txt ------------------------------------------------------------------- Wed Jan 21 07:23:07 UTC 2015 - dmueller@suse.com - update to 0.6.1: * Remove need to inherit/adjust netutils split * Allow specifying the engine 'executor' as a string * Disallowing starting the executor when worker running * Use a single shared queue for an executors lifecycle * Avoid creating a temporary list(s) for tree type * Update statement around stopwatch thread safety * Register with 'ANY' in the cloned process * Remove less than useful action_engine __str__ * Ensure manager started/shutdown/joined and reset * Return the same namedtuple that the future module returns * Add a simplistic hello world example * Get event/notification sending working correctly * Move the engine scoping test to its engines test folder * Get the basics of a process executor working * Correctly trigger 'on_exit' of starting/initial state * Add an example which shows how to send events out from tasks * Move over to using oslo.utils [reflection, uuidutils] * Updated from global requirements * Add a basic map/reduce example to show how this can be done * Add a parallel table mutation example * Add a 'can_be_registered' method that checks before notifying * Base task executor should provide 'wait_for_any' * Replace autobind with a notifier module helper function * Cleanup some doc warnings/bad/broken links * Use the notifier type in the task class/module directly * Use a tiny clamp helper to clamp the 'on_progress' value * Retain the existence of a 'EngineBase' until 0.7 or later * Remove the base postfix from the internal task executor * Remove usage of listener base postfix * Add a moved_inheritable_class deprecation helper * Avoid holding the lock while scanning for existing jobs * Remove the base postfix for engine abstract base class * Avoid popping while another entity is iterating * Updated from global requirements * Use explict 'attr_dict' when adding provider->consumer edge * Properly handle and skip empty intermediary flows * Ensure message gets processed correctly * Just assign a empty collection instead of copy/clear * Remove rtype from task clone() doc * Add and use a new simple helper logging module * Have the sphinx copyright date be dynamic * Add appropriate links into README.rst * Use condition variables using 'with' * Use an appropriate ``extract_traceback`` limit * Allow all deprecation helpers to take a stacklevel * Correctly identify stack level in ``_extract_engine`` * Stop returning atoms from execute/revert methods * Have tasks be able to provide copy() methods * Allow stopwatches to be restarted * Ensure that failures can be pickled * Rework pieces of the task callback capability * Just use 4 spaces for classifier indents * Move atom action handlers to there own subfolder/submodule * Workflow documentation is now in infra-manual * Ensure frozen attribute is set in fsm clones/copies * Fix split on "+" for connection strings that specify dialects * Update listeners to ensure they correctly handle all atoms * Allow for the notifier to provide a 'details_filter' * Be explicit about publish keyword arguments * Some package additions and adjustments to the env_builder.sh * Cache immutable visible scopes in the runtime component * Raise value errors instead of asserts * Add a claims listener that connects job claims to engines * Split the scheduler into sub-schedulers * Use a module level constant to provide the DEFAULT_LISTEN_FOR * Move the _pformat() method to be a classmethod * Add link to issue 17911 * Avoid deepcopying exception values * Include documentation of the utility modules * Use a metaclass to dynamically add testcases to example runner * Remove default setting of 'mysql_traditional_mode' * Move scheduler and completer classes to there own modules * Ensure that the zookeeper backend creates missing atoms * Use the deprecation utility module instead of warnings * Tweaks to setup.cfg * Add a jobboard high level architecture diagram * Mark 'task_notifier' as renamed to 'atom_notifier' * Revert wrapt usage until further notice * Updated from global requirements * Add a history retry object, makes retry histories easier to use * Format failures via a static method * When creating daemon threads use the bundled threading_utils * Ensure failure types contain only immutable items * Mark 'task_notifier' as renamed to 'atom_notifier' * Use wrapt to provide the deprecated class proxy * Updated from global requirements * Updated from global requirements * Updated from global requirements * Reduce the worker-engine joint testing time * Link bug in requirements so people understand why pbr is listed * Updated from global requirements * Use standard threading locks in the cache types * Handle the case where '_exc_type_names' is empty * Add pbr to installation requirements * Updated from global requirements * Remove direct usage of the deprecated failure location * Fix the example 'default_provides' * Use constants for retry automatically provided kwargs * Remove direct usage of the deprecated notifier location * Remove attrdict and just use existing types * Use the mock that finds a working implementation * Add a futures type that can unify our future functionality * Bump the deprecation version number * Use and verify event and latch wait() return using timeouts * Deprecate `engine_conf` and prefer `engine` instead * Use constants for link metadata keys * Bump up the sqlalchemy version for py26 * Hoist the notifier to its own module * Move failure to its own type specific module * Use constants for revert automatically provided kwargs * Improve some of the task docstrings * We can now use PyMySQL in py3.x tests * Updated from global requirements * Add the database schema to the sqlalchemy docs * Change messaging from handler connection timeouts -> operation timeouts * Switch to a custom NotImplementedError derivative * Allow the worker banner to be written to an arbitrary location * Update engine class names to better reflect there usage ------------------------------------------------------------------- Thu Oct 16 16:19:30 UTC 2014 - dmueller@suse.com - update to 0.5.0: * Avoid usage of six.moves in local functions * Make it so that the import works for older versions of kombu * Rework the state documentation * Updated from global requirements * Adjust docs+venv tox environments requirements/dependencies * Adjust the WBE log levels * Use the features that the oslotest mock base class provides * Use oslotest to provide our base test case class * Jobboard example that show jobs + workers + producers * Adjust on_job_posting to not hold the lock while investigating * Move some of the custom requirements out of tox.ini * Stop using intersphinx * Expand toctree to three levels * Documentation cleanups and tweaks * Fix multilock concurrency when shared by > 1 threads * Increase/adjust the logging of the WBE response/send activities * Color some of the states depending on there meaning * Switch to using oslo.utils and oslo.serialization * Typos "searchs" * Update the requirements-py2.txt file * Updated from global requirements * Example which shows how to move values from one task to another * Mention issue with more than one thread and reduce workers * Add a mandelbrot parallel calculation WBE example * Add existing types to generated documentation * Remove the dependency on prettytable * Work toward Python 3.4 support and testing * Update the state graph builder to use state machine type * Add a docs virtualenv * Reduce unused tox environments ------------------------------------------------------------------- Wed Sep 10 13:30:08 UTC 2014 - dmueller@suse.com - update to 0.4.0: * Updated from global requirements * Make the WBE worker banner information more meaningful * Allow worker count to be specified when no executor provided * Remove sphinx examples emphasize-lines * Split requirements into py2 and py3 files * Update oslo-incubator to 037dee004c3e2239 * Avoid naming time type module the same as a builtin * Add a pformat() failure method and use it in the conductor * add pre/post execute/retry callbacks to tasks * Use checked_commit() around consume() and abandon() * Use a check + create transaction when claiming a job * Improve WBE testing coverage * Add basic WBE validation sanity tests * WBE request message validation * WBE response message validation * WBE notification message validation * Allow handlers to provide validation callables * Use a common message dispatcher * Use checked commit when committing kazoo transactions * Enable hacking checks H305 and H307 in tox.ini template * Fixes unsorted dicts and sets in doctests * README.rst: Avoid using non-ascii character * Updated from global requirements * Enabled hacking checks H305 and H307 * Bump hacking to version 0.9.2 * Allow a jobs posted book to be none by default * Cleanup some of the example code & docs * Make greenexecutor not keep greenthreads active * Add the arch/big picture omnigraffle diagram * Remove pbr as a runtime dependency * Use the `state_graph.py` for all states diagrams * Make the examples documentation more relevant * Raise NotImplementedError instead of NotImplemented * Move the stopwatch tests to test_types * Remove need to do special exception catching in parse_uri * Update oslo incubator code to commit 0b02fc0f36814968 * Fix the section name in CONTRIBUTING.rst * Add a conductor considerations section * Make the expiring cache a top level cache type * Use `flow_uuid` and `flow_name` from storage * Fix traces left in zookeeper * Clarify locked decorator is for instance methods * Create a top level time type * Simplify identity transition handling for tasks and retries * Remove check_doc.py and use doc8 * Remove functions created for pre-six 1.7.0 * Add a tree type * Make intentions a tuple (to denote immutability) * Updated from global requirements * Add example for pseudo-scoping * Fix E265 hacking warnings * Fix doc which should state fetch() usage * Adjust sphinx requirement * Upgrade hacking version and fix some of the issues * Denote that other projects can use this library * Remove misc.as_bool as oslo provides an equivalent * Update zake to requirements version ------------------------------------------------------------------- Tue Jun 24 06:29:26 UTC 2014 - dmueller@suse.com - update to 0.3.21: * Switch to a restructuredtext README file * Include the function name on internal errors * Add in default transaction isolation levels * Allow the mysql mode to be more than just TRADITIONAL * Make the runner a runtime provided property * Rename inject_task_args to inject_atom_args * Rename the graph analyzer to analyzer * Provide the compilation object instead of just a part of it * Ensure cachedproperty descriptor picks up docstrings * Warn about internal helper/utility usage * Rename to atom from task * Invert the conductor stop() returned result * Move flattening to the action engine compiler * Increase the level of usefulness of the dispatching logging * Avoid forcing engine_conf to a dict * Allow for two ways to find a flow detail in a job for a conductor * Add docs related to the new conductor feature * Add docstring describing the inject instance variable * Finish factoring apart the graph_action module * Update sphinx pin from global requirements * Fix docstring list format * Allow indent text to be passed in * Factor out the on_failure to a mixin type * Use a name property setter instead of a set_name method * Adds a single threaded flow conductor * add the ability to inject arguments into tasks at task creation * Synced jsonutils from oslo-incubator * Remove wording issue (track does not make sense here) * Fix case of taskflow in docs * Put the job external wiki link in a note section * Rework atom documentation * Add doc link to examples * Rework the overview of the notification mechanism * Standardize on the same capitalization pattern * Regenerate engine-state sequence diagram * Add source of engine-state sequence diagram * Add kwarg check_pending argument to fake lock * Add a example which uses the run_iter function in a for loop * Fix error string interpolation * Rename t_storage to atom_storage * Create and use a new compilation module * Add engine state diagram * Add tests for the misc.cachedproperty descriptor * Complete the cachedproperty descriptor protocol * Don't create fake LogBook when we can not fetch one * Use futures wait() when possible * Use /taskflow/flush-test in the flush function * Add a reset nodes function * Default the impl_memory conf to none * Fix spelling mistake * Add a helper tool which clears zookeeper test dirs * Add a zookeeper jobboard integration test * Cleanup zookeeper integration testing * Use a more stable flush method * Remove the _clear method and do not reset the job_watcher * Allow command and connection retry configuration * Check documentation for simple style requirements * Add an example which uses the run iteration functionality * Implement run iterations * Put provides and requires code to basic Flow * Allow the watcher to re-register if the session is lost * Add a new wait() method that waits for jobs to arrive * Add a cachedproperty descriptor * Add an example for the job board feature * Engine _cls postfix is not correct * Pass executor via kwargs instead of config * Allow the WBE to use a preexisting executor * Tweaks to object hiearchy diagrams * Adjust doc linking * Medium-level docs on engines * Add docs for the worker based engine (WBE) * Updated from global requirements * Move from generator to iterator for iterjobs * Add a jobboard fetching context manager * Wrap the failure to load in the not found exception * Update jobboard docs * Synced jsonutils from oslo-incubator * Remove persistence wiki page link * Load engines with defined args and provided kwargs * Integrate urlparse for configuration augmentation * Fix "occured" -> "occurred" * Documentation tune-ups * Fix spelling error * Add a resumption strategy doc * Docs and cleanups for test_examples runner * Skip loading (and failing to load) lock files * Add a persistence backend fetching context manager * Add a example that activates a future when a result is ready * Fix documentation spelling errors * Add a job consideration doc * Add last_modified & created_on attributes to jobs * Allow jobboard event notification * Use sequencing when posting jobs * Add a directed graph type (new types module) * Add persistence docs + adjustments * Updated from global requirements * Stings -> Strings * Be better at failure tolerance * Ensure example abandons job when it fails * Add docs for jobs and jobboards * Get persistence backend via kwargs instead of conf * Allow fetching jobboard implementations * Reuse already defined variable * More keywords & classifier topics * Allow transient values to be stored in storage * Doc adjustments * Move the daemon thread helper function * Create a periodic worker helper class * Fix not found being raised when iterating * Allow for only iterating over the most 'fresh' jobs * Updated from global requirements * Update oslo-incubator to 46f2b697b6aacc67 * import run_cross_tests.sh from incubator * Exception in worker queue thread * Avoid holding the state lock while notifying ------------------------------------------------------------------- Wed Apr 2 08:21:32 UTC 2014 - speilicke@suse.com - Update to version 0.2: * Allow atoms to save their own state/result * Use correct exception in the timing listener * Add a engine preparation stage * Decrease extraneous logging * Handle retry last_results/last_failure better * Improve documentation for engines * Worker executor adjustments * Revert "Move taskflow.utils.misc.Failure to its own module" * Move taskflow.utils.misc.Failure to its own module * Leave the execution_graph as none until compiled * Move state link to developer docs * Raise error if atom asked to schedule with unknown intention * Removed unused TIMED_OUT state * Rework documentation of notifications * Test retry fails on revert * Exception when scheduling task with invalid state * Fix race in worker-based executor result processing * Set logbook/flowdetail/atomdetail meta to empty dict * Move 'inputs and outputs' to developers docs * tests: Discover absence of zookeeper faster * Fix spelling mistake * Should be greater or equal to zero and not greater than * Persistence cleanup part one * Run worker-based engine tests faster * SQLAlchemy requirements put in order * Add timeout to WaitForOneFromTask * Use same code to reset flow and parts of it * Optimize dependency links in flattening * Adjust the exception hierachy * docs: Links to methods on arguments and results page * Add __repr__ method to Atom * Flattening improvements * tests: Fix WaitForOneFromTask constructor parameter introspection * Rework graph flow unit tests * Rewrite assertion for same elements in sequences * Unit tests for unordered flow * Linear flow: mark links and rework unit tests * Drop indexing operator from linear flow * Drop obsolete test_unordered_flow * Iteration over links in flow interface * Add a timeout object that can be interrupted * Avoid shutting down of a passed executor * Add more tests for resumption with retry * Improve logging for proxy publish * Small documentation fix * Improve proxy publish method * Add Retry to developers documentation * Move flow states to developers documentation * Remove extraneous vim configuration comments * Make schedule a proper method of GraphAction * Simplify graph analyzer interface * Test storage with memory and sqlite backends * Fix few minor spelling errors * Fix executor requests publishing bug * Flow smart revert with retry controller * Add atom intentions for tasks and retries * [WBE] Collect information from workers * Add tox environment for pypy * docs: Add inheritance diagram to exceptions documentation * Adjust logging levels and usage to follow standards * Introduce message types for WBE protocol * Add retry action to execute retries * Extend logbook and storage to work with retry * Add retry to execution graph * Add retry to Flow patterns * Add base class for Retry * Update request `expired` property docsting * docs: Add page describing atom arguments and results * docs: Improve BaseTask method docstrings * Remove extra quote symbol * docs: Relative links improvements * docs: Ingore 'taskflow.' prefix when sorting module index * Update comment + six.text_type instead of str for name * Avoid calling callbacks while holding locks * Rename remote task to request * Rework proxy publish functionality * Updated from global requirements * Use message.requeue instead of message.reject * Lock test tweaks * Move endpoint subclass finding to reflection util * Correct LOG.warning in persistence utils * Introduce remote tasks cache for worker-executor * Worker-based engine clean-ups * A few worker-engine cleanups * Add a delay before releasing the lock * Allow connection string to be just backend name * Get rid of openstack.common.py3kcompat * Clean-up several comments in reflection.py * Fix try_clean not getting the job_path * Updated from global requirements * Rename uuid to topic * Fixups for threads_count usage and logging * Use the stop watch utility instead of custom timing * Unify usage of storage error exception type * Add zookeeper job/jobboard impl * Updated from global requirements * Removed copyright from empty files * Remove extraneous vim configuration comments * Use six.text_type() instead of str() in sqlalchemy backend * Fix dummy lock missing pending_writers method * Move some common/to be shared kazoo utils to kazoo_utils * Switch to using the type checking decode_json * Fix few spelling and grammar errors * Fixed spelling error * Run action-engine tests with worker-based engine * Message-oriented worker-based flow with kombu * Check atom doesn't provide and return same values * Fix command for pylint tox env * Remove locale overrides form tox template * Reduce test and optional requirements to global requirements * Rework sphinx documentation * Remove extraneous vim configuration comments * Sync with global requirements * Instead of doing set diffing just partition when state checking * Add ZooKeeper backend to examples * Storage protects lower level backend against thread safety * Remove tox locale overrides * Update .gitreview after repo rename * Small storage tests clean-up * Support building wheels (PEP-427) - Update requirements - Add _service file for easier updates ------------------------------------------------------------------- Thu Feb 20 09:26:12 UTC 2014 - dmueller@suse.com - update to 0.1.3: * Small bug fixes for 0.1.2 * Concurrency adjustments * Exception unicode text cleanup ------------------------------------------------------------------- Mon Jan 13 14:10:35 UTC 2014 - dmueller@suse.com - update to 0.1.2: * Small bug fixes for 0.1.1 * python3 adjustments * requirements updated to unbind sqlalchemy ------------------------------------------------------------------- Fri Dec 27 13:34:14 UTC 2013 - dmueller@suse.com - add missing networkx dependency ------------------------------------------------------------------- Fri Dec 27 11:25:22 UTC 2013 - dmueller@suse.com - fix requires ------------------------------------------------------------------- Sat Dec 14 10:33:26 UTC 2013 - dmueller@suse.com - Initial package (0.1.1)
