Releases: cooperative-computing-lab/cctools
release/7.9.0
- adds spool to wq condor_submit_workers (#3751)
- transfer missing to forsaken (#3747)
- vine: remove transfer pairs with sources (#3749)
- vine: set transfer failure on cache invalid (#3748)
- vine: cleanup vine_submit_workers (#3735)
- Vine: Forsake functions when library exits. (#3742)
- copy manager addrs with DOMAIN_NAME_MAX limit (#3740)
- vine: only checkpoint DaskVineFile's (#3746)
- Vine: Fix Library Failure Segfault (#3743)
- Add additional environment variables to set number of cores appropriately (#3733)
- Last transfer failure (#3745)
- vine: use environment for library tasks in dask_executor (#3736)
- Switch to HMAC_CTX_new to allocate context, instead of declaring on stack. (#3720)
- vine: adds --spool to vine_submit_workers -T condor (#3732)
- vine: adds a transient result failure to tasks (#3729)
- vine: move retry logic into a proper place (#3730)
- fix debug flag (#3724)
- vine: temp fix, worker does not fail on repeated put_url (#3723)
- vine: record replicas in transit (#3719)
- dttools: add hash iteration from a given key (#3722)
- set: array of elements in random order (#3718)
- guard div zero for random bucket starts (#3717)
- configure: turn on max debug symbols with --debug (#3713)
- vine: update replica sets when worker is removed (#3708)
- parrot: fix new compiler strict warnings (#3712)
- vine: fix recovery tasks multiple creation (#3707)
- vine: delete workflow files on worker disconnection (#3705)
- vine: fix peer_addr double free (#3704)
- vine: chech start time in seconds (#3703)
- vine: worker<->file association (#3702)
- Makeflow: Fix handling of dashes in filenames. (#3701)
- Library minor fixes (#3697)
- check available (#3694)
- Fix several aspects of handle_cache_invalid: (#3695)
- vine: consider cached output buffers as replicas at workers (#3690)
- vine: Hash random start (#3688)
- vine: use port range in futures test (#3689)
- vine: compare cache level TASK instead of WORKFLOW (#3687)
- vine: set function start time when sent to library (#3686)
release/7.8.1
release/7.8.0
-
WQ RemoteTask Cleanup (#3600) -
dask+vine: set custom name to file outputs (#3604) -
dask+vine: Do not immediately serialize waiting calls. (#3605) -
Vine: Fix Up Manual with Plotting Tools (#3616) -
vine: write custom entries to debug and transactions logs (#3617) -
Vine: Report UUID and Catalog Properties (#3623) -
vine: correctly gc temp files on refcount (#3627) -
have poncho fail if mkdir fails (#3629) -
Factory: Handling of Scratch Dir for HTCondor (#3630) -
Unlink when done (C and python bindings) (#3632) -
vine: remove_file to undeclare_file -
Vine: File/Replica Code Cleanup (#3647) -
do not measure disk at the manager (#3651) -
Vine: Rework Empty Dir Handling (#3645) -
vine: correctly rc files on manager exiting (#3656) -
vine: adds stat inuse_cache (#3659) -
Factory: Report Owner and Version (#3661) -
add a parsl condor example (#3658) -
Vine: Factor Out Worker-From-Factory Code (#3654) -
vine_graph_log: Plot from dispatch (#3663) -
Vine: Cleanup Worker Info and Stats (#3653) -
added vertical line to transaction log graph (#3664) -
DaskVine Serverless (#3581) -
vine: remove files as results are checkpointed in dask_executor (#3640) -
vine: use a single file for wrappers, buffer for functions (#3634) -
vine: ensure factory scratch dir exists (#3672) -
vine: future function calls (#3670) -
Vine: DaskVine Doc Example (#3674) -
vine: make FunctionCall a subclass of PythonTask (#3677) -
vine: don't reap on task app failure (#3678)
release/7.7.3
We are pleased to announce the release of version 7.7.3
of the Cooperative Computing Tools from the University of Notre Dame,
including TaskVine, Work Queue, Makeflow, Parrot, Chirp, and other software.
Docs: https://cctools.readthedocs.io/
Download: http://ccl.cse.nd.edu/software/download
Forum: http://ccl.cse.nd.edu/community/forum
This is a minor bug-fix release:
- Fix segfault in Work Queue coprocess feature when under high load. (#3584)
release/7.7.2
We are pleased to announce the release of version 7.7.2
of the Cooperative Computing Tools from the University of Notre Dame,
including TaskVine, Work Queue, Makeflow, Parrot, Chirp, and other software.
Docs: https://cctools.readthedocs.io/
Download: http://ccl.cse.nd.edu/software/download
Forum: http://ccl.cse.nd.edu/community/forum
This is a minor bug-fix release:
Contributors
Assets 6
release/7.7.1
We are pleased to announce the release of version 7.7.1
of the Cooperative Computing Tools from the University of Notre Dame,
including TaskVine, Work Queue, Makeflow, Parrot, Chirp, and other software.
Docs: https://cctools.readthedocs.io/
Download: http://ccl.cse.nd.edu/software/download
Forum: http://ccl.cse.nd.edu/community/forum
This is a minor bug-fix release:
What's Changed
Contributors
Assets 6
parsl-wq-chdir-fix
fix (#3542)
release/7.7.0
We are pleased to announce the release of version 7.7.0
of the Cooperative Computing Tools from the University of Notre Dame,
including TaskVine, Work Queue, Makeflow, Parrot, Chirp, and other software.
Docs: https://cctools.readthedocs.io/
Download: http://ccl.cse.nd.edu/software/download
Forum: http://ccl.cse.nd.edu/community/forum
This is a feature release that primarily improves the scalability and performance of TaskVine:
Main Features:
- TaskVine workers now perform transfers asynchronously while communicating with manager, by @BarrySlyDelgado
- TaskVine Serverless function execution simplified and accelerated by @tphung3
- Improved integration of Parsl and TaskVine by @tphung3
- Improved scheduler performance in Work Queue and TaskVine by @colinthomas-z80
- Multiple improvements to reliability at scale with physics applications by @btovar
- Change to API for cancelling tasks: all tasks are now returned by
vine_waitby @dthain - Change to serverless resource management: functions consume library resources by @dthain
- Improved visualization by @JinZhou5042
- New environment.yml for development dependencies by @thieber22
Full Changelog: nightly...release/7.7.0
Contributors
Assets 6
release/7.6.2
We are pleased to announce the release of version 7.6.2
of the Cooperative Computing Tools from the University of Notre Dame,
including TaskVine, Work Queue, Makeflow, Parrot, Chirp, and other software.
- Docs: https://cctools.readthedocs.io/
- Download: http://ccl.cse.nd.edu/software/download
- Forum: http://ccl.cse.nd.edu/community/forum
This is a bug fix release that addresses several minor issues:
Bug Fixes
- dttools: fix too many open files by @tphung3 in #3416
- Vine Futures Executor by @BarrySlyDelgado in #3403
- TaskVine: fix FunctionCall API, update example, and add test by @tphung3 in #3418
- Vine: Removed Serverless Test by @dthain in #3426
- TaskVine + Poncho: Add env option serverless by @tphung3 in #3427
- adds del dummy method to WorkQueue by @btovar in #3428
- Vine: Fix worker crash when using serverless. by @dthain in #3435
- Vine: Fix two core bugs. by @dthain in #3437
Test Infrastructure
- Build: Add Python deps to docker images. by @dthain in #3421
- Vine: Remove test for poncho to force test run. by @dthain in #3422
- Parrot: Fix test cases. by @dthain in #3424
- Build: Add Conda developer platform. by @dthain in #3423
- Parrot: Fix test cases by @dthain in #3425
Full Changelog: release/7.6.1...release/7.6.2
Contributors
Assets 6
release/7.6.1
We are pleased to announce the release of version 7.6.1
of the Cooperative Computing Tools from the University of Notre Dame,
including TaskVine, Work Queue, Makeflow, Parrot, Chirp, and other software.
- Docs: https://cctools.readthedocs.io/
- Download: http://ccl.cse.nd.edu/software/download
- Forum: http://ccl.cse.nd.edu/community/forum
This release introduces several bug fixes and minor improvementsto the TaskVine workflow executor and Work Queue scheduler.
TaskVine:
- Fix bug in task scheduling that would result in manager hanging. (Colin Thomas)
- Fix bug in execution of Dask task graphs that would lead to a hang. (Ben Tovar)
- Fix bug in deployment of serverless LibraryTask. (Thanh Phung)
- Add option to specify Python package dependencies inline. (Barry Sly-Delgado)
- Add visualization of task graph and documentation. (Douglas Thain)
Work Queue:
- Fix bug in task scheduling that would result in manager hanging. (Colin Thomas)