Steep 5.3.0 has been released
A new minor version of my workflow management system Steep is now available.
The most notable changes in version 5.3.0 are the deprecation of the argument
type argument
in the process chain model and service metadata as well as
the deprecation of parameters
of execute actions in the workflow model. Both
properties were mostly unnecessary. The argument type argument
should be
changed to input
, and parameters
of execute actions should be merged into
their inputs
.
This change is completely backwards compatible. Steep will automatically modify posted workflows and the configured service metadata. It will issue a warning in the log file if it encounters deprecated properties. You should migrate to the new ones as soon as possible as the deprecated ones will be removed in Steep 6.0.0 or with the workflow API 5.0.0.
Existing workflows and process chains in your database will automatically be migrated to the new model if necessary.
Steep 5.3.0 also comes with a few other improvements and fixes (see complete list below). The version has been thoroughly tested in practice over the last couple of months.
Steep is a scientific workflow management system that can execute data-driven workflows in the Cloud. It is very well suited to harness the possibilities of distributed computing in order to parallelise work and to speed up your data processing workflows, no matter how complex they are and regardless of how much data you need to process. Steep is an open-source software developed at Fraunhofer IGD. You can download the binaries and the source code of Steep from its GitHub repository.
New features
- Allow separate SSH usernames per setup to be configured
- Allow additional environment variables to be configured that will be passed to containers created by the Docker runtime
- Add validator that checks for common mistakes in posted workflows. Invalid workflows will be rejected with HTTP status code 400.
- Use new web UI by default. The old UI is now deprecated and will be removed in one of the next versions.
- Deprecate action parameters and service arguments:
- Parameters of execute actions are actually unnecessary because they have the same structure as inputs. I’ve decided to deprecate parameters. They will be removed in Steep 6.0.0. In the meantime, parameters of an execute action in a posted workflow will automatically be merged into its inputs. A warning will be logged.
- The same applies to service parameters with the type
argument
. They are unnecessary because they can be easily mapped to inputs. I’ve deprecated the typeargument
and will remove it in Steep 6.0.0. For the time being,argument
will automatically be replaced byinput
in yourservices.yaml
file. A warning will be logged.
- Add database migration to remove deprecated data model properties. This will
rename the argument type
argument
in process chains toinput
and mergeparameters
of execute actions into theirinputs
.
Maintenance
- Bump lodash from 4.17.15 to 4.17.19
Bug fixes
- Prevent duplicate setup IDs
- Do not throw exception in
NotifyingSubmissionRegistry
if VM does not exist - Update websocket-extensions to 0.1.4
- Fix position of text in dropdown button
Posted by Michel Krämer
on 24 July 2020
Next post
bson4jackson 2.11.0
This version is a maintenance release that updates Jackson and fixes
some minor issues. Performance of the UTF-8 decoder has been improved
and precision of BigDecimals
has been increased. Updating is recommended
for all users.
Previous post
Two new cloud-based data processing papers published
My latest research papers about “Capability-based Scheduling of Scientific Workflows in the Cloud” and “Scalable processing of massive geodata in the cloud” are now available.
Related posts
Steep 6.0.0
The new version of the scientific workflow management system contains many new features including an improved workflow syntax, better parallelization, workflow priorities, and full-text search. It also fixes a few bugs.
Steep - Run Scientific Workflows in the Cloud
I’m thrilled to announce that the workflow management system I’ve been working on for the last couple of years is now open-source! Read more about Steep and its features in this blog post.
Steep 5.7.0
I’ve just released a new version of my scientific workflow management system Steep. It introduces live process chain logs, improved VM management, and many other new features. This post summarises all changes.