Steep 5.3.0 has been released

A new minor version of my workflow management system Steep is now available. The most notable changes in version 5.3.0 are the deprecation of the argument type argument in the process chain model and service metadata as well as the deprecation of parameters of execute actions in the workflow model. Both properties were mostly unnecessary. The argument type argument should be changed to input, and parameters of execute actions should be merged into their inputs.

This change is completely backwards compatible. Steep will automatically modify posted workflows and the configured service metadata. It will issue a warning in the log file if it encounters deprecated properties. You should migrate to the new ones as soon as possible as the deprecated ones will be removed in Steep 6.0.0 or with the workflow API 5.0.0.

Existing workflows and process chains in your database will automatically be migrated to the new model if necessary.

Steep 5.3.0 also comes with a few other improvements and fixes (see complete list below). The version has been thoroughly tested in practice over the last couple of months.

Steep is a scientific workflow management system that can execute data-driven workflows in the Cloud. It is very well suited to harness the possibilities of distributed computing in order to parallelise work and to speed up your data processing workflows, no matter how complex they are and regardless of how much data you need to process. Steep is an open-source software developed at Fraunhofer IGD. You can download the binaries and the source code of Steep from its GitHub repository.

New features

  • Allow separate SSH usernames per setup to be configured
  • Allow additional environment variables to be configured that will be passed to containers created by the Docker runtime
  • Add validator that checks for common mistakes in posted workflows. Invalid workflows will be rejected with HTTP status code 400.
  • Use new web UI by default. The old UI is now deprecated and will be removed in one of the next versions.
  • Deprecate action parameters and service arguments:
    • Parameters of execute actions are actually unnecessary because they have the same structure as inputs. I’ve decided to deprecate parameters. They will be removed in Steep 6.0.0. In the meantime, parameters of an execute action in a posted workflow will automatically be merged into its inputs. A warning will be logged.
    • The same applies to service parameters with the type argument. They are unnecessary because they can be easily mapped to inputs. I’ve deprecated the type argument and will remove it in Steep 6.0.0. For the time being, argument will automatically be replaced by input in your services.yaml file. A warning will be logged.
  • Add database migration to remove deprecated data model properties. This will rename the argument type argument in process chains to input and merge parameters of execute actions into their inputs.

Maintenance

  • Bump lodash from 4.17.15 to 4.17.19

Bug fixes

  • Prevent duplicate setup IDs
  • Do not throw exception in NotifyingSubmissionRegistry if VM does not exist
  • Update websocket-extensions to 0.1.4
  • Fix position of text in dropdown button

Profile image of Michel Krämer

Posted by Michel Krämer
on 24 July 2020


Next post

bson4jackson 2.11.0

This version is a maintenance release that updates Jackson and fixes some minor issues. Performance of the UTF-8 decoder has been improved and precision of BigDecimals has been increased. Updating is recommended for all users.

Previous post

Two new cloud-based data processing papers published

My latest research papers about “Capability-based Scheduling of Scientific Workflows in the Cloud” and “Scalable processing of massive geodata in the cloud” are now available.

Related posts

Steep 6.0.0

The new version of the scientific workflow management system contains many new features including an improved workflow syntax, better parallelization, workflow priorities, and full-text search. It also fixes a few bugs.

Steep - Run Scientific Workflows in the Cloud

I’m thrilled to announce that the workflow management system I’ve been working on for the last couple of years is now open-source! Read more about Steep and its features in this blog post.

Steep 5.7.0

I’ve just released a new version of my scientific workflow management system Steep. It introduces live process chain logs, improved VM management, and many other new features. This post summarises all changes.