Steep 5.1.0 has just been released
I’m very happy to announce that Steep 5.1.0 has just been released. This version introduces a new web-based user interface, which looks very modern, is responsive, and provides many features that make work with workflows and process chains easier. Steep 5.1.0 also adds new HTTP endpoints and stores information about created VMs in the database. The version has been thoroughly tested in practice over the last couple of months.
Steep is a scientific workflow management system that can execute data-driven workflows in the Cloud. It is very well suited to harness the possibilities of distributed computing in order to parallelise work and to speed up your data processing workflows, no matter how complex they are and regardless of how much data you need to process. Steep is an open-source software developed at Fraunhofer IGD. You can download the binaries and the source code of Steep from its GitHub repository.
- New web-based user interface
- Modern look
- Responsive (works on mobile devices)
- Filters for workflows, process chains, etc. (e.g. show only failed process chains)
- … many more features
- Add possibility to configure a pool of remote agents for which to create VMs
- Cloud VMs are now kept in the database
- Add HTTP endpoint for VMs
- Access information about created VMs
- Get reason why a VM was destroyed
- Fetch VMs by status
- Improved HTTP endpoint for workflows
- Add possibility to fetch workflows by status
- Provide required capabilities of workflows
- Add support for Cross-Origin Resource Sharing (CORS)
- Allow multiple SSH commands to be executed in parallel while creating new VMs
- Add possibility to disable controller
- Log agent capabilities on startup
- Add interface for initializer plugins
- Speed up discovery of plugins and service metadata
- Update Gradle to 6.3
- Update Kotlin to 1.3.72
- Include conf directory in distribution
- Allow the Steep start script to be run from anywhere
- Include results of partially succeeded submissions in the HTTP response
Posted by Michel Krämer
on 15 May 2020
Two new cloud-based data processing papers published
My latest research papers about “Capability-based Scheduling of Scientific Workflows in the Cloud” and “Scalable processing of massive geodata in the cloud” are now available.
GeoRocket: A scalable and cloud-based data store for big geospatial files
My paper about GeoRocket’s software architecture has just been published in Elsevier’s SoftwareX. The article explains how GeoRocket manages very large geospatial datasets in the cloud.
Steep - Run Scientific Workflows in the Cloud
I’m thrilled to announce that the workflow management system I’ve been working on for the last couple of years is now open-source! Read more about Steep and its features in this blog post.
The new version of the scientific workflow management system contains many new features including an improved workflow syntax, better parallelization, workflow priorities, and full-text search. It also fixes a few bugs.
I’ve just released a new version of my scientific workflow management system Steep. It introduces live process chain logs, improved VM management, and many other new features. This post summarises all changes.