Skip to content

Enable automatic rerun of post-processing when things change #330

Description

@ntalluri

Currently, SPRAS does not automatically rerun post-processing steps if the logic or configuration of those steps changes. (The only time the post processing is rerun is if the algorithms change in some manner - parameters or adding/removing an algorithm). This can lead to outdated results being used without the user's awareness. This will be a problem for the continuous benchmarking.

We want to expect that if a user updates a post-processing function or its configuration, SPRAS should automatically mark dependent outputs as outdated and rerun the corresponding steps.

Proposed solution:

  1. Add the config file as a parameter sent to each post processing step because it is timestamped and will trigger reruns.
  2. Otherwise Add logic to detect changes in post-processing functions or configuration files.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    analysisAnalysis of PRA outputsenhancementNew feature or request

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions