Incremental resources controller

[stemangiola]

I remember the discussion about dropping the incremental resource controller

library(crew.cluster)
controller <- crew_controller_sge(
  name = "my_workflow", # for informative job names
  workers = 16,
  tasks_max = 2, # to avoid reaching wall time limits
  seconds_idle = 10, # to release resources when they are not needed,
  # Try 16 GB memory first, then use 32 GB to retry if the worker crashes,
  # then 64 GB for all subsequent retries after failure. Go back to 16 GB
  # if the worker completes all its tasks before exiting.
  sge_memory_gigabytes_required = c(16, 32, 64),
  script_lines = "module load R" # if R is an environment module
)
controller$start()

But I still see it here. Could I have an update on the plans to deprecate this formulation in favour of the multi-controller? I guess this will break at some point, so I expect to have to refactor my code. (?)

Thanks.

[wlandau]

It's deprecated already. You'll see it if you upgrade to crew.cluster 0.3.8

[stemangiola]

So am I reading it well, that the usage section should be updated as it displays the old framework?

[wlandau]

Oh, I forgot about the README. fixed in 2483049

[stemangiola]

For completeness, the alternative strategy (I believe) is described here

https://wlandau.github.io/crew/articles/groups.html#backup-controllers

Please @zhanchen make sure we have updated our pipelines to this new framework to prevent errors due to deprecation.

@

[stemangiola]

@zhanchen