RunPod's new Generator Handler allows fetching /stream endpoint to get continuous updates on a job without the need for RunPod to send updates to your server as it had to be done previously.
The maximum size for a payload that can be sent using yield to stream results is 1 MB.
Needed steps are:
- Check if this limit is not exceeded in any situation.
- Change the handler type to the Generator one
- Add code that will yield previews to the handler
- Test it
RunPod's new Generator Handler allows fetching
/streamendpoint to get continuous updates on a job without the need for RunPod to send updates to your server as it had to be done previously.Needed steps are: