cubicweb-subprocess #13306495 avoid cw_set + commit on each line read from the subprocess [open]

In cubicweb-subprocess 0.3.0, each time the subprocess emits a line on stdout or stderr, the cube executes a cw_set + a commit to the database (to enable tail-like feature in the browser I guess).

When the process outputs hundreds or thousands of lines, this becomes a performance killer for a feature one might not even need.

I suggest either :

  • to provide options such as tailmode=True/False, bufsize=X, timeout=X that would let the client specify the flush-to-db policy,
  • or to provide alternative implementation / views to keep the "tailmode" feature in the browser.
priorityimportant
typeenhancement
done in<not specified>
closed by<not specified>