[WIP, do not review] Polling-based asynchronous verbose mode for execution time-tracking

[avmanerikar]

Description

This PR is an alternative approach to the callback-based asynchronous verbose mode implemented in PR #4187 - the method relies on a periodic event polling to record and log profiling info. The motivation to using this approach is to have a unified implementation for the asynchronous mode that does not rely on runtime-specific callback APIs.

The implementation addresses points that the callback-based approach fails to triage:

• Event-polling does not rely on runtime-specific callback API (required for supporting L0 runtime).
• The callback method does not triage MFDNN-14331 for SYCL graphs.

Failing reproducer for SYCL Graph:

DNNL_VERBOSE=1 .\tests\benchdnn\benchdnn.exe --eltwise --engine=gpu --execution-mode=graph 1

• Extension to CPU Threadpool is difficult with callback-based method.

This prototype is implemented for OpenCL GPU runtime.