I think you can do *something like that* from Custom-UI, via attribute-packages.
See attached snapshots.
you can select a metric, then check the "violation of the upper/lower dynamic threshold as key indicator", and get KPI alert when that's breached.
worth a try 