audio: tdfb: Improve robustness for invalid configuration #23445

Job	Run time
manifest-check	2m 47s
LP64-WIP	3m 53s
build-linux (mnfst, tgl)	4m 56s
build-windows (mnfst, tgl)	11m 29s
build-linux (-d, mnfst, lnl)	4m 30s
build-windows (mnfst, tgl-h)	8m 25s
build-windows (mnfst, imx8m imx8ulp)	11m 20s
build-linux (mnfst, tgl-h)	4m 16s
build-linux (mnfst, mtl)	4m 37s
build-windows (mnfst, lnl)	10m 29s
build-linux (mnfst, wcl imx95)	7m 35s
build-linux (mnfst, imx8 imx8x)	5m 25s
build-windows (mnfst, mtl)	11m 41s
build-linux (mnfst, ptl)	5m 56s
build-windows (mnfst, imx8 imx8x)	10m 26s
build-linux (mnfst, imx8m imx8ulp)	5m 10s
build-linux (mnfst, lnl)	3m 52s
build-windows (mnfst, ptl)	11m 21s
build-windows (-d, mnfst, lnl)	9m 30s
compare-linux-win	25s
	2h 18m 3s

Provide feedback