I have kernel (fused attention) that deals with 4d tensors. and it fails with.
File "/home/jovyan/lighthouse/examples/xegpu/fused_attention.py", line 362, in <module>
times = runner.benchmark(
^^^^^^^^^^^^^^^^^
File "/home/jovyan/lighthouse/lighthouse/execution/runner.py", line 186, in benchmark
return self._execute_kernel(
^^^^^^^^^^^^^^^^^^^^^
File "/home/jovyan/lighthouse/lighthouse/execution/runner.py", line 154, in _execute_kernel
with allocator() as inputs:
File "/home/jovyan/miniforge3/envs/imex-dev-torch-mlir/lib/python3.11/contextlib.py", line 137, in __enter__
return next(self.gen)
^^^^^^^^^^^^^^
File "/home/jovyan/lighthouse/lighthouse/execution/memory_manager.py", line 139, in clone_host_buffers
buf = self.alloc(
^^^^^^^^^^^
File "/home/jovyan/lighthouse/lighthouse/execution/memory_manager.py", line 88, in alloc
assert rank in (1, 2), "Only 1d or 2d arrays are supported."
^^^^^^^^^^^^^^
AssertionError: Only 1d or 2d arrays are supported.
any plans for supporting this? workarounds also welcome.
I have kernel (fused attention) that deals with 4d tensors. and it fails with.
any plans for supporting this? workarounds also welcome.