Index command never start

[hkn-wt]

Hello, I try to index a large php codebase but when i run cocoindex-code index the process is stuck and a python3.13 process take all my memory. I'm on MacOS 26.3 M1 Pro 16Go.

❯ cocoindex-code index
⠂⠂ app_main: ▕                                        ▏0/1
⏳ Elapsed: 6.0s                                                                                                                                              Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads.
WARNING:huggingface_hub.utils._http:Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and fa⠒⠒ app_main: ▕                                        ▏0/1
Loading weights: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████| 103/103 [00:00<00:00, 5873.58it/s]
BertModel LOAD REPORT from: sentence-transformers/all-MiniLM-L6-v2
Key                     | Status     |  |
------------------------+------------+--+-
embeddings.position_ids | UNEXPECTED |  |

Notes:
⠐⠐ app_main: ▕                                        ▏0/1
✅ declare_target_state_with_child: ▕████████████████████████████████████████▏1/1: 1 added
⠤⠤ process_file: ▕                                        ▏0/21
⏳ Elapsed: 203.3s

[badmonster0]

@hkn-wt thanks a lot for reporting this! we will take a look and keep you posted!

[georgeh0]

Hi @hkn-wt ,

I happen to be using the same MacBook (MacOS M1 Pro) :) Just tried a large PHP codebase (not familiar with the eco-system, picked a random one magento2) and indexing work well for me.

From your output, "process_file ... 0/21" indicates that only 21 files are traversed and 0 finished processing. Since you mentioned it's a large codebase, looks like it's stuck at the first file somehow.

It can be a few reasons:

• The file is super large?
• Somehow there's an issue in running the GPU?

Can you try this to switch to CPU and see it starts to make progress:

export COCOINDEX_CODE_DEVICE=cpu
cocoindex-code index

From here we can narrow down the problem.

Thanks!