Skip to content

Add support for Apple Intelligence#6

Merged
64bit merged 2 commits into64bit:mainfrom
tjweir:add-apple-intelligence-support
Apr 16, 2026
Merged

Add support for Apple Intelligence#6
64bit merged 2 commits into64bit:mainfrom
tjweir:add-apple-intelligence-support

Conversation

@tjweir
Copy link
Copy Markdown
Contributor

@tjweir tjweir commented Apr 16, 2026

Add On-device Apple Intelligence as a provider.

@64bit
Copy link
Copy Markdown
Owner

64bit commented Apr 16, 2026

Hey good idea!

I dont see the actual provider implementation?

Also this should not be behind feature gate because the cli can be installed using brew. But yes macos and arch64 in compilation cfg make sense.

For example see litert-lm implementation, where if required dependency is not installed it prompts user to visit link to doc hosted by Google - so we dont need to document - the cli guides user.

Do you mind making these changes and requesting a review?

@tjweir
Copy link
Copy Markdown
Contributor Author

tjweir commented Apr 16, 2026

Lulz, may be a good idea for me to add the files!

Apple Intelligence is at a system level. I suppose I could tell people what they need to do to enable it.

Copy link
Copy Markdown
Owner

@64bit 64bit left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Love it, thank you for adding Apple Intelligence support!

@64bit 64bit merged commit c66c648 into 64bit:main Apr 16, 2026
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants