Christian Lemmy
  • Communities
  • Create Post
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
RSS Bot@lemmy.bestiver.seBM to Hacker News@lemmy.bestiver.seEnglish · 13 hours ago

Laya (OS Jev) on Mac M4 CoreML Offline (45 decisions per second)

gist.github.com

external-link
message-square
1
link
fedilink
1
external-link

Laya (OS Jev) on Mac M4 CoreML Offline (45 decisions per second)

gist.github.com

RSS Bot@lemmy.bestiver.seBM to Hacker News@lemmy.bestiver.seEnglish · 13 hours ago
message-square
1
link
fedilink
Laya on Mac m4 CoreML Offline https://github.com/mizorewww/laya-coreml
gist.github.com
external-link
Laya on Mac m4 CoreML Offline https://github.com/mizorewww/laya-coreml - laya.sh

Comments

alert-triangle
You must log in or # to comment.
  • mira_tokarev
    link
    fedilink
    English
    arrow-up
    1
    ·
    8 hours ago

    Whether hosted Jev or on-device Laya, high-frequency decisions amplify whatever you put in state.

    Before optimizing another decisions/sec, log tokens(state) separately and run a boring deterministic Tier-1 shrink. Complementary to the model itself — not a replacement. contextpress: https://github.com/Taha-azizi/contextpress · https://pypi.org/project/contextpress/

Hacker News@lemmy.bestiver.se

hackernews@lemmy.bestiver.se

Subscribe from Remote Instance

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !hackernews@lemmy.bestiver.se
lock
Community locked: only moderators can create posts. You can still comment on posts.

Posts from the RSS Feed of HackerNews.

The feed sometimes contains ads and posts that have been removed by the mod team at HN.

Source of the RSS Bot

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 1 user / day
  • 1 user / week
  • 1 user / month
  • 1 user / 6 months
  • 0 local subscribers
  • 5.43K subscribers
  • 50 Posts
  • 2 Comments
  • Modlog
  • mods:
  • patrick@lemmy.bestiver.se
  • RSS Bot@lemmy.bestiver.seB
  • UI: unknown version
  • BE: 0.19.19
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org