Show HN: Tabby – AI Coding Assistant Runs on Apple M1/M2 GPU

Read Post
Hi HN, after five months of hard work since Tabby's previous Show HN (https://news.ycombinator.com/item?id=35470915), I'm thrilled to share you the release of Tabby v0.1.1.

Previously, Tabby ran exclusively on CUDA devices, posing a significant barrier for developers looking to effectively utilize LLMs in their day-to-day coding.

The Tabby team made a significant contribution by enhancing support for the StarCoder series models (1B/3B/7B) in llama.cpp. This enhancement allows these models to run on Metal, providing comparable performance to that of an NVIDIA GPU.

I eagerly look forward to receiving feedback from the community and witnessing the enhanced on-edge deployment experience!

References:

[1] Apple Installation Instructions: https://tabby.tabbyml.com/docs/installation/apple/

[2] Launch blog: https://tabby.tabbyml.com/blog/2023/09/18/release-0-1-1-meta...


Get Top 5 Posts of the Week



best of all time best of today best of yesterday best of this week best of this month best of last month best of this year best of 2024 best of 2023 yc w25 yc s24 yc w24 yc s23 yc w23 yc s22 yc w22 yc s21 yc w21 yc s20 yc w20 yc s19 yc w19 yc s18 yc w18 yc all-time 3d algorithms animation android [ai] artificial-intelligence api augmented-reality big data bitcoin blockchain book bootstrap bot css c chart chess chrome extension cli command line compiler crypto covid-19 cryptography data deep learning elexir ether excel framework game git go html ios iphone java js javascript jobs kubernetes learn linux lisp mac machine-learning most successful neural net nft node optimisation parser performance privacy python raspberry pi react retro review my ruby rust saas scraper security sql tensor flow terminal travel virtual reality visualisation vue windows web3 young talents

andrey azimov by Andrey Azimov