Show HN: Shoehorn – Quantize any model down to run on your machine
5 by rhgraysonii | 2 comments on Hacker News.
Working on Mac, Linux, and Windows now. I include a simple GUI to find new models and get things built and set up. It is working quite well across a few models for me. The GitHub README and DESIGN.md files go into detail of the how/why and it's working remarkably well so far. https://ift.tt/GAwV98b
No comments:
Post a Comment