AirLLM 70B inference with single 4GB GPU

Article URL: https://github.com/lyogavin/airllm Comments URL: https://news.ycombinator.com/item?id=49154228 Points: 60 # Comments: 27