guqiong96/Lsglang: Lsglang is a special extension of sglang that fully utilizes CPU and GPU computing resources with an efficient GPU parallel + NUMA parallel architecture, suitable for MOE model hybrid inference.
Related Stories
Show HN: Coldframe, a honeypot that poses as a supermarket fridge controller
Hacker News
1 hour ago
How Long Can Life Wait?
Hacker News
2 hours ago
They don't make 'em like that any more: Borland Turbo Pascal 7
Hacker News
2 hours ago
The Gordon Gekko Effect: The Role of Culture in the Financial Industry [pdf]
Hacker News
4 hours ago
The $8 Linux Computer (2022)
Hacker News
4 hours ago