Whisper.cpp and llama.cpp also work with Vulkan. | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		lostmsu 9 days ago \| parent \| context \| favorite \| on: Robotopia: A 3D, first-person, talking simulator Whisper.cpp and llama.cpp also work with Vulkan.

tom_0 8 days ago [–]

Yeah, I researched this and I absolutely missed this whole part. To my defense I looked into this in 2023 which is ages ago :) Looks like local models are getting much more mature.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact