This desktop pet uses Gemini Live and GPT realtime for realtime conversation, and jev for model pose control. Check the github for how to create a controllable model.