Facemoji

A voice chatbot that can imitate your expression.

This is a Unity project (just for Android now), which has two modules.

One is FaceTracking, which using OpenCV and Dlib to detects facial expressions, converts them into Live2D model, and record gif.
The other is AI ~~(chatbot)~~, which uses Turing Robot, Iflytek IAT and Iflytek TTS to make a voice chat.

English | 简体中文

Releases

Setup

Download shape_predictor_68_face_landmarks.dat(Facial Landmark Detector) and Facemoji_Plugins_Assets_1.5.0.unitypackage(Streamlined OpenCV, Dlib, Live2D and Iflytek Assets Library) from Drive.Google or Pan.Baidu
git clone https://github.com/huihut/Facemoji.git
Create new Unity project (called FacemojiDemo)
Copy Facemoji/Assets and Facemoji/ProjectSettings to your unity project (FacemojiDemo/)
Copy shape_predictor_68_face_landmarks.dat to your FacemojiDemo/Assets/StreamingAssets/
Import Facemoji_Plugins_Assets_1.5.0.unitypackage
Select Android platform
Build & Run

Usage

FaceTracking

Using OpenCV and Dlib to detects facial expressions, converts them into Live2D model.

She can move with your face and you can try shaking your head.

Record gif

The middle of the above is the record button, you can record 3 seconds gif.

Recorder State : Recording(Ready to record) -> PreProcessing(Is recording) -> Paused(Compressing gif) -> Recording(Ready to record)

Save the gif in Application.dataPath

(Android in /storage/emulated/0/Android/data/com.huihut.facemoji/files/)

Voice and text chat (chatbot? She said she is AI, not Robot! hhhh...)

Using Turing Robot, Iflytek IAT and Iflytek TTS.

You can chat with her by voice or text.

She's a great AI ~~(robot)~~, and she can:

Chat
Encyclopedia
Calculate
Tell a story
Tell a joke
Idiom Solitaire
Horoscope
Weather forecast
...

But because she is a Chinese robot(Turing robot only supports Chinese), she can only chat in Chinese.

~~She will chat in English later.~~

Preview

Gif

Come On !
No~ No~
Wink !

License

GPL v3.0

Project Name	Stars	Repos Using This	Packages Using This	Most Recent Commit	Total Releases	Latest Release	Open Issues	License	Language
Jovo Framework	1,647	46	31	5 days ago	212	February 17, 2022	22	apache-2.0	TypeScript
🔈 The React for Voice and Chat: Build Apps for Alexa, Google Assistant, Messenger, Instagram, the Web, and more
Alan Sdk Reactnative	560			a month ago	21	June 02, 2022	7		Ruby
In-App assistant SDK to build a multimodal conversational UX for applications created with React Native (iOS, Android)
Alan Sdk Pcf	426			a month ago
Build a voice assistant for any application created with Microsoft Power Apps
Facemoji	256			4 years ago				gpl-3.0	C#
😆 A voice chatbot that can imitate your expression. OpenCV+Dlib+Live2D+Moments Recorder+Turing Robot+Iflytek IAT+Iflytek TTS
Gpt Voice Conversation Chatbot	149			7 days ago			6	gpl-3.0	Python
Allows you to have an engaging and safely emotive spoken / CLI conversation with the AI ChatGPT / GPT-4 while giving you the option to let it remember things discussed.
Livewhisper	127			a month ago				mit	Python
A nearly-live implementation of OpenAI's Whisper, using sounddevice. Requires existing Whisper install.
Leopard Chat Ui Teneo	65			a year ago			13	apache-2.0	Vue
Leopard Chat UI - A Teneo Chat Client based on Vue and Vuetify
Chatbot	48			a year ago			2	apache-2.0	Jupyter Notebook
Hybrid Conversational Bot based on both neural retrieval and neural generative mechanism with TTS.
Voice Assistant	38			6 days ago				mit	C++
A lightweight intelligent voice assistant built on tools such as Snowboy, Whisper, ChatYuan and Azure TTS
Gpt_chatbot	31			a month ago			1		Python
This chatbot lets you use your microphone to communicate with GPT-4. It uses the Windows TTS to respond with a voice. It uses Pinecone to store long term information and retrieves it to create context. API keys for OpenAI and Pinecone required. Tested on Windows