With the rapid development of artificial intelligence, the Internet of Things and big data, etc., the smart home enters the Era 3.0, which profoundly relies on user-based big data mining and deep learning. At present, smart interaction, intelligent perception, and complex decision-making in the smart home urgently need new supporting technologies and methods. This paper integrated a large amount of frontier research worldwide and summarized and refined the three elements required for the future smart home: "perception" "thinking" and "execution". This paper began with an overview of the frontier platforms for smart homes in China and abroad, followed by an elaboration and review of the research on data collection, feature extraction, perception in smart home scenarios, and multimodal human-computer interaction and innovation scenarios for smart homes, respectively. The authors presented a series of related research work of Future Lab in the smart home field for researchers in related fields.

smart home  /  affective computing  /  intelligent perception  /  multimodal interaction