In this paper, we describe a novel approach of combining an emotion voice aware system with a fuzzy logic system to develop embedded agents aimed at creating an Ambient Intelligent Environment (AIE). This combined approach was evaluated in the GUC intelligent Classroom (iClass) which a is real world AIE testbed. The developed system aims to control the user environment on his behalf while taking into account the user's emotions. The agent learns online the fuzzy membership functions and rules from the user monitored actions to generate an agent that models the user behavior in an educational AIE like the iClass. The agent then operates in a life long learning mode where the agent can be adapted over long time intervals to the user's changing desires and preferences.