Abstract：Using Hand Postures for Interacting with Assistant Robot in Library Visual interpretation of hand gesture for human-system interaction in general and human-robot interaction in particular is becoming a hot topic in computer vision and robotics fieldsHand gestures provide very intuitive and efficient means and enhance th Consulting ServiceUsers can interact with the librarys service robots more intuitively and efficiently through a gesture recognition systemDiscusses how gesture recognition is used in computer vision and robotics for human-machine interactionespecially human-robot interactionGestures provide a very intuitive and efficient way of communicationDespite numerous studies on gesture recognitiontheir application in real-world human-robot interaction remains limitedBased on our previous research on hand detection and gesture recognitionwe developed a fully automated gesture recognition system and applied it to a human-robot interaction applicationa library service robotThis article details the various aspects of this applicationfrom user needs analysis to system deployment and experiments with end-users