International Journal of Advances in Engineering Science and Technology Available online at www.ijaestonline.com

111 ISSN: 2319-1112

FACE RECOGNITION APPROACHES USING SIXTH SENSE TECHNOLOGY: A REVIEW Charan Pratap Singh1, Pratap Srivastava2, M.Tech Scholar ,Faculty of Engineering1 M.Tech Faculty of Engineering2 Email: [email protected] ABSTRACT This paper deals with the Sixth Sense, a tool that connects the physical world with the world of data. It’s a high tech device which can supplement the physical world around us with digital information. This wearable device has the capability of turning everything to touch screen just by capturing the gestures of a person. But alongside it has led to invention to another concept having the same point but by using commands instead of gestures. For orders face recognition technique is used algorithms with the sixth sense method. Here the database is used which will be initially trained for storage. With this model, our goal is to demonstrate, within a neurobiological framework, the ability of network that process details of any person just by capturing the natural photographs. It implements the similar command which will gain access to the operation from the mobile device associated to it and action finally projector is used for projection over any surface. Because of its cost constraint it’s more likely to be implemented in future. Keywords : Sixth sense, face recognition, projector, mobile device, spike neural networks

I. INTRODUCTION Sixth Sense Technology is an innovatory idea to boundary the physical world with digital in sequence. It is a Wearable Gestural Device in which there is a pocket projector attached with a camera and a mobile which acts as the machine and connected to the cloud, the projected output competence and accuracy of this innovative technology depends upon the position of camera, which is a major constraint in the image capturing system and this constraint leads to innovatory idea of using another technique instead of hand gestures. in this technique the repeatedly performed proceedings in our daily life are improved to commands and are trained to face recognition software and keep in database. Next the related trial are execute whenever the face is known from the user as the recognition of hand gestures were done in former technique. These Hi-Tech Devices allow integration of analog information with our everyday physical world smoothly. This method has the capability of identifying the face and projecting the details on any surface within fractions of seconds, and the action is projected on the surface. The return of such a device is its handy the act that we on a regular basis perform in proposed algorithm.

II.WORKING LAYOUT In Starting the workings of sixth sense technology engage the use of gestures. The client finger tips are colored with markers and thus gestures performed are captured by the camera. Then the digital in sequence form of video streams is given to the mobile device for the corresponding action to be processed. The action is projected on the surface through the projector. Software algorithms and computer vision technologies are being used to enable the action from the mobile device for the corresponding gesture tracked and captured by the camera. This gesture based technology imparts several varieties of applications which highlight its usefulness, flexibility and viability of the system. It includes basic actions of zooming in , out or pan using intuitive hand movements, locating points in the map, watching video in newspaper, dialing number in hand etc. But as technology advances and modification are required in the existing method. Now when we see any person and we want to know about his profile without asking

ISSN: 2319-1120 /V4N3: 111-117 © IJAEST

Face Recognition Approaches Using Sixth Sense Technology: A Review 112 him, then such a boring task could be expert by doing few additions in the above mention process which can lead to the use of neural networks for face Classification which will produce analog signals. The analog data is changed into digital and perform as deed, as all times the gestures cannot be used. The above figure shown above shows how the wearable device is built-in to the human body .Here color markers are been used in the finger tips. In our technology we use spiking neural networks (SNN) for the theater the same operation. Many high knowledge face recognition develop our operation with more advanced facial appearance. In order to ensure perfect gesture recognition and sensitive interface a number of constraint are functional. .

Fig1: Representation of Gesture Based Design

A region in the front of the ledge screen is defined as the active zone and the gestures are ignored, if the gestures are performing out of this area. Gestures are also defined by a set start posture, end posture and energetic motion between the start and end postures. Maybe the use of gestures becomes more powerful when combined with other input modalities, especially voice.

III. MOTIVATION AND BACKGROUND In the past era evolved such as enlarged truth which is doomed to add in rank and gist to real entity or place. not like virtual reality, enlarged truth does not create a copying of actuality as a choice it takes a real object or space as the base and integrate technologies that add correlated data to deepen a person understanding of the subject. Gesture recognition is a term with that deals with interpreting human gestures through mathematical gestures and statistical algorithms. Computer vision is that expertise of technology that concerns with the theory behind mock systems that extract information from the images. As a scientific discipline, computer vision seeks to apply its theories and models to the construction of computer vision systems. The examples include the controlling processes, detecting events; arrange in sequence, modeling stuff or environment and interface. Just face recognized software’s are evolved which finds applications in car mechanization and home appliances. It eases the operation and saves the function time of the manual operation performed by the human’s every day. The software which performs such tasks is known as face recognition engine. The primary function of this is to process the input i.e. the face detected by the FR software.

IV.DESIGN AND WORKING Device comprises (sixth sense) of; 1. Face identification 2. Mobile identification device 3. Mobile projector

ISSN: 2319-1120 /V4N3: 111-117 © IJAEST

IJAEST, Volume 4, Number 3 Charan Pratap Singh and Pratap Srivastava 4. Mirror or reflector Also known as "Palmtop" or simply handheld The sixth sense device is a mini projector coupled with face recognition and a cell phone, which acts as a computer and our relation to the cloud, all the information stored on the web. The means are controlled by the mobile computing device carried in the user’s pocket. The hardware components are attached in a mobile wearable device. The face recognition and the projector both are connected to the mobile computing device. The projector projects the visual information enabling surfaces, walls and physical objects all over the place to the user to be used as boundaries. While the face recognition stores commands which were trained by the user and performs the matching action via projector, allowing the actions from the mobile device. Also a remote computer can also be connected which gathers data from user, processes it, searches the web for related implementation of the facility and proceeds the result in real time to the user. The face recognition is skilled with regularly used operating data and thus it acts as a database for storing all such instructions. There are many face integrated circuits with fabulous technical aspects that can be embedded for vast kind of applications. The IC will be trained with a sophisticated neural network to recognize the commands and activate it correspondingly. The face recognition is initially trained with the images or pictures. The user gives the input as commands and when such speech is received to the FR and In this section we

briefly review some of the technologies that have been used for face recognition. In overall, face identification systems continue by detecting the face in an image or outcome, with the end conclusion of guessing and regularizing for conversion, scale and in-plane spin. Given a regularized image or outcome, the topographies, either universal or local, are take-out and reduced in a compact face illustration which can then be stored in a database or a smartcard and likened with face representations resulting at later times.The data is converted into digital and is sent to the mobile device. Therein the mobile device triggers the command and in turn conveys to the projector. The projector projects the output on the screen through the mirror or reflector for correct projection from the projector which is wearable in the body.

Fig 2: Basic Design of Our Concept

ISSN: 2319-1120 /V4N3: 111-117 © IJAEST

Face Recognition Approaches Using Sixth Sense Technology: A Review 114

The flowchart shown above gives the basic idea of our concept. For more advanced operations and for accessing net which is our future work, can be accessed from the remote computer simultaneously and projected as before.

Flow chart of our system

V. APPLICATIONS The basic processes such as enabling clock, inbox, Surfing, examining gallery, calendar, seeing contact list etc. that are performed regularly in the mobile every time. Apart from these areas with the help of integrated FR technique it finds applications in many others fields especially in the field of security. An all the information can be accessed on the monitor or on any external layer using our technology and skill within fractions of seconds.

Fig 3. Example of Commonly Used Applications

ISSN: 2319-1120 /V4N3: 111-117 © IJAEST

IJAEST, Volume 4, Number 3 Charan Pratap Singh and Pratap Srivastava

This layout clearly states the pros and cons of both the Gestural use and Audio mode of technology in our concept of sixth sense. Both methods have their own strengths contingent upon the kind of applications we used.

VI. PLANNED TECHNIQUES AND ANALYSIS A. Six Sense Technology Its wearable gestural boundary that augment the physical world everywhere with digital information and lets us use natural hand gestures to work together with that information. The tactic used is based on the SST where user has some devices which in concert acts as a structure. Our object is to move mouse cursor as the user moves hand fingers. For this purpose, three components of Sixth Sense are used i.e. Camera, Coloured Caps and Microsoft Visual studio and MATLAB installed in Laptop/computer. We proposed a algorithm for this system and also make a sample model. The method we use is based on Sixth sense technology where user has some devices such as a laptop embedded with webcam for capture the live video of the user, a open source software for processing the input and recognize the colours at the fingertips of the user. The aim of our project is to move the mouse cursor on the screen in accordance with the finger movements of the user. The following figure shows the hardware devices we have used for tentative purpose.

ISSN: 2319-1120 /V4N3: 111-117 © IJAEST

Face Recognition Approaches Using Sixth Sense Technology: A Review 116 The emergence of Neural Network technology has provided many promising results in the field of complex or other computer and analytical methods. The Neural Network is a massively parallel distributed information processing system based on the models resulting from study on the environment of human brains, and has many distinct advantages for modeling and simulation. So, there is no doubt that the neural network is a powerful computation tool for estimation in the areas where few data are available. Due to the skill of Neural Network to recognize and study the input-output designs without being openly programmed to do so, it has become a potential research area with great possible. There are the main advantages are listed below; 1. 2. 3. 4.

Self-Organization: in Neural Network during learning time we can represent organize the information. Adaptive learning: How to perform data given for training and initial experience. Real Time Operation: ANN computations can be accepted out in similar and special devices are designed and manufactured. Fault Lenience via Redundant Information: Partial destruction of a network leads to the corresponding degradation.

Fig.4:camera initialization

VII.CONCLUSION This technology using gesture movement and face recognition integrated circuits are emerging innovative ideas. We can have picture perfect access to data or information that may exist to help us make decision. This provides access to relevant information about the people that occupies our environment and enables the new interactions between the real world and the world of data. Even if the miniaturisation of computing devices allows us to carry computers in our pockets Its residential to like a dream put together in sequence into truth. The future may depend upon this sixth sense. May be within this 2020, the proliferation and these of this technology is in immense. Sufficient awareness of the sixth sense will lead to additional growth and the development of any technology which aids for getting information and performing any type of achievement basically at any time, using simply the gestures and instructions or commands given. The advantage of this technology is may be its all one piecebetween the world and the information as image. Its cost effectiveness and data can edited from the mechanism straight in real time. It can

ISSN: 2319-1120 /V4N3: 111-117 © IJAEST

IJAEST, Volume 4, Number 3 Charan Pratap Singh and Pratap Srivastava also be said as an open source technology. Next twenty years this technology will take a strong change in field of science and will create innovative change among the mass.

REFERENCES [1].

[2].

[3]. [4]. [5]. [6].

[7]. [8]. [9].

[10].

[11]. [12]. [13]. [14]. [15]. [16]. [17]. [18]. [19]. [20]. [21]. [22].

Alon,J.Athitsos,V.Quan,YuanSclaroff,S. computer Science Dept.,Boston Univ., Boston, MA, USA, A Unified Framework for GestureRecognition and Spatiotemporal Gesture Segmentation, IEEEtransactions on Pattern Analysis and Machine Intelligence, Volume:31, Issue:9 pp 1685 - 1699 ., Sept. 2009 Mu-Chun SuInst. Of Computer Science & Inf. Eng., Nat. CentralUniv., Chung-Li A fuzzy rule-based approach to spatio-temporal hand gesture recognition, Systems, Man, and Cybernetics, Part C: Applications and Reviews, IEEE Transactions on Volume: 30, Issue: 2 pp276 – 281. May 2000 Kirishima, T. Sato, K. Chihara, K.Dept. ofElectr. Eng., Nara Nat. Coll.of Technol., Japan Robotics, Gesture Spotting and Recognition for Human–Robot Interaction, IEEE Transactions on Volume: 23,Issue:2 pp256 – 270., April 2007 Real-time gesture recognition by learning and selective control of visual interest points: Pattern Analysis and Machine Intelligence,IEEE Transactions on, Volume: 27 , Issue:3, pp351 – 364., March2005 Ozer, I.B. Tiehan Lu Wolf, W. Princeton Univ., NJ, USA Design of a real-time gesture recognition system: high performance through algorithms and software Signal Processing, IEEE Volume: 22, Issue:3,pp 57 – 64., May 2005 Evans, J.R. Tjoland, W.A. Allred, L.G.Ogden Air Logistics Center,Hill AFB, UT Achieving a hands-free computer interface using voice recognition and speech synthesis [for Windows-based ATE] Aerospaceand Electronic Systems, IEEE Volume: 15, Issue:1, pp 14-16., Jan2000 S.SadhanaRao,Proceedings of the International Conference on Communication and Computational Intelligence – 2010,Kongu Engineering College, Perundurai,Erode,T.N.,India.27–29December,2010.pp.336-339. Gomez, A.M. Peinado, A.M. Sanchez, V. Rubio, A.J.dept. eoria de laSenal, Granada Univ Recognition of coded speech transmitted over wireless channels Wireless Communications, IEEE Transactions onVolume: 5, Issue: 9, pp-2555 – 2562., September 2006 Pelaez-Moreno, C. Gallardo-Antolin, A. Diaz-de-Maria, F.Dept. de Tecnologias de lasComunicaciones, Univ. Carlos III de Madrid, Recognizing voice over IP: a robust front-end for speechrecognition on the world wide web Multimedia, IEEE Transactions on Volume: 3, Issue:2, pp-209 – 218., Jun 2001 Kaynak, M.N. Qi ZhiCheok, A.D. Sengupta, K. Zhang JianKo ChiChung Dept. of Electr. Eng., Arizona State Univ., Tempe, AZ, USAAnalysis of lip geometric features for audio-visual speech recognition Systems, Man and Cybernetics, Part A: Systems and Humans, IEEETransactions on Volume: 34, Issue: 4, pp-564 – 570., July 2004 Andrew W. Senior and Ruud M. Bolle face recognition and its applications INTERNATIONAL JOURNAL OF ENGINEERING SCIENCE & ADVANCED TECHNOLOGY Volume-2, Issue-2, 245 – 249 http://www.ted.com/talks/pranav_mistry_the_thrilling_potential_of_sixthsense_technology.html (Last visited on 20 september 2012) http://dspace.cusat.ac.in/jspui/bitstream/123456789/2207/1/SIXTH%20SENSE%20TECHNOLOGY.pdf (Last visited on 25 September 2012) http://www.slideshare.net/AppamSushma/sixth-sense-tecnology(Last visited on 22 October 2012) http://sic.ppu.edu/papers/086017_883934824_GestureRecognition.pdf(Last visited on 22 October 2012) http://www.mathworks.in/products/image/(Last visited on 22 October 2012) http://amath.colorado.edu/courses/5720/2000Spr/Labs/Worksheets/OpenCV_tutorial/OpenCVimpr.html(Last visited on 22 October 2012) http://personal.ee.surrey.ac.uk/Personal/T.Windeatt/msc_projects/symeonidis/Final%20Project.pdf(Last visited on 22 October 2012) http://arxiv.org/ftp/arxiv/papers/1204/1204.1277.pdf(Last visited on 23 October 2012) Various articles from www.wikipedia.org International Journal of Infinite Innovations in Technology|ISSN:2278-9057 IJIIT|Volume-I|Issue-III|2012-2013 January|Paper-08 Reg. No.:20121208|DOI:V1I3P08

ISSN: 2319-1120 /V4N3: 111-117 © IJAEST