Real time image and voice processing input for online multiplayer computer games

Abstract

Real Time image processing and voice processing in computer gaming is a very recent topic as companies like Microsoft and Sony have researched and implemented this technology recently in their gaming consoles XBOX-360 and Play Station 3 respectively. As these consoles have high performance processor likes CELL or XENON with POWER (Performance Optimization with Enhanced RISC) PC Architecture unlike desktop computers which uses x86 and legacy architecture processor which is slower than console’s processors. Gaming with “Natural User Interface” such as gestures and voice was the main focus of the research of this project which is named as “Project: Control Scheme Revolution”. To materialize this challenge, several approaches were carried out. An open source game engine JMonkey Engine 3 (JME3) was customized with natural user interface. To measure the goodness of the system which is being developed by this project, Frame per Second (FPS) of the game was kept in account. All the approaches were taken to integrate different libraries to the core of the Game Engine ensuring a playable FPS for good user experience. Besides that, this research is also focused on implementing this system on the Multiplayer and Massively Online Multiplayer games as the participation of the more than one user in gaming produces an extra over head on the overall processing of the computer. As not all computers are powerful enough to support all of these systems at real time effortlessly, this research also focused on developing a system to render and stream a game from high performance computer to a moderate or low performance device such as note book or android device. Performance analysis of all of these approaches to develop a system which will bring the feeling of gaming in a console to the gaming in an ordinary computer is the main goal of this project.