Machine vision sensors are often likened to human eyes: They scan and “see” the world around them, then transmit the data elsewhere for some action to occur. But can a vision sensor watch TV? Turns out it can. And when put together with mechanical actuators and a PLC brain, it can also play video games.
Casting about for a project for his robotics class at Minnesota West Community and Technical College, engineering student Pete Nikrin hit on the idea to design a robot to compete against a friend newly introduced to the Guitar Hero electronic game. Playing Guitar Hero requires fast button-pushing on a guitar-shaped input device in response to dots (notes) that move down a path on a video screen.
For the project, Nikrin decided to use a mannequin—complete with Minnesota West sweatshirt and painted fingernails—with a vision sensor in its left eye and mechanical actuators attached to its painted nails. AndCONTROL ENGINEERING China版权所有, he wanted to keep the video game and the robot two separate entities.
CONTROL ENGINEERING China版权所有," src="http://www.cechina.cn/upload/article/9517ca6c-20db-4493-a40b-49bd60d3db55/1_new.jpg">
When Roxanne plays Guitar HeroCONTROL ENGINEERING China版权所有, she can achieve up to 95% accuracy on Hard mode, besting creator, Pete Nikrin.
At first, he says, “I couldn't find anything online like it. Then, a month or two into itwww.cechina.cn, a bunch of videos showed up [using other methods]. To the best of my knowledgewww.cechina.cn, though, mine is the only one that has the robot linked only by vision to the game.” Other projects tap directly into the game's electronic signal, which Pete, as a robotics guy控制工程网版权所有, thinks “is kind of cheating.”
Not unlike the process of problem-solving in an industrial application, Nikrin hit upon two frustrations early on: finding the right sensor and building a vision system with high enough speed for the application.
&