Sketch recognition describes the process by which a computer or artificial intelligence can interpret hand-drawn sketches, created by a human being or other machine.Hammond, T. and Davis, R. (2005), "LADDER, a sketching language for user interface developers", Computers & Graphics, 2005, 29(4), pp. 518-532. Sketch recognition is a key frontier in the field of artificial intelligence and human-computer interaction, similar to natural language processing or conversational artificial intelligence.Hammond, T., Logsdon, D., Peschel, J., Johnston, J., Taele, P., Wolin, A., and Paulson, B. A sketch recognition interface that recognizes hundreds of shapes in course-of-action diagrams. In Proceedings of the 28th of the international conference extended abstracts on Human factors in computing systems (CHI EA '10), 2010, pp. 4213-4218.Jorge, J. and Samavati, F. (2011), Sketch-Based Interfaces and Modeling, Springer
Uses and Applications Research in sketch recognition lies at the crossroads of artificial intelligence and human–computer interaction. Recognition algorithms usually are gesture-based, appearance-based, geometry-based, or a combination thereof.
Advances in the field of sketch recognition would have significant application in the field of forensic science, in which sketches are often used to identify suspects associated with a crime.
In 2023, two developers used OpenAI's DallE-2 image generation platform to create a forensic sketch program. The program's results were described as "hyper-realistic" and purported the potential of exponentially decreasing the creation time of a forensic sketch, while increasing accuracy.
Sketch recognition technology has also been linked to applications in the fields of architecture, videogame production, animation, construction, and academia, among others.
See also Gesture recognition Handwriting recognition Human–computer interaction Multi-touch gestures Pen computing Sketch-based modeling Tablet computer
References
External links
Notes on the History of Pen-based Computing (Youtube) Annotated Bibliography in Tablets, Gesture and Handwriting Recognition, and Pen Computing