August 31, 2015
This age of ballpoint and gel pens, and people tapping on keyboards and touchscreens to write, is far removed from the time when writing was done with dip pens. Dip penmanship was mentioned in the enjoyable 1986 animated movie, "Happy New Year, Charlie Brown," when Linus was scolding Charlie Brown for not having the fortitude to read Tolstoy's War and Peace.
"When Leo Tolstoy was writing War and Peace, his wife, Sonya, copied it for him seven times. And she did it by candlelight, and with a dip pen... And you're telling me you can't even read it once?"
Dip pen writing is enabled by some elementary physical principles, as shown in the figure.
I'm admitting my age when I recall that my desk in elementary school had an ink reservoir, and that I practiced penmanship with dip pens. Our penmanship lessons, which all students uniformly detested, taught the Palmer Method. The Wikipedia page on the Palmer Method states that its regimentation was believed to increase "discipline and character, and could even reform delinquents." My wife once saw our penmanship teacher in a bank actually writing using that method.
My handwriting has always been abominable, so I was was an early adopter of computer word processing, using the first version of WordStar on an S-100 computer running CP/M in the very early 1980s. Shortly thereafter, Microsoft Word became ubiquitous in the corporate world, as I migrated over the years from StarOffice, to OpenOffice, to LibreOffice.
Computers are now quite adept at handwriting recognition. My venerable Palm Zire 31 has been doing this for more than a decade using a slightly contrived character set called Graffiti. Computer science has advanced handwriting recognition beyond that stage to making sense of arbitrary script through innovations such as recurrent neural networks, as schematically illustrated in the figure. I wrote about neural networks in the context of solving the knight's tour on a chess board in a previous article (The Knight's Tour, March 7, 2014).
If you're interested in the inverse problem of producing what looks like handwriting from a text file, there's one easy option; namely, using a font that simulates handwriting. There are a number of these script typefaces, one of the most elegant being Mistral. Alex Graves, a Canadian Institute for Advanced Research Junior Fellow at the Department of Computer Science of the University of Toronto, took a more elegant approach, as described in an arXiv paper.[3-5]
Graves' particular approach uses what's termed a "Long Short-Term Memory" recurrent neural network. As if the name isn't confusing enough, look at the basic network node, as shown in the figure. This is definitely not the simple neural network of a decade ago. The network operates by predicting one data point at a time.
The neural network required training data obtained "online;" that is, the (x,y) pen positions were obtained as the writing was taking place. The alternative "offline" data would just be images of handwriting. The training data were taken from the IAM online handwriting database (IAM-OnDB), as described in ref. 6. These data were obtained by having people write samples from a standard corpus (the Lancaster-Oslo-Bergen text corpus) on a "smart whiteboard."
Simulations can be as good, or as bad, as desired, depending on the amount of computing power used. Graves' network has a bias factor that allows generation of handwriting in various degrees of perfection, perfect handwriting being the average script of the multitude of writers. At low perfection level, the same letter is written in a slightly different manner at different parts of the script. The same line, rendered under different initial conditions, is shown in the figure.
|One node of a "Long Short-Term Memory" recurrent neural network, as described in ref. 3.|
This type of network has been shown to generate an excellent simulation of handwriting.
(Fig. 2 of ref. 3, via arXiv.)
- Happy New Year, Charlie Brown, TV Movie (1986, Sam Jaimes, Bill Melendez, Directors) on the Inrenet Movie Database.
- Quotes from "Happy New Year, Charlie Brown," TV Movie, 1986, on the Internet Movie Database.
- Alex Graves, "Generating Sequences With Recurrent Neural Networks," arXiv, June 5, 2014.
- Online Handwriting Application, University of Toronto Computer Science Web Site.
- Matthew Braga, "This Post Was Handwritten by a Neural Network," motherboard.vice.com, July 23, 2015.
- M. Liwicki and H. Bunke, "IAM-OnDB - an on-line English sentence database acquired from handwritten text on a whiteboard," Proc. 8th Int. Conf. on Document Analysis and Recognition, vol. 2 (2005), pp. 956-961 (PDF File).
Permanent Link to this article
Linked Keywords: Ballpoint pen; gel pen; keyboard; touchscreen; writing; write; dip pen; penmanship; animated cartoon; animated movie; Happy New Year, Charlie Brown; Linus van Pelt; Charlie Brown; fortitude; Leo Tolstoy; War and Peace; candlelight; physical law; physical principle; surface tension; ink; dip pen; nib; capillary action; Wikimedia Commons; desk; elementary school; ink reservoir; lesson; student; Palmer Method; Wikipedia; juvenile delinquency; delinquent; wife; teacher; bank; abominable; computer word processing; WordStar; S-100 bus computer; CP/M; 1980s; Microsoft Word; corporation; corporate; StarOffice; OpenOffice; LibreOffice; computer; handwriting recognition; Palm Zire 31; decade; character encoding; character set; Graffiti 2; computer science; innovation; recurrent neural network; schematic; schematically; artificial neural network; knight's tour; chess board; feedforward connected network; recurrent neural network; recurrent connection; data; Inkscape; inverse problem; text file; font; simulacrum; simulate; script typeface; Mistral; Alex Graves; Canadian Institute for Advanced Research Junior Fellow; Department of Computer Science; arXiv; scientific literature; paper; node; Cartesian coordinate system; (x,y); digital image; text corpus; Lancaster-Oslo-Bergen text corpus; interactive whiteboard; smart whiteboard; computer simulation; alphabet letter; handwriting; online generating program.
Latest Books by Dev Gualtieri
Thanks to Cory Doctorow of BoingBoing for his favorable review of Secret Codes!
Blog Article Directory on a Single Page
- J. Robert Oppenheimer and Black Holes - April 24, 2017
- Modeling Leaf Mass - April 20, 2017
- Easter, Chicks and Eggs - April 13, 2017
- You, Robot - April 10, 2017
- Collisions - April 6, 2017
- Eugene Garfield (1925-2017) - April 3, 2017
- Old Fossils - March 30, 2017
- Levitation - March 27, 2017
- Soybean Graphene - March 23, 2017
- Income Inequality and Geometrical Frustration - March 20, 2017
- Wireless Power - March 16, 2017
- Trilobite Sex - March 13, 2017
- Freezing, Outside-In - March 9, 2017
- Ammonia Synthesis - March 6, 2017
- High Altitude Radiation - March 2, 2017
- C.N. Yang - February 27, 2017
- VOC Detection with Nanocrystals - February 23, 2017
- Molecular Fountains - February 20, 2017
- Jet Lag - February 16, 2017
- Highly Flexible Conductors - February 13, 2017
- Graphene Friction - February 9, 2017
- Dynamic Range - February 6, 2017
- Robert Boyle's To-Do List for Science - February 2, 2017
- Nanowire Ink - January 30, 2017
- Random Triangles - January 26, 2017
- Torricelli's law - January 23, 2017
- Magnetic Memory - January 19, 2017
- Graphene Putty - January 16, 2017
- Seahorse Genome - January 12, 2017
- Infinite c - January 9, 2017
- 150 Years of Transatlantic Telegraphy - January 5, 2017
- Cold Work on the Nanoscale - January 2, 2017
- Holidays 2016 - December 22, 2016
- Ballistics - December 19, 2016
- Salted Frogs - December 15, 2016
- Negative Thermal Expansion - December 12, 2016
- Verbal Cues and Stereotypes - December 8, 2016
- Capacitance Sensing - December 5, 2016
- Gallium Nitride Tribology - December 1, 2016
- Lunar Origin - November 27, 2016
- Pumpkin Propagation - November 24, 2016
- Math Anxiety - November 21, 2016
- Borophene - November 17, 2016
- Forced Innovation - November 14, 2016
- Combating Glare - November 10, 2016
- Solar Tilt and Planet Nine - November 7, 2016
- The Proton Size Problem - November 3, 2016
- Coffee Acoustics and Espresso Foam - October 31, 2016
- SnIP - An Inorganic Double Helix - October 27, 2016
- Seymour Papert (1928-2016) - October 24, 2016
- Mapping the Milky Way - October 20, 2016
- Electromagnetic Shielding - October 17, 2016
- The Lunacy of the Cows - October 13, 2016
- Random Coprimes and Pi - October 10, 2016
- James Cronin (1931-2016) - October 6, 2016
- The Ubiquitous Helix - October 3, 2016
- The Five-Second Rule - September 29, 2016
- Resistor Networks - September 26, 2016
- Brown Dwarfs - September 22, 2016
- Intrusion Rheology - September 19, 2016
- Falsifiability - September 15, 2016
- Fifth Force - September 12, 2016
- Renal Crystal Growth - September 8, 2016
- The Normality of Pi - September 5, 2016
- Metering Electrical Power - September 1, 2016
Deep Archive 2006-2008