Where does the word 'booting' comes from when referring to electronic devices?

Quick google search regarding the origin of the word:
http://desktopreality.com/why-booting-is-called-booting/

Never used the word booting regarding simpler devices myself but that may be because im not a native english speaker

"Booting" is a short form of the common English phrase "Lifting oneself by his boot straps". Bootstraps = shoe laces. A whimsical term that suggests an image that you are lifting your whole body by pulling up on your shoe laces & thus obviously defying gravity. Metaphorically, it means getting yourself started from a dead stop.

Typically for smaller devices the words "reset" or "initialize" are used.

By way of further documentation for WhatRoughBeast's answer, I offer two discussions of the origin of the term. First, from Eric Raymond, The New Hacker's Dictionary, third edition (1996):

boot v.n. {techspeak, from 'by one's bootstraps'} To load and initialize the operating system on a machine. This usage is no longer jargon (having passed into techspeak) but has given rise to some derivatives that are still jargon [such as cold boot, warm boot, soft boot, and hard boot]. ...

Historical note: this term drives from 'bootstrap loader', a short program that was read in from cards or paper tape, or toggled in from the front panel switches. This program was always very short (great efforts were expended on making it short in order to minimize the labor and chance of error involved in toggling it in), but was just smart enough to read in a slightly more complex program (usually from a card or paper tape reader), to which it handed control; this program in turn was just smart enough to read the application or operating system from a magnetic tape drive or disk drive. Thus, in successive steps, the computer 'pulled itself up by the bootstraps' to a useful operating state. ...

And from Oxford Dictionary of Computing, sixth edition (2008):

boot To start a computer by turning the power on. Specifically, to invoke a bootstrap, especially to read from backing store the operating system of a computer and load it into the empty memory.

...

bootstrap ... The term originates from a story told by Baron Munchausen, who boasted that, finding himself trapped and sinking in a swamp, he lifted himself by the bootstraps and carried himself to safety on firm ground.

On early computers in the 1960s up to 1970s, the initial instructions to read the media that contained the program was wired up on a small patchboard reassembling bootstraps. That's the origin of the word bootstrap or to boot a computer, for short. The term remained but the reason was forgotten.