After installing Windows on a new HP laptop, I started noticing that the keyboard required me to press SPACE after typing quote characters, for them to become visible.

Fix: This happens because your keyboard is currently set to United States-International keyboard. Change it to something else and the keys work as intended.