I think we take for granted how alien a basic desktop computer is to someone who never used it. Pretend you're from some third-world shithole where no one has even seen a computer, and someone sat you in front of a computer and told you to figure it out. And then an hour later told you to figure out Excel.
My point is this: You were taught how to use a computer at some point in your life. I believe that programming could be just as easy if someone were to teach you how the rules and syntax work, just like they taught you the rules of the desktop paradigm (double click to launch a program, start menu, etc.)
Now that doesn't mean that the average joe will automatically be an expert software developer or computer scientist designing complex algorithms. Just like how you have the average Windows user who doesn't know shit about computers, and then you have the people who use powershell and shit. It's kinda like that.