Is it the job of a CEO to be aware of how technical is the company he runs? I am not really sure.
In many industrial companies, CEOs knows that robots are mandatory in today's factories. But do they know exactly the brands and models, and how to program them? They also know that the company have a very big information system. But do they run sql querries by themselves?
Many startup founders in IT, be it B2B or B2C, used to develop and write code at the beginning of their company. Once it is big, do CEOs continue to write code, or are they working on business development and strategy?
On a ship, the captain take the decisions, then officers take their part depending on what they manage, and their team do the job. Do the captain really knows how the motor is working in details, or how to fix it? However, he knows how important the motor is.
IMHO, the job of a CEO is very different depending on the size of the company, and its business. The common point is that CEOs have to give the right direction to make their company succesful. They have to understand the environment of the business, the evolution and changes of this environment, and more. But they can't be experts in everything. That is why they try to hire the best people for Sale, Communication, Production, ... and IT.
Of course, I know that it is a simplification.