Can I plug an Ethernet cable into the wall outlet?
You can't use a cable directly to that sockets for a wired internet connection. Is that correct? The wall sockets are probably not connected to a modem or a router. If you want to use it, you need the cable that goes into it. The wall sockets are not a magic Internet source.
Let's Get It Fixed!
HomeX virtual experts will assess your issue (for free!) and can resolve simple problems.