1. Who do you know?
You have enough design skill to be in the game. So do many, many others. In order to actually make a living at what you want to do, my experience has been that most people in creative industries need to have one or two major clients - people who have a lot of work for you to do, and once they get used to using you, they'd rather stick with you than look for someone else. If you feel like you have these, then start working hard to make them choose you as their go-to designer. If you have more than two of these and they keep you really, really busy, you may be able to carve out your niche in a more permanent manner.
If you do not have these kinds of contacts yet, question two is:
2. Who can you meet?
Trade shows, cold calls, portfolio presentations, meetups, recommendations, introductions, whatever it is, wherever you can meet people, try to get a couple of solid, hungry clients. It may be mundane, but every successful independent creative worker I have seen has taken this path.