How can I make illogical feelings go away?

In my experience you cannot simply will a feeling away. Feelings want to be felt, and surpressing or ignoring them can be counterproductive and unhealthy. Instead try acknowledging them, naming them and then moving on. They will not go away, but knowing what you're feeling and truly being able to identify it, is already a big step and will lessen the immediate control it has over you. Feelings often aren't logical, and that's okay. Recognizing them and then letting them be as they are is the best way to go, in my opinion. In time, they might go away on their own.