Yep! I had to decide to make an effort. Step 1 is to force myself to listen to what the other person was saying without getting engaged in other things in my own head - i.e. wandering onto different topics in my head, or starting to formulate my response to what I think they are going to say.
Step 2 I've also found a good tactic is to always paraphrase back to the other person what you believe you heard them say. It is at this time, when I am paraphrasing, that my brain starts to determine what I want to say in response.
Paraphrasing what they said back to them is not only validating for them but it lets them feel like you were listening, and you then have an opportunity to correct/clear up any misconceptions in what you heard.
Not all conversations are going to be engaging. I suggest you remove yourself from the situation or change the subject, if you can. In the situations where that is not possible, you just need to tell yourself (in your head) I need to focus and listen.
If you practice you will get it. It's a great tool for having quality communication.
Side note: what I really get annoyed with/what I have now noticed is - I give the speaker the time they need to completely finish their train of thought, while I focus and thoughtfully listen BUT after I have paraphrased back and have started to reply, THEY feel as if it is perfectly okay to cut me off. I have had to also train myself to gently but firmly insist that they allow me to finish as I allowed them to finish. 60% of the time the person whom is used to cutting someone off cant control themselves. Frustrating.