I assume so, based on the wording, by I want to know for sure. Like, if my character is deaf and replys on reading lips, and the person they're talking to casts GoG, would it effect me? I can't hear them, but the magic is meant to alter the memories to think you said something different. 

Yes.  Gift of Gab has no requirement that the targets be able to hear you.  Bear in mind you'll need the Observant feat in order to read lips well enough to actually understand people.

I don't think so. The spell says it reshapes the memories of "listeners." But maybe... ?

The spell is definitely written with only voice and hearing in mind. It is definitely something to discuss with a DM, preferably before it comes up.

I don't think that the rules need to state that a "listener" must be able to interpret the communication presented; that is implied by the word choice. Beyond that, I think I would allow the spell to affect a deaf creature if the caster were communicating with signs.

By the way, this spell is all about reshaping transient communication. If the target were deaf and the caster were speaking, would the target need their memory of what was said altered?

Quote from WolfOfTheBees >>

If the target were deaf and the caster were speaking, would the target need their memory of what was said altered?

 Yes, if the deaf person has the observant feat and is reading lips.

 So then is a listener someone who is interpreting the communication or one who is only doing so by hearing?