Alright, so I was testing bans on a dedicated server. First, I banned myself. I was still banned until I closed the server, then I was able to join once I re-hosted the server. The ban.txt didn't update.
I thought this had something to do with me being unable to be banned, but then I tested it...