I read somewhere the system takes your first rating and that's all, but if it does average them out, then I will reduce mine with this entry I hope.
I don't know where you get that, but that's wrong. Your first rating is taken, but if you change your rating after, this new rating is taken. You can't rate twice or more.
Your first comment was five stars and you changed your rating to three stars and both comments show three stars.