Should I pay off my car loan?

I owe about $3000 on my car loan. My car payment is $450 a month, my interest is 5.75% and everyday I don't pay it off there's a .53 cent charge (per diem). By paying it off, I would save about $150. Some say pay it off, others say just wait it off because it will be paid off this year. Thoughts?