Yes... Generally speaking, whenever you update some files (ESPECIALLY language files), you should hit the 'Admin > Purge cache' option in the main menu. I'm not sure plugin language files are cached, but if it doesn't work for you, maybe they are.
As for this particular plugin, I've only updated the language files, but I may have mixed up the language entry names, I don't know.