There are two errors in the translit...I think that it's the transliterator's personal choice to put the kanji character '行' as either 'i' or 'yu' in part of a word, but in this case it's sung as 'yu'.
[kieteiku deshou]: kieteyuku deshou
[kaeteiku deshou]: (in the fifth stanza) kaeteyuku deshou
These are small things, but they trip people up when sung. =S