Why LLM learns translation capability without bilingually aligned sentences? Our study reveals that such capability may be attributed to those training instances which contains some word-aligned translation pairs.
Please check our ICLR24 paper : https://t.co/KZhAXAIfIL.