UK watchdog warns chatbot developers over data protection laws

Referring to the LLM training process, Almond said data protection law still applied when the personal information being processed came from publicly accessible sources.

It added that companies had to carry out a data protection impact assessment and mitigate security risks such as personal data leaks and so-called membership inference attacks, whereby rogue actors try to identify whether a certain individual was used in the training data for an LLM.

The previous version, GPT-3, was trained on 300bn words scraped from the public internet, as well as the contents of millions of ebooks and the whole of English-language Wikipedia.