In addition to the possible business threat, forcing OpenAI to identify its use of copyrighted data would expose the company to potential lawsuits. Generative AI systems like ChatGPT and DALL-E are trained using large amounts of data scraped from the web, much of it copyright protected. When companies disclose these data sources it leaves them open to legal challenges. OpenAI rival Stability AI, for example, is currently being sued by stock image maker Getty Images for using its copyrighted data to train its AI image generator.
Aaaaaand there it is. They don’t want to admit how much copyrighted materials they’ve been using.
if you read a copyrighted material without paying and then forgot most of it a month later with vague recollection of what you’ve read the fact is you still accessed and used the copyrighted material without paying.
Now let’s go a step further, you write something that is inspired by that copyrighted material and what you wrote become successful to some degree with eyes on it, but you refuse to admit that’s where you got the idea from because you only have a vague recollection. The fact is you got the idea from the copyrighted material.
That’s still not how LLMs work. I can’t believe everybody who is upset with them doesn’t understand this.
The LLM has no idea what it’s reading. None. It’s just doing a word association game, but at a scale we can’t comprehend. It knows what arrangement of words go together, but it’s not reproducing anything with any actual intent. To get it to actually output anything that actually resembles a single piece of material it was trained against would require incredibly specific prompts to get there, and at that point it’s not really the LLM’s making anymore.
There’s plenty of reasons to be against AI. Such as the massive amounts of data scraping that happens to train models, the possible privacy invasions that come with that, academic cheating, etc. But to be mad at AI for copyright infringement only shows a lack of understanding of what these systems actually do.
The training process of LLMs is to copy the source material word for word. It’s instructed to plagiarize during the training process. The copyrighted material are possibly in one way or another embedded into the model itself.
In machine learning, there’s always this concern whether the model is actually learning patterns, or if it’s just memorizing the training data. Same applies to LLMs.
Can LLMs recite entire pieces of work? Who knows?
Does it count as copyright infringement if it does so? Possibly.
The training process of LLMs is to copy the source material word for word. It’s instructed to plagiarize during the training process. The copyrighted material are possibly in one way or another embedded into the model itself.
No it isn’t. That;s not how neural networks work, like at all
In machine learning, there’s always this concern whether the model is actually learning patterns, or if it’s just memorizing the training data. Same applies to LLMs.
It’s learning patterns. It’s not memorising training data. Again, not how the system works at all
Can LLMs recite entire pieces of work? Who knows?
No. No they can’t.
Does it count as copyright infringement if it does so? Possibly.
That’d be one for the lawyers were it to ever come up, but it won’t
FWIW that’s pretty much exactly how all creative works are created. Especially music.
I think there can be said to be a meaningful difference due to the sheer scale and speed at which AIs can do this though.
Ultimately, I think it’s less of a direct legal question and more a societal question of whether or not we think this is fair or not. I’d expect it to ultimately be resolved by legislative bodies, not the courts.
Except that nobody has a superhuman ability to create endless amounts of content almost instantly based on said work.
People throw this “artists/writers use inspiration to create X” argument all the time and it just totally ignores the fact that we’re not talking about some person spending 10s/100s/1000s of hours of their time to copy someone’s working style.
It’s a piece of software churning it out in seconds.
If I would create a very slow AI that takes 10 or 100 hours for each response, would that make it any better in your opinion? I do not think calculation speed of a software is a good basis for legislation.
If analyzing a piece of art and replicating parts of it without permission is illegal, then it should be illegal regardless of the tools used. However, that would make every single piece of art illegal, so it’s not an option. If we make only the digital tools illegal then the question still remains where to draw the line. How much inefficiency is required for a tool to still be considered legal?
Is Adobe Photoshop generative auto-fill legal?
Is translating with deepl.com or the modern Google Translate equivalent legal?
Are voice activated commands on your mobile phone legal (Cortana, Siri, Google)?
All of these tools were trained in similar ways. All of these take away jobs (read: make work/life more efficient).
It’s hard to draw a line and I don’t have any solution to offer.
Do generative AI models typically focus on ONE person’s style? Don’t they mix together influences from thousands of artists?
FWIW this is not an area I read up on, and so I don’t have a strong opinion one way or the other.
Except the illegally obtaining the copyrighted material part, which is the main point. And definitely not on this scale.