Actually it be better classed as a “ARPG” rather than a “cRPG”
If you're running an rpg... on a computer... without a DM... it's a cRPG. There is literally nothing new here. Improvements in AI will just (potentially) result in better cRPGs.
It's not a direction I'd particularly recommend Wizards head into, they'd be competing in a field they don't have a lot of experience in, I'd leave it to the video game companies and licensing deals, but there's nothing inherently heinous about it.
Someone at WoTC please tell Chris Cocks to go lay down.
In a March 1st interview with Venturebeats Cocks states he forsees a future where AI is generating content.
Absolutely not! The OGL debacle should have been a lesson in the community not putting up with nonsense. The blowback on AI tools used to touch up art in Bigby's should have been a lesson, uet here we are.
Hasbro needs to sell WoTC or Chris Vocks needs to either leave or stay out of it. He clearly is not friendly to this community.
Why is Hasbo/WoTC the one company that shouldn't be investigating the potential uses of AI? The company has to think about its investors', consumers', and employees' (current and future) interest in how AI can service them. Competitors of theirs are surely paying attention and exploring its use.
Hasbro just does not have the free expendable cash to create their very own AI using D&D copy writes. But they could wait for a good one to come out and partner with them to make something they want and need.
First I would like to see a digital system for each official module or world. Something the DM can use to keep track of all of his notes. Maybe even a verbal input for those who do not want to type. Maybe a way for it to cross check and find any conflicts then remind the DM.
Someone at WoTC please tell Chris Cocks to go lay down.
In a March 1st interview with Venturebeats Cocks states he forsees a future where AI is generating content.
Absolutely not! The OGL debacle should have been a lesson in the community not putting up with nonsense. The blowback on AI tools used to touch up art in Bigby's should have been a lesson, uet here we are.
Hasbro needs to sell WoTC or Chris Vocks needs to either leave or stay out of it. He clearly is not friendly to this community.
Why is Hasbo/WoTC the one company that shouldn't be investigating the potential uses of AI? The company has to think about its investors', consumers', and employees' (current and future) interest in how AI can service them. Competitors of theirs are surely paying attention and exploring its use.
I’d rather be offed an Ai ASSISTANT then a bot that tries to run a game. IMHO
Someone at WoTC please tell Chris Cocks to go lay down.
In a March 1st interview with Venturebeats Cocks states he forsees a future where AI is generating content.
Absolutely not! The OGL debacle should have been a lesson in the community not putting up with nonsense. The blowback on AI tools used to touch up art in Bigby's should have been a lesson, uet here we are.
Hasbro needs to sell WoTC or Chris Vocks needs to either leave or stay out of it. He clearly is not friendly to this community.
Why is Hasbo/WoTC the one company that shouldn't be investigating the potential uses of AI? The company has to think about its investors', consumers', and employees' (current and future) interest in how AI can service them. Competitors of theirs are surely paying attention and exploring its use.
Hasbro just does not have the free expendable cash to create their very own AI using D&D copy writes. But they could wait for a good one to come out and partner with them to make something they want and need.
First I would like to see a digital system for each official module or world. Something the DM can use to keep track of all of his notes. Maybe even a verbal input for those who do not want to type. Maybe a way for it to cross check and find any conflicts then remind the DM.
Most companies don't; that is why they have to look at outsourcing the production and what services are available. Overall, I think there is a market for tools to help both D/GMs and players. I can rattle off about a half dozen ideas that make sense now, but I don't know if the service can provide a worth product at this time. It would more be a wish list or good objective.
The arguments I hear against AI sound an awful lot like the arguments people had against past paradigm-shifting technologies like television or cars or the internet. Those arguments didn't age well. And as for "ChatGPT 4 has severe limitations as a DM," of course it does. This is the infancy of AI. The first cars couldn't outrun horses either.
No, we're not going to take a brave stand until it goes away. Because it's not going away. Anticipating how it is going to transform your industry is basically required for any company that wants to still be relevant 10 years from now. Now what that actually looks like is just a guess at this point, which is why we need to be talking about it and thinking about it. AI has at least as much potential to assist humans as it does to "replace" them. But rejecting any discourse like an old man shaking his fist at kids on his lawn is not going to help steer things in a productive direction.
First of all, for every new technology that's an actual paradigm-shift, there are dozens that are sold as being paradigm shifts but don't actually ever amount to anything. Hyperloop, anyone? Second of all, one of the main reasons companies are trying to jump on the AI bandwagon is so that they can fire their human employees and shift to a purely automated workforce. That's not something to be celebrated. Unless you're really excited about big businesses delivering you an inferior product for less cost to themselves (but not to you).
Rollback Post to RevisionRollBack
Find your own truth, choose your enemies carefully, and never deal with a dragon.
"Canon" is what's factual to D&D lore. "Cannon" is what you're going to be shot with if you keep getting the word wrong.
The arguments I hear against AI sound an awful lot like the arguments people had against past paradigm-shifting technologies like television or cars or the internet.
Or Segway, or Theranos, or bitcoin...
Rollback Post to RevisionRollBack
Active characters:
Edoumiaond Willegume "Eddie" Podslee, Vegetanian scholar (College of Spirits bard) Lan Kidogo, mapach archaeologist and treasure hunter (Knowledge cleric) Peter "the Pied Piper" Hausler, human con artist/remover of vermin (Circle of the Shepherd druid) PIPA - Planar Interception/Protection Aeormaton, warforged bodyguard and ex-wizard hunter (Warrior of the Elements monk/Cartographer artificer) Xhekhetiel, halfling survivor of a Betrayer Gods cult (Runechild sorcerer/fighter)
The arguments I hear against AI sound an awful lot like the arguments people had against past paradigm-shifting technologies like television or cars or the internet. Those arguments didn't age well. And as for "ChatGPT 4 has severe limitations as a DM," of course it does. This is the infancy of AI. The first cars couldn't outrun horses either.
No, we're not going to take a brave stand until it goes away. Because it's not going away. Anticipating how it is going to transform your industry is basically required for any company that wants to still be relevant 10 years from now. Now what that actually looks like is just a guess at this point, which is why we need to be talking about it and thinking about it. AI has at least as much potential to assist humans as it does to "replace" them. But rejecting any discourse like an old man shaking his fist at kids on his lawn is not going to help steer things in a productive direction.
First of all, for every new technology that's an actual paradigm-shift, there are dozens that are sold as being paradigm shifts but don't actually ever amount to anything. Hyperloop, anyone? Second of all, one of the main reasons companies are trying to jump on the AI bandwagon is so that they can fire their human employees and shift to a purely automated workforce. That's not something to be celebrated. Unless you're really excited about big businesses delivering you an inferior product for less cost to themselves (but not to you).
The hype cycle is very reminiscent of the ones that surrounded cryptocurrency/NFTs/metaverse, with many of the exact same people and companies hopping off that train and onto this one. It's bigger because there's something there, but the people who are massively invested in making this the next big thing are not to be trusted on its potential.
Does our long history of science fiction prime us to believe that a computer that can talk like a human can think like a human? Very much so.
Is machine learning a fascinating technology that could improve a lot of things? Yes.
Is generative 'AI' the next big thing that will create shedloads of value and revolutionize creative work? It remains to be seen.
Is it going to lead to true human-like AI? No.
Is its primary use case so far putting creative workers out of a job in order to make inferior material, along with 'search' that makes things up and even more SEO junk sites clogging up the real search? Yes.
I will say I do not feel there is an ethical use for "ai", it's very nature is to be unethical. JMHO.
What's so fundamental and intrinsic to AI use that's unethical, that you can't change to make it ethical? Every criticism I've heard has been how it's used (basically copyright infringement) rather than AI per se. The only thing I can see is that artists etc might lose their jobs, but while that's a shame and I have sympathy for them, given the amount of jobs lost to automation in our lives, it'd be oddly selective to criticise AI for that.
The problem is that in a lot of ways being unethical is baked into how it works. To get a large enough sample to actually work they have to pool thousands, if not millions, of sources. Each one of those is essentially stealing someone elses work and talent. Sure you could actually make it ethical by honouring copyright but that would result in you having to pay every single creator and get them to agree, making it both too costly and too time consuming to be viable, and an awful lot of artists would say no no matter how much you offered them. Throw in as well that most of the people and companies creating AI tools seem to have a really shakey grasp of ethics and don't see anything wrong with stealing other people's work to get their algorithms to work and you'll never get an ethical AI on the current business model
He specifically mentions using only the books WOTC owns the copyright to in the AI database.
I'm not sure how that's relevant? I'm sure the core AI code would be licensed from someone else, but it's the training data that determines what it produces.
I will say I do not feel there is an ethical use for "ai", it's very nature is to be unethical. JMHO.
What's so fundamental and intrinsic to AI use that's unethical, that you can't change to make it ethical? Every criticism I've heard has been how it's used (basically copyright infringement) rather than AI per se. The only thing I can see is that artists etc might lose their jobs, but while that's a shame and I have sympathy for them, given the amount of jobs lost to automation in our lives, it'd be oddly selective to criticise AI for that.
The problem is that in a lot of ways being unethical is baked into how it works. To get a large enough sample to actually work they have to pool thousands, if not millions, of sources. Each one of those is essentially stealing someone elses work and talent. Sure you could actually make it ethical by honouring copyright but that would result in you having to pay every single creator and get them to agree, making it both too costly and too time consuming to be viable, and an awful lot of artists would say no no matter how much you offered them. Throw in as well that most of the people and companies creating AI tools seem to have a really shakey grasp of ethics and don't see anything wrong with stealing other people's work to get their algorithms to work and you'll never get an ethical AI on the current business model
He specifically mentions using only the books WOTC owns the copyright to in the AI database.
Would that even work? How many books does WOTC own the copyright to? I was under the impression you would need something on the scale of thousands of books to train a generative AI that's even a little bit competent.
It sounds pretty questionable. WotC doesn't have any AI-building ability in the first place, they'd need to buy it from someone else and then dump their own content into it.
Rollback Post to RevisionRollBack
Find your own truth, choose your enemies carefully, and never deal with a dragon.
"Canon" is what's factual to D&D lore. "Cannon" is what you're going to be shot with if you keep getting the word wrong.
Would that even work? How many books does WOTC own the copyright to? I was under the impression you would need something on the scale of thousands of books to train a generative AI that's even a little bit competent.
They've got fifty years of D&D artwork, although the early stuff was obviously not as detailed. They also have thirty years of Magic the Gathering card artwork. Then there will also be the thousands of pieces that were submitted by the artists they hired but was rejected for publication.
And, of course, they also have access to anything in the Public Domain.
Honestly I don’t understand how it can be unethical use if it’s referencing millions of different data points, anymore than an artist is unethical for studying famous works of a style they want to use or an author is unethical for looking at how other authors write certain scenes. The vast majority of art is built on what came before, this is just the next technological extension of that. Obviously if you exclusively train it on a single artist it’ll just imitate them, but once you’ve got several dozen in the mix can it really be said to be taking enough from any single one to be stealing?
If I steal a bunch of other people's paintings and put them in my woodchipper, do I own the confetti?
I'm not sure how that's relevant? I'm sure the core AI code would be licensed from someone else, but it's the training data that determines what it produces.
I disagree I see the code as more important than the data, as it is the code that will "decide" what data it uses, and how it is used. Just look at the multitude of debates on RAW/RAI we have, and all of us have been "trained" on the same data.
No, the code is much less important than the data. The core of large language models is a database of words, correlated along vast numbers of different axes. While there's code around it, the model's behavior isn't programmed like we're used to.
He specifically mentions using only the books WOTC owns the copyright to in the AI database.
Would that even work? How many books does WOTC own the copyright to? I was under the impression you would need something on the scale of thousands of books to train a generative AI that's even a little bit competent.
I'm pretty sure that every single word written about and for D&D throughout the last 50 years would not be enough to train a modern LLM. A customized model is (I believe) invariably done by taking one of the generic models like GPT 4, trained on whatever they grabbed off the internet, and putting it through a second round of training with the domain-specific data set. Everything in the original model is likely still there, just deemphasized.
Even if WotC did own enough material to fully train an LLM from scratch, doing so is extremely expensive.
Honestly I don’t understand how it can be unethical use if it’s referencing millions of different data points, anymore than an artist is unethical for studying famous works of a style they want to use or an author is unethical for looking at how other authors write certain scenes. The vast majority of art is built on what came before, this is just the next technological extension of that. Obviously if you exclusively train it on a single artist it’ll just imitate them, but once you’ve got several dozen in the mix can it really be said to be taking enough from any single one to be stealing?
If I steal a bunch of other people's paintings and put them in my woodchipper, do I own the confetti?
That's a fascinating and evocative metaphor that is entirely unrelated to what's happening with an AI. A better one would be: "If I go to an art museum and look at the pieces they have on display for inspiration, am I plagiarizing if I borrow from one person's use of colors, and another's use of perspective and so on?"
The art work isn't gonna help the "ai" "learn" much about being a DM.
The use of public domain is precluded by Cocks' statement of using only WotC owned copyrighted materials.
For that they have fifty years of published adventures as well as podcasts. Dragon magazine was owned by TSR, then there are the licensed games such as the SSI gold box series. They've even got DM questions and answers on D&D Beyond to pull from.
But yeah, I too totally believe him when he says they're not going to use public domain items.
Honestly I don’t understand how it can be unethical use if it’s referencing millions of different data points, anymore than an artist is unethical for studying famous works of a style they want to use or an author is unethical for looking at how other authors write certain scenes. The vast majority of art is built on what came before, this is just the next technological extension of that. Obviously if you exclusively train it on a single artist it’ll just imitate them, but once you’ve got several dozen in the mix can it really be said to be taking enough from any single one to be stealing?
If I steal a bunch of other people's paintings and put them in my woodchipper, do I own the confetti?
That's a fascinating and evocative metaphor that is entirely unrelated to what's happening with an AI. A better one would be: "If I go to an art museum and look at the pieces they have on display for inspiration, am I plagiarizing if I borrow from one person's use of colors, and another's use of perspective and so on?"
No, it's kind of apt.
Despite it being called "training" or "learning", what the generative models do is vastly different from what people do. (As best we understand the latter.)
Because they're probabilistic, when specific sets of words or pixels are strongly correlated and well-represented in the training data, they're very likely to show up in the output. If you give an image generator the phrase "Italian plumber", we all know the way the output's going to trend. If you ask a person to draw you an Italian plumber, you will only get Mario if they choose to draw you Mario.
That said, the legal issues around whether LLMs are infringing the copyright of their training data are complex and deeply unresolved. Transformative use is a significant fair-use principle in the US, and there's a solid argument to be made that this stuff is transformative. The fact that it's pretty easy to poke them into just spitting out training data nearly verbatim is also rather persuasive.
I think there's a real chance that we're going to see some kind of split, where they're legally legit in principle, but the massive copyright infringement committed in assembling the training data for the current models is not. But that's many years and millions of dollars in legal expenses away. (And will only apply to the US. The EU, China, etc. will have their own rulings. So much fun.)
The ethical and artistic issues are each their own cans of worms as well.
Again I disagree, without the "code" it is just data. How is data going to run a session without the "code"?
A LLM doesn't function without both data and code, but the relationship between a LLM and data is similar to the relation between a search engine and data.
The main problem with using only licensed sources is that it's probably not enough data. There's likely on the order of ten million words across all 5e official publications, I suspect most LLMs are trained on many billions.
If you're running an rpg... on a computer... without a DM... it's a cRPG. There is literally nothing new here. Improvements in AI will just (potentially) result in better cRPGs.
It's not a direction I'd particularly recommend Wizards head into, they'd be competing in a field they don't have a lot of experience in, I'd leave it to the video game companies and licensing deals, but there's nothing inherently heinous about it.
Hasbro just does not have the free expendable cash to create their very own AI using D&D copy writes. But they could wait for a good one to come out and partner with them to make something they want and need.
First I would like to see a digital system for each official module or world. Something the DM can use to keep track of all of his notes. Maybe even a verbal input for those who do not want to type. Maybe a way for it to cross check and find any conflicts then remind the DM.
No disagreement here. Sounds like a good idea.
Most companies don't; that is why they have to look at outsourcing the production and what services are available. Overall, I think there is a market for tools to help both D/GMs and players. I can rattle off about a half dozen ideas that make sense now, but I don't know if the service can provide a worth product at this time. It would more be a wish list or good objective.
First of all, for every new technology that's an actual paradigm-shift, there are dozens that are sold as being paradigm shifts but don't actually ever amount to anything. Hyperloop, anyone? Second of all, one of the main reasons companies are trying to jump on the AI bandwagon is so that they can fire their human employees and shift to a purely automated workforce. That's not something to be celebrated. Unless you're really excited about big businesses delivering you an inferior product for less cost to themselves (but not to you).
Find your own truth, choose your enemies carefully, and never deal with a dragon.
"Canon" is what's factual to D&D lore. "Cannon" is what you're going to be shot with if you keep getting the word wrong.
Or Segway, or Theranos, or bitcoin...
Active characters:
Edoumiaond Willegume "Eddie" Podslee, Vegetanian scholar (College of Spirits bard)
Lan Kidogo, mapach archaeologist and treasure hunter (Knowledge cleric)
Peter "the Pied Piper" Hausler, human con artist/remover of vermin (Circle of the Shepherd druid)
PIPA - Planar Interception/Protection Aeormaton, warforged bodyguard and ex-wizard hunter (Warrior of the Elements monk/Cartographer artificer)
Xhekhetiel, halfling survivor of a Betrayer Gods cult (Runechild sorcerer/fighter)
Nah, "this is stupid/looks like a scam" is different from "this is scary".
The hype cycle is very reminiscent of the ones that surrounded cryptocurrency/NFTs/metaverse, with many of the exact same people and companies hopping off that train and onto this one. It's bigger because there's something there, but the people who are massively invested in making this the next big thing are not to be trusted on its potential.
Does our long history of science fiction prime us to believe that a computer that can talk like a human can think like a human? Very much so.
Is machine learning a fascinating technology that could improve a lot of things? Yes.
Is generative 'AI' the next big thing that will create shedloads of value and revolutionize creative work? It remains to be seen.
Is it going to lead to true human-like AI? No.
Is its primary use case so far putting creative workers out of a job in order to make inferior material, along with 'search' that makes things up and even more SEO junk sites clogging up the real search? Yes.
There's only one suitable TTRPG for AI tools. Paranoia.
Jander Sunstar is the thinking person's Drizzt, fight me.
He specifically mentions using only the books WOTC owns the copyright to in the AI database.
I'm not sure how that's relevant? I'm sure the core AI code would be licensed from someone else, but it's the training data that determines what it produces.
Would that even work? How many books does WOTC own the copyright to? I was under the impression you would need something on the scale of thousands of books to train a generative AI that's even a little bit competent.
It sounds pretty questionable. WotC doesn't have any AI-building ability in the first place, they'd need to buy it from someone else and then dump their own content into it.
Find your own truth, choose your enemies carefully, and never deal with a dragon.
"Canon" is what's factual to D&D lore. "Cannon" is what you're going to be shot with if you keep getting the word wrong.
They've got fifty years of D&D artwork, although the early stuff was obviously not as detailed. They also have thirty years of Magic the Gathering card artwork. Then there will also be the thousands of pieces that were submitted by the artists they hired but was rejected for publication.
And, of course, they also have access to anything in the Public Domain.
If I steal a bunch of other people's paintings and put them in my woodchipper, do I own the confetti?
No, the code is much less important than the data. The core of large language models is a database of words, correlated along vast numbers of different axes. While there's code around it, the model's behavior isn't programmed like we're used to.
I'm pretty sure that every single word written about and for D&D throughout the last 50 years would not be enough to train a modern LLM. A customized model is (I believe) invariably done by taking one of the generic models like GPT 4, trained on whatever they grabbed off the internet, and putting it through a second round of training with the domain-specific data set. Everything in the original model is likely still there, just deemphasized.
Even if WotC did own enough material to fully train an LLM from scratch, doing so is extremely expensive.
That's a fascinating and evocative metaphor that is entirely unrelated to what's happening with an AI. A better one would be: "If I go to an art museum and look at the pieces they have on display for inspiration, am I plagiarizing if I borrow from one person's use of colors, and another's use of perspective and so on?"
For that they have fifty years of published adventures as well as podcasts. Dragon magazine was owned by TSR, then there are the licensed games such as the SSI gold box series. They've even got DM questions and answers on D&D Beyond to pull from.
But yeah, I too totally believe him when he says they're not going to use public domain items.
No, it's kind of apt.
Despite it being called "training" or "learning", what the generative models do is vastly different from what people do. (As best we understand the latter.)
Because they're probabilistic, when specific sets of words or pixels are strongly correlated and well-represented in the training data, they're very likely to show up in the output. If you give an image generator the phrase "Italian plumber", we all know the way the output's going to trend. If you ask a person to draw you an Italian plumber, you will only get Mario if they choose to draw you Mario.
That said, the legal issues around whether LLMs are infringing the copyright of their training data are complex and deeply unresolved. Transformative use is a significant fair-use principle in the US, and there's a solid argument to be made that this stuff is transformative. The fact that it's pretty easy to poke them into just spitting out training data nearly verbatim is also rather persuasive.
I think there's a real chance that we're going to see some kind of split, where they're legally legit in principle, but the massive copyright infringement committed in assembling the training data for the current models is not. But that's many years and millions of dollars in legal expenses away. (And will only apply to the US. The EU, China, etc. will have their own rulings. So much fun.)
The ethical and artistic issues are each their own cans of worms as well.
A LLM doesn't function without both data and code, but the relationship between a LLM and data is similar to the relation between a search engine and data.
The main problem with using only licensed sources is that it's probably not enough data. There's likely on the order of ten million words across all 5e official publications, I suspect most LLMs are trained on many billions.