I decided to test DS's ability to act as a DM. I have a small campaign that I had an outline for.
First, I ran the outline through DS and had it create a campaign out of my outline.
I next uploaded the outline and had DS run as DM. I played 2 characters. DS added a ton of flavor in there. Names, some general backgrounds and attitudes, names of places, etc.
The interactions were pretty good. It acted out the interactions with my characters. The interactions stayed in character, relevant to the world, relevant to the character's background, and relevant to the current events that had happened both in world and with my characters.
I ran it as 1 continuous chat. No parsing. No summary. I wanted to test the limits of DS and see how far I could push it until it majorly stumbled and went completely off the rails.
To my surprise, I was able to finish the entire campaign (short)! There were a couple of stumbles. Mainly in initiative order. I had to remind it a few times who's turn it was. There were 2 other places that I noticed outside of combat. All instances of stumbles only occured later in the campaign.
It started to try and voice for my characters. I reminded it not to and it didn't again.
When I returned to the beach of the island I landed on, the ship I came on was wrecked. That one I'm on the fence on. The waters around the island were treacherous, and it is completely within reason that the ship could have beached itself while I was gone on the island.
There is a story I had written that I had it make into a campaign. That one is a bit longer but still short compared to many other campaigns. I will try to run that one next. I'm downloaded all of the LLM sizes right now. I am probably going to try that locally hosted with the 158g one. I'm going to end up adding 128g ram soon. I will try the larger size DS LLMs after that.
I'm really curious to see just how far I can push it until it completely breaks down.