Plans for updates

by dosb - opened Oct 8

Discussion

dosb

Oct 8

Hi, this has been a great model. Thanks for all your work, and for releasing this to the community.

Any chance of an update with Llama 3.1? Seems like the context window has been substantially extended.

DreamGenX

DreamGen org Oct 8

Hello @dosb ! I am glad you liked it! :)

Even better, I currently working on larger and cleaner version of my dataset.

I will definitely experiment with Llama 3.1 and Qwen 2.5 as the base models in the ~70B class.

dosb

Oct 9

That's great news. Your models are still the best open storywriting models I've seen! If you ever wrote a blog post/posts on your training process, I'm sure there'd be great interest.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment