Recipe three: How to add depth to your drawings
Aug 19, 2024Today I’ll show you how I create 3D characters by experimenting with prompts and using the results to re-train a model. This method won’t work for every model, but it might spark some new ideas for experimentation. The results are unpredictable, but when they work they’re stunning. Plus, it’s actually quite simple!
1. Using pop-culture characters to train a model is particularly effective – it’s something AI excels at – so I started by drawing these minimal but recognizable characters and fed them to a model.
2. While playing around with it, I thought they would make fantastic sculptures. Through trial and error, I incorporated various words like CGI, 3D render, plastic texture into my prompts. The result was a variety of 3D characters, some in a style that aligned with design trends today.
3. But out of all of my generations, the 3D effect I was looking for was rarely coming up. This was frustrating, so I gathered all the successful generations and trained a model based on those.
4. Adding certain materials to the prompts like '3D render' made for better results. I became curious to repeat this, so I very quickly sketched up characters that looked like they were made of sausages.
5. The prompt '3D render' didn’t work for them, but when I tried 'product photo of sculpture made of sausages' the result was amazing. The plasticity of my drawing was subtly echoed in the sausages.
6. Here's another model where I made ceramic figurines based on my drawings.
7. The other model follows the classics of Soviet propaganda cartoons "Kukryniksy", originally consisting of complex metaphors, metamorphoses, and dynamic poses. I couldn't achieve any specific metaphors, but it turned out to be some kind of crazy madness. Here I would like to note that exactly.ai recognised the era by the illustrations, and the photos of the sculptures turned out to be of that time.
I haven't seen anyone else use this method of converting 2D into 3D in AI, and I'm very curious if you try to do the same and show what comes out of it.
By perfecting prompts and training models on successful outputs, you can experiment with depth and dimension too. Start with something simple and try it out for yourself.