Jump to content

Neural network-generated custom portraits (aka "Why haven't I seen anyone suggest this before?")


Recommended Posts

Trash batch

7 computer role playing game, player portrait. 

Are you a WEART gamer? I'm more of a Pleyec Pey person. Laclec Cag is a bit too mainstream for me, but at least their forum isn't filled with racists.

1541969785_7computerroleplayinggameplayerportrait.thumb.jpg.07d8dd08a0387f5594c03e3021299c5a.jpg

Edited by Swatcher
  • Haha 1
Link to comment
Share on other sites

43 credits remaining. [INSERT COIN]

From this trash batch, the biggest issue is DALLE2 doesn't recognize "Pillars of Eternity" unlike DALLE Mini/Craiyon.

It's harder to get portraits resembling Pillars of Eternity's art style, without the right keywords.

Need to get creative... I'm trying to think of digital/oil painting portrait terms or using other CRPGs. Maybe even other video games.

I'm open to any and all ideas for better prompts than mine

Edited by Swatcher
Link to comment
Share on other sites

dang. while the art is definitely more coherent than the other one, it's wild to me that the corpus is so different that it doesn't know what you're talking about. (lol at the AI generated craiyon poe screenshots though)

does "screenshot" as a prompt do anything?

Edited by thelee
Link to comment
Share on other sites

Mmm it might pull out some fake video game screenshots, which it has done before (for example I can invent Call of Duty 10: Space Warfare), but it won't ever be Pillars of Eternity I think. It needs to be well-known enough. Another fantasy game, on the other hand...

I'm going to try to take some advice and use more old-school fantasy artists, along with more well-known terms like D&D for this next batch.

Edited by Swatcher
Link to comment
Share on other sites

DALL-E 2: THE SECOND BATCH (Only a week left til Sep17. Anyone else, feel free to get in on this. How do we make it look like PoE?)

8 Black woman with white hair, Dungeons & Dragons portrait

374246624_8BlackwomanwithwhitehairDungeonsDragonsportrait.thumb.jpg.f75ed893730885a34d66c6c630ef1645.jpg

 

9 portrait of a male rogue with curly black hair, in the style of Frank Frazetta

1935874892_9portraitofamaleroguewithcurlyblackhairinthestyleofFrankFrazetta.thumb.jpg.8b656e30572578b001c3b3615384b42f.jpg

 

10 painted portrait of a male rogue with wavy black hair and facial hair, in the style of Larry Elmore, Dungeons & Dragons

1618129953_10paintedportraitofamaleroguewithwavyblackhairandfacialhairinthestyleofLarryElmoreDungeonsDragons.thumb.jpg.dc68c68d8a37721e41e4f8ccc94f6e11.jpg

 

11 painted portrait of a knight, in the style of Larry Elmore

1586446775_11paintedportraitofaknightinthestyleofLarryElmore.thumb.jpg.a3786296685a7ff172638ac89ebca299.jpg

#3 Earth Wind and Fire? Maurice?

 

12 painted portrait of a knight, in the style of Frank Frazetta

662375228_12paintedportraitofaknightinthestyleofFrankFrazetta.thumb.jpg.9f2922f0f47049bb6ba3bbb2482ec504.jpg

I like all these but #3 is wicked

 

13 portrait of white woman with ginger hair, Acrylic painting, classical fantasy art, Dungeons and Dragons, in the style of Frank Frazetta

1542834001_13portraitofwhitewomanwithgingerhairAcrylicpaintingclassicalfantasyartDungeonsandDragonsinthestyleofFrankFrazetta.thumb.jpg.8b3f6b614a350c38d4f6bcad5ce84554.jpg

I just threw like all the words in on the last one

______________________________________________________________________________

I'm realizing this site highly compresses each image to a few kb, so unlike the trash batch I'll be fitting these pics into one post from now on.

As expected, it's not Pillars of Eternity, but some of them are pretty cool. Wouldn't be out of place in a completely different RPG.

If in case you ever wanted to make art of characters for the classic TTRPGs

Edited by Swatcher
  • Like 1
Link to comment
Share on other sites

14/15 "The Statue of Eothas & Statue of Liberty will never be ballin—"

Spoiler

1967885640_DALLE2022-09-0921_51.17-greenstatueofabaldmanplayingbasketballagainstladylibertydramaticbacklighting.thumb.jpg.06b3676db438736dbb4659305026b333.jpg188861098_DALLE2022-09-0921_50.10-greenstatueofabaldmanplayingbasketballagainstladylibertydramaticbacklighting.thumb.jpg.65e28d200682f2c69b0bb2cd74566b94.jpg1207638117_DALLE2022-09-0921_50.47-greenstatueofabaldmanplayingbasketballagainstladylibertydramaticbacklighting.thumb.jpg.421fa4a6229d2fe0781d92a0d4aa7b54.jpg1146892055_DALLE2022-09-0921_51.07-EDITEDjadestatueofabaldmancoveredingoldfiligreedunkingonthestatueoflibertyonthebasketballcourtdramaticbacklighting.thumb.jpg.4d5aea3a4d96d7acef7367cbd97ae486.jpg

"Bah gawd she's doing it. Lady Liberty is hopping from the half-cou—  SHE'S GOING FOR THE HALF-COURT CHAOS DUNK!!! MY GOD WITH 1 SECOND ON THE TIMER LEFT, EOTHAS CRUMBLES INTO DUST. THIS IS A BATTLE FOR THE HISTORY BOOKS" 

(green color correction+crown fix—Had to edit this last one a bit admittedly)

 

EDIT:

Spoiler

So that's why they built the fingers like that.

______________________________________________________________________________________________________________

b6NVbAy9_400x400.jpgCaed Nua? Building repairs?

Untitled.jpg.487e049be0220b2acc67811c00444ebe.jpg

Untitled.thumb.jpg.3077d387961bdec3d4da8d59a6f2db1f.jpgBasketball Church

Dv2G0nzWkAExQYd.jpg:orig

Part 2

Spoiler

 

eothas-ballin.jpg "REAL SH!T".

eothas-oneal.png

"Sooner or later, we all have to lay up."

 

Edited by Swatcher
  • Haha 5
Link to comment
Share on other sites

Slowly but surely, I'm getting there.

16 male wizard, dungeons and dragons portrait, digital art

515854439_16malewizarddungeonsanddragonsportraitdigitalart.thumb.jpg.5073104acb1c6bebdd48ef7db86d7515.jpg

 

17 male wizard, dungeons and dragons D&D RPG, modern digital art portrait ('bolding' = changes or new words)

660145658_17malewizarddungeonsanddragonsDDRPGmoderndigitalartportrait.thumb.jpg.9a853a5c5d81c89dadb847ea9292dc46.jpg

 

18 male wizard, dungeons and dragons D&D RPG, modern realistic digital art portrait

1283525860_18malewizarddungeonsanddragonsDDRPGmodernrealisticdigitalartportrait.thumb.jpg.fe78ac3ff9839ed980628573046e8234.jpg

 

19 male wizard, dungeons and dragons D&D RPG portrait, modern realistic digital painting

1116420285_19malewizarddungeonsanddragonsDDRPGportraitmodernrealisticdigitalpainting.thumb.jpg.a80c99e28e5205ef3d9da2909e48fd9e.jpg

Edited by Swatcher
  • Like 1
Link to comment
Share on other sites

By the way, I should probably go over some of the other features DALL-E 2 can do. I haven't mentioned them yet.

Making variations:

Upload any image (AI or real) and DALL-E 2 can make variations of it. See this timestamp.

Editing / "Inpainting" / "Outpainting":

DALL-E 2 can fill in empty transparent areas--Say for example, you can erase part of an image to transparency and describe what you want there, and DALL-E 2 will fill in the erased area. Similarly, you can also crop out/resize an image and DALL-E 2 will fill the rest of the empty transparent canvas.

Upload must be a .png file, to support transparency. EDIT: For more on "Outpainting" see my later post. It's definitely one of the coolest, most powerful parts.

Edited by Swatcher
Link to comment
Share on other sites

Examples 

'Variations'

20: tbh Boeroer i still recognize you more by the old profile pic. Funny part is since the pic was so lowres, the AI made its images blurrier too. I didn't expect that

593404136_20boeroervariations.thumb.jpg.2804ebd24b2b9e331a372b96d10e9b71.jpg

Spoiler

Untitled.thumb.jpg.11c70d67ec206ea239030ee85b250275.jpgYes, that's the full resolution. OG pic was 100x100. The AI did this.

21

1409324122_21percyvariations.thumb.jpg.aa8a651d2075d468d23910b10577b6db.jpg

Ever wanted to beat the game with 5 of yourself? PERCY GANG PERCY GANG

A.K.A. 'Percy & his fanclub go and gang up on the rest of the Deadfire'.

Edited by Swatcher
  • Like 2
Link to comment
Share on other sites

Editing/"Inpainting"

23

76159569_2223DwayneJosh0Base.jpg.4dd09b62180a3e089a62a7a916c77e43.jpgjosh. it him

1256165428_2223DwayneJosh0.5.thumb.jpg.94c014ec42f77e3ae301d45f430f22d1.jpgoh no, someone took his face. i can fix it

here we have:

Jwayne The Rock Joshson

884392709_2223DwayneJosh1.thumb.jpg.a2df157769079f4ef4ede7b4d33e796b.jpg

Dwayne "The RocKick" Johnson

1303547872_2223DwayneJosh2.thumb.jpg.a029cad8f00cf945b002519f69c3ac3d.jpg

 

Josh "The RJOTKN" Johnson. Jrett M. Sawyer

571728179_2223DwayneJosh3.thumb.jpg.c48c68ab68cb2d78b0619e60a7a4c848.jpg

Pain "The Josh" Xianson. - Also known as Woiny

1488681379_2223DwayneJosh4.thumb.jpg.278b78b2d6939c0f4b823a80bbd4a756.jpg

The words? I think bc of Dwayne Johnson the AI took faces from movie posters which have text. lmao. AI is goofy with text. You should see how it interprets fast food signs

Spoiler

a keener eye might have noticed 22 is missing. it didn't turn out so well is why haha

 

 

1869023745_22HyperrealisticDwayneJosh.thumb.jpg.00558299605f883ca6423b6b1776f503.jpg

 

Edited by Swatcher
  • Like 1
  • Haha 1
Link to comment
Share on other sites

Yooooooo

What if instead of relying on prompts, I just do variations of existing portraits? What better way to nail the artstyle? Editing/Inpainting could work too, but I don't trust it with faces. It would have to be replacing other stuff like armor or like giving someone godlike horns or something. I at least want to try variations of a few portraits.

Edited by Swatcher
  • Like 1
  • Thanks 1
Link to comment
Share on other sites

Yeahaaaaa boiii i think we're getting somewhere with variations.

Oh, and one more thing. Before I keep going with DALL-E 2, I wanted to try a different diffusion model AI for just one post. It's a very new AI that was publicly released a few weeks ago:

b0cd19de-343f-4201-bbcb-c5e727779272

5c5af248-bf90-4f67-a007-7fc0f06be74b

76aef6d8-c9e1-49cb-a000-d808b88f167e

4d7b2cb2-2501-44c9-9b2e-92bba4cece59

a231d9ac-05fe-4bd7-ad46-a4fccb661e51

What Stable Diffusion can make

______________________________________________________________________________________________________________________

A test below I ran on the "demo" version of Stable Diffusion. Not an ideal representation of this brand new AI. You can find cooler examples on google or using the searchbar on this website.
Anyway, on my first attempt: "rogue, pillars of eternity portrait", I made an important realization.

41621368_1roguepillarsofeternityportrait.jpg.5e1c27b28466f498befd3c251fea36fb.jpg

2044733004_2roguepillarsofeternityportrait.jpg.3eae561a21d4e1ca86dab4912854ab1f.jpg

536213849_3roguepillarsofeternityportrait.jpg.8188a8a1731ff53c1ad4fa7dd2396702.jpg

1963706546_4roguepillarsofeternityportrait.jpg.504ed2466b9e5633bf23f5937a5a8a35.jpg

Hey hey, so it DOES recognize Pillars of Eternity, unlike DALL-E 2. That was such a big hurdle. This'll make generating images so much easier.

This is the open-source Stable Diffusion

Using it will take just a bit of tutorial-ing, but it's 100% free. It's much better.

Bit of context:

Spoiler

There have been a couple of different AIs that, unlike DALL-E 2, are open-source; in general with open source code, anyone is free to implement the code and if they want, run it on servers online for others. Whether they charge you for the AI is another thing. For example: the "official" version from Stable Diffusion's creators is on DreamStudio.ai and free-to-try, until the trial runs out that is, then $$$. But, that's not the only version! Far from it

For versions of Stable Diffusion you can 100% freely use, there's pre-made GUIs built off the source code that you can download, if you just google around or check the subreddit. Heck you can even run Stable Diffusion simply online on a Google Colab Notebook; pretty straightforward. Anyway, there's a million versions to use, some with huge custom modifications to the training images, thanks to being open source. Some guys even used the Stable Diffusion model to create a 'Waifu Diffusion', using Danbooru images.

And unlike the closed-source DALL-E 2, ones like this based off open-source models often have more settings you can tinker with, so you have much more flexibility over your image in comparison. You just have to learn how, which is a little trickier in my opinion. By comparison, things like DALL-E Mini are stupidly simple to use. You have so much more control here.

Or if Google Colab isn't up your alley, the simplest but slowest way to run Stable Diffusion is running the "demo" here, same as I just did w/ the rogues (you'll be competing with other people in a queue, waiting in line). It even has a few "Advanced options" there you can modify, right underneath. But, it's just a demo; Not the full range of capabilities.

The main point is, this AI model is powerful AND it's free. Go crazy.

EDIT:

Spoiler

https://old.reddit.com/r/StableDiffusion/comments/wqaizj/list_of_stable_diffusion_systems/ 

^A much more comprehensive list of systems you can use than what I mentioned, courtesy of the subreddit. Made by /u/Wiskkey (still being updated as of this edit). Check this list; There's even ways to run image variations, in addition to plug-ins like img2img--if I want to turn, say, a doodle into an AI-generated piece of artwork. Demonstration video. DALL-E 2 can't do that. This can do photos too

 

____________________________________________________________________________________________

https://lexica.art/?q=rpg+portrait <— Oh, and if you wanna skip all of that. Here's Lexica, a massive database of people's Stable Diffusion images. They look better than what I made, a better idea of how powerful the AI is. You can search whatever you want in this huge image library. After finding a good image, click "explore this style"

I'm still going to generate portraits ITT, but go check ^this link out if you want to search for a pre-made portrait that fits your tastes. I just put in "rpg portrait", but go look up whatever you can think of in the search bar. Link it here if you find some cool stuff

Edited by Swatcher
  • Like 2
Link to comment
Share on other sites

wow - i know that stable diffusion's corpus (controversially) uses a lot of stuff from deviantart and such, so it makes sense it would likely be able to understand pillars of eternity more.

i have a decent gpu at home, i need to get it a try.

with your first rogue art, even though the eye is kinda screwed up, at the same time it looks like an intentional effect (e.g. scarring).

Link to comment
Share on other sites

tbh it's probably a good thing they pull from as many sources as possible, without nsfw filters or any filters that DALL-E 2 does.

You and everyone should totally pick up Stable Diffusion. Shouldn't be too bad to set up with plenty of tutorials floating around. Once I finish up with DALL-E 2, I'm probably going to take a break anyway.

 

And speaking of DALL-E 2, back to it: Non-human races.

God, I forgot just how bad the situation was, just how few portraits there are of orlans. Literally ONE male portrait for each of their two subraces. Let's see what some variations of rare portraits look like

Aumaua too

 

 

 

Results are ...Ehhhhhhhh

24 hearth orlan variations

1036093900_24Vhearthorlan.thumb.jpg.efc4da6a178acfb87f47a97e5069d976.jpg

(to make variations look unique for your portrait, you'd have to do some re-coloring, regardless of the AI. Use PS, GIMP, etc)

 

25 wild orlan variations

247992385_25Vwildorlan.thumb.jpg.be2d6501f1a4ed2d32abe034f1b7fa73.jpg

Who are these little fellas? A buncha little gremlins. Trolls. Imps. Goblins. Duendes. Up to some devious shenanigans. Some foolish tomfoolery. Coaxing you into a snafu. They're gonna call you a b!tch.

Not really wild orlans, though.

 

26 coastal aumaua variations

1763291663_26Vcoastalaumauaf.thumb.jpg.a4a461081d9884abc56426243623a1d5.jpg

 

27 island aumaua variations

1919279645_27Vislandaumauam.thumb.jpg.7c9ccb9b9906e0da75d89f1525555c74.jpg

28

uhhhhhhhhhh

Spoiler

28. Kana variations.

724968535_28Vkana.thumb.jpg.4346f17e295a9a63f870c5957647f996.jpg

Yeah.

 

Ok maybe Variations isn't as good as I thought it was

Edited by Swatcher
  • Like 2
Link to comment
Share on other sites

I tried another idea for prompts

29-31 The Rembrandt run1441470765_29blueorcaphotographbyRembrandt.thumb.jpg.a26d360ee35e690f5b37e7f27dcb531e.jpg

ig my 'blue orc' idea wasn't as effective this time. It was something from the DALL-E Mini series on pg.1, the jokepost about 'how to make coastal aumaua'.

Now it's smurfs lol

2016686250_30arabianknightaphotographbyRembrandt.thumb.jpg.7d862660b1beb8d5ae65cb1abf0d8389.jpg

1874630795_31RPGDDknightaportraitbyRembrandt.thumb.jpg.9bc42db6579ccbc71cdc432d6335d80d.jpg

 

I was trying to see if I could recreate any of these stylistically. Like the style of this or this reddit post (the last image)

Edited by Swatcher
  • Like 2
Link to comment
Share on other sites

One more try

32. black woman with white hair, in the style of Rembrandt

1174947211_32blackwomanwithwhitehairinthestyleofRembrandt.thumb.jpg.516c95508f9768327e7b2c23d3526c50.jpg

Too realistic

 

33. black woman with white hair, wearing fantasy clothes, portrait, in the style of Rembrandt (bolded=changes)

2035516457_33blackwomanwithwhitehairwearingfantasyclothesportraitinthestyleofRembrandt.thumb.jpg.9b3b366426921137121dcd1e2a277042.jpg

 

34. portrait painted in the style of Rembrandt of a black woman with white hair, dressed like a fantasy RPG character

59139931_34portraitpaintedinthestyleofRembrandtofablackwomanwithwhitehairdressedlikeafantasyRPGcharacter.thumb.jpg.0b0d4f977e3bae050efc5e940bfdc298.jpg

"painted" changes a lot, but the style is usually way too matte (like an acrylic painting or flat-looking digital art). Its problem is its light and dark values lack a certain depth—I can't believe I'm judging the art style of an A.I., a computer, unironically. It just occurred to me. Well, at least a computer can't take it personally, I think.

 

35. realistic portrait painted in the style of Rembrandt of a black woman with white hair, dressed like a fantasy RPG character, hyperrealistic digital art

905117755_35realisticportraitpaintedinthestyleofRembrandtofablackwomanwithwhitehairdressedlikeafantasyRPGcharacterhyperrealisticdigitalart.thumb.jpg.3599aac16750df38a2de773e1888f065.jpg

I still have 11 credits left until the 17th.

 

Not recognizing Pillars of Eternity is a real kneecapper for this AI. Not that these are bad. It's just, having it instantly recognize Pillars of Eternity makes it so much easier, like with DALL-E Mini aka Craiyon. That was a weaker, less-trained AI, yet look at my profile pic compared to these and tell me which one matches the artstyle better. Probably squeezed DALL-E 2 as much as we could.

 

Stable Diffusion is definitely the way to go in the future. At least you won't need to spend $$$ or go on a waitlist. Better have enough VRAM tho

Edited by Swatcher
  • Like 2
Link to comment
Share on other sites

[screenshots of avowed, an open world RPG that combines Fallout: New Vegas and Skyrim]

Do any very specific pillars of eternity terms work? [Eothas sunbathing on a beach with Berath]

[Screenshots of Josh Sawyer's latest independent game, a pixel art Bike Shop RPG simulator]

Edited by thelee
  • Like 1
Link to comment
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
×
×
  • Create New...