Emotion-Puppeteer

🎭 Emotion Puppeteer 🎭

UPDATE: Now available as an SD 1.5 LoRA and SDXL LoRA

• Photoreal faces with exact control of facial expressions

• If you like the model, please post your generations!

• Safetensors and inpaint models available on Huggingface, along with training details

• These instruction apply to v2 only. There's no good reason to use v0.1.

Import Instructions

To get what you want, you should read this.

Use this prompt format for best results

• "{A} face, {B} eyes, {C} mouth, {D}, {anything else}"

• e.g. "plain face, seething eyes, screaming mouth, closeup portrait, looking away, old man with white hair"

• CFG = 5 is recommended

A - Face keywords

• plain, unattractive face - my subjective opinion - biased towards extreme emotions

• cute, attractive face - my subjective opinion - biased towards pleasant emotions

• adorable, most attractive face - my subjective opinion - strongly biased towards pleasant emotions

B - Eye keywords

• seething, >: shaped brows - scrunched brows

• grieving, <: shaped brows - scrunched brows

• widening, eyelids raised very high - brows arched

• glaring, lowered brows - eyelids lowered

• pleasing, neutral brows - eyes crecent shaped and smile crinkled

• piercing, neutral brows - eyelids neutral

• squinting, lowered brows - eyelids squeezed closed or almost closed

• winking, right eye open, left eye closes

C - Mouth keywords

• breathing, mouth relaxed and slightly open

• resting, neutral or slight relaxed frown - lips together

• smiling, smiling with lips parted - teeth together or slightly apart

• screaming, mouth wide open - lower-teeth visible or chin scrunched

• sneering, nose scrunched - left upper-lip raised - upper-teeth not bared

• singing, mouth wide open and oval-shaped

• delighting, smiling with mouth wide open

• kissing, puckered lips

• gnashing, nose scrunched - upper-lip evenly raised - teeth together - lower-teeth bared

• gasping, mouth open and frowning-bean-shaped - chin relaxed

• relaxing, slight relaxed smile - lips together

• frowning, chin and or nose scrunched - lips together

• snarling, nose scrunched - upper-lip evenly raised - lower-teeth not bared

• pouting, slight frown - lower-lip extended

• grimacing, lips apart and stretched wide - lips apart - teeth may be visible

D - Other keywords

• extreme closeup portrait, cropped at neck or closer

• closeup portrait, cropped at shoulders

• looking straight, head facing forward and eyes looking into the camera

• lookway away, head turned to three-quarters, regardless of eye direction