어린이용 동화책 만들기

아래는 반나절정도의 시간에 AI만으로 어느정도의 창작활동이 가능한지 실험해 보았습니다.

스토리와 prompt는 다음과 같이 ChatGPT에게 부탁했습니다.

> Hi, can you write a very short bedtime story for kids?

Once upon a time, there was a little pig family that lived in a forest next to a lake. There was the eldest piglet, a boy named Wilbur, the middle piglet, a girl named Oink, and the youngest piglet, a girl named Babe. Their mother and father were both very kind and loving, and they taught their children everything they knew about living in the forest.

Wilbur was a very curious pig, and he loved to explore the forest. Oink was a little more cautious, but she was still brave and adventurous. Babe was the youngest and shyest of the piglets, but she looked up to her siblings and wanted to be just like them.

One day, Wilbur was exploring the forest when he came across a strange creature he had never seen before. It was tall and thin, with long arms and legs, and it had a big head with big eyes. Wilbur was scared at first, but the creature didn't seem to be afraid of him. In fact, it seemed to be friendly.

The creature introduced itself as a giraffe, and it told Wilbur that its name was George. George and Wilbur became fast friends, and they spent many days playing together in the forest. Oink and Babe were introduced to George as well, and they all became best friends.

One day, Wilbur's parents told him that it was time for him to leave the forest and go out into the world. Wilbur was sad to leave his home and his friends, but he knew that it was time for him to spread his wings and fly.

Wilbur said goodbye to George and his sisters, and he left the forest to explore the world beyond. He had many adventures, and he met many new friends, but he always remembered his time in the forest and his best friends, George and the pig sisters.

스토리가 좀 짧다 싶으면 "Can you write a bit longer version of it?" 이라고 부탁하면 조금 더 길게 다시 써줍니다.

다음은 prompt 생성을 부탁합니다. 웹으로 공개된 버전은 아직 Stable Diffusion에 대해 학습이 안되었는지 이해를 못하는 듯 했습니다. AI 이미지 생성에 대해 물어보니 "DALL-E"를 예로 드는것을 확인해서 아래와 같이 하니 그럴듯한 prompt를 생성해 주었습니다.

> With this story, can you generate a list of DALL-E prompts?

Draw the little pig family living in their cozy home in the forest next to the lake.

Create an image of the three piglets playing together in the forest.

Generate an image of Wilbur, the eldest piglet, going on an adventure in the forest.

Draw Oink, the middle piglet, being cautious but brave in the face of danger.

Create an image of Babe, the youngest piglet, looking up to her siblings and wanting to be just like them.

Generate an image of Wilbur meeting George, the tall and friendly giraffe, for the first time.

Draw the four friends, Wilbur, Oink, Babe, and George, playing together in the forest.

Create an image of the little pig family saying goodbye to Wilbur as he leaves to explore the world.

Generate an image of Wilbur having an adventure in a new and unfamiliar place.

Draw Wilbur reuniting with George and his pig sisters after his adventures, happy to be back with his old friends.

여기서 우리의 화가 AI는 캐릭터 이름같은건 잘 모르기때문에, 알아듣기 쉽게 prompt를 좀 손봐주고, 그림 스타일도 추가해서 아래와 같이 스크립트를 만들었습니다.

--prompt "watercolor, three piglets living in their cozy home in the forest next to the lake."

--prompt "watercolor, three piglets playing together in the forest."

--prompt "watercolor, a piglet, going on an adventure in the forest."

--prompt "watercolor, a piglet, being cautious but brave in the face of danger."

--prompt "watercolor, a piglet, looking up to her siblings and wanting to be just like them."

--prompt "watercolor, a piglet meeting the tall and friendly giraffe, for the first time."

--prompt "watercolor, three piglets and a giraffe playing together in the forest."

--prompt "watercolor, two piglets saying goodbye to a piglet as he leaves to explore the world."

--prompt "watercolor, a piglet having an adventure in a new and unfamiliar place."

--prompt "watercolor, a piglet reuniting with a giraffe and two piglets after his adventures, happy to be back with his old friends."

한개의 프롬프트당 넉넉하게 8장씩 그리도록 시켜두고 인간은 책을 편집할 준비를 합니다. 저는 단순히 그림과 글만 들어가면 되었기 때문에, 간편하게 Google Slides를 사용했습니다만, 익숙한 다른 도구가 있다면 무엇이든 상관 없을 것 같습니다.

최종 수정은 어차피 그림이 들어간 다음에 할 것이기에, 간단히 페이지별로 글만 복사해 넣고 폰트 종류와 크기, 디자인 정도만 살짝 손을 봐 줍니다. 그러는 사이에 이미 AI가 앞 페이지에 들어갈 그림을 완성했네요. 배경에 이미지를 넣고 그럴듯하게 다듬어봅니다. 그 이후로는 AI가 뿜어대는 그림중에 마음에 드는 것을 골라서 각 페이지에 넣는 반복 작업입니다. 아래는 그 결과물입니다. slide에서 export한거라 parameter 정보는 없습니다. 다른 그림도 동일한 parameter에 seed와 prompt만 다른거라 첫 페이지 것만 올렸습니다.

parameters

watercolor, three piglets living in their cozy home in the forest next to the lake.
Negative prompt: (worst quality, low quality:1.4),
Steps: 20, Sampler: Euler a, CFG scale: 7, Seed: 367629172, Size: 512x512, Model hash: 4c13cf9c00, Model: hasdx_hasedsdx

작업은 여기서 중단했습니다. 이유는 바로 문제가 된 다음 prompt 때문이었습니다.

"a piglet meeting the tall and friendly giraffe, for the first time."

"three piglets and a giraffe playing together in the forest."

AI가 다른 두 종류의 캐릭터를 동시에 그리려고 하면서 원하는 결과물을 얻을 수 없었습니다. prompt를 정교하게 손을 보던가 아니면 따로 그려서 합성하는 추가 노력이 들어가지 않는 이상, AI에게 모두 시키기에는 어려운 상황인 것 같습니다.

아래는 평화롭게 숲에서 놀고있는 돼기린(?)이들의 모습입니다. 실패작이지만 묘하게 끌리는 매력이 있네요.

watercolor, three piglets and a giraffe playing together in the forest.
Negative prompt: (worst quality, low quality:1.4),
Steps: 20, Sampler: Euler a, CFG scale: 7, Seed: 2649201772, Size: 512x512, Model hash: 4c13cf9c00, Model: hasdx_hasedsdx

이와 같은 현상은 Tarot 카드의 "Strength: A woman holding a lion's mouth open with her bare hands." 에서도 자주 목격했던 부분으로, 아래 그림처럼 woman이 lion과 합쳐지는 것과 동일해 보입니다.

Strength: A woman holding a lion's mouth open with her bare hands. art by EMB_skstest3
Negative prompt: (worst quality, low quality:1.4),
Steps: 20, Sampler: DPM++ 2M Karras, CFG scale: 7, Seed: 3324745849, Size: 512x880, Model hash: dce6b18d01, Model: dalcefoV3Painting_dalcefoV3Painting

마지막으로 개인적인 감상과 결론입니다.

저작권 문제등 법적 해석에 대한 숙제는 남아있지만, AI만으로 어느정도의 창작 활동은 가능하다는 것은 이미 다양한 분야에서 검증이 되어가고 있는 상황이라고 생각합니다.실제로 예전같으면 1~2주는 족히 걸렸을법한 동화책 만들기가 반나절만에 뚝딱 나오는 생산성 향상을 피부로 직접 느낄 수 있었습니다.

다만 아직 완벽하지 않은 부분도 존재하며, 과도기가 지나면 해결될지 모르겠지만, 아직은 인간의 손길이 필요한 부분도 분명히 있어 보입니다.