"I am always doing that which I cannot do, in order that I may learn how to do it."
— Pablo Picasso

If you read my previous guides, you know my prompting strategy is highly minimalist. I keep my prompts as simple as possible. And when going for a complex one, I will comprise it of smaller parts that I know work by themselves. It allows control and repeatability of the outcome.

The idea is to check that Midjourney can interpret specific parts of the final complex prompt on their own in a given style.

However, in this study, the prompts used to achieve the final results are the exact opposite of my approach. They are wordy, seem half-random, and some parts don't make sense—even as stand-alone prompts.

The method we will dive into today can be such a fantastic creative tool that I, for once, will step away from my cozy and controlled prompt strategy. (≧∀≦)

IMAGE TO TEXT TO IMAGE

In a nutshell, CLIP Interrogator 2 (available to play with at Huggingface for free↗) analyzes an image and comprises a prompt based on what it "saw."

It's difficult to believe, but despite the inflated and often absurd prompts, their interpretation is stunningly close to the original. It seems like an AI knows how to talk to another AI... |。_。|

CLIP Interrogator's primary goal is Stable Diffusion prompts. However, the experience of using its prompts in Midjourney is simply fantastic! It gives you a whole new perspective on creating art in MJ and launches a creative journey to chaos, full of unexpected insights and mind-blowing visuals.

CLIP Interrogator has a very straightforward interface, works fast (all samples in this study were interpreted in between 30 to 120 seconds each), and has only four settings.

Different modes render different results, and each is worth experimenting with. For this study, however, I primarily used the default Best mode.

NEW PERSPECTIVE

I started the previous chapter with an example from my photographic portfolio. Of course, it's not the only one. :) For visual artists with a portfolio of past works, CLIP Interrogator is an excellent instrument to re-imagine their work and look at it with fresh eyes.

Of course, I couldn't help but start by offering CLIP Interrogator the portrait of Francis D. for interpretation.

Apart from looking at your own work through different optics, I easily imagine text-to-image helping artists overcome creative blocks. How about not just getting a prompt from an image but developing a whole story from one picture?

IMAGE TO TEXT TO STORY TO IMAGE

Undoubtedly, you've heard about ChatGPT ↗. So I'll skip the introduction and cut to the chase: I used it to generate a sensible short story from the CLIP Interrogator's results. Here is what I asked:

Please, rewrite the following gibberish into a sensible text. Use all the words from the original.

And this is what happened:

But how about we remove the limitation and let ChatGPT run wild(er)?

Please, rewrite the following gibberish into a short story (think of it as a movie still). Use all the words from the original.

You can help us maintain and expand Midlibrary and produce more regular educational content of higher quality. And keep it free for all!

Support Midlibrary on Patreon! →

All samples are produced by Midlibrary team using Midjourney AI (if not stated otherwise). Naturally, they are not representative of real artists' works/real-world prototypes.

We'll be grateful for shares and backlinks!

Ver. 2.8.3

Midlibrary by
Midlibrary.
Bob Mackie
Andrei Kovalev's Midlibrary
Suggest a style

Midlibrary Catalog grows largely through the contributions of our Community.
Thank you for taking time to share your suggestion!

THANK YOU!

Your submission has been received. 

We will now test it and add it to Midlibrary Catalog if Midjourney recognizes the suggested style(s).
In case you left your email, we will notify you when it happens!


Something went wrong while submitting the form. Please, check that you filled all fields.
We're here to help! If you're unable to resolve the issue, please, contact us.
Report a bug

We do our best to keep this website running as smoothly as possible.
However, stuff happens. Thank you for letting us know about it!

THANK YOU!

Midlibrary Groundskeeper has been notified about the issue
and—if you left your email—will come back to you ASAP.


Onward to Midlibrary →
Something went wrong while submitting the form. Please, check if you filled all fields.
We're here to help! If you're unable to resolve the issue, please, contact us.
Subscribe to Midlibrary Newsletter

Every week we publish a new Midjourney study and a new Editor's Pick.
Receive our newsletter to never miss an important Midlibrary update!

After you subscribe, you will receive one email weekly. We never share your email with anyone outside our team and infrastructure. Don't worry, after signing up, you can unsubscribe from our newsletter anytime.

Thank you for subscribing!

IMPORTANT

  • Please, make sure to add [email protected] in your mailer White List.
  • If you don't receive a newsletter by Sunday morning: please, check your Spam folder.
Onward to Midlibrary →
Something went wrong while submitting the form. Please, check that you filled all the fields.
We're here to help! If you're unable to resolve the issue, please, contact us.
Rename Collection
Create new Collection
Personal Libraries
are available to our
Patreon Community
Andrei Kovalev's Midlibrary Patreon Community

Check out the benefits of becoming a Midlibrary Patron ↗︎

You have just became a Patron, and cannot log in?
1. Please, allow our Technical Department up to 24 hours to set up your Personal Library.
2. You may be using different emails for your Patreon and Discord accounts. If that is the case, please, send your Discord email to [email protected].
3. If you are still having issue, please, inform us via Bug Report form.

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.