The Hitchhiker's Guide to AI

Hi Hitchhikers,

I’m excited to share another interview from my podcast, this time with David Kossnick, Product Manager at Coda. Coda is a collaborative document tool combining the power of a document, spreadsheet, app, and database.

Before diving into the interview, I have an update on Parcha, the AI startup I recently co-founded. We’re building AI Agents that supercharge fintech compliance and operations teams. Our agents can carry out manual workflows by using the same policies, procedures, and tools that humans use. We’re applying AI in real-world use-cases with real customers and we’re hiring an applied AI engineer and a founding designer to join our team. If you are interested in learning more, please email [email protected].

Also don’t forget to subscribe to The Hitchhiker’s Guide to AI:

Now, onto the interview...

Interview: Supercharging your team with Coda AI | David Kossnick

I use Coda daily to organize my work, so I was thrilled to chat with David Kossnick, the PM leading Coda’s AI efforts. We discussed how Coda built AI capabilities into their product, and their vision for the future of AI in workspaces, and he gave me some practical tips on how to use AI to speed up my founder-led sales process.

Here are the highlights:

* The story behind Coda’s AI features: Coda started by allowing developers to build “packs” to integrate with their product. A developer created an OpenAI pack that became very popular, showing Coda the potential for AI. At a hackathon, Coda explored many AI ideas and invested in native AI capabilities. They started with GPT-3, building specific AI features, then gained more flexibility with ChatGPT.

* Focusing on input and flexibility: Coda designed flexible AI to work in many contexts. They focused on providing good “input” to guide users. The AI understands a workspace’s data and connections. Coda wants AI to feel like another teammate—able to answer questions but needing to be taught.

* Saving time and enabling impact: Coda sees AI enabling teams to spend less time on busywork and more time on impact. David demonstrated how Coda’s AI can summarize transcripts, categorize feedback, draft PRDs, take meeting notes, and personalize outreach.

* Tips for developing AI products: Start with an open-ended prompt to see how people use it, then build specific features for valuable use cases. Expect models and capabilities to change. Focus on providing good "input" to guide users. Launching AI requires figuring out model strengths, setting proper expectations, and crafting the right UX.

* How AI can improve team collaboration: David shared a practical example of how AI can help product teams share insights, summarize meetings and even kick-start spec writing.

* Using AI for founder-led sales: David also helped me set up an AI-powered Coda template for managing my startup's sales process. The AI can help qualify leads and draft personalized outreach emails.

* The future of AI in workspaces: David is excited about AI enabling smarter workspaces and reducing busywork. He sees AI agents as capable teammates that understand companies and workflows. Imagine asking a workspace about a project's status or what you missed on vacation and getting a perfect summary.

* From alpha to beta: Coda’s AI just launched in beta with more templates and resources. You can try it for free here: http://coda.io/ai

David’s insights on developing and launching AI products were really valuable. Coda built an innovative product, and I'm excited to see how their AI capabilities progress.

Thanks for reading The Hitchhiker's Guide to AI! Subscribe for free to receive new posts and support my work.

Episode Links

Coda’s new AI features are available in Beta starting today and you can check them out here: http://coda.io/ai.

You can also check out the founder-led sales CRM I build using Coda here: Supercharging Founder-led Sales with AI

Transcript

HGAI: Coda AI w/ David Kossnick

Intro

David Kossnick: ,One of our biggest choices was to make AI a building block initially. And so it can be plugged in lots of different places. There's a writing assistant, but there's also AI, you can use in a column. And so you can use it to fill in data, you can use it to write for you to categorize, for you, to summarize for you and so forth across many different types of content.

David Kossnick: Having that customizability and flexibility is really important. I'd say the other piece more broadly is there's been a lot of focus across the industry on what, how to make good output from AI models and benchmarks and what good output is and when do AI models hallucinate and lie to you and these types of things.

David Kossnick: I think there's been considerably less focus on good input. And what I mean by that is like, how do you teach people what to do with this thing? It's incredibly powerful, but also writing natural language is really imprecise and really hard.

AJ Asver: Hey everyone, and welcome to another episode of the Hitchhikers Guide to ai. I'm your host, AJ Asver and in this podcast I speak to creators, builders, and researchers in artificial intelligence to understand how it's going to change the way we live, work, and play. Now, You might have read in my newsletter that I just started a new AI startup

AJ Asver: since starting this startup a few months ago, a big part of my job has been attracting our first set of customers. I love talking to customers and demoing our product, but when it comes to running a founder-led sales process, prospecting, qualifying leads, And synthesizing all of those notes can be really time consuming, and that's exactly why I decided it was time to use AI to help me speed up the process and be way more productive with my time.

AJ Asver: And to do that, I'm gonna use my favorite productivity tool, Coda. Now, if you haven't heard of Coda, it's a collaborative document editing tool that's a mashup of a doc, a wiki, a spreadsheet, and a database.

AJ Asver: In this week's episode, I'm joined by David Kossnick, who's the product manager that leads Coda's AI efforts. David's going to share the story behind Coda adding AI to their product. Show us how their new AI features work, and give me some tips on how I can use AI in Coda.

AJ Asver: By the way, I've included a template for the AI powered sales CRM I built in the show notes, so you can check it out for yourself.

AJ Asver: But before I jump into this episode, I wanted to share a quick update on my new startup At Parcha, we're on a mission to eliminate boring work. Our AI agents make it possible to automate repetitive manual workflows that slow down businesses today.

AJ Asver: And we're starting with FinTech in compliance and operations. Now, if you're excited by the idea of working on cutting edge autonomous AI and you're a talented applied AI engineer or designer based in the Bay Area, we would love to hear from you. Please reach out to [email protected] if you wanna learn more about our company and our team.

AJ Asver: Now, let's get back to the episode. Join me as I hear the story behind Coda's latest AI features in the Hitchhikers Guide to AI.

AJ Asver: hey David, how's it going? Thank you so much for joining me for this episode.

David Kossnick: It's going great. Thanks for having me on today.

What is Coda?

AJ Asver: I am so excited to, go deeper into Coda's AI features with you. As I was saying at the beginning of this episode, I've been using Coda's AI features for the last month. It's been kind of a preview and it's been really cool to see, it's capable of. I'm already a massive Coda fan, as you know. I used it previously at Brex. I used it to organize my podcast and my newsletter, and most recently it's kind of running behind the scenes at our startup as well for all sorts of different use cases. But in this episode, I'd love to jump in and really understand why you guys decided to build this and what really was the story behind Coda's AI tools and how it's gonna help everyone be more productive.

AJ Asver: So maybe would you describe and what exa…

This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit operatorsguidetoai.substack.com

Interview: AGI and developing AI Agents with Josh Albrecht, CTO of Generally Intelligent

I’ve been spending a lot of time researching, experimenting and building AI agents lately at Parcha. That’s why I was really excited I got the chance to interview AI researcher Josh Albrecht, who is the CTO and co-founder of Generally Intelligent. Generally Intelligent’s work on AI Agents is really at the bleeding edge of where AI is headed.

In our conversation, we talk about how Josh defines AGI, how close we are to achieving it, what exactly an AI researcher does, and his company’s work on AI agents. We also hear about Josh’s investment thesis for Outset Capital, the AI venture capital fund he started with his co-founder Kanjun Qui.

Overall it was a really great interview and we covered a lot of ground in a short period of time. If you’re as excited about the potential of AI agents as I am or want to better understand where research is heading in this space, as I am this interview is definitely worth listening to in full.

Here are some of the highlights:

* Defining AGI: Josh shares his definition of AGI, which he calls Human-level AI a machine’s ability to perform tasks that require human-like understanding and problem-solving skills. It involves passing a specific set of tests that measure performance in areas like language, vision, reasoning, and decision-making.

* Generally Intelligent: General Intelligence's goal is to create more general, capable, robust, and safer AI systems. Specifically, they are focused on developing digital agents that can act on your computer, like in your web browser, desktop, and editor. These agents can autonomously complete tasks and run on top of language models like GPT. However, those language models were not created with this use case in mind, making it challenging to build fully functional digital agents.

* Emergent behavior: Josh believes that the emergent behavior we are seeing in models today can be traced back to training data. For example being back to string together chains of thought could be from transcript of gamers on Twitch.

* Memory systems: When it comes to memory systems for powerful agents, there are a few key things to consider. First of all, what do you want to store and what aspects do you want to pay attention to when you're recalling things? Josh’s view is that while it might seem like a daunting task, it turns out that this isn't actually a crazy hard problem.

* Reducing latency: One way to get around the current latency when interacting with LLMs that are following chains of thought with agentic behavior is to change user expectations. Make the agent continuously communicate updates to the user for example vs. just waiting for to provide the answer. For example, the agent could send updates during the process, saying something like "I'm working on it, I'll let you know when I have an update." This can make the user feel more reassured that the agent is working on the task, even if it's taking some time.

* Parallelizing chain of thought: Josh believes we can parallelize more of the work done by agents in chain of thought processes, asking many questions at once and then combining them to reach a final output for the user.

* AI research day-to-day: Josh shared that much of the work he does as an AI researcher is not that different from other software engineering tasks. There’s a lot of writing code, waiting to run it and then dealing with bugs. It’s still a lot faster than research in the physical sciences where you have to wait for cells to grow for example!

* Acceleration vs deceleration: Josh shared his viewpoints for both sides of the argument for accelerating vs decelerating AI. He also believes there are fundamental limits to how fast AI can be developed today and this could change a lot in 10 years as processing speeds continue to improve.

* AI regulation: We discussed how it’s challenging to regulate AI due to the open-source ecosystem.

* Universal unemployment: Josh shared his concerns that we need to get ahead of educating people on the potential societal impact of AI and how it could lead to “universal unemployment”.

* Investing in AI startups: Josh shared Outset Capital’s investment thesis and how it’s difficult to predict what moats will be most important in the future.

Episode Links:

The Hitchhiker’s Guide to AI: http://hitchhikersguidetoai.com

Generally Intelligent: http://generallyintelligent.com

Josh on Twitter: https://twitter.com/joshalbrecht

Episode Content:

00:00 Intro

01:42 What is AGI?

04:40 When will we know that we have AGI?

05:40 Self-driving cars vs AGI

07:10 Generally Intelligent's research on agents

09:51 Emergent Behaviour

11:07 Beyond language models

13:17 Memory and vector databases

15:25 Latency when interacting with agents

17:13 Interacting with agents like we interact with people

19:08 Chaing of thought

19:44 What do AI researchers do?

21:44 Accelerations vs. Deceleration of AI

24:05 LLMs as natural language-based CPUs

24:56 Regulating AI

27:31 Universal unemployment

Thank you for reading The Hitchhiker's Guide to AI. This post is public so feel free to share it.

This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit operatorsguidetoai.substack.com

Hi Hitchhikers!

I’m excited to share this latest podcast episode, where I interview Charlie Newark-French, CEO of Hyperscience, which provides AI-powered automation solutions for enterprise customers. This is a must-listen if you are either a founder considering starting an AI startup for Enterprise or an Enterprise leader thinking about investing in AI.

Charlie has a background in economics, management, and investing. Prior to Hyperscience, he was a late-stage venture investor and management consultant, so he also has some really interesting views on how AI will impact industry, employment, and society in the future.

In this podcast, Charlie and I talk about how Hyperscience uses machine learning to automate document collection and data extraction in legacy industries like banking and insurance. We discuss how the latest large-scale language models like GTP-4 can be leveraged in enterprise and he shares his thoughts on the future of work where every employee is augmented by AI. We also touch on how AI startups should approach solving problems in the enterprise space and how enterprise buyers think about investing in AI and measuring ROI.

Finally, I get Charlie’s perspective on Artificial General Intelligence or AGI, how it might change our future, and the responsibility of governments to prepare us for this future.

I hope you enjoy the episode!

Please don’t forget to subscribe @ http://hitchhikersguidetoai.com

Thanks for reading The Hitchhiker's Guide to AI! Subscribe for free to receive new posts and support my work.

Episode Notes

Links:

* Charlie on Linkedin: https://www.linkedin.com/in/charlienewarkfrench/

* Hyperscience: http://hyperscience.com

* New York Times article on automation: https://www.nytimes.com/2022/10/07/opinion/machines-ai-employment.html?smid=nytcore-ios-share

Episode Contents:

00:00 Intro

01:56 Hyperscience

04:52 GPT-4

09:41 Legacy businesses

11:13 Augmenting employees with AI

15:48 Tips for founders thinking about AI for enterprise

20:34 Tips enterprise execs considering AI

23:49 Artificial General Intelligence

29:41 AI Agents Everywhere

32:12 The future of society with AI

37:44 Closing remarks

Transcript:

HGAI: Charlie Newark French

Intro

AJ Asver: Hey everyone, and welcome to the Hitchhiker Guide to ai. I am so happy for you to join me for this episode. The Hitchhiker Guide to AI is a podcast where I explore the world of artificial intelligence and help you understand how it's gonna change the way we live, work, and play. Now for today's episode, I'm really excited to be joined by a friend of mine, Charlie Newark, French.

AJ Asver: Charlie is the CEO of hyper science, a company that is working to bring AI into the enterprise. Now, Charlie's gonna talk a lot about what hyper science is and what they do, but what I'm really excited to hear Charlie's opinions on is how he sees automation impacting our future.

AJ Asver: Both economically, but as a society, as you've seen with recent launch of G P T four and all the progress that's happening in AI, there's a lot of questions around what this means for everyday knowledge workers and what it means for jobs in the future. And Charlie, has some really interesting ideas about this, and he's been sharing a lot of them on his LinkedIn and I've been really excited to finally get him on the show so we can talk. Charlie also has a background in economics and management. He studied an MBA at Harvard and previously was at McKinsey, and so he has a ton of experience thinking about industry as a whole, enterprise and economics and how these kind of technology waves can impact us as a society.

AJ Asver: If you are excited to hear about how AI is gonna impact our economy, our society, and how automation is gonna change the way we work, then you are gonna love this episode of The hitchhiker Guide to ai.

AJ Asver: Hey Charlie, so great to have you on the podcast. Thank you so much for joining me.

Charlie: Aj, thank you for having me. I'm excited to discuss everything you just talked about

AJ Asver: maybe to start off, one of the things I'm really excited to understand is how did you end up at Hyper Science and what exactly do they do?

Hyperscience

Charlie: Yeah, hyper Science was founded in 2014. It was founded by three machine learning engineers. so We've been an ML company for a long time. My background before hyper science was in late stage investing. Had sort of the full spectrum of outcomes there.

Charlie: Some why successful IPOs, some strategic acquisitions, and then a lot of miserable, sleepless nights on some of the other areas. I found, hyper science, incredibly impressed with, their ability to take cutting edge technology and apply it to real well problems. We use machine vision, we use large language models, and we use natural language processing, and we use that those technologies to speed up back office process.

Charlie: The best examples here are a loan origination, insurance claims processing, customer onboarding. These are sort of miserable long processes, a lot of manual steps, and we speed those up. With some partners taking it down from about 15 days to four hours.

Charlie: So all of that data that's flowing in of this is who I am, this is what's happened, this is the supporting evidence. We ingest that. It might be an email, it might be a document. It's some human readable data. We ingest that, we process it, and then ultimately the claims administrator can say, yes, pay out this claim, or no, there's something.

AJ Asver: Yeah, so what, what you guys are doing essentially is you had folks that were previously looking at these documents, assessing these documents, maybe extracting the data out of these forms, maybe it was emails, and entering those into some database, right? And then decision was made, and now your technology's basically automating that. It's kind of sucking up all these documents and basically extracting all that information, helping make those decisions. My understanding is that with machine learning, what you're really doing is you've kind of trained on this data set, right, in a supervised way, which means you've said like, this is what good looks like.

AJ Asver: This is what, you know, extracting a, a, a data from this form looks like now we're gonna teach this machine learning algorithm how to do it itself. Now what what I found really interesting is that, That was kind of where we made the most advancements, really in kind of AI over the last decade, I would say.

AJ Asver: Right? It's like these deeper and deeper neural networks. They could do machine learning in very supervised ways, but what's recently happened with large language models especially, is that we've now got this like general purpose AI that, you know, GPT-4, for example, just launched this. and there was an amazing demo where I think the CTO of OpenAI basically sketched on like the back of a napkin, a mockup for a website, and then he put in in GPT and it was able to like, make the code for it.

AJ Asver: Right. So when you think about a general purpose, let large language model like that, compared to the machine learning, y'all are using do you consider that to be a tool that you'll eventually use? Do you think it's kind of a, a threat to like the companies that have spent the last, you know, 5, 6, 7 years, decades, maybe kind of perfecting these ma machine learning tools or, you know, I, is it something that's gonna be more like different use cases that won't be used you know, by your customers?

GPT-4

Charlie: Open ai ChatGPT, GPT-4. Anything that's been, the technology you're speaking about has really had two fundamental impacts. There's been the technology. It's just very, very cutting edge, advanced technology. And then you've got the adoption side of it. And I think both sides are as interesting as each other.

Charlie: On the adoption side, I sort of like to compare it to the iPhone that there was a lot of cutting edge technology, but what they did is they made that technology incredibly easy to use. There's a few thi…

This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit operatorsguidetoai.substack.com

Note: This episode is best experienced as a video: https://www.youtube.com/watch?v=KDD4c5__qxc

Hey Hitchhikers!

MidJourney V5 was just released yesterday so it felt like the perfect opportunity to do a deep dive on prompting with a fellow AI newsletter . Linus creates amazing MidJourney creations every day ranging from retro rally cars to interior design photography that looks like it came straight out of a magazine. You wouldn’t believe that some of Linus’s images are made with AI when you see them.

But what I love most about Linus is his focus on educating and sharing his prompting techniques with his followers. In fact, if you follow Linus on Twitter you will see that every image he creates includes the prompt in the “Alt” text description!

In this episode, we cover how Linus shares how he went from designer to AI influencer, what generative AI means for the design industry, and we go through a few examples of prompting in MidJourney live. One thing we cover that is beneficial for anyone using MidJourney for creating character-driven stories is how to create consistent characters in every image.

Using the tips I learned from Linus, I was able to create some pretty cool Midjourney images of my own, including this series where I took 90s movies and turned them into Lego!

I also want to thank Linus for recommending my newsletter on his substack, which has helped me grow my subscribers to over a thousand now! Linus has an awesome AI newsletter that you can subscribe to here:

I hope you enjoy the episode and don’t forget to subscribe to this newsletter at http://HitchhikersGuideToAI.com.

Show Notes

Links:

- Watch on Youtube: https://bit.ly/3mWrE5e

- The Hitchhikers Guide to AI newsletter: http://hitchhikersguidetoai.com

- Linus's twitter: http://twitter.com/linusekenstam

- Linus's newsletter: http://linusekenstam.substack.com

- Bedtime stories: http://bedtimestory.ai

- MidJourney: http://midjourney.com

Episode Contents:

00:00 Intro

02:39 Linus's journey into AI

05:09 Generative AI and Designers

08:49 Prompting and the future of knowledge work

15:06 Midjourney prompting

16:20 Consistent Characters

28:36 Imagination to image generation

30:30 Bonzi Trees

31:32 Star Wars Lego Spaceships

37:57 Creating a scene in Lego

43:03 What Linus is most excited about in AI 46:10 Linus's Newsletter

Transcript

Intro

aj_asver: Hey everyone. And welcome to the Hitchhiker's guide to AI. I am so excited for you to join me on this episode, where we are going to do a deep dive on mid journey.

aj_asver: MidJourney V5, just launched. So it felt like the perfect time for me to jump in with my guests, Linus Ekenstam. And learn how to be a prompting pro.

aj_asver: Linus is a designer turned AI influencer. Not only does he have an AI newsletter called inside my mind, but he's also created a really cool website where you can generate bedtimestories for your kids. Complete with illustrations. And he is a mid journey prompting pro. I am constantly amazed by the photos and images that Linus has created using mid journey. It totally blows my mind.

aj_asver: From rally cars with retro vibes to bonsai trees that have candy growing on them. And most recently hyper-realistic photographs of interior design that looked like they came straight out of a magazine. Linus is someone I cannot wait to learn from. And he's also going to share his perspective on what all this generative AI means for the design industry, which he has been a part of for over a decade. By the way it's worth noting that a lot of the stuff we cover in this episode is very visual. So if you're listening to this. As an audio only podcast. You may want to click on the YouTube link in the show notes and jump straight to the video when you have time.

aj_asver: So if you're excited about I'm one to learn how you can take the ideas in your head and turn them into awesome images. Then join me for this episode of the Hitchhiker's guide to AI.

aj_asver: Thank you so much for joining me on the Hitch Hiker's Guide to ai. Really glad to have you on the podcast. I feel like I'm gonna learn so much in this episode.

Linus Ekenstam: Yeah. Thank you for having me.

Linus Ekenstam: I mean, I'm not sure about the prompt, you know, prompt guru, but let's try

aj_asver: Well, I mean, you tweet about your prompts every day.

aj_asver: on Twitter, and they seem to be getting better every time. So You are my source of truth when it comes to becoming a great prompter. And I also, by the way, love the one thing you do when you tweet your mid journey kind of pictures that you built, um, that you've created, that you always add in the alt text on Twitter. Um, exactly what the prompt was. And I found that really helpful. Cause when I'm trying to work out how to use Mid Journey, I look at a lot of your alt texts. So, um, also include a link to your Twitter handle so everyone

Linus Ekenstam: Nice

aj_asver: it out. But I guess

Linus Ekenstam: I guess I'll stop.

aj_asver: you know, you've been in the tech industry for a while as both a designer and a founder as well

Linus Ekenstam: Yeah. Yep.

aj_asver: love to hear your story on what made you, um, kind of get excited about AI and starting an AI newsletter and then, you know, sharing everything you've been learning as, as you go.

Linus's journey into AI

Linus Ekenstam: Yeah. I mean, if we rewind a bit and, and we start from the beginning, um, I got into the tech industry a little bit on a banana, like a bananas ski. I, I started working in, like, the agency world when I was 17. I'm 36 now, so 19 years ago, time flies. Um, and after like working with, um, customers, clients, and big ones as well, through like, through my initial years there, I kind of got fed up with it.

Linus Ekenstam: And. . I went into my first SaaS business as an employee and it was email like way, way, way, way, way before this day and age, right, where you had to like code everything using tables and transparent GIFs. It was just a different world.

Linus Ekenstam: And 2012 was like, that's when I started my first own business. And that was like my first foray into like the, the startup world or like building something that was used by people outside of the vicinity of, of, of Sweden or Nordics. Um, it was very interesting times. Um, and I, I've always been kind of like early when it comes to New tech, I consider myself being a super early adopter. I got Facebook as like one of the first people in. By hacking or like social hacking a friend's edu email address. And I got an MIT email address just so I could sign up on Facebook.

Linus Ekenstam: Um, so now that we are here, it's like I've been touching all of these steps, like all the early tech, every single time, but I never really capitalized on it or I, I never really pushed myself into a position. I would contribute, but this time around I just, you know, I felt like I had a bit more under my belt.

Linus Ekenstam: I've seen these cycles come and go, uh, and I just get really excited about like, oh s**t. Like this is the first time ever that I might get automated out by a machine. So my response or flight and fight response to this was just like, learn as much as possible as quickly as possible, and share as much of my learnings as possible to help others.

Linus Ekenstam: Cannot not end up. In the same position where they fear for their lives.

aj_asver: Yeah, it's, it's interesting you talk about that because I think that's a huge motivator for me as well. It's just help people understand that this AI technology is coming and it's not like it's gonna replace everyone's job, but it certainly is gonna change the way we work. And make the way we work very different. And as -you've been doing and sharing, you know, how to prompt and what it means to use ai, one of the things I've noticed is you've also received a little bit of backlash, you know, from other designers in the space

Generative AI and Designers

aj_asver: That maybe as embracing of AI as you have. And I, I know recently there were probably two or three different startups that announced text to UX products where you can basically type in the kind of, uh, user experience you want and it generates, mockups right which I thought was amazing and I thought, You know, that would take years to get to, but we've got that now.

Linus Ekenstam: yeah, you

Linus Ekenstam: post.

aj_asver: and I think one of the things you said was designers need to have less damn ego and lose the God complex.

aj_asver: Tell

aj_asver: me a little,

aj_asver: what the feedback has been like in the AI space around kind of how it's impacting design, especially your field.

Linus Ekenstam: So I think, um, there, there is this like weird thing going on where. They're a lot of nice tooling coming out and engineers and, and, and developers. You kind of embrace it. They just like have a really open mindset and go, yeah, if this can help me, you know, I'll, I'll, I'll use it.

Linus Ekenstam: Like, take Github Copilot is a good example. People are just raving about it and, and there is some people that are like, oh, it's, it's not good enough yet, or whatever. But like the general consensus is that this is a great tool, it's saving me a lot of time and I can focus on like more heavy lifting or thinking about deeper problems.

Linus Ekenstam: But then enter the designer , like turtleneck, you know, black, all dressed in black. I mean, I'm, I, I'm one of those, right? So I'm, I'm, I'm making fun of myself as well. I'm not just pointing fingers at others here. I just think it's like weird that. Here's a tool that comes along and it's a tool, it won't replace you.

Linus Ekenstam: Like I'm being slightly sarcastic and using like marketing hooks to get people really drawn in, in my content on Twitter. So I'm not really, meaning, it's not literal. I'm not saying, Hey, you're gonna be out of a job. It's more like, You better embrace this because like the change is happening and the longer you stay on the sidelines, the, the, the more of a, a leap that your peers will have that are starting to embrace this technology.

Linus Ekenstam: And I, it's so weird to see like people being so anti and it's like, it's just a tool. It's not, it's not like the tool itself is dangerous. It's like people with the tool will become dangerous and they will threaten your position. Right. So I just find it very interesting to this whole kind of landscape where people, on one hand, it's just embracing it and people on the other hand are just like, no, I'm not, I'm not gonna touch it cuz he can't do X or he can't do Y.

Linus Ekenstam: It's like, bear with you. It's like we're in the very, very early days of ai. , we might be seeing half a percent or 1% of what's possible. And these tools are here today, like you said. Um, so I think my kind of like vantage point is like I'm not looking at the next six months or the next 12 months. I'm just like drawing out an arc and going like, where are we 20, 30?

Linus Ekenstam: My whole game here is to get as many people as possible.

Linus Ekenstam: Ve well versed into these tools as fast as possible. Like, I want to make sure that the divide between the people that haven't got experience and the people that haven't yet played with these tools kind of make sure that divide doesn't grow too big. I think that's my mission really.

aj_asver: Yeah, You pointed out there there about how, you know these advancements are happening really quickly and you want people to be able to adopt the tools is I think a really important one. And I think a lot of people don't really understand conceptually how exponential advancements kind of work. And I think Sam Altman recently had this good quote where he said something along along the lines of, when you're standing on an exponential qu curve, it's flat behind you, but it's like vertical in front of you, right?

aj_asver: And we're like like climbing this exponential curve, and I think some of us probably see the writing on the wall of how quickly this is all gonna happen. But for other people, know there's always gonna be this resistance. You mentioned like how this tool is gonna help people and people should embrace it, and you of course share a lot of what you are learning and especially when it comes to prompting and you and the art of kind of prompting in mid journey to create interesting images.

aj_asver: And I think you've done some prompting on ChatGPT as well

Linus Ekenstam: Yeah,

Prompting and the future of knowledge work

aj_asver: One thing I'm curious about is, do you think that's the future of the, like knowledge work for us? Is it gonna be like we all just become really good prompt engineers and we're just prompting away when it comes to like writing, you know, writing documents or when it comes to creating design in ux or when it comes to, you know, making images or, or do you think there's more to it than that?

Linus Ekenstam: I think prompting the way that it's done now is gonna be very short-lived. Um, if we're doing an analogy and compare, like prompting with ai, with what we're people that are doing really root level programming, let's say assembly type code for computers.

Linus Ekenstam: Um, so we're in the age now where everything is new, uh, and the way to interact with these models, whether. ChatGPT or Mid Journey or Dolly or Stable Diffusion. It's a very, very root level. Uh, I think I'm, I'm already starting to see like products popping up that are precursors or like tools that put, put themselves like a layer on top.

Linus Ekenstam: So instead of writing like a 200 keyword, Um, prompt to mid journey. You're essentially writing like five words or 10 words that's very descriptive of what you want. And then the precursor takes care of like generating the necessary keywords for you.

Linus Ekenstam: I don't think we'll see these like prompt tags where people figure out me included, figuring out like ways to, you know, if you do this in this sequence or this order, you will able to do. This with a, with a, you know, with a model. Right. Um, I think we'll see less of that potentially, um, and, and move more towards like really natural language and, and less kind of like prompt engineering around it.

Linus Ekenstam: But I think very, um, important here to note is that the kind of like precursors will happen, like we will kind of move away from talking assembly line situation with AI models and that's also like, that's a barrier to entry right now. If you look at mid journey, you want to get. A lot of the things you need to just overcome is kind of how do you write what you want to get?

Linus Ekenstam: Because like if you just write, I want this image that does X, Y, and Z, you're probably not gonna get the thing that you have in your mind. So it's gonna be like you trying out different things and then getting to like slowly speak ai.

Linus Ekenstam: Don't focus too much on becoming like a, a super good prompter, right? To try to, to learn more like principles or techniques or, or, or like think more, um, holistically about this whole thing. How do you interact with ai? I think that's, uh, yeah, something I would recommend

aj_asver: I liked your analogy of, you know, assembly language and how we're all kind of writing assembly code right now. Um, another analogy I've also heard is like, it's, it's like DOS before Windows came and we're all kind of at the command line trying to get what we want by typing it into a computer before someone, you know, made like a user interface around it.

aj_asver: You know, very famously, you know, Xerox Park did it and then Apple was the one who kind of released the version of it. And I, I think that's gonna be something. We'll, all welcome. But in the meantime, I'm curious, how did you kind of learn that steep learning curve of becoming really great at prompting?

aj_asver: Because we all kind of start from zero here, and I think the example you gave where you said like, you know, you think you can just come in and describe what you want. That's exactly how I started. I was

Linus Ekenstam: I was just like

aj_asver: I'm just gonna the the scene and then it didn't end up anything. like wanted

aj_asver: What was your journey of becoming good at prompting and, and learning how to use the journey effectively?

Linus Ekenstam: I think the, the community's really well set up, uh, with my journey that you can. You can go onto midjourney.com and you can start kind of exploring what everyone else is doing. Um, initially I didn't really understand that they actually had a website. Um, but, but then after a few, I guess a few months, then I'm like, oh, there's actually a website here.

Linus Ekenstam: And maybe it wasn't there in the beginning either, so it might be that I just missed it completely. So I think like dissecting other people's work and trying to figure out like, oh, this was a nice cinematic shot. How did I get that look? Um, and, and mind you, like, I've been doing this now for a few months, or yeah, almost half a year.

Linus Ekenstam: Um, and it, it was really different. There was less people using the tool like six months ago than there is now. So I think. It's easier to jump into the tool now and see what others are doing and kind of learning by do, like learning by dissecting essentially. I think it's the same with design. Like if you're learning design today, like the best way is just to try to replicate as much work from everyone else as possible. And I'm not saying replicate in the sense of like, oh, that's a nice prompt, command C, command V, oh, now I did it. Um, that's k that's, that's not learning to prompt . All that it's very easy if you, if you find something you like, you wanna make your own derivative of it, go ahead.

Linus Ekenstam: I mean, that's the beauty of these tools as well. But if you really want to like learn the skill or like, you know, I have this idea I want to do, then I can go do this. But then I must say there's also some really talent. People, uh, on Twitter and elsewhere that are sharing their journeys as well, and, you know, figuring out ways to, to structure their prompts or, yeah, th there there's a bunch of people that we could potentially look at later or, or that we could recommend in the show notes.

Linus Ekenstam: Um, for sure.

aj_asver: Yeah, that would be, that would be great. And I think for people that aren't familiar, the way Mid Journey works is you, you have the website where you kind of explore existing images, but all of the work of creating Images is done through their Discord, which

aj_asver: Unintuitive to anyone that's not familiar with online communities and with Discord, which Discord itself is a fairly new phenomenon from the last like three or four years right? It was originally used in gaming, but now it's used a lot in communities across ai, across crypto and other and other places. And so was another thing that got, that took a while to get used to is like interacting with AI via Discord. But there's one cool advantage of it that I didn't really fully grasp until now, which is that I can pick up my phone and jump in the Discord any time when I have an idea for an image and just start making images.

aj_asver: One of the things I'm curious about, you've been doing this for about six months, ballpark, how many images have you created

Linus Ekenstam: I think I just passed, like the 10 K club. I'm not sure. I'm gonna have to look later.

aj_asver: I mean, one thing I would love to do in this episode, um, is learn from you some of the skills of like, you know, being a pro prompter in, in, uh, MidJourney. So I was wondering if we could kind of jump into it and maybe one, take a look at some of the creations you've done in the past. Walk us through a little bit, um, how you, how you came up with them and then I have a few ideas of things I wanna do in Midge. Maybe you can help me, um, make that happen.

Linus Ekenstam: Let's jump into it.

Midjourney prompting

aj_asver: Awesome. So we're gonna jump into Mid Journey now, and Linus is gonna show us some of the images he's created, give us a bit of a sense of kind of his approach to prompting and then we're gonna jump in and do a few examples too

aj_asver: So one area, for example, that I would love to learn more about is consistent characters in Mid journey. After we did the podcast, uh, with Ammar, where we built the, where we created the, um, children's book, a lot of people asked, oh, how do you get consistent characters across all the pages of the children's book in the illustrations? So I'm really curious about how you achieve that, cuz that's something I've struggled with as well.

Linus Ekenstam: This is interesting. So, um, it, it started with, A lot of people trying to achieve the same thing using mid journey, which is essentially, you know, you have a character, you want the character to be in different poses or in different photos or in different, you know, could be a car cartoon, it could be a real person.

Linus Ekenstam: Uh, and I saw different ways of doing it, and mainly they were for cartoons. Then I'm like, this doesn't not work well with a human. Uh, cuz I tried and it didn't work. So I'm like, there must be some other way to do this. Uh, and obviously this is like brute forcing a password really cuz like mid journey is not supposed to be this tool.

Linus Ekenstam: Uh, the best way to do consistent characters is to use stable diffusion or something else that you can pre-train on a set of images.

Consistent Characters

Linus Ekenstam: the, the way that I went about doing it is essentially, , uh, going to how illustrators work and when, when they create like a character for, for a movie or for an animated, whatever it might be that they're doing, they need reference materials so that other artists can work on the same characters.

Linus Ekenstam: You might have hundreds of artists working on the same character. Um, so then, you know, looking at how they are doing these, I'm like, maybe if I simplify this, what if, you know, I take left and right and up and down, and. and I used those images as inspiration cuz that's something you can do in my journey.

Linus Ekenstam: You can like image prompt, essentially just like putting an array of images and then adding your prompt. So I, I, I went about like starting up making a character, um, just using like a very simple prompt here. I didn't really have any intent of, of, of the output. I just like, let's make journey, do its thing.

Linus Ekenstam: Um, and then when I, I, I found one that I kind of like, oh, this could be nice. Let's work with this. Um, I started using something called a seed. and use that image. So a seat is essentially the noise number or the random noise that an image gets started from. So if. For anyone that doesn't know, you know, mid journey is a diffusion model, which essentially starts from noise and it takes a string of text and it uses that text to take the noise and transform it into an end result.

Linus Ekenstam: So if you want to know the pattern, the exact pattern of the noise that you're starting from, you can include a seed number and it's like randomly generated every time you do an image. So if you have an image and you use the seed and you prompt against that seed again, uh, the likelihood of getting something very similar is quite.

Linus Ekenstam: So I, I kind of went away and, and started doing different angles of this woman. And then once I had more angles, um, I put the angles together. So I'm just scrolling through here, but essentially just finding those up, down, left, right, and forward. And when I was happy with all of them, I just put them together in a long prompt.

Linus Ekenstam: Um, and then just having the same prompt again as the first time, you know, uh, a style, a, a, a portrait shot of a woman. Um, street photo of a woman shot on Kodak, which is essentially just like the, the type of film I wanted to emulate. And then I get the e exact woman out and, hi, this is like, you know, okay, now here we go.

Linus Ekenstam: Uh, what can we do with this? Right? Uh, and there is a bunch of things, like a bunch of learnings, um, from this, which is essentially like you can. Very specific images, if you have a bunch of, of images that you're using as the inspiration images,

Linus Ekenstam: but also when you do these technique. My kind of the, the culprit here is that I use street style photos.

Linus Ekenstam: So every time I'm trying to get her to do other things, like we can go over here. Uh, I, I wanted to try to get her in a, in a space suit, right? We can see that she's kind of in a space. , but she's still standing on a street. So

aj_asver: It's like a very, like a urban chic space suit,

Linus Ekenstam: yes, . It's an urban cheek spacesuit. And we can even see here, like try some different, um, ar like some different aspect ratios. She's in a spacesuit, but we still have the background of, of the street, right? So, . One way to combat this and that, you know, figure this out after the fact that I made this tutorial is like the, the, the source material, the source MAs that you're using, they should be isolated.

Linus Ekenstam: They should be like either against a transparent background or a white background. And that way all of a sudden you can start placing this woman in different areas. So what's neat about this, that you don't need to train a model. You only need to have a set of image. So let's say you have six or nine images that are your inspiration images, and they don't have to be AI generated either.

Linus Ekenstam: You could use like yourself, you can take photos of you from the different angles and put them together. Um, and I think a lot of people, it resonated with a lot of people because this is one of these things that are inherently hard to do in my journey, and there is quite a big use case for it. So I, I, I personally hope that, you know, my journey goes into the direction of kind of a little bit.

Linus Ekenstam: Stable effusion or Leonardo, where they're giving you tools to do these kind of things like fine tuning, but not maybe to the extent of like training your entire, your own model completely. Right. And we can look at this example. I think this is very nice as well. Like we can get her smiling cuz that was one of the things that, you know, people, oh, you used all these photos, which she's not smiling, you're never gonna get her to smile.

Linus Ekenstam: Uh, and basically you can like, there's a lot of like things you can do, even though mid journey is very. Has very opinionated. So there are ways to work around this. And if we're like diving a little bit into prompting here, um, we can just, let's, let's grab this full command here. Um, and we can,

Linus Ekenstam: yeah. Sorry,

Linus Ekenstam: Yeah.

aj_asver: Was you basically reverse engineered how, you know, a character animator would approach this idea of consistent characters. And the way they do it is they have different poses of a character that they kind of create first. So you kind of have a base, kind of almost like a sculpture that hasn't been fully molded yet. So to get an understanding of the character, you generated those using ai, but you could also have a. you know, photos you already have of a person or maybe you take photos of yourself at different angles. Then you inputted that as actually with the prompt, you inputted the images too, that was what allowed you to kind of then create these consistent characters cuz you now have this base image to work from. one of the things you said was, if you want to be able to change the background, so move them from like street photos for example, to be in space, you kind of need to remove the background from the original base images because that's that background. If you keep it in there, like the street photos has a street background is gonna influence what mid journey creates as well.

Linus Ekenstam: Yeah, correct. Um, let's , I just pushed this in here. Let's see if my journey does something with it. Sometimes when you're using a lot of high resolution, um, inspiration images, it actually crashes the, the bot. So it doesn't work. Oh, we're actually getting something that's good. So, uh, it's not entirely sure we're gonna get a smiling woman this time, but the way to kind of like force smiling for example, is give smiling a very high weight.

Linus Ekenstam: So when you're using, um, Let's see if I can scroll in here. Yeah. So when you are adding, uh, is it colon? Yeah. Is it colon, semicolon? Um, colon? Yeah, colon. Colon five, for example. Then you give smiling. The word smiling, uh, a weight of five. Uh, I think standard weight is like zero or one, I think one. Um, so we're really emphasizing here that we want her to be smiling and now I think we actually got something.

Linus Ekenstam: And it might not be that she's smiling in all of. , but she's, uh, kind of smiling . Forced,

aj_asver: got like a little bit

Linus Ekenstam: yeah. a bit of a forced smile. Uh, but

aj_asver: smile. Yeah.

Linus Ekenstam: yeah, and this is the thing. I mean, mid journey is opinionated and you, you might have to do re-roll, you might have to do things like over and over. And because it's not really trained on her smiling or being neutral is actually trained on her being.

Linus Ekenstam: Angry or just very like,

Linus Ekenstam: uh, so re-roll is like, essentially press a button here in, in, in this cord and it takes the exact same, uh, prompt, the same parameters, and a different seed so it won't use the same noise again. So it will start from the beginning One more time. Uh, if you wanted to get like more diverse outputs, we could use chaos, which is essentially how chaotic the difference is between the four image.

Linus Ekenstam: that we're going for. So we could add, uh, dash C and then let's say a hundred. So this value goes between zero and a hundred, and it will d dictate the difference between the four different images. So we can see up in, yeah.

aj_asver: I noticed, um, by the way, that there's a few different kind of arguments you can add to the end of your. Mid journey prompt, and I think one that you use often is aspect ratio. Um, and then chaos is one. You just mentioned hph and hph, and C. Where did you learn about these and how does someone kind of work their way around trying all these different ones?

Linus Ekenstam: um, i, I mid journey.com, they have like documentation I think people are a bit afraid of, of the documentation because they might not know what they're looking for or like, um, yeah, it, it's not that hard. Like when, when you're prompting in mid Journey and then you go like, okay, there is like, I think, uh, 6, 7, 8, 9.

Linus Ekenstam: Nine different arguments that you can use. So it's like aspect ratio, chaos. Quality seed stylized tile, which not many people know, and version and quality. So version, you don't need it if you're not. Like now it comes preloaded with the latest model. So if you just add dash dash V four four, it actually uses an older model.

Linus Ekenstam: Um, so a lot of prompts you'll see will have dash, dash, v4, uh, not necessary. So essentially now the model that's running is V4 C, which is like the third iteration of v4, uh, and quality two. You can go quality one, two, and up to five, I think. But they've done a lot of testing internally. people can't tell the difference between Q1 and q2.

Linus Ekenstam: Like, so it's just a waste of GQ 10 because essentially when you're doing quality two, you're gonna use twice as much GPU render time. And GPU render time is essentially how long, um, of like, how much of your credits get used to render an image? Um,

aj_asver: it. So high quality means if you're paying for mid

Linus Ekenstam: yeah.

aj_asver: actually to use the bot directly versus the

Linus Ekenstam: Yes. Yeah.

aj_asver: it's gonna cost more per image basically.

Linus Ekenstam: Yeah.

aj_asver: I notice as well is that you also include some details around how the shot is taken, right? The actual camera. Um, is, does that make a lot of difference kind of picking the, the camera? Because I noticed that was a pretty cool thing that I didn't, I wasn't aware of actually until I saw your, your images.

Linus Ekenstam: Yeah, I think we're, there's a bunch of people that I've, like, I, I saw this like in December, the first time. I think like people using camera. Like it's shot on a canon or it's shot on a hassle blood, or it's shot on an icon, or it's shot on this type of film, you know, emulating black and white film or emulating sepia tone film.

Linus Ekenstam: Um, and then now I think it's, there's a lot more people that are kind of dissecting it and like really going nitty gritty on it. Um, and, and trying to just be like, what are the things that we can do with this? Like, how. , how much can we describe with this? And it's, as it turns out quite a lot, especially like camera angles type of shots.

Linus Ekenstam: Like, you know, using wide, ultra wide narrow, you can go and use like lens parameters. So like for those that are interested in photography, um, you, you could use 50 millimeters, so 50 mm. Um, to, to decide kind of the, the, the, the framing of your shot and kind of what. Output should look like because it has a very distinct look.

Linus Ekenstam: You could go 80 millimeter, 120 millimeter tele lens. All these things matter. Actually, it matters quite a lot cuz if we go here and, and check some of the photos I did the other day about, so I did some, uh, national Euro graphic shots, right? So these are quite interesting where we have like, um, shot on the telephoto lens as one of the key things.

Linus Ekenstam: So what it does, it really gives you this super consumed in

Linus Ekenstam: photo with like bulky in the background. So you have a really blurred background and we can see that, like my journey is really good with hair. Um, and the compression might blow it, blow it down a bit, but Maur is fantastic with hair and feathers and fibers.

Linus Ekenstam: I'm not sure what they've done there, but it's, it's absolutely fantastic. Um, so yeah, and lens matters quite a lot.

aj_asver: you are, what you're doing there is really kind of imagining the camera you would take this photo with if it was a real photo, and using those, um, those properties of the camera as parts of the prompt. And one of the things I also noticed with your prompts is you are not necessarily describing the scene.

aj_asver: You are often described lots of, characteristics of the scene, right. What is your approach when it comes to, you have this idea in your head, uh, you, you, you kind of, ima have this idea in your imagination of what you wanna create and then getting that down into a prompt. How do you, how do you approach that?

Imagination to image generation

Linus Ekenstam: um, I mean, in the beginning I, I did write a really interesting one. Threads on this as well. Cause I was sitting in a restaurant you mentioned earlier that like, that, you know, it runs in Discord. You can bring up your phone, you can start prompting. I was, um, we're, I got two kids, right? And me and my partner, we actually had like the first weekend without kids, um, since pre pandemic.

Linus Ekenstam: So we basically haven't been out alone. And, and you, what, what I do, I sit with my phone in mid journey. That came out bad anyhow, we were sitting there and we're actually using it together. So we were like, we're talking, we're talking about like what we're building with bedtimestory and then we saw this like really nice geisha on the world cuz we were eating at an Asian fusion restaurant.

Linus Ekenstam: And I'm like, I wonder if I can do that mid journey. And then we're just like, you know, open up discord on the phone and we're sitting there chatting, drinking a little bit and just like, oh, okay, we, you know, let's try this. I think I ended up doing like 50, maybe 50 or 60 generations where like the initial.

Linus Ekenstam: Was a geisha, but it didn't look anything like the thing we saw on the wall, right? Because the, the geisha on the wall was like on a wooden plaque,

Linus Ekenstam: uh, just like a really nice white geisha face mask and some red, really tiny red, uh, pieces in it. So we basically just went like, iterated removed, you know, added, redacted.

Linus Ekenstam: It's just like added words, removing words, try different things, went completely crazy and go, what if we just take away all of this and write something completely different? Um, so it it, it's easy if you have an idea, right? That to just like continue to, to plow through. And then once you hit what you want, then you have that kind of like base prompt.

Linus Ekenstam: Then you can start altering that you. Exchange an a subject or an object or exchange a post or, but, but you have kind of your, your, your base prompt figured out.

Linus Ekenstam: So getting to the base prompt could be tricky. Sometimes you hit gold after just a few tries. Um, it really depends, uh, on what it is that you're looking to create.

Bonzi Trees

Linus Ekenstam: Right?

Linus Ekenstam: I had luck with like bon's eyes, for example. I just, what can I do bons eyes with, with ma journey and how does that work? You know? And I just type like, uh, pine tree bonsai. Why wait a minute. Like this is fabulous. You know, I, I, I think I made some bonis again yesterday just for fun. Um, so like raspberry bonai, that's, that's, this is the prompt.

Linus Ekenstam: This is it, you know, it's not harder than that. And like, you could do

Linus Ekenstam: raspberry. That's it. , right? And, and, and you can, you can, you can, you can imagine, you can do thousands of thousands of these, right? Uh, and you can be crazy about it. You can do, like, I think I did Candy Bon. Yeah. Here we go. Ken Bonk. Who, who knew

aj_asver: it's got like lollipops.

Linus Ekenstam: Yeah.

aj_asver: that bonai tree is something my kids would absolutely adore. So I, I had this idea, um, Linus, um, I would love to learn kind of how to do this. Um, and I have a concept in my head and I was wondering if we could try it out,

Linus Ekenstam: Yeah. Let's, let's,

aj_asver: if we, we can kind of bring it to life.

Linus Ekenstam: yeah, let's try

Star Wars Lego Spaceships

aj_asver: So the concept is I also have two kids and they're four and they are absolutely obsessed with Star Wars right

aj_asver: got their first two Star Wars Lego sets and now they want like everything in the collection.

aj_asver: And they went to the library recently and got a book, and the book just has all these Star Wars, um, Lego ships in it. And it made me think like that would be a cool, fun thing to do in Mid Journey is like create imaginary Star Wars kind of spaceships. And so I was just wondering how would I approach that?

aj_asver: Um, do I just type in Star Wars spaceships made out of lego. Do I need to kind of think about how it's shot? Do I need to think about kind of the features? And so that's my idea. Star Wars Lego spaceships. How do we turn that into a cool, mid journey image?

Linus Ekenstam: Okay, let, let's just start straight off with, with what you just said, like Lego , Lego Star Wars spaceship. We we're probably just gonna get something that's very similar to what what's already in, um, in Star Wars, but with some kind of reim to Lego. Mid journey is relatively good at like, creating Lego. So we're gonna have to figure that one out. Star Wars. Um, spaceship. actually we're gonna put,

aj_asver: It's already starting to generate some images and, and the cool thing about mid gen is it kind of shows you bit by bit as it's evolving, right?

aj_asver: They already look pretty, pretty cool from the, from the outset. Okay. So we got some Star Wars Lego images.

Linus Ekenstam: it doesn't re does it look Star Wars, though?

aj_asver: It, it kind of looks like, um, yeah, it, it doesn't look like a Star Wars ship, I would imagine existing in the Star Wars world, but it has some kind of Lego vibes about it.

Linus Ekenstam: Let's try to see if we can get an imperial. Maybe in a pure cruiser or something that's also a known set. Maybe there is something that we could go crazy about instead. So when we started with Spaceship and we wanted to be Nubian fighter, um, maybe we want it to be like silver with, um, loose stripes.

Linus Ekenstam: Want the side shots. See if we can get something there.

Linus Ekenstam: So

aj_asver: you just typed

Linus Ekenstam: So,

aj_asver: in Star Wars spaceship and then Nubian fighters. You're trying to be a bit more specific about it. And then you also added some color hints as well, right? Silver with with white stripes and then Lego. That was an important part

Linus Ekenstam: Yeah, and I've also added side shot here to make sure that we get the, the, the, the model from the side. I'm not sure we will actually get it, uh, the way we want here. And I'm also not sure a Nubian fighter is, well this, this was the first one, like the imperial, some imperial ship here still.

aj_asver: to look a bit more, a bit more like a

Linus Ekenstam: Yeah,

aj_asver: I think.

Linus Ekenstam: it looks like Star Wars Lego, but it's still, I don't know, mid Journey is doing some weird things here with like, I think it's trying, oh, okay. Now, now let's,

aj_asver: ones, when you described a specific type of, um, ship, it looks a bit closer. So, I mean, another one we could try is like, you know, a tie fighter or an or an X-wing. Oh,

Linus Ekenstam: yeah.

aj_asver: looks a lot more like Lego right now. So

Linus Ekenstam: Yeah.

aj_asver: see something come to shape. It looks a lot more like a Lego we might have.

aj_asver: So maybe we could try like X X-wing fighter or tie fighter.

Linus Ekenstam: Let's try with X-wing. X-wing, and we want it silver with orange stripes. Maybe we want it like in space. See, I think the, the thing thing that I, the, the, what I'm kind of doing when I'm promming is like, I'm really kind of playful with it. I don't really mind if it takes me a hundred shots to get something.

Linus Ekenstam: Uh, sometimes it's a bit frustrating because like you think you, you kind of get down into this rabbit hole and you just like, I'm, I'm doing the right thing, you know, I'm writing these things, why it's not giving me what I want. Um, but then either just like remove completely and you start over and you do something different.

Linus Ekenstam: you just like try a different image and then come back to it because like maybe you have some other things that you want to try out. Um, but I think this, this might turn out great actually. Then, then again, the, the X the X-wing is a known object, right? So I would be surprised if, if we wouldn't get anything here.

Linus Ekenstam: I think where mid journey might China is like trying to combine, um, things. But if we want something that looks outta Star Wars, um, especially in Lego, there we go. This doesn't look.

aj_asver: This looks like it could be a real Lego set now. So we've got like a couple of different riffs on X-Wing. They have like really big engines, which is, which is really cool, and lots of lasers, which the kids absolutely

Linus Ekenstam: Yeah.

aj_asver: And you just clicked U2 there. Now what that does is that upscales, the second image, right when you hit U2 and

Linus Ekenstam: Yeah, so I, I just wanted to see kind of like what we would get if we, if we kind of like tried to get this in a slightly larger, uh, resolution. So these images are relatively low rest, I think when you're doing 69. Let, I'm doing now aspect ratio 69. We're gonna see, like, the image is 600, um, 640 pixels white.

Linus Ekenstam: so, And what I did here now is like when, when you have a shot, uh, a co, a collection of images that you get back, if you react with the envelope emoji, you get back the, the job id, um, the seed number and the four individual images.

Linus Ekenstam: So singular images, if you. If you want to save them low rest, and if you're doing like image prompting where, where you kind of put images into the prompt as well to give some, like, to give the prompt some inspiration. This is a neat way to like make sure you're using low risk images instead of like pushing the highest definition images into, into the image prompt.

Linus Ekenstam: Cuz that could slow down my journey quite a lot.

Linus Ekenstam: Um,

aj_asver: that gave you four individual images. Instead of

Linus Ekenstam: yeah.

aj_asver: one image, which

Linus Ekenstam: Yeah.

aj_asver: it's kind of four, the default is one image of four things in a grid. Right. And instead it generated four different images. And to do that, you clicked on the envelope emoji. So that is like a super, um, that's like a really great Easter egg for people to know.

aj_asver: Cause I would not have known that if, if you hadn't told me. So, envelope emoji. Gives you the original images, um, in low res, which you can then use to feed back into mid journey.

Linus Ekenstam: And, and again, this, yeah, this is impressive cuz if we consider what's happening here, it's like the, the model is interpreting our Lego as like actually building something in Lego. It it, it kind of tries to do that and emulate that. And if we look at the lighting here, the reflection in the cockpits, we can see that it's like shot with some kind of studio lighting over overhead lighting.

Linus Ekenstam: Um, ah, look at this. This turned out great. Wow. I'm, I'm surprised myself, so

Creating a scene in Lego

aj_asver: is so cool. And, um, I have one more challenge for you. This one's a little bit harder. We'll see if we can make it happen. So I

aj_asver: I was lego.

aj_asver: okay, this is cool, but it's even more fun if you can create a scene, right. With a few different characters in it and the Lego, uh, the, and the Lego, um, figurines too.

aj_asver: So I was wondering if we could give that a try. I have this, um, I have this fun idea for a Twitter thread where you recreate scenes from famous TV shows in movies in Lego in Mid journey. So maybe we can start with like a Star Wars one or we can, we, we can do a different one. Um, but I think that could be an interesting one to try too, because one of the things that I think is a little bit harder is when you have characters or multiple characters and you're trying to get, get, get a scene going.

aj_asver: So how would you approach that?

Linus Ekenstam: Actually I, I think this is an interesting one cuz like, okay, let's do, we have a scene in mind from Star Wars that we would like to try to reenact? Um.

Linus Ekenstam: So what I would, I would, what I would then do is like, I would pro, I probably do something like this where I would go and look for, For source material, like what is it that I'm trying to create, like to get an idea for how it looks, right? So, uh, I think this one is relatively cool. Um, I'm not sure we could actually do this, but this could be an interesting experiment.

Linus Ekenstam: So let's copy this image address and let's try to use this as an image prompt. So we go imagine, and then we paste the image url and then we say,

aj_asver: so you're pasting URL of a Star Wars scene that you found on Google Image search. Right.

Linus Ekenstam: Yeah, so I don't know her name here, but this is Finn, right? And what's her name? This is from the later Star Wars. So we go Finn

aj_asver: should know this cause we talk about Star Wars characters all the time.

Linus Ekenstam: star Wars Finn Running, and then it's BBB eight rolling, uh, sand Dunes and uh, Lego. We want to do aspect ratio 69. So we have the image and what I'm doing now, I'm basically just describing the image that we're looking at, um, and. Adding that as the prompt and adding Lego. We could actually just make sure we weight this, so we go Lego important.

Linus Ekenstam: Uh, and let's see. So here is a bit of like, if you listen in on the mid journey, um, all hands or in the way they call 'em community chat or, or town halls. Um, you'll hear, uh, the founder speaking a lot and the team speaking a lot about how the next evolution of of prompt. Probably gonna be image to image or like, people will do a lot of stuff using an image, um, or images, multiple images.

Linus Ekenstam: And I kind of agree because like, um, if I have a, if I have the ability to kite, either just take a, a snapshot of something or I grab something on the internet and I can like, take that and mesh it with something else and then put my prompt on it, the, the likelihood of me getting what I want is like 10 times higher

Linus Ekenstam: than if I'm just like, uh, writing.

Linus Ekenstam: Prompts

Linus Ekenstam: So this did not turn into Lego at all. So let's skip the idea of using the image prompt. And let's try something else. So Lego Star Wars is known, right? There is,

aj_asver: Mm-hmm.

Linus Ekenstam: uh, Lego Star Wars. So what are we trying to do? We're trying to do a cinematic shot, maybe, um, what's gonna happen in there? Who we're gonna have, we're gonna have some new. Storm troopers maybe Darth. Sorry, I'm going a bit slow here. I'm just thinking, um, we want to, one, we want to talk about lighting perhaps.

Linus Ekenstam: If we try, try this, sorry. Cinematic Darth Vader, indoors, --ar 6:9.

aj_asver: I noticed by the way, that you put Lego Star Wars Co on at the beginning. Is that something you can do to kind of set the, the scene

aj_asver: of

Linus Ekenstam: Yeah, I act, Actually I should have done this. Select do a multi prompt. So we're deciding that like the first part of the prompt is Lego Star Wars. Like that's like just pure definition. And then we want the cinematic shot with Stormtrooper Star Vader indoors.

Linus Ekenstam: Actually, this is probably gonna give us something that's relatively good,

Linus Ekenstam: So it interpreted this, well, I don't, I don't think it turned it into a multi promptt, but it worked anyway, so yeah. Here we go. We have Lego

aj_asver: start to see an actual cinematic scene.

aj_asver: Okay. So now we, you know, did a few different iterations and by adding Lego Star Wars at the beginning of the prompt, we actually got to a scene or a few different scenes where we have storm troopers, we have Darth Vader, we even have a lightsaber.

aj_asver: And the background actually looks like it's Lego too. So this is really, really cool. I feel like, um, we made a lot of progress on here and this is giving me a ton of inspiration. I'm gonna go off and make my own Lego scenes after I, after I saw this now, and I feel like I've learned a few tips and tricks from it too.

aj_asver: Thanks, lightness. This is really, really cool.

linus_ekenstam-1: Yeah, you're welcome. Uh, I, I'm, I'm excited too. I'm a big Lego fan actually, so, uh, yeah. I should, I should, I should actually get, I should actually do some things for this and post to some of the Lego

What Linus is most excited about in AI

aj_asver: Yeah, we have to do

aj_asver: it. Alright.

aj_asver: well, I feel like this is setting me off on a really awesome path, and I'm really excited to explore this further. Um, I've learned a ton from just going through this with you, so thank you so much, Linus. Um, before we wrap up, I'm curious, like what are some of the things you're most excited about, um, in AI and especially in general AI right now?

Linus Ekenstam: I, I think in general, I'm just like really excited about the possibilities of all these tools, to be honest. Like these tools are, are accessible to pretty much anyone. Anyone that has a smartphone or anyone that has like a a a computer with a web browser doesn't really have to be a good computer.

Linus Ekenstam: Cuz all these tools are running in the browser, right? Like the gps are in the cloud. Uh, it doesn't matter if it's ChatGPT or if it's MidJourney or something else. Like it's enabling anyone, uh, to, to be creative. Like I don't really, I don't need to know anything about like drawing or, or, or, or being an artist.

Linus Ekenstam: Right. I can just, if I have a good enough imagination or if I, and everyone is imaginative, so.

Linus Ekenstam: Pretty much everyone fits that. Um, so I, I think I'm, I'm most excited about that, that like, there is no real barrier here. Like we, we could like go out and just tell anyone to go try this and, and anyone could.

Linus Ekenstam: Right? I think the biggest boundary or the biggest barrier has been, uh, Actually the interface. So the fact that Mid Journey decided to be like, we're gonna do this in Discord, um, a few months back on, on, you know, the, the all hands, like there was a lot of people complaining like, oh, you know, I love Mid Journey, but it was so difficult to learn Discord.

Linus Ekenstam: And I'm like, wait a minute, why don't you just have a wonderful website? Why don't you just put the UI there, like the generative part. There could, could be easily done. Like [email protected], amazing platform, super simple, prompt books on the website. Um, yeah, so I mean, there, there are few things that we could, that need solving, but like the fact that this is available for everyone, I think I'm most excited about.

Linus Ekenstam: And then when it comes to new tools, like it's really hard to keep up. Um, there's basically like a ton of new tools every day getting released. It feels like, you know, we're kind of in a. Hype cycle. A lot of people are getting their hands dirty. There is a lot of really good ideas and a lot of people are executing really fast.

Linus Ekenstam: I think ElevenLabs is sitting on some gold. They kind of like made it super simple to clone a voice and then used that voice by just inputting text.

Linus Ekenstam: So for example, if you know me, I'm building a, a storybook, um, generator for, for kids stories and, and we want to be able to cl clone parents' voices. So it's super easy for us to just like, Hey, record 60 seconds of your voice and then you can have any of the stories that you created written, like read back by you to your kids.

Linus Ekenstam: So I think that's, I'm really excited about that. And then I'm really excited about. A lot of these platforms opening up their APIs to developers. So, uh, we saw yesterday, the day before yesterday, like, you know, open AI released chat, G P T API and whisper api, um, through the world for everyone to use. And I think super excited about that as well.

Linus Ekenstam: So, yeah. Um, there there's not much underground, well, there is a few, you know, things that are popping up on the radar, but I don't think any, anything that's as exciting as the big things the macro.

Linus's Newsletter

aj_asver: Yeah, there is, so much happening in the space and folks can there is actually um, newsletter to, to get updates on, on kind of your, your take on the

Linus Ekenstam: Yeah. Yeah.

aj_asver: what's the name of the newsletter?

Linus Ekenstam: So the name is my name. So it's linusekenstam.substack.com. Uh, and actually the name of the name of the newsletter is inside my head. Um, so maybe I should change the URL to be inside my head. Uh, but yeah, it's linus eam.ck.com and, uh,

Linus Ekenstam: Yeah.

aj_asver: linusekenstam.substack.com Thank you so much Linus, for joining me, um, and helping me become a pro at Mid Journey. And also I feel like I learned a lot about kind of your, your perspectives on AI and generative AI and how it's gonna impact the design, industry too. So I'm really appreciate it.

aj_asver: Thank you so much. And until the next episode of Hitchhiker's Guide to AI. Thank you everyone for joining us.

Linus Ekenstam: Thank you. Thanks for having.

This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit operatorsguidetoai.substack.com

Hi Hitchhikers!

AI chatbots have been hyped as the next evolution in search, but at the same time, we know that they make mistakes. And what's even more surprising is that these chatbots are starting to take on their own personalities.

All of this got me wondering how these chatbots work? What exactly are they capable of, and what are their limitations?

In the latest episode of my new podcast, we dive into all of those questions with my guest, Kevin Fisher. Kevin is the founder of Mathex, a startup that is building chatbot products powered by large-scale language models like OpenAI’s GPT. Kevin’s mission is to create AI chatbots that have their own personalities and one day their own AI souls.

In this interview, Kevin shares what he's learned from working with large language models like GPT. We talk about exactly how large-scale language models works, what it means to have an AI soul, why chatbots hallucinate and make mistakes, and whether AI chatbots should have free will.

Let me know if you have any feedback on this episode and don’t forget to subscribe to the newsletter if you enjoy learning about AI: www.hitchhikersguidetoai.com

Show Notes

Links from episode

* Kevin’s Twitter: twitter.com/kevinafischer

* Try out the Soulstice App: soulstice.studio

* Bing hallucinations subreddit: reddit.com/r/bing

Transcript

Intro

Kevin: We built um, a, a clone of myself and um, the three of us were having a conversation. And at some point my clone got very confused and was like, who? Wait, who am I? If this is Kevin Fisher and I'm Kevin Fisher, who, which one of us is.

Kevin: And I was like, well, that's weird because we de like, we definitely didn't like optimize for that . And then we kept continuing the conversation and eventually my digital clone was like, I don't wanna be a part of this conversation with all of us. Like one of us has to be terminated.

aj_asver: Hey everyone, and welcome to the Hitchhikers Guide to ai. I'm your tour guide AJ Asper, and I'm so excited for you to join me as I explore the world of artificial intelligence to understand how it's gonna change the way we live, work, and.

aj_asver: Now AI chatbots have been hyped as the next evolution in search, but at the same time, we know that they made mistakes. And what's even more surprising is that these chatbots are starting to take on their own personalities.

aj_asver: All of this got me wondering how do these large language models. What exactly are they capable of and what are their limitations?

aj_asver: In this week's episode, we're going to dive into all of those questions with my guest, Kevin Fisher. Kevin is the founder of Mathex, a startup that is building chatbot products powered by large scale language models like OpenAI's. Their mission is to create AI chatbots that have their own personalities and one day their own AI souls

aj_asver: in this interview, Kevin's gonna share what he's learned from working with large language models like G P T. We're gonna talk about exactly how these language models work, what it means to have an AI soul, why they hallucinate and make mistakes, and what the future looks like in a world where AI chatbots can leave us on red.

aj_asver: So join me on this. As we explore the world of large scale language models in this episode of the Hitchhiker's Guide to ai.

aj_asver: hey Kevin, how's it going? Thank you so much for joining me on the Hitchhiker Guide to

aj_asver: ai.

Kevin: Oh, thanks for having me, aj. Great to be.

How large-scale language models work

aj_asver: appreciate you um, being down to chat with me on one of the first few episodes that I'm recording. I'm really excited to learn a ton from you about how large language models work and also what it means for AI is to have a soul. And so we're gonna dig into all of those things, but maybe we can start from the top for folks that don't have a deep understanding of ai.

aj_asver: What exactly is a large language model and how does it work?

Kevin: Well, so, uh, there's this long period of time in. Machine learning history where there are a bunch of very custom models built for specific tasks. And the last five years or so has seen a huge improvement in basically taking like a singular model with making it as big as possible and putting in as much data as possible.

Kevin: And so basically taking all human data that's accessible via the internet running this thing that learns to predict the next word given the prior set of words. And a large language model is the output of that process. And for the most part, when we say large, like what large means is hundreds of billions of parameters and trained over trillions of words.

aj_asver: when . You say it kind of predicts the next word. Now, that technology, the ability to predict the word in large language model has existed for a few years. I think GPT in fact, three launched maybe a couple of years

Kevin: Even before that as well. And so next word prediction is kind of like the canonical task or one of the canonical tasks in natural language processing, even before it became this like new field of transformers.

aj_asver: And so what makes the current set of large scale language models or lms, as what they're called as well, like GPT three, different from what came before it?

Kevin: There are two innovations. The first is this thing called the transformer, and the way the transformer works is it basically has the ability through this mechanism called attention to look at the entire sequence and establish long range correlation of like having different words at different places contribute to the output of next word prediction.

Kevin: And then the other thing that's been really big and then open AI has done a phenomenal job doing is just learning how to put more and more data through these things. There are these things called the scaling laws, which essentially. We're showing that if you just keep putting more data at these things their intelligence, essentially the metrics they're using to measure intelligence just kept increasing.

Kevin: Their ability to predict the for nextdoor accurately just kept growing with more and more.

Kevin: Data's basically no bound.

aj_asver: Seems like in the last few years, especially as we've got to like, you know, multi-billion parameter models like GPT three, we've kind of reached some inflection point where. Now they seem to somehow be more obviously intelligent to us. And I guess it's really with ChatGPT recently that the attention, has kind of been focused on large language models.

aj_asver: So is ChatGPT the same as GPT three or is there kind of more that makes ChatGPT able to interact with humans than just the language model

How ChatGPT works

Kevin: My co-founder and I actually built a version of ChatGPT long before ChatGPT existed. And the biggest distinction is that these things are now being used in serious context of use.

Kevin: And with OpenAI's distribution, they got this in front of a bunch of people. The problem that you face initially the very first problem is that there's a switch that has to flip when you use these things. When you go to a Google search bar if you don't get the right result, you're primed to think, oh, I have to type in something different.

Kevin: Historically with chatbots, when you went to a chatbot, if like it didn't give you the right answer, you're like pissed because it's like, it's a, it's like a human, it's like texting me. It's like supposed to be right. And so the chat, the actual genius of ChatGPT beyond the distribution is not actually the model itself because the model had been around for a long time and was being used by hackers and companies like myself who saw the potential.

Kevin: But with ChatGPT distribution plus the ability to reframe that switch so that you think, oh, I'm doing something wrong. I have to put in something different. And that's when the magic starts happening right now. At least

aj_asver: I remember chatbots circa 2015, right, for example, where they weren't running on a large language model. They w…

This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit operatorsguidetoai.substack.com

Hey Readers,

In today’s post, I want to share one of the first episodes of a new podcast I’m working on. In the podcast I will be exploring the world of AI to understand how it’s going to change the way we live, work and play, by interviewing creators, builders and researchers. In this episode, I interview Ammaar Reshi, a designer who recently wrote, illustrated and published a children’s book using AI! I highlighted Ammaar’s in my first post a few weeks ago as a great example of how AI is making creativity more accessible to everyone.

In the interview, Ammaar shares what inspired him to use AI to write a children’s book, the backlash he received from the online artist community and his perspective on how AI will impact art in the future. If you’re new to AI and haven’t yet tried using Generative AI tools like ChatGPT or MidJourney, this is a great video to watch because Ammaar also shows us step-by-step how he created his children’s book. This is a must-watch for parents, educators or budding authors who might want to make their own children’s book too!

To get the most out of this episode, I recommend you watch the video so you can see how all the AI tools we cover work > Youtube Video

I hope you enjoy this episode. I’ll be officially launching the podcast in a few weeks, so it will be available on your favorite podcast player soon. In the meantime, I’ll be sharing more episodes here as I record them and I would love your feedback in the comments!

Show Notes

Links from the episode

* Ammaar’s Twitter post on how he created a children’s book in a weekend:

* Ammaar’s book “Alice and Sparkles”: https://www.amazon.sg/Alice-Sparkle-exciting-childrens-technology/dp/B0BNV5KMD8

* Ammaar’s Batman video:

* ChatGPT for story writing: http://chat.openai.com

* MidJourney for illustrations: Midjourney.com

* Discord for using MidJourney: https://discord.com

* PixelMator for upscaling your illustrations: https://www.pixelmator.com/pro/

* Apple Pages for laying out your book: https://www.apple.com/pages/

* Amazon Kindle Direct Publishing for publishing your book: https://kdp.amazon.com/en_US/

Episode Contents:

* (00:00) Introduction

* (01:55) Ammaar’s story

* (05:25) Backlash from artists

* (12:20) From AI books to AI videos

* (16:20) The steps to creating a book with AI

* (18:55) Using ChatGPT to write an children’s story

* (23:45) Describing illustrations with ChatGPT

* (26:00) Illustrating with MidJourney

* (35:30) Improving prompts in Midjourney

* (37:20) Midjourney Pricing

* (40:00) Downloading image from MidJourney

* (44:20) Upscaling with Pixelmator

* (49:25) Laying out book with Apple Pages

* (53:40) Publishing on Amazon KDP

* (55:35) Ammaar shows us his hardcover book

* (56:25) Wrap-up

Full Transcript

[00:00:00]

Introduction

ammaar: I think it has to start with your idea of a story, right? I think, you know, people might think, okay, you press a button, it spits out a book, but I think it has to start with your imagination. And then we will provide that to ChatGPT to kind of give us a base for our story. I think then we'll iterate with ChatGPT almost like a brainstorming partner. We're gonna go back and forth. We're gonna expand on characters and the arcs that we might want to, you know, go through. And I think once we have that, Then we go back to imagining again.

We have to think through how do you take that script and that story and you bring it to life, how do you visualize it? And that's where MidJourney comes in. And we're gonna generate art that fits that narrative and expresses that narrative in a really nice way. And then we can combine it all together with you know, pages to create that book format.

aj_asver: Hey everyone, and welcome to the Hitchhikers Guide to ai. I'm your tour guide AJ Aser, and in this podcast I explore the world of artificial intelligence to learn how AI will impact the way we live, work, [00:01:00] and play. Now, if you're a parent like me in the middle of reading a book to your kids, this thought may have crossed your mind.

Hey, I think I could write one of these, but the idea of writing and publishing a children's book to many. Is a distant fantasy that is until now, because generative AI is making it easier than ever for anyone to become an author or illustrator.

Just like today's guest, Ammaar Reshi who wrote illustrated and published a children's book for his friend's children in one weekend using the latest AI products including ChatGPT and MidJourney in this episode. Ammaar's going to show us exactly how he did it.

So Hitch A Ride with me is we explore the exciting world of generative AI in this episode of the Hitchhiker Guide to ai.

Ammaar's Story

aj_asver: Hi Ammaar it's great to have you on the podcast.

ammaar: Hi. Great to be here, AJ. How are you doing?

aj_asver: I'm great. I'm so excited for you [00:02:00] to join me on this podcast especially to be one of the first people I'm interviewing. It's gonna be a learning experience for me, and we'll work it out together.

But anyway, I'm so excited to have you here. I talked about you in my newsletter in the first post because I thought what you did by publishing your book, Alison Sparkles, was such a great example of how AI is gonna change the world around us and really make creativity and being a creator a much more achievable and approachable thing for most people.

Since your book was published on Amazon in December of last year, you have sold, what is it, over 900 copies. Is that right?

ammaar: Yeah. It's about 1,200 now, so yeah. Crazy

aj_asver: That is amazing!

ammaar: Yeah, it's been wild

aj_asver: That is so cool. And at the same time, you've found yourself at the center of a growing debate about AI and the future of art. So tell us how it all happened.

Rewind us back to the start. What made you a designer at a tech company decide to publish a children's book?

ammaar: I guess what kicked it off to go all the way back to two of [00:03:00] my best friends basically had their first kids. And I went to visit one of them. She had turned one years old. And I went over and it was around her bedtime where she grabbed my hand and took me upstairs. And I was like, what's going on? And they're like, she's picked you tonight to read her bedtime story . So I was like, wow. I was like, I am honored.

This is one step closer to being that cool uncle. She hands me this book I was something about getting all these animals delivered from the zoo. And so I was, I mean my friend was there and I was reading her this book and we were both laughing cuz we were like, this book makes no sense at all.

This story is so random. But she loved it. You know, she loved it. She loved the art, she loved everything about it. And it then kind of hit me in that moment. I was like, it'd be really fun to tell her story of my own, you know? I just had no idea how I was gonna go and do that yet.

I told my friend, I was like, I think the next time I come over, there's gonna be a book on her shelf. It's gonna be mine. And he was like how are you gonna do that? I was like, well, gimme a weekend. I'll figure it out, right..

I had already been playing with MidJourney like sometime in February [00:04:00] of uh, last year.

And so, You know, I, I knew generative AI and the artwork stuff was there and it was really cool. And Dall-E also had blown up around then. And so yeah I knew okay, if I wanted to illustrate this book, I could lean on MidJourney to help me with some of the creation, but I hadn't yet come across ChatGPT. And a friend of mine actually, just that moment, like that Friday message meeting, he's have you seen ChatGPT? I've been playing with it all weekend, all week. I've even created music and chords and like chord progressions and stuff with it. And I was like, that's crazy. Like I wonder if it could help me craft a story, like a children's story.

And then I wanted the story to be something a little meta, you know, something about. But also a little personal. I remember as a kid, like my dad let me play with his computer when I was like four or five years old, right? And I, that kind of led me down the path of going into tech and like all of that and that curiosity.

And so I basically wanted to mash those two. It was [00:05:00] this young girl who's curious about technology, and specifically about ai and then ends up making her own. And that's essentially the prompt that I gave ChatGPT and that's what set off, the path into making this book.

aj_asver: That is such a cool story. I think the bit you talked about where you're like reading this book with a child and you're lucky because as an uncle you don't have to do it a hundred times.

ammaar: That's what he said. Yeah.

Backlack from artists

aj_asver: Yeah. It can get pretty tiresome and you're like, and you do wonder often wow. This book doesn't make a lot of sense, but like hundreds or thousands of copies have been sold.

It's really cool that you took the initiative to do that. Now, you were in the Washington Post recently in an article titled he made a children's book using AI, then came the Rage. Talk us about that. Why did you make so many people angry with the children's book?

ammaar: Yeah, that was also dramatically unexpected. So when I first created the book on that weekend, my goal was like, I need a paperback in hand as soon as possible. And Amazon, KDP, which [00:06:00] I think is the most underrated part of this whole discussion, where it's like there's a platform out there that can get you a paperback within a week , just upload a PDF.

No one talks about that. I used KDP, got the book and initially, just gave it to my friends. That's, that was the goal. And it was out there. And then, I was like, this would actually be really fun to share with other friends as well. And so I put it on my Instagram and have a good amount of friends who are not in tech, and so they replied and I put in my story. If you want a copy, I'm gonna gift it to you. Let me know. And so a lot of folks were like, oh, this is so cool. I want a copy. I want a copy. And everyone's reacting in a super positive way. And so this is forming my initial um, You know, opinion of how the story is going to be perceived.

It's going to be perceived in a way where everyone thinks this is very cool concept, right? Like the same way I thought it was. But boy was I wrong.

Then after the Instagram story, and I think this was the most Instagram messages I've received in a while in one go. A friend of mine was like, you gotta put this on Twitter. I think everyone should see this. And I was like, okay, yeah, [00:07:00] why not? So I quickly drafted up a tweet and put it out there first 24 hours. Tons of love and praise. You know, I had parents reaching out saying, I wanna make a book with my child over the weekend. Can you walk me through it?

Then I vividly remember it was like 4:00 AM the next day. And my phone is just buzzing like it is going. And I'm getting all these messages and it's you're scum. Like we hate you, like you're stole from us. I was just like, whoa. What is happening? And at the time, I hadn't read up on what had happened with Lensa or any of these other AI tools that were allegedly being trained on copyright material and and art without consent.

And I had not, I was just not aware of any of this. I was digging into it and I was like, why am I getting all this hate all of a sudden? And I realized that I'd been retweeted by some artists who had very large followings. We're talking about 40, 50,000 people. And I think then Tim Ferriss liked the tweet and I just blew it up to another yeah, I think he has like a million followers who, another, huge set of folks.

And then it was spreading across like illustrators, [00:08:00] writers, artists, and. and I know why they have these concerns, right? It's like you're seeing a piece of technology that is doing what you do on a day-to-day basis without you involved at any single part of that creation of that cycle, right?

I think AI, we've been talking about it for forever, right? Especially if you've been in the tech field for a long time. , but it's felt abstract. It's not tangible. And now you finally have this physical object that blends in with everything else that's out there, a children's book. And if I didn't say it was created by ai, I think most people would've just said, oh, it's just another random children's book. And so I think that provoked the discussion and created that fear that, wow, this is not. AI is good. It's so damn good that you could publish a book and it could be out there and no one would know, if you didn't say so.

And I think that struck a chord and that led to the reaction that I got. Death threats, everything in between. It was quite, quite the storm. I found myself caught in right after that.

aj_asver: Going [00:09:00] through that experience you saw this other side of ai. , as people in tech that have been using ai, probably with this optimism and excitement, you don't really realize how folks that aren't as familiar with it or folks that really find it threatening to their livelihood see how it might impact them.

One thing I'm curious about is did you experience or hear from any artists that thought about it in a positive way or excited about AI and how it could help them?

ammaar: I did get a few dms and there were DMs. They literally said, I don't wanna put this out there. They started the DM with that. So I think there was already this fear of backlash based on how the broader community was reacting to this. But they had said that They find this really exciting because of the way it could speed up their workflows.

They saw it as an opportunity to brainstorm faster, come to concepts much faster than they could, and then use, their skill to hand draw and expand on that. And I think that's really promising too. It's that view that this is supplemental and not a replacement and actually can fit into your existing workflows.

I think that's really exciting. . And I think the problem is like the rhetoric [00:10:00] around all of this is stuck between it's being conflated, right? It's one on the one hand, this is a very exciting progression in technology because you're enabling a new set of creators. People who, could imagine all of these things, but couldn't dream of creating them because they were limited by their skills.

Maybe they couldn't pay for the courses or anything like that, right? And now your imagination's limit and the technology is just empowering you to create, which I think is amazing, right? We're gonna get a whole new set of people. I'm sure there are young Spielbergs out there that now can create things they couldn't be for.

Very awesome. But it's being conflated with the other, A aspect of this, which is it is being trained on copyright material, it is being trained on work that's out there without people's consent. And I. , you do have to address that. But at the same time, you can still be excited about where this is going.

And unfortunately, it's become this blob of an argument where it's just bad period. And I think that's what people need to unpack because there are a whole set of artists out there who also think this is very cool and would just like it to be trained in a more ethical way. Which yeah, I would be So for that, I'm not [00:11:00] anti artist in any way.

It's Let's enable the artist to create, cuz again, their imaginations allowed this tool to exist and create some things that we couldn't even imagine. So imagine what they could do combined with this tool. I'm sure we'd see stuff we haven't even imagined yet which is even more awesome.

aj_asver: Yeah. A lot of people make that argument in the same way that you know, that I think this is like a classic business argument of the early part of the 20th century where the factories came and people thought it was gonna replace jobs, but it actually created more opportunity and more growth in the economy, but it's hard to see that viscerally when you see it impacting your work.

One of the interesting things about AI is there's been this inability to predict what will be easy and what will be hard for ai. So for example, you and I can learn to drive a car maybe in about 10 hours, and that actually is really hard for AI. But for me to become an illustrator or a master chess player as a different example, would probably take many years, right? I couldn't imagine myself becoming an illustrator. If I pick up a pen or, or a, a paint and try painting, it would take [00:12:00] me a really long time. But AI has learned to unexpectedly quickly, which is really interesting. And you went through this experience now after you went through this and experienced that, that kind of wave of first people being really excited and then people really being mad at you how did you feel after that? Did it stop you from wanting to go out there and make more stuff like this? Or did you keep going?

From books to videos

ammaar: it Was interesting because in the beginning it kind of forced some introspection, some reflection on like, why did it strike such a chord? What could I have done differently? I think realizing and seeing that, okay, this is copyright material uh, in these companies as well of really kind of dodging this question, right?

I think I watched an NBC nightly short where David Holz from MidJourney is asked Hey, you're caught in this copyright arguing. He's like, I don't wanna talk about that basically. I think they, these things aren't being addressed and. I was like, okay, I still really enjoy creating with this. I think it's allowed me, like I said, I felt empowered when I was using these tools and I'm sure a lot of other folks do as well. But I was, I was not going to continue to monetize with the art I think. [00:13:00] The book itself was just an experiment. And then, and again the only way to get that paper back really quickly was to put it on Amazon.

I didn't take the book down, which is another counter-argument you could give to me. Okay, if you don't wanna monetize, why is the book still up there? well, I, we left the book up there because I think it, it sparked an interesting discussion. And that discussion is now at a point where, we are having this, we are having this conversation. The Washington Post has elevated this conversation and I think the pessimistic point of view is oh, this is a quick cash grab or whatever. But I think the somewhat optimistic point of view the realist in you says okay, this discussion has now gotten so much light that we might make more progress on our concerns.

I think if you look at it that way the pragmatic point of view I think. . I think that's why the book is still up there. It's, we are now talking about this all over the place and it'll might actually lead to progress with, with getting these companies to maybe do things in a more responsible way.

So that's where I like, did not continue on the monetization path, but that didn't stop me on the creation path because I think it's still really cool to see how these tools can [00:14:00] bring your ideas to life. And a book was just one of the ideas that struck me that. But then as I was browsing Twitter one other weekend , I saw this like very short animated clip where someone had just animated this person, walk into a tavern, seen this mysterious and I've got sucked into this very short clip.

I was like, this is so intriguing. And. and that was before I realized that it was actually made using immuno generative ai. And I was like, what? Like how did they do this? There was no source to who made this video. And so I had to just spend like a few hours just de decomp and thinking about how they did this in reverse engineering the process in my own head.

But it got me so excited again because film is one of my. Favorite like things, it's like a hobby of mine to watch and log all the movies I watch. If I didn't study computer science, it definitely would've been film. And so to then see an avenue where I could tell my own story and animate it and create it was super exciting.

And yeah. And then one weekend I was like, you know [00:15:00] what? I'm gonna do this . I'm going to try to create my own short. And I do it with one of my favorite superheroes, Batman, which I think has like such a great audience as well. Like lots of people love the superhero. So it. To tell my own Batman story, and that's when I decided to make a little Anma animated short.

And again, tweeted about it this time, racing for impact a little bit given previous reactions. And within a few days it got 7 million views. So it was insane to see how it, resonated with folks again, but also of course struck a chord again.

aj_asver: 7 million views.

ammaar: Seven

That's amazing.

Okay. Ammar. You wrote illustrated and published a children's book and put it online for the world to buy in a weekend.

Yeah.

aj_asver: many people may not believe that's even possible. And in fact, many people that are listening to this podcast may not have tried Chat G P T or MidJourney or any of the other cool generative AI tools that you and I have tried.

And [00:16:00] so I thought it would be a really fun exercise for you to teach me exactly how you did it and for us to make a children's book.

Are you gay?

ammaar: let's go. Let's do it

How to write a book using AI

aj_asver: Let's start at a high level. Tell me the three to five steps that you went through to publish Alison Sparkles a weekend.

ammaar: Yeah. I think it has to start with your idea of a story, right? I think, you know, people might think, okay, you press a button, it spits out a book, but I think it has to start with your imagination. So I'm sure AJ, you've got a fun story we can craft together, but you know, it'll start with what you think that is.

And then we will provide that to ChatGPT to kind of give us a base for our story. I think then we'll iterate with ChatGPT, almost like a brainstorming partner. We're gonna go back and forth. We're gonna expand on characters and the arcs that we might want to, you know, go through. And I think once we have that, Then we go back to [00:17:00] imagining again.

We have to think through how do you take that script and that story and you bring it to life, how do you visualize it? And that's where MidJourney comes in. And we're gonna generate art that fits that narrative and expresses that narrative in a really nice way. And then we can combine it all together with you know, pages to create that book format.

aj_asver: Okay, so to recap, we've gotta come up with a story using our imagination. That's probably the one area where I might be able to help. Then we're gonna

ammaar: let's go. Yes.

aj_asver: we're gonna ask ChatGPT to help us turn it into a story, for a book. Then we're gonna. Iterate on it a little bit and develop the story. Then we're gonna take that and work out how to turn it into illustrations. Also think about the character arc and the different characters involved and how we describe them.

And then we're gonna try and put it all together into a book which we're gonna publish. Is that correct?

ammaar: Sounds good. Yeah.

aj_asver: All right. So we need a story now.

I've got this idea for a book that I wanna publish. It may have been inspired by a book I read [00:18:00] recently. It's a great fairytale. It has a prince, he meets a princess, they fall in love. There's some tragedy, but it has a happy ending. so the character in the book is Prince Harold. he's young, he loses his mother

ammaar: Oh, man.

aj_asver: And the only way for his heart to be mended is for him to meet someone special. And he

this actress named Megs and they fall in love and their love eventually men's his heart, he live happily ever after.

ammaar: That's a great story. Yeah. I th I think we can make something off of this for sure. Let's do it.

aj_asver: The first step you said was, we're gonna take this story and we're gonna put it in ChatGPT. So let's walk through that and I'd love you to show me how you use chat GB t

The URL is chat.openai.com will include the link in the notes for the podcast too. And you need to sign up, I think you can use a Google account on Microsoft account or use a, your email address. But ChatGPT is completely free so anyone can try this just like Ammaar's about to show us.

Using ChatGTP to write story

ammaar: All right let's work off of that original story [00:19:00] And you know, I like to start with something that just gives us a little bit of a base to work off of. You know, we could do, write a short story about a prince, whoops, can't spell, prince, called Harold, who loses his mother at a young age.

And the reason I'm giving it that is because I want it to introduce some tragedy into the short story, and let's see if it can kind of work off of that. He eventually meets the love of his life, an actress named Max.

Okay. So let's see what it's creating for us. So once upon a time, there was a young prince named Harold. He lived a life of luxury. Wow. it was a life that was missing something very important, the love and care of his mother. Wow. This is this is really building up the way you were describing it.

She passed away when he was just a boy, leaving him with a broken heart and a longing for someone to fill the void. Wow. [00:20:00] As he grew up, Harold became known for his adventurous spirit and charming personality. you say that lines up with how you imagined Harold? AJ

aj_asver: just like the Harold I was

imagining. It's like ChatGPT knew exactly what I was thinking about.

ammaar: Yeah. Amazing. Let's continue. He traveled the world, met new people and tried new things, but he was still searching for that. Someone special. One day he went to a play and met actress named Megs. She was the star of the show, and as soon as Harold laid eyes on her, he knew she was the one he had been searching for. Damn You can already uh, sparks.

Yeah. Megs was suggested intended by Harold, and soon they were inseparable. They went on adventures together, laughing and falling more in love every day. Harold finally found the love and comfort he had been missing for so long, and he knew that Megs was the missing piece to complete his life. This is quite the fairytale.

Wow.

The two of them got married in a grand ceremony with friends and family from [00:21:00] far and wide coming to celebrate their. Harold and Megs lived happily ever after. And their love continued to grow stronger with each passing day. the end, Harold realized that even though he had lost his mother, he had gained so much more in Megs. She was his rock, his partner in life, and the love of his heart. And together they built a life full of happiness, venture and endless love.

aj_asver: Wow. Chachi b t essentially wrote this story based off a few prompts that you gave it.

So you said write a

ammaar: one prompt.

aj_asver: right? One prompt, which is write a short story about a prince called Harold, who loses his mother at a young age. He eventually meets the love of his life, an actress named Max, ChatGPT, has this whole story. And in it, you know, Harold becomes known for his adventures.

He has a broken heart, but then he meets this actress at a play, which is really cool. And the two of them get married in a grand ceremony and they live happily ever after. And all of that ChatGPT came up with. So we've kind of already got parts of the story, so what's the next step? How do we turn this into a book?

ammaar: Yeah. [00:22:00] So the next step is gonna be taking that story and putting that I just like to work in Apple Notes, but putting that story in there and then thinking about what scenes we're imagining for that part of the story. So let's brainstorm a little bit, AJ, and figure that out, and then we can go to MidJourney and start to illustrate that stuff.

What do you think?

aj_asver: That sounds good. Let's try it.

ammaar: All right, so I've just copied the story. I'm just gonna paste it in.

Okay, so we've got a beginning. A once upon a Time there was a young prince named Harold.

What do you think we could do here? I think it could be maybe a young boy in a kingdom, you know, to show that Prince growing up

aj_asver: think that could be cool. Let's think about what it might look like. I'm thinking like maybe a redhead be kind of cool

ammaar: yeah. You're really original with this. Yeah.

aj_asver: I'm thinking the kingdom would have a lot of castles,

From the medieval times. That might be kind of cool.

of rolling green hills.

ammaar: I love that. very scenic. Yeah.

aj_asver: we could add some soldiers wearing red [00:23:00] tunics and really tall black hats made out of fur. I'm

you know,

ammaar: I've just never seen anything like that. That sounds so incredible.

aj_asver: We're kind of coming together with a story right now and you are writing it out and you are doing it in Apple, in your Apple notebook, but

this like in a Google Doc or

you could write out really anywhere. And what you're doing is you're essentially taking a story that ChatGPT created and just kind of describing the different scenes.

ammaar: where, right?

aj_asver: exercise to do and we're using a lot of our imagination. But I was curious, could chat g p d do this too? Like it, could it describe some of the scenes?

ammaar: Sure. Yeah. Why not? Let's just switch back to ChatGPT and pick a paragraph and then tell it to describe what that scene might look like and let's see what it gives us.

aj_asver: That would be really cool.

Describing illustrations with ChatGPT

ammaar: All right. So we're back in ChatGPT, we're still in the middle of our conversation with it. And let's, you know, let's just take, let's take that first paragraph and say, describe how you would illustrate [00:24:00] this scene. And I'm just gonna paste in the thing and let's see what it does

Now there we go. This is a really great description of what it described.

So we started with the first paragraph, which just to remind everyone was, once upon a time, there was a young prince named Harold.

He lived a life of luxury, but it was a life that was missing something very important, the love and care of his mother. She passed away when he was just a boy, leaving him with a broken heart and the longing for someone to fill the void. We asked basically to describe how it would illustrate the scene.

So here's what we got in response. To illustrate the scene of Prince Harold's life, I would depict a young prince standing in a grand castle surrounded by riches and luxury, but with a lonely and sad expression on his face. The room would be spacious and well appointed, but with a feeling of emptiness.

Wow. In the background, there would be a portrait of Harold's mother with a veil of sadness covering her face, symbolizing the [00:25:00] loss of her love and care for her son. The window of the room would show a view of a gray and gloomy sky reflecting the prince's heartache and longing for someone to fill the void left by his mother's passing.

This is very dramatic and emotional. To emphasize the Prince's loneliness, I would have him standing alone with no one in sight and his head bowed and sadness. The overall mood of the illustration would be somber with muted colors and soft light, but with a hint of hope in the prince's eyes hinting at the bright future that lies ahead for him.

aj_asver: So that was really cool because when we were talking about it, we kind of had a few words or

ammaar: Yeah,

aj_asver: it. But when we went back to ChatGPT and actually just said, Hey, ChatGPT I want you to illustrate, how you would describe this part of the story. It actually went into a lot of detail to do that.

And what it means is for someone that isn't necessarily good at imagining this and really describing it to illustrate it, you can actually shortcut that and let ChatGPT do some of that work for you, which is really cool. So we've got an idea, a scene now for the [00:26:00] first part of the book. How do we turn this into an illustration?

Illustrating with MidJourney

ammaar: So this is where MidJourney comes into play.

aj_asver: so what is MidJourney Ammaar?

ammaar: Yeah. So MidJourney is the generative AI tool we're gonna use where chat G B T is kind of giving us text descriptions of things.

MidJourney allows us to visualize that. So with a prompt, the same way we gave it to ChatGPT, it's gonna create images for us that we could start using and, you know, a book. So let's dive in.

the first step to using MidJourney is heading over to MidJourney.com. And you know, you come across this very trippy homepage very eighties hacker esque. And honestly that's probably reflective of what it feels like using MidJourney.

It's not the most approachable but it's not that hard to get started. So what you wanna do is click Join the Beta, and once you click that you're going to be guided to Discord. And so this is where you need a Discord account to join essentially the MidJourney channel. It's like joining a Slack channel, basically where you can then talk to the MidJourney [00:27:00]bot and provide at the prompts.

And so for those who are not familiar with what Discord is, it's basically it's basically Slack for communities. So if you've ever used Microsoft Teams or Slack or any of these tools that allow you to communicate with people, discord is aimed at those niche communities of people who just are hobbyists in different fields.

Could be movies, you know, cartoons, games really started with video games actually. And and now you know, it's got AI enthusiasts. So this just a channel a home for anyone who's really interested in generating art to join this channel and have conversations and share their creations with each other.

Okay, so in discord. So this is Discord. This is what it looks like. You know, you've got essentially. seems like a chat app, like an instant messaging app.

If you've ever played with MSN Messenger back in the day, or Yahoo Messenger, this is just like that. Or AIM I think in the States. But what we're going to do, I said that, you know, MidJourney had its own channel where you can see the community and here's just a preview of that. It, you know, you can see someone's creations, looks like they've made some [00:28:00] incredible art about, you know, with Spider-Man and The Hulk.

Beautiful style. But what we wanna do is we want to communicate with the MidJourney Bot. And the MidJourney bot is essentially this automated, you know, chatbot just like ChatGPT that lives inside of Discord. And we're going to tell it what we want to see and what we want to imagine, and it's going to end up creating images for us.

So let's jump over to the MidJourney bot and start generating some images.

All right, so we are in MidJourney and we are about to bring Prince Harold to life, . Let's see what we had. So AJ, your description was a young boy in the kingdom redhead with freckles has a lot of castles, scenic soldiers. All right, so I'm just gonna copy that over. And let's work with, let's work with this.

To use MidJourney, the first thing you wanna do is you type slash Imagine and so slash imagine allows you to start entering your prompt and creating images and artwork. [00:29:00] And so I copied that description that we had written in Apple Notes, and I'm just pasting it in MidJourney, and I'm saying young boy in a kingdom redheaded with freckles.

Kingdom has a lot of castles, scenic soldiers with large black hats. And I'm actually just gonna add a few more adjectives to this. Maybe I'm gonna say a prince actually in a kingdom, a young prince. I wanted to create and generate some of that royalty and that feeling of royalty in this image, right?

And I'm also gonna say a children's book illustration to make it, you know, approachable and approachable art style, children's book illustration.

aj_asver: That bit is really interesting that you just talked about the art style, because I've seen so many different styles of art come out in MidJourney and it seems like a big part of successfully using a product like MidJourney is really being able to describe the kind of style of art you want. You know, it does everything from like photorealistic art that looks like a photograph all the way through to, you know, comic style art that might look like, you know, a graphic novel [00:30:00]or a comic. And then, you know, in between. Like I'm sure we could get it to generate an illustration that looks like something from the Pixar universe, for example. That's really cool. And then when you put it in and you say Children's book illustration, is that enough or do you try to add more?

What's kind of some of the tips you have for making a really good prompt in MidJourney?

ammaar: Yeah it's really interesting you asked that because I think the more specific you can get, the better your results are. And sometimes you really need to, you know, I think this prompt, if I was gonna critique it, I would actually say it's probably got too much going. You know, it's going to try to get that children's book style.

It's going to try to bring a young prince in. We're giving descriptions to the prince. We're describing the kingdom around them. So there's a lot going on here, and I think we're gonna, you know, we'll generate and we'll see where the results are. But then the really the way to get better at this is to whittle down that prompt to get to just the parts that are yielding exactly what you want.

And you know, our prompt here, children's book illustration, A young prince in a kingdom redhead with freckles. And what's gonna be interesting there is will it know [00:31:00] to associate the redhead with freckles with the prince. We don't know that yet.

aj_asver: Yep.

ammaar: Kingdom has a lot of castles. Now where's it gonna place this print?

Because now we're describing kind of the background and the setting and the, you know, it's a scenic background, so that's also gonna be interesting. And then soldiers with large black hats, so another character has been introduced as well in this prompt. Usually I like to stick to one character in a prompt or maybe two max.

And, you know, the setting behind them. But, you know, I think this is just gonna be a really great way to see where we end up and, you know, work with that.

aj_asver: That was a really good point, by the way on the number of different characters. Oftentimes when I've seen general AI has had one character in it, and there's a few times where I've tested out with multiple characters that it kind of finds it a little bit harder to discern between the two. Let's see how this one works.

And then if we need to, we can always remove the the second characters.

ammaar: Yeah. That sounds great. Let's let's do it. So I'm just gonna hit enter and we are gonna start generating some art. So the thing I really enjoy about using MidJourney is you start to get a [00:32:00] preview of how that image is being composed live.

aj_asver: And for folks that don't know how MidJourney works, it actually uses AI approach called Stable Diffusion. And what that does is it actually takes images and destroys the images into noise. Like the noise you would see on an old television you know, before we had cable just with like white and black dots, and then it learns how to take that noise and rebuild it back into an image again. And so what MidJourney and other products like it stable diffusion and like Dali have done is they've taken millions of images and done the process of destroying it to noise and building it back up into image. And over time as you do that, you train the model to learn exactly how an image is made in all the different parts of an. and how to take text that's related to that image using a separate model, which is usually a language model and associate them together. And the process that we just saw that am that Ammar showed us is actually that live process of the idea that Ammar fed into MidJourney, the prompt being turned from noise into an [00:33:00] image bit by bit. And cool. What do we have?

ammaar: All right, so the first thing it does is it gives us this grid of four images, and it just likes to give us a few options to work with. And so looking at this grid, we can see that it has indeed placed castles behind this prince. And really it's a closeup shot of the prince. We didn't even specify that, but it decided to kind of give us that perspective, which is pretty cool.

It looks though that while it nailed our scenic background and that magical kingdom feel our young prince is wearing the outfit that we had planned for the soldiers. So he is wearing that black hat. He's dressed in military uniform, I have to say. He looks pretty sharp, it's really cool to see that.

While in some of the images it kind of dropped those freckles. It looks like it's not a fan, but in others it seems to be present. So we see four images, 1, 2, 3, and four, and. . You can see there's a slight variation in the art style. You know, the first one is a little bit it's got a little bit of that painted, like touch to it.

The second [00:34:00] one's a bit more of a, you know, pencil drawing kind of feel on the third. The fourth one is like almost very hyper-realistic to some extent. So now the cool thing is MidJourney then presents eight buttons to you. Nine actually. U1, U2, U3, U4 and V1, V2, V3, V4.

So what does that mean? U1, U2, U3, U4

the image on the grid. So image number one, image number two, you can choose to upscale that. So if you like any of these images and you actually want to use it somewhere, you can click u2. And we're gonna get image number two on that grid in a high resolution format that we can start using elsewhere.

Now, if we like what's happening in image number two, but maybe we wanted to see something a little different, we'd click v2 and that just means variations on image number two, variations on image number one or three or four. And so that's just a fun way to remix and kind of still get to a style that you know you really like before you settle on something.

And then you've got that little spiny arrows, and that just means restart this whole prompt again. I didn't like anything. And so that's [00:35:00] if you just want a little reset, but you don't really wanna change the description. I actually really what we have here and I almost want to double down on, you know, number three.

What do you think AJ?

aj_asver: Awesome. Yeah I mean, it's really cool to see how it generates those four different images and how they're kind of different. And one thing I've noticed about that is, You a little bit of choice of, you know, which image you want to go with. All four of them look pretty great. The only thing I'm thinking about is that black hat kind of makes them look a little bit more like a soldier than a prince.

So I'm wondering if we need to change it up a little bit to remove the hat. What do you think?

ammaar: Yeah, we could try that. So why don't we pick an image we like.

I kind of like number three and I'm just gonna click v3. And what's cool here is MidJourney then brings up that prompt again and allows me to change any part of the description so that I could tweak that prompt and maybe change specific detail about it.

So in this case, you know, let's remove that Soldiers with Black Hats part from our prompt. And so I'm just gonna delete this bit. and I'm gonna add a young prince [00:36:00] in a kingdom redheaded with freckles wearing a crown. And so our final prompt is children's book illustration. A young prince in a kingdom redheaded with freckles wearing a crown.

The kingdom has a lot of castles and scenic background, and we removed the part where it was black soldiers with black hats. That's gone. So with that, we can hit submit again. Let's see what we get.

aj_asver: So how long does it usually take for MidJourney to give you a response? And does it depend on how many people are using it, or is it fairly consistent?

ammaar: It it can be pretty fast. You usually get images generated within 30 seconds. But that's if you're on the paid plan. So if you're on the paid plan, you have what they call fast image generations and fast image generations allow you to basically prioritize your prompt amongst all the other people that might be generating at the same time.

So you get priority in the queue and you get your images faster. For most people though, you'd be on the relaxed queue, and in that it can take up to five to 10 [00:37:00] minutes, sometimes even to get some of your images back. So it can be a bit of an involved process.

aj_asver: Some of these products are starting to use speed and access to getting back the thing you're asking for as a way to kind of differentiate their priced versus free version. You know, the free version, you can get a response, but it might take a bit longer.

And then the fast version, no matter how busy it is or how many people are using MidJourney you'll get a response much faster, but you have to pay for it. How much does it cost?

ammaar: Yeah, so I think the basic plan is $10 per user per month, and then $30, and then just introduced a pro plan, which is $60 per user per month. That just means you get more, more fast image generations which they've capped per plan which is pretty interesting.

aj_asver: Awesome. So if you are finding that you use this tool a lot, or it's useful to you or you want to kind of come back and make lots of different images, it could be worth spending that extra 10 bucks a month to, to get faster feedback from MidJourney.

ammaar: Totally.

aj_asver: Cool. So MidJourney is working away in the background, and for folks that don't know how this works, the MidJourney team have [00:38:00] thousands of servers or hundreds of servers running in the background that are essentially taking all these prompts from all these different people that are using the Discord channel and churning out these images, sending them back to us so we can take a look at them.

ammaar: Exactly. And so it looks like we've got new output and the one thing you're gonna notice is. Our prince looks like an entirely new person. And that's because every fresh prompt just starts from scratch. Again, you're not maintaining your previous history. It's not chat g b t where it understands the context that it was in prior.

This is just starting fresh again. And so we're working with a new set of images and a completely fresh looking print . What I really like though about the images we just got is this crown looks fantastic. You have another great closeup shot of the prince in all four images and you're seeing that somber personality of his come through and the way he's looking, you know, in the distance, but composed calm for a young child.

aj_asver: Yeah. For folks that are listening to this, by the way [00:39:00] and I encourage you to watch the video in the show notes. The princes already do have this kind of somber look to them. And the fourth one in particular

it kind of looks like some a prince that's you know, experienced some hardship but has some hopeful hopefulness.

He's looking directly at the camera, but a little bit off center, kind of with that kind of vulnerable look in his eyes. And it looks like the perfect prince for us, I think. So that's the one I would go with. Let's go with number four.

ammaar: I completely agree. The first one was looking much more like a soldier, I think, in this path. But this one has that innocence in his eyes, which is beautiful. So let's get an upskilled image of that one. So I'm gonna click U4 and that's going to pick the fourth image on the grid and upscale it.

And the fourth image is the one we really enjoyed. And so now what's gonna happen is MidJourney is going to actually add a few more details to this image. Might even change the way the prince looks a little bit because it's trying to, you know, create a high resolution version of what was otherwise a very small square grid.

And we're gonna see that come [00:40:00] to life in.

aj_asver: And that's a really cool feature that MidJourney has actually, is that it takes that small image and kind of fills it out. And it's not just enlarging the photo so we can see it bigger. It's actually adding extra detail to make it a higher resolution image. And as you mentioned, when it does that, it's not just adding extra detail in pixels, but it might actually add extra features into the image itself, which is really cool.

You know, now we get another reveal of seeing what the upscaled image is gonna look like, which I'm so excited to see.

ammaar: Exactly. I think that's one of the most fun parts of the process. You just, you know, you're imagining something, it's coming to life and then it's going in a direction maybe you didn't expect, but you enjoy and want to keep. And I think that process of iteration and back and forth that, you know, we saw with ChatGPT when it was kind of expressing the story and we were able to expand on it, MidJourney kind of does that visually.

And that's really fun as.

aj_asver: Yeah, that's one thing I actually really love about generative ai, and especially if you're not someone with any experience actually using tools like this. And, you know, if you haven't ex had experience using something like Photoshop to come up with an illustration is it's much more of an iter iterative [00:41:00] and conversational experience where you're like going back and forth with this AI to come up with the answer. And it just feels a lot more approachable, and I would dare to say a lot more human in the interface than, you know, pointing and clicking on a bunch of different buttons and a bunch of different you know, squares and circles and stuff to try and make this image. And so to me that makes it way more approachable for anyone to really try and have a go at this.

And, you know, in the space of about 10 minutes of iterating, we've now come up with this awesome very vulnerable but hopeful prince standing in front of his castle that we can use in our in our story.

ammaar: Absolutely. So you can see it's made him a little more stern in this final image that we've gotten but still see that childlike innocence. He's still kind of looking in the distance. Slightly off camera. One other thing we can do real quick is we can just hit light, upscale, redo, and that is just another way to maybe say the MidJourney.

Hey. Give it another shot at that upscale process that you just did, and again, maybe try to tweak some [00:42:00] of those details because I still really liked that original prints had a bit more innocence to him and less that let stern looks. I'm really hoping that light upscale redo button gets us that.

But let's see what happens.

aj_asver: Yeah. And as you do this, one thing to bear in mind is that there's a lot of randomness involved in using generative ai. You know, it isn't something where every time you put the same prompt in, you'll get the same result. And so we're actually gonna see what a different look might look like and exactly how you just talked about that.

We now see a prince that does look a bit more innocent and is a bit closer to our original version. The other cool thing to bear in mind is you're doing this in discord in a chat channel. So every single step of the process, you get to see that as an image, and you can always go back to the step and download that image if you don't like what you get when you know, do the redo.

ammaar: Exactly nothing is lost. You can just keep expanding on your iterations, which is really fun and looks like it's giving us that young, innocent prince that we wanted in a high resolution version, which is awesome.

aj_asver: Very cool. So we have our Prince Harold. He's taking [00:43:00] shape. We're seeing him in front of his castle. We have an upscaled image of Prince Harold that you created using generative AI using MidJourney, and we did it. By first having the story that we made in chat G p T. And then from the story we created some scenes, which we described.

Now we described it ourselves, but we also showed you how you could describe the scene in chat G P T and use some of that language from describing in chat G P T to actually then create the prompt that you put into MidJourney as well. And you know, there's many different ways you can approach this.

You can use your imagination, you can ask chat g p t to help you. It's a really fun process and one thing I've really enjoyed about using generative AI is that kind of back and forth fun of trying different ways and experimenting. And I really encourage everyone that's listening to this and wanting to try it out for yourself to just experiment a lot and try different processes, try different ways, click the different buttons and try the different variations to see what you get. And don't be afraid to, you know, experiment.

ammaar: Absolutely. It is just as much of a process, of just [00:44:00] iteration and back and forth and, you know, brainstorming with this bot, you know, almost to come and bring your ideas to life.

aj_asver: All right, so we've got this image of Prince Harold. He's staring into the distance. He's hopeful, he's looking a little bit sad, but this is kind of the beginning of our story. How do we get this onto a page and then turn it into a book

Upscaling with PixelMator

ammaar: Yeah. So the first thing you're gonna notice is even though we've gotten, what I would say is a high resolution image of what was on the grid, it's still not high resolution enough for print. And so we're going to use another tool called Pixel Made for Mac which you can get on the Mac App Store.

And it's got this amazing feature called Super Resolution, which uses machine learning to try and expand the image that you have to a high resolution version and maintain the details that were there. And I'm gonna show you how you can do that in just a couple of clicks and it's just magical.

aj_asver: So we've got this image, but we wanna make it even bigger. And I assume that's because in order to. this as a book, you need a super high [00:45:00] resolution image. And so you're gonna use a different tool for that. Now remind me, that tool is called Pixel Meter

It's a Mac app, that you can install off the app store.

We'll include a link to that app in the show notes for anyone that wants to try it out. And there are many apps like this that do upscaling that you can Google for as well. But we're gonna try this one.

ammaar: Exactly. Awesome. So I'm going to save this image from MidJourney to my desktop and then I'm gonna fire a pixel made and we're just gonna blow this image up, so that's ready for prime time.

We're in PixelMator and

all I've done is dragged that image that I saved from a journey onto the PixelMator icon on my dock. But if you just fire open the PixelMator app, you can just open image, select the image you downloaded and it opens up. So now the main thing I want you to focus on is look at the resolution of this image.

It's 1536 by 1536 pixels. So it's not that big. It's a bit of a, it's a square, right? But I want this to be really big. I want it to be good enough for a book cover. I want it to be good [00:46:00] enough for pages that are gonna come in high quality print. And all I'm gonna do, there's just two clicks and we're gonna make that way bigger.

So I just click the three dots in the corner and hit super re. and it works like magic. And so now it gives me this before and after where you can see the details that are actually preserved, there's no blurriness. So notice that we've got this 1536 by 1536 pixel image. You know, it's a good enough size square, want something a lot bigger, something that could be printed and high quality on pages, on book covers, posters, whatever. So to do that, I just have to click the three dots in the corner here.

And then you wanna scroll down and look at this thing here in the side, which says super resolution. And so when I click that, it's going to blow up this image and take our image from the small square 15 by 1500 to something a lot bigger. And there you go. So in just that one or two seconds, you [00:47:00] know, you're seeing that there's no level of detail that's really lost between the two.

But more importantly, that image is now a 4,000 by 4,000 pixel image. and you know, I can just keep going. I can just go again and click super resolution and it's a little slower this time because it's making it huge, right? And you probably don't have to go this big, but you can, and this is helpful if you're making an animated short and you want it to be a 4K resolution shot.

But now you can see it's a 13,000 by 13,000 pixel image to really high quality. And, you know, you can zoom in and you can see that there's no blurred lines or anything like that. This is gonna work great for our book.

aj_asver: This is really cool and it's a little bit harder to see it in the video, but I've tried this myself and seen how impressive it is to see the amount of pixels that it fills. And so it's something worth definitely trying yourself. We're not just making the image bigger. We're actually adding more pixels to it, and it's done using artificial intelligence to actually [00:48:00] work out where the image should add pixels and what those pixels should look like. And now we get an image that's big enough for us to put on a book.

ammaar: All right, so now that we have our high resolution image, let's just put this on a page of a book with the description we got from chat G b t to bring it to life.

So the first thing I'm gonna do is I'm going to export the image that I just created with PixelMator and, you know, pick the JPEG format. It's gonna be a five megabyte image. Gonna click export here, and I'm gonna just choose my desktop and save it. I think because I'm sharing my screen a certain way, you can't see the save dialogue, but just imagine that classic Max Save dialogue is there and I'm just choosing my desktop.

And now we're gonna move over to Pages, which allows us, comes free with all Most Max today. And that just allows us to compose our book by giving us the right templates to start doing that. And it's really easy.

​[00:49:00]

aj_asver: Okay, so we've got a high resolution image. We've got some texts that we generated with ChatGPT. We took that image from MidJourney. We scaled it up using PixelMator, and now we're gonna put it into pages,

Laying out book with Pages

ammaar: absolutely. It just comes with your Mac. And if it's not on your Mac pre-installed, it's free on the app store so you can easily grab it.

So now I'm in pages and you know, when you click new document, you're asked what kind of document, choose a template. And on the left hand side you can see basic reports, books, letters, where after books here, right? So you can click books and you can see that it's got a bunch of, different templates for us to work with.

A basic photo book, contemporary novel you've got a storybook. There's some really nice ones for us to work with here. I like the storybook one. It looks like a children's book. It kind of fits the vibe we're going for. So let's go ahead and create with that [00:50:00] one.

So I clicked that and now I have essentially a template to work off of. It's given me a few different layouts, right? We've gotten the cover page a page here, which tells a little bit of a story with a big image as like the focus. A page that's just dedicated to an image.

And this is great because we've got enough here to work with to kind of lay out our book and give it that style. So let's just use that image that we had of the Prince and, you know, start our story the way ChatGPT kind of helped us describe it. So what I'm gonna do is I'm going to grab that image from my desktop, and I am just going to drag it here and bring it to life by putting it in there.

So as you can see, I just dragged my image over to Pages and it gave us the Prince as the focus of this first page, which looks great. We can obviously also just double click and slightly move it. If you wanna maybe emphasize this crown a little [00:51:00] bit. You could also resize a little bit, so maybe, it's not exactly that whole width, but you're getting a scene of that castle as well in it.

Again, it was cropped out before, slightly above the chin. Let's give him some of that room. And there you go. You've got the prince looking there at the reader, which is pretty fun. And now I'm gonna go grab that description we got from ChatGPT so I've just copied the text that we already had saved, and I'm gonna paste it in here.

So one thing you'll notice is messed up the formatting, but that's okay. What we're gonna do is go to text and just choose the body template text that it's already given us. And that'll fix it. But now you'll notice that it's a little out of the box, right? It's not fitting. So we can just slightly resize that and it fits into place but it's also given us these nice headers that we can work with.

So what I'm gonna do is actually, I'm just gonna cut out this once upon a time from this part and paste that in here. And that [00:52:00] just gives it that nice dramatic storybook feel as you're reading it. And I don't think we really need this one, so I'm just gonna go delete that. And now what we've actually done is we've created a little bit of room for ourselves, so we can actually increase the size of the text again and drag the box down just a little bit.

And there you go. There's our first page of the storybook for us to go ahead and roll with.

aj_asver: Wow, that was amazing. So we went from an idea for a storybook to then generating the actual story using ChatGPT to then creating some descriptions for what the first scene might look like. Putting that in MidJourney, going through a few iterations to come up with an illustration, and then using PixelMator to make that image even bigger so that we can use it in print.

And then we brought it into a Mac app called, pages, which is available on your MacBook. And we've used a template to turn it into the first page of a story. And this is amazing. So we've actually started writing a story now, and obviously you can keep doing this and you can [00:53:00] continue the rest of the story, which is what exactly what I'm gonna do now that Ammar has shown me how to do it.

But there's one piece that I still don't understand how you did Ammar. So we, let's say we made whole book.

How did you get it? Into the Amazon bookstore, how do you make it into an actual book that someone can have in their hands?

ammaar: Yeah, for sure. So once you've kind of composed all of your pages, what you want to do is export this book and that export functionality is available on pages. You just click on the MAC toolbar, click export, and export to pdf. And so once you have that pdf, you're going to go to Amazon KDP and publish your title.

aj_asver: what's Amazon KDP?

Publishing on Amazon KDP

ammaar: Yeah. So for those who don't know,

KDP is the Kindle Direct Publishing platform for Amazon, and that essentially allows anyone to publish their own Kindle books. They just make you sign up, provide tax information if you're selling that book. And then you can go and fill out the information about your book.

So the title, who the authors are illustrators, description, and then you [00:54:00] just upload your pdf. Then once you're on KDP, it's just gonna ask you if the formatting looks good. You can also enable if you want it to be a paperback and click next, next, next, and you're done. And then it's live on the Amazon store. Within 72 hours if approved.

aj_asver: That is amazing. So within 72 hours of having this book ready in pages, you can actually have it on the Amazon bookstore. And now it's not just a Kindle book. They actually give you a paperback version or a hardback version too, that people can then buy. And did you have to spend any money to publish this book?

ammaar: I didn't have to spend any money apart from the MidJourney subscription. That was the only thing that cost money here.

aj_asver: That's so cool. So you really didn't have to pay for publishing the book. Amazon is basically kind of putting the book there and then if people want it, I guess they print it and then send it to 'em. So it's kind of on demand.

ammaar: It's on demand. Print on demand is this new phenomenon actually, that they they've somewhat pioneered, which is, yeah, they don't have to hold all this inventory. They can just print on demand with all these printers across the world. [00:55:00] And the way they make money from it is if there's a sale, they take a cut from your sales.

And so you don't have to put up any upfront capital. So if you're someone who wants to put your book out there, you don't have to worry about buying a load of books and hoping that someone's going to buy them and hold that inventory. Amazon's taking care of that for you.

aj_asver: Wow. So really thanks to Amazon, anyone can be their own publisher, which is so cool. And I'm gonna go do this. I'm so excited to make this into a real book and publish it and then get a copy of it delivered to me so I can show everyone and all my friends just like you did. Now, do you have a copy of your book?

I really wanna see what it looked like.

ammaar: Here's the book, it's the hardcover version. And, you know, it's it's in my hands which is kind of crazy, right? Yeah, I love some how some of these images came out.

And yeah, the print quality as well was also really impressive. This one's my favorite image in the book kind of shows Alice all grown up with her robot friend. So yeah, there you go.

aj_asver: That is so cool. And one of the things to also think about is if you don't wanna publish this book to everyone and you just want to kind of make a [00:56:00] gift, let's say it's for Mother's Day or for your friend, or maybe you want to gift it to a niece or a nephew, you can just publish it and then buy one copy.

And I guess after that you can stop publishing that book. So it's, that's kind of a cool hack to just make a custom book for yourself.

ammaar: Absolutely. Yeah. I think this is a great way to just gift personal stories to people, which, you know, is just, it's amazing that we can now go ahead and do that and realize that.

aj_asver: thank you so much Ammaar for being down to show us exactly how you illustrated and published a book in the space of a weekend. And anyone can try this. Just follow along with the steps in the video. It's very straightforward. We'll include all the links in the show notes as well, so you can give it a try to.

Ammar, so glad that you were able to make it. I really appreciate you joining me for one of the first podcast episodes . Do you have any future plans to create any more cool stuff? One area you haven't ventured into is music. Should we expect an Ammaar Reshi billboard top 10 anytime soon? Yeah.

ammaar: I [00:57:00] think I'm waiting for Google to release that model so that we can start working with some music. I've also been seeing a lot of these 3D tools out there now where you can text to 3D models and so might be fun to make a little video game with generated AI assets. That could be really fun.

I'm just gonna let inspiration take the wheel, so I'll let you know when that happens.

aj_asver: Amazing. Thank you so much for listening. I really appreciate it. If you enjoyed this podcast and wanna learn more about generative ai, about the world of ai, and follow me as I explore, artificial intelligence and the way it changes how we live, work, and play, just subscribe to this podcast and your favorite podcast player and we'll have more episodes coming up soon too. Thank you, Amara, and have a great day.

ammaar: Thanks for having me. Thanks.

This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit hitchhikersguidetoai.substack.com

Hey everyone,

Welcome to The Hitchhiker’s Guide to AI podcast. With all the excitement around AI over the last year, I wanted to find out whether it's a tech fad or if it's really going to change the way we live, work and play.

In this podcast, I'll answer that question by talking to builders, creators and researchers pushing the boundaries of AI to really understand what's possible in the future. And what AI can and can't do today.

But most of all, I'm excited for you to join me on this journey together, we're going to work out what a future looks like with AI as a big part of it, so if you're curious about how AI is going to impact the world around us. Then subscribe to the Hitchhiker's guide to AI and join me on this journey as we explore the world of artificial intelligence!

If you want the latest AI updates and learn more about the space, subscribe to The Hitchhikers Guide to AI newsletter at hitchhikersguidetoai.substack.com.

This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit hitchhikersguidetoai.substack.com