At Home with Tech

Unlock the power of all your technology and learn how to master your photography, computers and smartphone.

Tag: Google Whisk

How to Use AI to Visualize Your Memories

I’ve always been a bit obsessed with capturing family photos to document our story.  And I often refer to my photo library as the official record of our lives. More than just the images themselves, the metadata of the ‘where’ and ‘when’ is quite useful.

But the photos we collect may not always live up to the memories we hold onto. 

And this limitation often crops up for me when I sit down to design and print a photo collage card. Sometimes the pictures from yesteryear just aren’t there.

So, I’ve just tried an experiment…

Text-To-Photo Prompts

I decided to generate new images for a photo collage from my memories. No, this is not science fiction. Thanks to the magic of generative AI, I scanned through my memories and turned a few into photos. 

How? Simply through some simple AI text-to-photo prompting.

I didn’t try to create photo-real images. Instead, I decided to visualize my past in cartoon form… as far away from reality as you can get. That way, it’s just the essence of a memory that’s represented. That’s all I wanted.

4 Steps to Bring the Past Back to (Cartoon) Life

So yes, I sat down at my computer and created cartoon scenes from my life to weave into a photo collage.

Here’s how:

  • Design your character prototypes. You can type in the physical characteristics or use a photo as a reference. A partial similarity is all you need to get to. Remember, it’s just a cartoon. I’m going for fun here… not accuracy.
  • Once you’ve got your character blueprints, upload them as your subjects. 
  • Then simply type in a couple sentences from your memory as your prompt.
  • If you happen to have an actual photo from the location of your memory, you can also upload that as part of the ‘scene.’ 

I found this process remarkably easy and successfully generated a variety of fun cartoon scenes from my life to stitch together into a unique photo-collage card.

I used Google Whisk for this first experiment, but there are many other generative AI platforms to use, including Adobe Firefly.

Cartoon Barrett

Let me share a few examples how this all works. First, here’s cartoon Barrett I created. 

This is the blueprint.

Then I got to work reviewing some of my recent trips and thought about a few key moments that weren’t photographed.

Lost in Alaska

I’ve shared photos from our big 2023 hike up the Harding Icefield Trail in Alaska’s Kenai Fjords National Park. But there’s another moment from this excursion.

I accompanied a group of hikers for this challenging trek, but I was a real slow poke. After a couple hours, I was pulling up the rear. Near the top, I realized I had fallen so far behind, there wasn’t a soul in sight. And the trail through the rocky surface had disappeared. Then, there were a few minutes when I was totally alone… and effectively lost. 

I’m on a mountain, next to a glacier, and it’s cold. Now what?

My heart pumped harder. I had no choice but to keep moving. Fortunately, I walked in the correct direction and soon spotted the lead from our group (who was looking for me).  

So, my ‘moment’ was really just for a moment. Still, I hold onto this vivid memory. 

Crashing a New Orleans Parade

During our 2022 vacation to New Orleans, I captured some great street photos. But there was this one amazing scene I walked through that I just couldn’t get a shot from. It all happened too fast. 

We were strolling through the French Quarter, turned a corner to cross a street and crashed into one of those glorious small parades with music and dancing down the avenue. I was literally in the middle of it all, and before I knew it, they were gone.

The lingering memory feels something like this…

The space was much tighter as everyone swarmed around me, but this cartoon does a good job capturing my feeling. 

This represents the great photo in New Orleans I never snapped.

A Wild Turkey Flew into My Car

One of the freakiest driving experiences I ever had was during a spring road trip with my family. I was driving through the countryside, and a wild turkey flew into our car. 

Thankfully, it wasn’t a direct impact. As I tried to veer away, the turkey clipped the passenger’s window and tore off the side mirror. Fortunately, we were all fine (not sure about the turkey).

This is certainly not a moment you’d expect to get a photo from. This representation does plenty justice to the absurdity of it all.

Camera Overboard?

The truth is none of these memories could really have accompanying photos. 

The fact that I can now quickly generate images (however silly) with a few clicks to reflect my experience is quite powerful.

And sometimes, it’s the story behind the story. Like the time I worried I would lose my camera overboard on our cruise while I shot a few timelapses.

This never happened. It’s simply a memory of how I felt. (Now, we’re drilling deep into my head.)

A New Way to Tell Your Story

Whether reconstructing past moments or simply visualizing old feelings, this AI-fueled image creation process is just another way AI is empowering us with new artistic and storytelling skills.

Impressive. Most impressive.

For your consideration.

Here’s How I Finally Wrapped My 9th Grade Film Thanks to AI Video Generation

These are the AI characters I created to star in the big scene from “The Portal in Central Park,” originally written by me and a few friends decades ago and finally brought to life through Google’s Veo 3’s AI superpowers. Here’s how I did it.

When I was in 9th grade, I joined a school project with some friends. We were going to shoot a science fiction mini movie around Central Park in New York City. We wrote part of our time travel script, discussed the many logistics and locations we’d shoot in. 

Young Filmmakers on the Streets of New York?
I remember we were going to feature a tall, black obelisk that at the time was found at the entrance to Central Park on 59th Street and 5th Avenue. The sculpture would be the ‘time portal’ that our characters would walk towards and disappear through. Clever editing would avoid the need for special effects.

We were in ‘preproduction’ that spring, and it would have been a spectacular time to film on the streets of New York. Though we were all inspired by the potential of our little project, most eventually realized the many complexities of making a movie and how long it really would take to pull it off. Still, I felt undeterred. But the others had a different (more realistic) view.

Our project started losing steam, and ultimately, our short flick never got out of development. It was simply too big a lift. A few months later, we all graduated, and that was it.

My Origin Story that Never Happened
This would have been my origin story as a fifteen-year-old filmmaker, but it was not to be. (Instead, a year later, I found a more structured opportunity to explore my video production interests in high school.) 

But I’ve never forgotten about my first student movie short that never was. That obelisk scene is seared into my long-term memory. I really wanted to capture that shot. I saw it so clearly.

I still do.

AI Video Generation Can Bring Your Vision to Life
Over the decades, I’ve occasionally found myself returning to the nagging sadness that we never finished our movie. Heck, we never started it!

But if I could somehow go back to the future and capture that obelisk scene, maybe I could check it off my bucket list.

Well, now I can… from the comfort of my home office with a little text-to-video prompting and the power of AI video generation.

Yes, the magic of Gen AI is transforming our existence on a daily basis. And yes, it can now enable me to finally manifest my dusty vision out of thin air. 

So that’s exactly what I decided to do. 

There are multiple platforms that are up to the task. I decided to use Google’s Veo 3.1 and Flow/Scenebuilder. So, I signed up for the Google AI Pro plan for twenty bucks a month. I felt that would give me enough generative AI credits for what would be a 30-second scene.Text to Image Prompting
First, I created still images of my three main characters using Google Whisk and its text-to-image generation powers:

The Leader

Second in Command

The Nerd

Text to Video Prompting in Scenebuilder
Any remnants of our original script were long gone, but as I’ve said, the obelisk imagery remained clearly in my mind.

I’ve admittedly updated the characters (away from a few school kids) and added a few lines (current scriptwriter’s prerogative). Yes, these AI characters can talk!

Then, I uploaded the images of my AI actors and began typing in prompts for individual shots around this one scene. I relied on the ‘Scenebuilder’ mode to retain the same characters and background from shot to shot.

Veo 3.1 is impressive, but it also hallucinated a fair amount, adding in new scripted lines, a few of which I end up using. 

“The Portal in Central Park,” My AI-Generated Movie Scene
And here’s my completed 30-second scene, “The Portal in Central Park”… finally ready for its premiere all these decades later.

Imperfect, Yet Simultaneously Stunning
Okay. This is not exactly going to win any awards, and it does look rather fake (Though not entirely fake… It could easily serve as an early draft for a pitch to do a real shoot).

And I also found myself struggling to get precisely what I wanted. (Perhaps that’s due to the limitations in my basic text prompting skills.) Strangely, I felt like a director arguing with live actors who didn’t want to follow my direction.

As I mentioned, I ended up accepting the actors’ improv in a couple of the hallucinations. So, this scene isn’t exactly what I originally envisioned, but it’s close.

The background music is also AI-generated through Google’s MusicFX platform. I just typed in… “A cinematic feeling piece of music suggesting that time is running out. Exciting violins. Medium tempo.”

Click. One try is all it took.

That’s a Wrap!
Ultimately, I found it amazing what I was able to accomplish in just a few hours. That said, I edited the clips together manually in Final Cut Pro. This part still required (for now) nuanced timing and a human touch.

Each clip took about a minute to generate using Veo 3.1 Fast mode. And yes, there were many that ended up on the cutting room floor. 

But as imperfect as the results were, I can still say I successfully brought my teenage cinematic vision ‘to life.’

The Future of Visual Storytelling
But I must admit there’s more to this exercise than completing the big scene from an old school project that I’m sure my former classmates have long forgotten about.

The truth is I’m back to where I started as a teenager. I still feel the creative passion to bring stories to life, but I again need to learn how to use the tools available to me.

And that’s exactly what I’m doing.

For twenty bucks, you and I can conjure up complete videos with stories and characters based on simple text prompts. It feels entirely like a fantasy. But it’s not. 

The only part of the process that feels normal is this: 

-The power of the written word is as strong as ever.

Keep It Real
We’re clearly in the middle of a creative revolution. If you want to keep up, there’s no time to lose.

Learn how to use these new AI-fueled creative tools, which will continue to improve… There are countless reasons why.

…Or else you may find yourself eventually becoming the hallucination on the cutting room floor.

Using AI to Bend Reality in My Vacation Photography

I enjoy taking lots of photos of my life. Why exactly? Well, why does anybody?

  • To remember. To reflect. To share. To prove that it happened.
  • Family. Vacation. Adventure. Misadventure. Home. Passion. Life.

But now with a little help from generative AI, you can whip up your own life’s photos without having to actually experience… your life. Now, you can document your imagined life and share this alternate version if you want.

Sure, I know this all sounds rather absurd. But the fact that it’s possible now… easy in fact, should give us all pause. What is real anymore? 

This is, of course, a big topic of discussion on any number of fronts. For the moment, I’m simply directing the focus inward from societal to individual impact.

Google Whisk’s ‘Precise Reference’ Mode
Okay. So, with that set up, here’s how to have some ‘fun’ reinventing your life in pictures.

I’ve been experimenting with Google Whisk (one of several players in this disruptive and quickly evolving digital sandbox). Here’s the game-changing trick I’ve recently learned that turned this AI image generator into a reality-blending tool.

  • Activate ‘Precise Reference’ mode in Settings.

From there you simply need to upload at least one pictures of yourself for Whisk to see. That’s the critical reference point that puts ‘you’ in the new scene.

You can also upload photo backgrounds to help art-direct your shot or create them via text prompts.

Then, everything is ready for you to prompt your new photo into existence…starring you.

And then just click to generate.

Photos from My Vacations Not Taken
I followed the above steps, and within seconds, I received back each of these vacation photos from my alternate universe.

Sailboat Racing Fun

Seeing is Believing?
Whoa. This other guy sure is having fun. Maybe he should dial it back a bit. No, these AI-generated shots aren’t perfect. But they’re close enough to prove my point.

Creating a fake photo isn’t exactly new. Other tools have been available to do that for years. But it used to take a certain amount of skill and effort. Now, with a couple reference photos, a few clicks and a basic understanding of the process, everyone can access this great power. 

And we all know the line from “Spider-Man.”

Time to Meet Your Doppelgänger
I am fascinated. I am concerned. I am confused. My creative center feels in flux. My very existence can be morphed (as can yours).

But I’m determined to figure out how to properly integrate this AI-led creative revolution into my own reality (as we all should).

To truly understand it, you have to know how to operate within it. This is no time to ignore what’s already happened.

That’s why I’m spending time creating a vacation album from my alternate universe. Yes, it’s been a fun exercise. 

But I couldn’t be more serious.