cover

Pixel Magic Math

How does AI make pictures from words?
You type "a dragon eating ice cream on the moon" and ~~two seconds later~~ โ€” there it is, painted on your screen. **How

You type "a dragon eating ice cream on the moon" and two seconds later โ€” there it is, painted on your screen. How does the computer do that? It has never seen a dragon eating ice cream on the moon. It has never seen anything at all.

The AI starts with **pure noise** โ€” a rectangle of random static, ~~like a TV with no signal~~. *Every pixel is a differ

The AI starts with pure noise โ€” a rectangle of random static, like a TV with no signal. Every pixel is a different random color. It looks like colorful confetti exploded across the screen. This mess is the blank canvas.

Now the AI reads your words and begins to clean up the noise, one tiny step at a time. It asks itself: "If this static w

Now the AI reads your words and begins to clean up the noise, one tiny step at a time. It asks itself: "If this static were ACTUALLY a dragon eating ice cream on the moon, which pixels would I need to change just a little bit to make it look more like that?" Then it makes those changes. The static gets slightly less random.

The AI repeats this ~~hundreds of times~~. Each time, it looks at the current messy image and your words, and nudges a f

The AI repeats this hundreds of times. Each time, it looks at the current messy image and your words, and nudges a few more pixels in the right direction. Slowly, like a photo developing in a darkroom, shapes emerge from the chaos. A round thing appears. A long curvy thing. Patches of gray and silver.

How does it know which pixels to change? The AI was trained on **millions of pictures** that humans labeled with words.

How does it know which pixels to change? The AI was trained on millions of pictures that humans labeled with words. It saw thousands of dragons, thousands of ice cream cones, thousands of moons. It learned patterns โ€” dragon shapes usually have scales and wings, ice cream cones are usually triangular with a round scoop on top, moons are cratered and gray.

But the ++AI++ doesn't copy those old pictures. It learned the **IDEA of dragon-ness, ice-cream-ness, moon-ness**. Think

But the AI doesn't copy those old pictures. It learned the IDEA of dragon-ness, ice-cream-ness, moon-ness. Think of it like this: if you learned to draw dogs by looking at a hundred different dogs, you could then draw a NEW dog you've never seen, in a pose nobody ever photographed. The AI does the same thing, but with pixel math instead of a pencil.

After **hundreds of these tiny pixel nudges**, the noise has ~~transformed completely~~. The dragon's scales *catch imag

After hundreds of these tiny pixel nudges, the noise has transformed completely. The dragon's scales catch imaginary moonlight. The ice cream cone is bright against the gray dust. Stars dot the black sky. The AI combined three things it learned separately โ€” dragons, ice cream, moons โ€” into one picture it has never seen in its training data.

Every picture starts as **noise and ends as a dream made visible**, hundreds of tiny decisions guided by patterns learne

Every picture starts as noise and ends as a dream made visible, hundreds of tiny decisions guided by patterns learned from millions of images. The AI never "sees" the way you do โ€” it just knows which pixels, when nudged in which direction, tend to make shapes that humans call dragons, or ice cream, or moons. It's a mathematical magician, turning your words into colored light, one pixel at a time.

How was this book?

A Wonderleaf Book

Pixel Magic Math

โ€” How does AI make pictures from words? โ€”

Wonderleaf Editions
โ€” ex libris โ€”
A Wonderleaf Book

Pixel Magic Math

How does AI make pictures from words?

Wonderleaf Editions ยท MMXXVI
Scene 1
You type "a dragon eating ice cream on the moon" and ~~two seconds later~~ โ€” there it is, painted on your screen. **How
Pixel Magic Math2
Scene 1

You type "a dragon eating ice cream on the moon" and two seconds later โ€” there it is, painted on your screen. How does the computer do that? It has never seen a dragon eating ice cream on the moon. It has never seen anything at all.

3Pixel Magic Math
Scene 2
The AI starts with **pure noise** โ€” a rectangle of random static, ~~like a TV with no signal~~. *Every pixel is a differ
Pixel Magic Math4
Scene 2

The AI starts with pure noise โ€” a rectangle of random static, like a TV with no signal. Every pixel is a different random color. It looks like colorful confetti exploded across the screen. This mess is the blank canvas.

5Pixel Magic Math
Scene 3
Now the AI reads your words and begins to clean up the noise, one tiny step at a time. It asks itself: "If this static w
Pixel Magic Math6
Scene 3

Now the AI reads your words and begins to clean up the noise, one tiny step at a time. It asks itself: "If this static were ACTUALLY a dragon eating ice cream on the moon, which pixels would I need to change just a little bit to make it look more like that?" Then it makes those changes. The static gets slightly less random.

7Pixel Magic Math
Scene 4
The AI repeats this ~~hundreds of times~~. Each time, it looks at the current messy image and your words, and nudges a f
Pixel Magic Math8
Scene 4

The AI repeats this hundreds of times. Each time, it looks at the current messy image and your words, and nudges a few more pixels in the right direction. Slowly, like a photo developing in a darkroom, shapes emerge from the chaos. A round thing appears. A long curvy thing. Patches of gray and silver.

9Pixel Magic Math
Scene 5
How does it know which pixels to change? The AI was trained on **millions of pictures** that humans labeled with words.
Pixel Magic Math10
Scene 5

How does it know which pixels to change? The AI was trained on millions of pictures that humans labeled with words. It saw thousands of dragons, thousands of ice cream cones, thousands of moons. It learned patterns โ€” dragon shapes usually have scales and wings, ice cream cones are usually triangular with a round scoop on top, moons are cratered and gray.

11Pixel Magic Math
Scene 6
But the ++AI++ doesn't copy those old pictures. It learned the **IDEA of dragon-ness, ice-cream-ness, moon-ness**. Think
Pixel Magic Math12
Scene 6

But the AI doesn't copy those old pictures. It learned the IDEA of dragon-ness, ice-cream-ness, moon-ness. Think of it like this: if you learned to draw dogs by looking at a hundred different dogs, you could then draw a NEW dog you've never seen, in a pose nobody ever photographed. The AI does the same thing, but with pixel math instead of a pencil.

13Pixel Magic Math
Scene 7
After **hundreds of these tiny pixel nudges**, the noise has ~~transformed completely~~. The dragon's scales *catch imag
Pixel Magic Math14
Scene 7

After hundreds of these tiny pixel nudges, the noise has transformed completely. The dragon's scales catch imaginary moonlight. The ice cream cone is bright against the gray dust. Stars dot the black sky. The AI combined three things it learned separately โ€” dragons, ice cream, moons โ€” into one picture it has never seen in its training data.

15Pixel Magic Math
Scene 8
Every picture starts as **noise and ends as a dream made visible**, hundreds of tiny decisions guided by patterns learne
Pixel Magic Math16
Scene 8

Every picture starts as noise and ends as a dream made visible, hundreds of tiny decisions guided by patterns learned from millions of images. The AI never "sees" the way you do โ€” it just knows which pixels, when nudged in which direction, tend to make shapes that humans call dragons, or ice cream, or moons. It's a mathematical magician, turning your words into colored light, one pixel at a time.

17Pixel Magic Math

~ finis ~

Tiny picture books for big little questions.

โ€” a small constellation of questions โ€”
โœฆWonderleaf
Editions