<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>text-to-video | Federico Bo</title>
	<atom:link href="https://www.federicobo.eu/tag/text-to-video/feed/" rel="self" type="application/rss+xml" />
	<link>https://www.federicobo.eu</link>
	<description>Intelligenza Artificiale, Blockchain, NFT, metaverso e altre visioni</description>
	<lastBuildDate>Mon, 01 Jul 2024 19:27:52 +0000</lastBuildDate>
	<language>it-IT</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=6.8.3</generator>
	<item>
		<title>Sora, Luma, Runway Gen-3: il text-to-video comparato</title>
		<link>https://www.federicobo.eu/texttovideo_comparato/</link>
		
		<dc:creator><![CDATA[Federico Bo]]></dc:creator>
		<pubDate>Mon, 01 Jul 2024 19:27:52 +0000</pubDate>
				<category><![CDATA[Sperimentazioni]]></category>
		<category><![CDATA[text-to-video]]></category>
		<guid isPermaLink="false">https://www.sophia.vision/?p=1736</guid>

					<description><![CDATA[<p>Una comparazione tra i modelli text-to-video Sora, Luma e Runway Gen-3.</p>
The post <a href="https://www.federicobo.eu/texttovideo_comparato/">Sora, Luma, Runway Gen-3: il text-to-video comparato</a> first appeared on <a href="https://www.federicobo.eu">Federico Bo</a>.]]></description>
										<content:encoded><![CDATA[<p>Il text-to-video è la frontiera più avanzata dei modelli generativi di Intelligenza Artificiale. Scrivere un prompt, più o meno dettagliato, e veder comparire un video è affascinante ma il lavoro che devono fare le reti neurali soggiacenti questi modelli è notevole. Le difficoltà che i modelli text-to-image incontrano &#8211; coma la consistenza tra immagini successive o la comparsa di difetti nell&#8217;anatomia delle forme umane &#8211; sono, nel text-to-video, ingigantite dal fattore temporale e dalla necessità di rispettare vincoli stringenti come quelli derivanti dalla forza di gravità.</p>



<p>Tuttavia aumentano le aziende che cercano di creare e migliorare rapidamente questa tipologia di IA generative.</p>



<p><a href="https://openai.com/index/sora/" target="_blank" rel="noopener" title="">Sora di OpenAI</a> è stata la prima a produrre video qualitativamente superiori. Sebbene dopo mesi dall&#8217;annuncio il modello non sia ancora disponibile pubblicamente, i test fatti dai ricercatori e dai professionisti a cui è stata data la possibilità di sperimentare sono ancora i benchmark di riferimento.</p>



<p><a href="https://lumalabs.ai/" target="_blank" rel="noopener" title="">Luma</a> è un&#8217;azienda specializzata nella conversione di oggetti e scene reali, catturati per esempio con la fotocamera dello smartphone, in modelli interattivi 3D. <a href="https://lumalabs.ai/dream-machine" target="_blank" rel="noopener" title="">Dream Machine</a> è un modello IA, gratuito con limitazioni di prompt giornalieri, per la generazione di video a partire da una richiesta testuale.</p>



<p><a href="https://runwayml.com/" target="_blank" rel="noopener" title="">Runway</a>, altro competitor di Sora, ha da poco rilasciato, per alcuni tester, una nuova versione (Gen-3) del suo text-to-video,</p>



<p><a href="https://vincos.it/" target="_blank" rel="noopener" title="">Vincenzo Cosenza</a> è uno dei fortunati ad averlo già provato e mi ha fornito i video per una comparazione con Sora e Luma.</p>



<p><em>A stylish woman walks down a Tokyo street filled with warm glowing neon and animated city signage. She wears a black leather jacket, a long red dress, and black boots, and carries a black purse. She wears sunglasses and red lipstick. She walks confidently and casually. The street is damp and reflective, creating a mirror effect of the colorful lights. Many pedestrians walk about.</em></p>



<div class="wp-block-columns is-layout-flex wp-container-core-columns-is-layout-28f84493 wp-block-columns-is-layout-flex">
<div class="wp-block-column is-layout-flow wp-block-column-is-layout-flow" style="flex-basis:25%"></div>



<div class="wp-block-column is-layout-flow wp-block-column-is-layout-flow" style="flex-basis:50%">
<figure class="wp-block-video"><video controls src="https://cdn.openai.com/sora/videos/tokyo-walk.mp4"></video><figcaption class="wp-element-caption">Sora</figcaption></figure>
</div>



<div class="wp-block-column is-layout-flow wp-block-column-is-layout-flow" style="flex-basis:25%"></div>
</div>



<div class="wp-block-columns is-layout-flex wp-container-core-columns-is-layout-28f84493 wp-block-columns-is-layout-flex">
<div class="wp-block-column is-layout-flow wp-block-column-is-layout-flow">
<figure class="wp-block-video"><video controls src="https://www.sophia.vision/wp-content/uploads/2024/07/Gen-3-Alpha-2814777022-A-stylish-woman-walk.mp4"></video><figcaption class="wp-element-caption">Runway</figcaption></figure>
</div>



<div class="wp-block-column is-layout-flow wp-block-column-is-layout-flow">
<figure class="wp-block-video"><video controls src="https://storage.cdn-luma.com/lit_lite_inference_im2vid_v1.0/13eca1fd-66b9-4ed2-9add-a7b2f6f5e28b/watermarked_video01f5ce5f1873f4229b90d20d258f92102.mp4"></video><figcaption class="wp-element-caption">Luma</figcaption></figure>
</div>
</div>



<p><em>Drone view of waves crashing against the rugged cliffs along Big Sur’s garay point beach. The crashing blue waters create white-tipped waves, while the golden light of the setting sun illuminates the rocky shore. A small island with a lighthouse sits in the distance, and green shrubbery covers the cliff’s edge. The steep drop from the road down to the beach is a dramatic feat, with the cliff’s edges jutting out over the sea. This is a view that captures the raw beauty of the coast and the rugged landscape of the Pacific Coast Highway.</em></p>



<div class="wp-block-columns is-layout-flex wp-container-core-columns-is-layout-28f84493 wp-block-columns-is-layout-flex">
<div class="wp-block-column is-layout-flow wp-block-column-is-layout-flow" style="flex-basis:25%"></div>



<div class="wp-block-column is-layout-flow wp-block-column-is-layout-flow" style="flex-basis:50%">
<figure class="wp-block-video"><video controls src="https://cdn.openai.com/sora/videos/big-sur.mp4"></video><figcaption class="wp-element-caption">Sora</figcaption></figure>
</div>



<div class="wp-block-column is-layout-flow wp-block-column-is-layout-flow" style="flex-basis:25%"></div>
</div>



<div class="wp-block-columns is-layout-flex wp-container-core-columns-is-layout-28f84493 wp-block-columns-is-layout-flex">
<div class="wp-block-column is-layout-flow wp-block-column-is-layout-flow">
<figure class="wp-block-video"><video controls src="https://www.sophia.vision/wp-content/uploads/2024/07/Gen-3-Alpha-3275036836-Drone-view-of-waves.mp4"></video><figcaption class="wp-element-caption">Runway</figcaption></figure>
</div>



<div class="wp-block-column is-layout-flow wp-block-column-is-layout-flow">
<figure class="wp-block-video"><video controls src="https://storage.cdn-luma.com/lit_lite_inference_text2vid_v1.0/5176c222-10ef-4d94-b101-4c7b47a58441/watermarked_video0fb84fd5e0d534808bba8defd12abac38.mp4#t=0.1"></video><figcaption class="wp-element-caption">Luma</figcaption></figure>
</div>
</div>



<p><em>A movie trailer featuring the adventures of the 30 year old space man wearing a red wool knitted motorcycle helmet, blue sky, salt desert, cinematic style, shot on 35mm film, vivid colors.</em></p>



<div class="wp-block-columns is-layout-flex wp-container-core-columns-is-layout-28f84493 wp-block-columns-is-layout-flex">
<div class="wp-block-column is-layout-flow wp-block-column-is-layout-flow" style="flex-basis:25%"></div>



<div class="wp-block-column is-layout-flow wp-block-column-is-layout-flow" style="flex-basis:50%">
<figure class="wp-block-video"><video controls src="https://cdn.openai.com/sora/videos/mitten-astronaut.mp4"></video><figcaption class="wp-element-caption">Sora</figcaption></figure>
</div>



<div class="wp-block-column is-layout-flow wp-block-column-is-layout-flow" style="flex-basis:25%"></div>
</div>



<div class="wp-block-columns is-layout-flex wp-container-core-columns-is-layout-28f84493 wp-block-columns-is-layout-flex">
<div class="wp-block-column is-layout-flow wp-block-column-is-layout-flow">
<figure class="wp-block-video"><video controls src="https://www.sophia.vision/wp-content/uploads/2024/07/Gen-3-Alpha-4252919700-A-movie-trailer-feat.mp4"></video><figcaption class="wp-element-caption">Runway</figcaption></figure>
</div>



<div class="wp-block-column is-layout-flow wp-block-column-is-layout-flow">
<figure class="wp-block-video"><video controls src="https://storage.cdn-luma.com/lit_lite_inference_text2vid_v1.0/49c91cb9-c8ba-40eb-bccf-bde71c6d0fb8/watermarked_video09b8d553febda4b848c5f5028d4b597f6.mp4#t=0.1"></video><figcaption class="wp-element-caption">Luma</figcaption></figure>
</div>
</div>



<p><em>A gorgeously rendered papercraft world of a coral reef, rife with colorful fish and sea creatures</em></p>



<div class="wp-block-columns is-layout-flex wp-container-core-columns-is-layout-28f84493 wp-block-columns-is-layout-flex">
<div class="wp-block-column is-layout-flow wp-block-column-is-layout-flow" style="flex-basis:25%"></div>



<div class="wp-block-column is-layout-flow wp-block-column-is-layout-flow" style="flex-basis:50%">
<figure class="wp-block-video"><video controls src="https://cdn.openai.com/sora/videos/origami-undersea.mp4"></video><figcaption class="wp-element-caption">Sora</figcaption></figure>
</div>



<div class="wp-block-column is-layout-flow wp-block-column-is-layout-flow" style="flex-basis:25%"></div>
</div>



<div class="wp-block-columns is-layout-flex wp-container-core-columns-is-layout-28f84493 wp-block-columns-is-layout-flex">
<div class="wp-block-column is-layout-flow wp-block-column-is-layout-flow">
<figure class="wp-block-video"><video controls src="https://www.sophia.vision/wp-content/uploads/2024/07/Gen-3-Alpha-3565186055-A-gorgeously-rendere.mp4"></video><figcaption class="wp-element-caption">Runway</figcaption></figure>
</div>



<div class="wp-block-column is-layout-flow wp-block-column-is-layout-flow">
<figure class="wp-block-video"><video controls src="https://storage.cdn-luma.com/lit_lite_inference_text2vid_v1.0/36b4e197-7b6c-4950-b69d-0a855964be95/watermarked_video05a4c302003f2447381e2969e500160fc.mp4#t=0.1"></video><figcaption class="wp-element-caption">Luma</figcaption></figure>
</div>
</div>



<p>Sora risulta decisamente migliore rispetto a Luma mentre Runway Gen 3 si avvicina e in alcuni casi (per esempio la vista a volo d&#8217;uccello dell&#8217;oceano) lo supera. Nel caso della ragazza per le vie di Tokio il movimento di Luma non è fluido e mancano dettagli; con Runway è notevole il dinamismo della gonna della ragazza. L&#8217;astronauta di Luma non è male (ma perché tutti sembrano avere un centrino ricamato all&#8217;uncinetto sul casco? <em>update</em> giustamente <a href="https://www.linkedin.com/in/nicologallio/" target="_blank" rel="noopener" title="">Nicolò Gallio</a> mi fa notare che nel prompt c&#8217;è scritto: &#8220;<em>a red wool knitted motorcycle helmet</em>&#8220;&#8230;). Il Nemo di Luma sembra un&#8217;inquietante mutaforma, Runway ha scelto un stile &#8220;infantile&#8221;.</p>



<p>Un&#8217;analisi più dettagliata di Gen-3 di Runway in questo video di Vincenzo.</p>



<figure class="wp-block-embed aligncenter is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio"><div class="wp-block-embed__wrapper">
<iframe title="Esclusiva: la prova di Runway Gen-3 Alpha (video da testo con IA)" width="500" height="281" src="https://www.youtube.com/embed/-iPAonvFKPM?feature=oembed" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" referrerpolicy="strict-origin-when-cross-origin" allowfullscreen></iframe>
</div></figure>



<div class="wp-block-columns is-layout-flex wp-container-core-columns-is-layout-28f84493 wp-block-columns-is-layout-flex">
<div class="wp-block-column is-layout-flow wp-block-column-is-layout-flow"></div>



<div class="wp-block-column is-layout-flow wp-block-column-is-layout-flow"></div>
</div>

<p>Originariamente pubblicato sul sito di SophIA &#8211; Laboratorio cine-audiovisivo di Intelligenza Artificiale.</p>The post <a href="https://www.federicobo.eu/texttovideo_comparato/">Sora, Luma, Runway Gen-3: il text-to-video comparato</a> first appeared on <a href="https://www.federicobo.eu">Federico Bo</a>.]]></content:encoded>
					
		
		<enclosure url="https://cdn.openai.com/sora/videos/tokyo-walk.mp4" length="48439249" type="video/mp4" />
<enclosure url="https://storage.cdn-luma.com/lit_lite_inference_im2vid_v1.0/13eca1fd-66b9-4ed2-9add-a7b2f6f5e28b/watermarked_video01f5ce5f1873f4229b90d20d258f92102.mp4" length="8217176" type="video/mp4" />
<enclosure url="https://cdn.openai.com/sora/videos/big-sur.mp4" length="17049093" type="video/mp4" />
<enclosure url="https://cdn.openai.com/sora/videos/mitten-astronaut.mp4" length="54498572" type="video/mp4" />
<enclosure url="https://cdn.openai.com/sora/videos/origami-undersea.mp4" length="64501592" type="video/mp4" />
<enclosure url="https://www.sophia.vision/wp-content/uploads/2024/07/Gen-3-Alpha-2814777022-A-stylish-woman-walk.mp4" length="5098129" type="video/mp4" />
<enclosure url="https://www.sophia.vision/wp-content/uploads/2024/07/Gen-3-Alpha-3275036836-Drone-view-of-waves.mp4" length="6493818" type="video/mp4" />
<enclosure url="https://www.sophia.vision/wp-content/uploads/2024/07/Gen-3-Alpha-4252919700-A-movie-trailer-feat.mp4" length="3395500" type="video/mp4" />
<enclosure url="https://www.sophia.vision/wp-content/uploads/2024/07/Gen-3-Alpha-3565186055-A-gorgeously-rendere.mp4" length="6304983" type="video/mp4" />
<enclosure url="https://storage.cdn-luma.com/lit_lite_inference_text2vid_v1.0/5176c222-10ef-4d94-b101-4c7b47a58441/watermarked_video0fb84fd5e0d534808bba8defd12abac38.mp4" length="1957820" type="video/mp4" />
<enclosure url="https://storage.cdn-luma.com/lit_lite_inference_text2vid_v1.0/49c91cb9-c8ba-40eb-bccf-bde71c6d0fb8/watermarked_video09b8d553febda4b848c5f5028d4b597f6.mp4" length="3419375" type="video/mp4" />
<enclosure url="https://storage.cdn-luma.com/lit_lite_inference_text2vid_v1.0/36b4e197-7b6c-4950-b69d-0a855964be95/watermarked_video05a4c302003f2447381e2969e500160fc.mp4" length="3423758" type="video/mp4" />

			</item>
	</channel>
</rss>
