The Melting Future by Wei Qin

Page 1


The Melting Future

StudentName:WeiQin MatriculationNo:U2230161H

GenerativeAIappliesatechnologycalledaneuralnetworktocreateartworkfroma prompt.Aneuralnetworkisamathematicalsystem—analgorithm—thatfinds patternsinbigsetsofdata.

Forexample,whenyoupromptanAIgeneratortodepictatree,itusesthe informationithaslearnedabouttreestocreateanewimage.Ourguidanceasthe artistrefinesthoseimagesevenfurther–tellingittogenerateapinkfirtree,for instance,oratreebloomingwithtropicalflowers.

AI-Generated Artworks

WhatAIartmeansforsociety,accordingtoYaleexperts

AIinArt:

AIartinvolvestheuseoftext-to-imagegeneratorslikeDALL-E2orMidjourney, trainedonlargedatasetstomimichumanartisticability.

AI-generatedartisbecomingincreasinglysophisticated,raisingquestions aboutitsimpactontheartindustryandthecreativeprocess.

ControversiesandEthicalConcerns:

SomeartistsarguethatAIartgeneratorsare"anti-artist"astheyusehuman artists'workwithoutconsentfortraining,leadingtoconcernsaboutcopyright infringement.

Recentlawsuitshighlightartists'claimsthatAIcompaniesusecopyrighted imageswithoutpermissionorcompensation.

Ethicalconcernsrevolvearoundtherespectforartistsandtheundervaluation ofartasacraftinthewakeofAIadvancements.

ConcernsareraisedaboutthepotentialforAI-generatedarttoleadto increasedmistrustinsociety,similartoskepticismaroundnewsandscience.

HumanCreativityvs.AI:

SomeexpertsbelievethatAImaydisplacecertainaspectsofhumancreativity butwon'tfullyreplacetheartisticprocess.AIisseenasatoolthatchangeshow artistscreateratherthanreplacingthementirely.

ChallengesinAIArtRecognition:

AsurveyofYaleundergraduatesrevealedthatdistinguishingbetweenAIgeneratedandhuman-madeartischallenging,withrespondentscorrectly identifyingAI-generatedart54%ofthetimeonaverage.

https://yaledailynewscom/blog/2023/01/23/what-ai-art-means-for-society-according-to-yale-experts/

AI-Generated Artworks

WillAIartelevatehumancreativity?

WillAIbeatoolorareplacementforartists?

IsAIart,art?Yaleexpertsweighin

Reflection

Asadesignstudent,thinkingabouthowAIaffectsartisinteresting.Theideaof AIasatoolratherthanareplacementresonateswithmyownexperiencesin design.AImakingartiscool,butitalsomakesmequestionhowweusually thinkaboutcreatingart.It'samixofamazementanddoubt.Thebigquestionis whetherAIcanelevatehumancreativity.WhileAIcanbringinnewideas,artis allaboutexpressingemotions,andthat'ssomethinguniquetohumans.The expertsatYalearetalkingaboutfairness,sayingthathumanartistsshouldbe paidfortheirworkandthatweshouldthinkabouthowartistsoftenendup doingmenialstuffjusttomakealiving.Itmakesmethinkaboutwhatart meansandhowtechnologylikeAIfitsintothatpicture.

https://yaledailynewscom/blog/2023/01/23/what-ai-art-means-for-society-according-to-yale-experts/

AI-Generated Artworks

Capabilities&Limitations:

Soracanturntextintorealisticvideosuptoaminutelong.Itisdesignedto createmodelsthatunderstandandsimulatereal-worldinteractions;asaresult, itcangeneratecomplexsceneswithmultiplecharacters,specificmotions,and accuratedetails.

However,itcurrentlyhassomelimitations,suchasstruggleswithaccurately simulatingcomplexphysicsandunderstandingspecificcause-and-effect instances.

SafetyConcerns:

BeforereleasingSora,they'reworkingwithexpertstotestitforissueslike spreadingfalseinformation,promotinghate,andbias.

Theyareintroducingadetectionclassifiertohelpidentifymisleadingcontent generatedbySora.

ToidentifypositiveusecasesforAI,learningfromreal-worlduseiscriticalto creatingandreleasingincreasinglysafeAIsystemsovertime.

Howitworks/FutureChallenges:

SimilartootheradvancedmodelslikeGPT,Sorausesatransformerarchitecture forimprovedperformance.Itrepresentsvideosandimagesassmallerunits calledpatches,allowingittohandleawiderrangeofvisualdataintermsof duration,resolution,andaspectratio.

SoraisbuiltuponpreviousresearchfromDALL·EandGPTmodels.It incorporatestherecaptioningtechniquefromDALL·E3,generatingdetailed captionsfortrainingdata,whichhelpsthemodelbetterfollowuserinstructions inthegeneratedvideos.

AI-Generated Artworks

openai.com

Sora:Creatingvideo fromtext

SoraisanAImodelthatcancreate realisticandimaginativescenesfrom textinstructions.Readtechnicalreport Allvideosonthispageweregenerated directlybySorawithoutmodification. We'reteachingAItounderstandand simulatethephysicalwo…

Reflection

TheuseofAItoolslikeSorapresentsafascinatingyetcomplexreflectionon theintersectionoftechnologyandcreativity.Itopensupnewpossibilitiesfor artistsandcontentcreatorsbystreamliningthecreativeprocessandoffering innovativewaystobringideastolife.

However,thistechnologicaladvancementalsoraisessignificantethicaland societalconcerns.ThepotentialmisuseofAI-generatedcontentcouldposea threattotheintegrityofinformationonline.Aswecontinuetoexploreand integrateAItoolsintovariousaspectsofourlives,itbecomescrucialtostrikea balancebetweeninnovationandresponsibleuse.

AI Artists

Ig@refikanadol

MachineLearning,StyleGAN2ADAandStyleGANAlgorithms.

ByintegratingAItechnologiesintohisartisticpractice,RefikAnadolpushesthe boundariesoftraditionalartformsandexploresnewwaysofunderstandingand expressingcomplexinformation.HisuseofAIasa"thinkingbrush"notonlyexpands thepossibilitiesofartisticexpressionbutalsopromptsreflectionontheroleof technologyinshapingourunderstandingofcreativityandaesthetics.

Ig@joshuavermillion

JoshuaVermillionrecognizesAIasacrucialassetforarchitects,providingaplatform todelveintocreativeexploration,innovation,andefficientcommunicationofdesign concepts.ThroughhisexperimentationwithAItools,hebelievesit'sagreatwayto visualizeunconventionalspaces,alsoasapositivemeanstosavetimeandenhance theefficacyofconveyingideas.

https://wwwinstagramcom/joshuavermillion/?hl=en

AI Artists

Ig@infiniteyay

Midjourney&StableDiffusion

InfiniteYay'suseofAItoolsinvolvesemployingthemasacreativemediumto visuallyarticulatetheexpansivelandscapesofhisimagination.Hisapproach encompassesportrayingcontrastingrealities,mergingspontaneitywiththeprompts, andfosteringadeepconnectionwithpersonalintereststocraftcompellingand enchantingartworks.

AI Artists

Ig@radugadesign

Gen-2,RIFEAIinterpolation,andStableDiffusion

RadugadesignstudioleveragesAItoolsasintegralcomponentsintheirartistic process,particularlyintheirprojectofgeneratingAI-basedflowers.Frominitialdata inputandgenerationusingGen-2torefiningtransitionswithRIFEAIinterpolation andStableDiffusion,theyemploysthesetechnologiestocreatevisuallycompelling andnatural-lookingAI-generatedflowers.

https://wwwinstagramcom/radugadesign/

AI Artists

Ig@Katsukokoiso.ai

Midjourney+V6Alpha+Runwayapp

KatsukoKoiso'sworkfocusesonportraitsoftwins,utilizingthetechniqueof #sintography.Hisartisticvisionisacompellingexplorationofhumandiversity.The videoshecreatesaregeneratedusingMidjourneyinconjunctionwithrunwayapp.As anexperiencedphotographer,Koisorefrainsfromreferencingotherphotosorartists whilepromptinghisAI-generatedimages,contributingtothedistinctandoriginal natureofhisartwork.

https://wwwinstagramcom/katsukokoisoai/

AI Artists

Ig@thijs_biersteker

ofourdailydata ombinesvisual elements(theartinstallation),datatrackingandcalculation,andreal-time interactionthroughZoommeetings.Thismultimodalityenrichesthevisitor's experienceandhelpsconveythemessageeffectively.

https://thijsbierstekercom/mbco2

MoodBoard

https://wwwpinterestcom/weiqin2017/dm2021-ai-art/

Concept Development

Nature and Data

AsignificantportionofEarth'sfreshwaterisintheformofglaciersandicesheets, mainlyinGreenlandandAntarctica.Themeltingorbreakingoffoficecontributesto risingsealevels.NASA,usingsatelliteslikeGRACEandGRACE-FollowOn,hasbeen monitoringtheweightofglaciersandicesheetssince2002.Thedataunequivocally indicatesthattheseiceformationsarediminishing,posingaconcernforglobalsea levelrise.

Concept Development

Nature and Data

JuanSiliezar,2021

TheHarvardresearchshowsthatthemeltingWestAntarcticIceSheetcouldcause moresignificantsea-levelrisethanpreviouslythought,withawater-expulsion mechanismplayingacrucialrole,causingthebedrockbeneaththeicesheetto rebound,pushingadditionalwaterintotheocean.Shockingly,thefindingsindicate thatiftheicesheetweretocompletelycollapse,globalsea-levelriseestimates couldbe30%higherthanpreviouslythought,addinganextrameterwithinthenext 1,000years.Short-termimpactsarealsosignificant,withaprojected20%increase insea-levelrisebytheendofthiscentury.

Concept Development

Nature and Data

It'scrucialtoemphasizethatwhilenaturalfactorsplayaroleintheEarth'sclimate system,theacceleratedpaceoficesheetmeltingobservedinrecentdecadesis largelyattributedtohumanactivitiesandtheincreaseingreenhousegas concentrationsintheatmosphere.Reducinggreenhousegasemissionsisakey strategytomitigatefurthericesheetmeltinganditsassociatedimpactsonglobal climateandsealevels.

Concept Development

The Melting Future

From“thirteenWaysOfLookingAtAGlacier”

Inmyproposedconcept,IenvisionanAI-generatedartworkfeaturingicedcrystal plantsintricatelymanipulatedbymachineswithinalaboratorysetting.However, beneaththisaestheticfacadeliesapoignantmessage.Theseicedcrystalplants symbolizeourdelicatenaturalbiotope,underthreatfromtheadverseimpactsof humanactivities,includingproductionandindustrialization,leadingtoescalating globalwarming.Themachines,ontheotherhand,symbolizehumanpower, acceleratingthepaceoficesheetmeltingattributedtohumanactivities.

Theartworkaimstodrawattentiontothealarmingrealityofclimatechange, emphasizingtheconsequencesofhumanbehavior.Thebeautyofthefrozenplants contrastswiththeharshtruthoftheEarth'srisingtemperaturesandtheaccelerated icelossinAntarctica.Datafromthepastdecadesrevealsasixfoldincreaseinthe speedoficeloss.ThisAI-generatedvideoartseekstotranslatethisinvisibleyet criticalinteractionsbetweennaturalecosystemsandhumanactionsintoa compellingnarrative adepictionoftheice-meltingprocessoverrecentyears.

Itservesasavisualconfrontation,urgingviewerstorecognizetheurgentneedfor systemicchange.Throughthisjuxtapositionofbeautyandfragility,theartworkaims toprovokecontemplationandinspirecollectiveactiontowardasustainablefuture.

Concept Development

Data Visualization

Examplesofvisualizationsshowthesteady meltoftheArcticicecap

BelowisthedataIcollectedfromNASA,showingAntarcticicesheetmasslosses between2002and2023,andIinputthemintoRawGraphstogeneratedata visualizations.

Concept Development

Data Visualization

svs.gsfc.nasa.gov

NASAScientific VisualizationStudio| AntarcticIceMassLoss 2002-2023

ThemassoftheAntarcticicesheethas changedoverthelastdecades. Researchbasedonobservationsfrom theGravityRecoveryandClimate Experiment(GRACE)satellites(20022017)andGRACEFollow-On(since2018 -)indicatesthatbetween2002and 202…

DataVisualization: AntarcticIceMassLoss2002-2023

ScientificVisualizationStudioNASAandJPL/Caltech

DatashowingAntarcticicesheetmasslossesbetween2002and2023with superimposedicesheetvelocitystreamlines.

Concept Development

Data Visualization

AntarcticIceLossAccelerates,ContributingtoRisingSeaLevels

Inacomprehensivestudyspanningovertwodecades,scientistsutilizingdatafrom theGravityRecoveryandClimateExperiment(GRACE)satelliteshaveuncovered alarmingtrendsinAntarctica'sicemass.

Theresearch,whichcoverstheperiodfrom2002to2023,revealsastaggeringloss ofapproximately150gigatonsoficeannually,resultinginaglobalsealevelriseof 0.4millimetersperyear.

WhilepartsofEastAntarcticahaveshownminorgainsinicemassduetoincreased snowfall,thesegainshavebeenovershadowedbysubstantiallossesintheWest AntarcticIceSheet.Thedata,gatheredfromtheGRACEsatellitesandtheir  successor,GRACEFollow-On,paintaconcerningpictureoficedepletioninthe region.

Thisrevelationunderscorestheurgencyofaddressingclimatechangeandits profoundimpactsonpolaricesheets.AsAntarcticacontinuestoloseiceatan alarmingrate,theconsequencesforcoastalcommunitiesaroundtheworldbecome increasinglydire.Scientistsemphasizetheneedforswiftanddecisiveactionto mitigatefurthericelossandtheassociatedriseinsealevels.

stable-diffusion-art.com

StableDiffusion Samplers:A ComprehensiveGuideStableDiffusionArt

Manysamplingmethodsareavailablein AUTOMATIC1111.Eulera,Heun,DDIM... Whataresamplers?Howdotheywork? Whatisthedifferencebetweenthem? Which

ThisarticleexploreshowdifferentsamplersinStableDiffusionaffectthefinal outcomeofanimage,offeringacomprehensiveguide.Itexplainshoweachsampler influencesthefinalresult.

https://stable-diffusion-artcom/samplers/

AI Models Exp

Ifyouprioritizespeed,convergence,anddecentquality,besttoworkwithinclude DPM++2MKarraswith20–30stepsandUniPCwith20-30steps.

Forgoodqualityimageswithoutmuchconcernforconvergence,bestisDPM++SDE Karraswith10-15steps(Note:Thisisaslowersampler)andDDIMwith10-15steps.

EulerandHeunaresuitablechoicesforsimplicity,withtheoptiontoreducethe numberofstepsforHeuntosavetime.

https://stable-diffusion-artcom/samplers/

education.civitai.com

QuickstartGuideto StableVideoDiffusionCivitaiEducation

QuickstartguidetoStableVideo Diffusion(SVD)inComfyUI.Turnyour stillimagesintomovinganimations easilywithStableVideoDiffusion

https://educationcivitaicom/quickstart-guide-to-stable-video-diffusion/

AI Models Experimented

AI Models Experimented

https://wwwinstagramcom/joshuavermillion/?hl=en

AI Models Experimented

Midjourney

Prompt:technocore,frozenplants,inalabsetting,machinelike,intertwined,minimalist,conceptabout nature,acceleratedicelossinAntarctica,whitebackground--s250

AI Models Experimented

Midjourney

Prompt:hyper-realistic,photographic,techno-core,frozennaturalbiotopesareintertwinedwithelectric silverwires,manipulatedbymachinesinalaboratorysetting,machine-like,intertwined,minimalist, conceptaboutnature,acceleratedicelossinAntarctica,whitebackground

AI Models Experimented

Midjourney

Prompt:hyper-realistic,photographic,techno-core,frozennaturalbiotopesareintertwinedwithelectric silverwires,manipulatedbymachinesinalaboratorysetting,machine-like,intertwined,minimalist, conceptaboutnature,acceleratedicelossinAntarctica,whitebackground

AI Models Experimented

StableDiffusion&MidjourneyModelV6[ALPHA]

Prompt:technocore,frozenplants,inalabsetting,machinelike,intertwined,minimalist,conceptabout nature,acceleratedicelossinAntarctica,whitebackground--s250

AI Models Experimented

StableDiffusion&MidjourneyModelV6[ALPHA]

Prompt:technocore,frozenplants,inalabsetting,machinelike,intertwined,minimalist,conceptabout nature,acceleratedicelossinAntarctica,whitebackground--s250

AI Models Experimented

DreamStudio

Prompt:Hyper-realistic,minimaliststyle,cleanlooking,impactontheindustrialrevolution,machine learning, frozenplants, cleanwhitebackgroundinsidealab,-conceptaboutthealarmingrealityof climatechangeespeciallyacceleratedicelossinAntarctica.

Prompt:icefrozenplants,intertwined,machine-like,labenvironment,minimalist,technocore,lightsilver andsilver,naturallighting,conceptaboutclimatechangeandtheacceleratedicelossinAntarctica

AI Models Experimented

ComfyUI

IsimplyconvertedtheimagetovideobasedontheresultIgotfromDreamstudio

AI Models Experimented

DreamStudio

Prompt:hyper-realistic,photographic,techno-core,multiplefrozennaturalbiotopesareintertwinedwith electricsilverwires,manipulatedbymachinesinalaboratorysetting,machine-like,intertwined, minimalist,conceptaboutnature,acceleratedicelossinAntarctica,blackbackground

Size1536×640

Seed651929

Steps40

AI Models Experimented

DreamStudio

Prompt:hyper-realistic,photographic,techno-core,multiplefrozennaturalbiotopesareintertwinedwith electricsilverwires,manipulatedbymachinesinalaboratorysetting,machine-like,intertwined, minimalist,conceptaboutnature,acceleratedicelossinAntarctica,blackbackground stable-diffusion-xl-1024-v1-0

Size1536×640

Seed651929

Steps40

AI Models Experimented

DreamStudio

Prompt:hyper-realistic,photographic,techno-core,frozennaturalbiotopesareintertwinedwithelectric silverwires,manipulatedbymachinesinalaboratorysetting,machine-like,intertwined,minimalist, conceptaboutnature,acceleratedicelossinAntarctica,whitebackground stable-diffusion-xl-1024-v1-0

Size1536×640

Seed37562

Steps40

AI Models Experimented

DreamStudio

Prompt:hyper-realistic,photographic,techno-core,frozennaturalbiotopesareintertwinedwithelectric silverwires,manipulatedbymachinesinalaboratorysetting,machine-like,intertwined,minimalist, conceptaboutnature,acceleratedicelossinAntarctica,whitebackground stable-diffusion-xl-1024-v1-0

Size1536×640

Seed37562

Steps40

AI Models Experimented

FinalImage(3840pixelsby480pixels)

Tomaintainconsistentstyle,IutilizedPhotoshoptoolssuchasthehealingbrush, removetools,andgenerativefillstomergeeachindividualimagefromDreamStudio beforeimportingthemintoRunwayGen2togeneratethevideos.

AI Models Experimented

Prompt:hyper-realistic,photographic,techno-core,frozennaturalbiotopesareintertwinedwithelectric silverwires,manipulatedbymachinesinalaboratorysetting,machine-like,intertwined,minimalist, conceptaboutnature,acceleratedicelossinAntarctica,whitebackground--ar8:1--niji6-Remix(Strong) Midjourney(Blend)

AI Models Experimented

Prompt:hyper-realistic,photographic,techno-core,frozennaturalbiotopesareintertwinedwithelectric silverwires,manipulatedbymachinesinalaboratorysetting,machine-like,intertwined,minimalist, conceptaboutnature,acceleratedicelossinAntarctica,whitebackground--ar8:1--niji6-Remix(Strong) Midjourney(Blend)

AI Models Experimented

Prompt:hyper-realistic,photographic,techno-core,frozennaturalbiotopesareintertwinedwithelectric silverwires,manipulatedbymachinesinalaboratorysetting,machine-like,intertwined,minimalist, conceptaboutnature,acceleratedicelossinAntarctica,whitebackground--ar8:1--niji6-Remix(Strong) Midjourney(Blend)

AI Models Experimented

Storyline

Conclusions

Reflection

ThroughoutthisAIgenerativeartmodule,Ihavegainedabetterunderstanding ofvariousAItoolsandhoweachtooldiffersfromtheothersthrough experimentation.Formyfinalvideo,IselectedDreamStudio,poweredby StableDiffusion,becauseIbelieveitsstylealignsmorewiththeminimalist, machine-likeaestheticIaimfor.WhileIattemptedtouseMidjourneyto generatesomefinalimagesbyreferencingthosefromDreamStudio,the resultsdidnotmeetmyexpectations.AlthoughMidjourneyisgoodatupscaling imagestohighresolutions,itaddedtoomuchextradetailinmycase. Consequently,IdecidedtomanuallymergeandediteachimageinPhotoshop tomaintainacoherentandconsistentstyle.

OnekeychallengeIfacedwastimemanagement.Ispentconsiderabletime renderingthesameimagerepeatedlyuntilachievingthedesiredoutcome.I realizedthatwhileAItoolsarestilldeveloping,it'sunrealistictoexpectthemto produceexactlywhatIenvision.Therefore,Ilearnedtoacceptthebestresult withinthetimeconstraintsandproceedwitheditingthevideos.

Overall,IbelieveIhavelearnedagreatdealfromthismodule,notonlyfrom ProfessorInabutalsofrommypeers.Everyoneshowsdedicationand willingnesstostriveforexcellence,assistingoneanotherandsupportingthe classininstallingComfyUI.Throughthisprocess,Ihavegainedfresh perspectivesnotonlyonhowtouseAItoolsbutalsoonhowAIgenerates images.Iamconfidentthatthismoduleishighlyrelevanttomystudiesandwill providemewithasolidfoundationinAItools,enablingmetoovercomefuture challengesmoreeasily.

Turn static files into dynamic content formats.

Create a flipbook
Issuu converts static files into: digital portfolios, online yearbooks, online catalogs, digital photo albums and more. Sign up and create your flipbook.