Logo by stereoman - Contribute your own Logo!

END OF AN ERA, FRACTALFORUMS.COM IS CONTINUED ON FRACTALFORUMS.ORG

it was a great time but no longer maintainable by c.Kleinhuis contact him for any data retrieval,
thanks and see you perhaps in 10 years again

this forum will stay online for reference
News: Visit the official fractalforums.com Youtube Channel
 
*
Welcome, Guest. Please login or register. January 12, 2026, 02:49:34 PM


Login with username, password and session length


The All New FractalForums is now in Public Beta Testing! Visit FractalForums.org and check it out!


Pages: 1 ... 5 6 [7] 8 9 ... 13   Go Down
  Print  
Share this topic on DiggShare this topic on FacebookShare this topic on GoogleShare this topic on RedditShare this topic on StumbleUponShare this topic on Twitter
Author Topic: Turning Neural Networks Upside Down  (Read 47930 times)
0 Members and 2 Guests are viewing this topic.
Chillheimer
Global Moderator
Fractal Schemer
******
Posts: 972


Just another fractal being floating by..


chilli.chillheimer chillheimer
WWW
« Reply #90 on: July 09, 2015, 10:59:27 AM »

Just use fractal compression to enlarge to any size withiout loss.

 shocked
How?!? What tool can do this? (win8)

(I found why I can't do larger images. I change the allocated memory in oracle virtual box to 8gb but as soon as I start vagrant up it automatically sets it down to 2048mb. I already use the 64bit cmd.exe, so this is not the problem. any tips how I can raise the memory in vm constantly?)

also: found that with max 2gb you can go as high as around 1550pixels.
« Last Edit: July 09, 2015, 11:44:28 AM by Chillheimer » Logged

--- Fractals - add some Chaos to your life and put the world in order. ---
cKleinhuis
Administrator
Fractal Senior
*******
Posts: 7044


formerly known as 'Trifox'


WWW
« Reply #91 on: July 09, 2015, 11:00:08 AM »

wow, that's disturbing, but...

<a href="https://www.youtube.com/v/X_tvm6Eoa3g&rel=1&fs=1&hd=1" target="_blank">https://www.youtube.com/v/X_tvm6Eoa3g&rel=1&fs=1&hd=1</a>

... so is this  undecided chatbots? (I know a bit off topic but could be the audio interaction portion)

lets be careful ... the AI is trained to be veeeeeeeeeeeeeeery polite cheesy
Logged

---

divide and conquer - iterate and rule - chaos is No random!
Syntopia
Fractal Molossus
**
Posts: 681



syntopiadk
WWW
« Reply #92 on: July 09, 2015, 02:10:35 PM »

Some notes from my experiments so far:

Speed

(tested on 0.4MP image, 4 octaves, 10 iterations):

Use "caffe.set_mode_gpu()" to enable GPU (if you have a CUDA compatible setup)

CPU (Intel i7-4710HQ CPU @ 2.50GHz): 154.99 s
GPU (Nvidia 850M):   7.03 s (22x faster)
Using NVIDIA cuDNN may improve GPU speed by a additional factor of 2x (haven't tried)

Memory

On my 2GB GPU, I run out of memory when running on images larger than ~0.5 MP.

I have made the following function to automatically resize:
Code:
def loadWithMaxSize(imagename, maxSize = 400000):
    ig = PIL.Image.open(imagename)
    dim = ig.size[0]*ig.size[1]
    print "Initial size: ", dim, " ", ig.size[0], "x", ig.size[1]
    factor = math.sqrt(float(maxSize)/dim)
    ig = ig.resize((int(factor*ig.size[0]),int(factor*ig.size[1])), PIL.Image.ANTIALIAS)
    dim = ig.size[0]*ig.size[1]
    print "Final size: ", dim, " ", ig.size[0], "x", ig.size[1]
    return ig

imagename = '/home/mikael/Downloads/cheese1.jpg'
img = np.float32(loadWithMaxSize(imagename))
showarray(img)

Predictions

It is also interesting to see what the net actually predicts to be in the image.

To do this you need the label definitions, which for instance can be downloaded from here:
https://github.com/HoldenCaulfieldRye/caffe/blob/master/data/ilsvrc12/synset_words.txt


Code:
with open("/home/mikael/Downloads/synset_words.txt") as f:
    labels = f.readlines()
        
input_image = caffe.io.load_image(imagename)
prediction = net.predict([input_image], oversample=False)
top5predictions = prediction[0].argsort()[-5:][::-1]

for p in top5predictions:
    print "Predicted class:", labels[p].strip('\n').split(' ', 1)[1], " (", "{:.3f}".format(100*prediction[0][p]), "%)"



which will output something like:

Code:
Predicted class: cheeseburger  ( 99.991 %)
Predicted class: hotdog, hot dog, red hot  ( 0.004 %)
Predicted class: bagel, beigel  ( 0.003 %)
Predicted class: guacamole  ( 0.001 %)
Predicted class: plate  ( 0.000 %)

In order for this to work, you need to added a 'raw_scale' parameter to the classifier initalization, e.g.:

Code:
net = caffe.Classifier('tmp.prototxt', param_fn,
                       mean = np.float32([104.0, 116.0, 122.0]), # ImageNet mean, training set dependent
                       channel_swap = (2,1,0), # the reference model has channels in BGR order instead of RGB
                      raw_scale=255)



Logged
youhn
Fractal Molossus
**
Posts: 696


Shapes only exists in our heads.


« Reply #93 on: July 09, 2015, 09:51:00 PM »

lets be careful ... the AI is trained to be veeeeeeeeeeeeeeery polite cheesy

LOL!!! thanks for sharing this video conversation. Great quotes from the context to be plucked. But all together ... "it makes me sad".

Whish they could add some tone/melody/emotion. It's a kind a stupid to read *whispers, while the robotic voice continues to speak out loud and constant as ever. More dynamics! More fire! Let's go to war!

And why does it seem that they are trying real hard to be polite ... ?!  huh?

Weird stuff. AI programmers have lots of learning and developing to do.  Order in the court !!
Logged
Chillheimer
Global Moderator
Fractal Schemer
******
Posts: 972


Just another fractal being floating by..


chilli.chillheimer chillheimer
WWW
« Reply #94 on: July 10, 2015, 08:07:48 PM »

here's a nice guide that shows you how to set up deepdream on windows:
http://overstruck.com/how-to-use-googles-deepdream-in-windows/

wish I had found this before spending 2 days cursing and crying wink


and I recommend this, to find out what the different Layers do with your images:
https://www.reddit.com/r/deepdream/comments/3ck6mi/here_is_a_python_script_to_test_every_type_of/?sort=old
here someone posted example images of all modes:
http://hideepdreams.tumblr.com/tagged/layer-test
« Last Edit: July 10, 2015, 11:06:09 PM by Chillheimer » Logged

--- Fractals - add some Chaos to your life and put the world in order. ---
Chillheimer
Global Moderator
Fractal Schemer
******
Posts: 972


Just another fractal being floating by..


chilli.chillheimer chillheimer
WWW
« Reply #95 on: July 10, 2015, 10:51:37 PM »

Best online site yet:
https://dreamscopeapp.com
no queue, very fast, and lots of modes to choose from! smiley

also, best collection of tips and tricks and many links here:
https://www.reddit.com/r/deepdream/comments/3cawxb/what_are_deepdream_images_how_do_i_make_my_own/
« Last Edit: July 10, 2015, 11:01:37 PM by Chillheimer » Logged

--- Fractals - add some Chaos to your life and put the world in order. ---
Sockratease
Global Moderator
Fractal Senior
******
Posts: 3181



« Reply #96 on: July 10, 2015, 10:56:51 PM »

here's a nice guide that shows you how to set up deepdream on windows:
http://overstruck.com/how-to-use-googles-deepdream-in-windows/

wish I had found this before spending 2 days cursing and crying wink


and I recommend this, to find out what the different Layers do with your images:
https://www.reddit.com/r/deepdream/comments/3ck6mi/here_is_a_python_script_to_test_every_type_of/?sort=old

Best online site yet:
https://dreamscopeapp.com
no queue, very fast, and lots of modes to choose from! smiley

Thanks Muchly for those links!  Been meaning to check this out but never found any direct links to where to start, only background info and images.  I've been too stressed with personal life to patiently read the whole thread or full articles to find where to begin using this toy   sad

Was planning on trying this weekend, but this should save a lot of time seeking the right starting point.  I've got a lot of images I wanted to plug into this, so I may as well go have a peek.  Will post any interesting results  afro
Logged

Life is complex - It has real and imaginary components.

The All New Fractal Forums is now in Public Beta Testing! Visit FractalForums.org and check it out!
Fitz
Explorer
****
Posts: 53


« Reply #97 on: July 11, 2015, 05:11:53 AM »

This is one of the most impressive developments in technology that I've seen in my lifetime. The thought network of a computer was able to turn this:

http://i.imgur.com/vkxSzlt.jpg

Into this:

http://i.imgur.com/5H16Ykt.jpg
Logged
Chillheimer
Global Moderator
Fractal Schemer
******
Posts: 972


Just another fractal being floating by..


chilli.chillheimer chillheimer
WWW
« Reply #98 on: July 11, 2015, 12:49:28 PM »

google have updated this page:
https://github.com/google/deepdream/blob/master/dream.ipynb
at the bottom they show how you can analyze a picture and interpret it into another picture smiley
Logged

--- Fractals - add some Chaos to your life and put the world in order. ---
Sockratease
Global Moderator
Fractal Senior
******
Posts: 3181



« Reply #99 on: July 11, 2015, 01:10:28 PM »

Just curious why this obvious one hasn't been seen here yet, unless I missed it!



Woof!

I finally used this   afro  

Despite being a google thing, it's actually pretty cool   alien


EDIT - YUP!  I knew this had to be in this thread!  I somehow read from page 1 to page 3, and missed the stuff on page 2!  Oopsy...   embarrass
« Last Edit: July 11, 2015, 05:10:35 PM by Sockratease » Logged

Life is complex - It has real and imaginary components.

The All New Fractal Forums is now in Public Beta Testing! Visit FractalForums.org and check it out!
Chillheimer
Global Moderator
Fractal Schemer
******
Posts: 972


Just another fractal being floating by..


chilli.chillheimer chillheimer
WWW
« Reply #100 on: July 12, 2015, 11:36:49 AM »

more resources, huge overview of how all the different layers and training models look like:
http://www.csc.kth.se/~roelof/deepdream/
Logged

--- Fractals - add some Chaos to your life and put the world in order. ---
kram1032
Fractal Senior
******
Posts: 1863


« Reply #101 on: July 12, 2015, 11:52:09 AM »

Looks like there is a new technique in town
https://plus.google.com/+ResearchatGoogle/posts/NoBnPqwq3wh
"Guided Dreaming" where you take an image which's motifs are searched for in another image.
I suspect it'll still only work within whatever the network has actually learned but nevertheless it could be an interesting way to combine two fractals: Have one be the input and one the search image.
Here's one of the examples. The AI is asked to specifically dream of antelopes and Savanna trees found in an image of clouds in the sky:

This already comes closer to what might be considered art: First, a scene is interpreted, then that interpretation is used to modify another scene.
Logged
Sockratease
Global Moderator
Fractal Senior
******
Posts: 3181



« Reply #102 on: July 12, 2015, 12:33:51 PM »

Looks like there is a new technique in town
https://plus.google.com/+ResearchatGoogle/posts/NoBnPqwq3wh
"Guided Dreaming" where you take an image which's motifs are searched for in another image....

I left a similar suggestion in one of those site's comment boxes recently!  I wanted a way to favor bugs over doggies and thought that either using an "input image" as a guide or else a way to assign "weighted values" to which general type of stuff to recognize.

Looks like I was thinking along the same lines as these folks.

What an amusing way to kill an afternoon!  I still need to get this installed and running locally so I can do higher resolution stuff, but have had great fun with the online toys   afro

Here's what it did to my entry in this year's Contest.  It started out as a Black and White JWildfire image.  Colors all added by the toy.

Logged

Life is complex - It has real and imaginary components.

The All New Fractal Forums is now in Public Beta Testing! Visit FractalForums.org and check it out!
Chillheimer
Global Moderator
Fractal Schemer
******
Posts: 972


Just another fractal being floating by..


chilli.chillheimer chillheimer
WWW
« Reply #103 on: July 12, 2015, 12:52:30 PM »

wow, this whole thing just keeps getting better and better. i got the other training-net run
http://www.csc.kth.se/~roelof/deepdream/VIS_googlenet_places205_allLayers.html
and this in combination with mandelbulb3d architecture is just frigging mindblowing!!!  shocked
I want to live there!!


* thegate_sml2.jpg (127.95 KB, 1024x576 - viewed 200 times.)
Logged

--- Fractals - add some Chaos to your life and put the world in order. ---
Sockratease
Global Moderator
Fractal Senior
******
Posts: 3181



« Reply #104 on: July 12, 2015, 03:14:58 PM »

... I wanted a way to favor bugs over doggies ...

Has anybody else noticed a general trend for the AI to put doggies on brightly colored areas and buggies on darker colored areas?

I begin to see how this thing thinks! Going to test this theory...
Logged

Life is complex - It has real and imaginary components.

The All New Fractal Forums is now in Public Beta Testing! Visit FractalForums.org and check it out!
Pages: 1 ... 5 6 [7] 8 9 ... 13   Go Down
  Print  
 
Jump to:  

Related Topics
Subject Started by Replies Views Last post
The Upside Mandelbulb3D Gallery lenord 0 1721 Last post September 06, 2011, 04:07:55 PM
by lenord
Turning around the Beast Mandelbulb3D Gallery bib 1 2307 Last post March 26, 2012, 12:14:34 PM
by cKleinhuis
Using complex neural networks to generate 2D fractals: Thesis Survey (new) Theories & Research rrhvella 12 3343 Last post January 12, 2013, 05:30:52 PM
by Alef
Understanding Long Short Time Memory Neural Networks (new) Theories & Research kram1032 0 1114 Last post August 28, 2015, 02:37:25 AM
by kram1032
FRACTALNET: Ultra-Deep Neural Networks Without Residuals Fractals Applied or in Nature mancoast 0 4650 Last post April 02, 2017, 08:05:36 PM
by mancoast

Powered by MySQL Powered by PHP Powered by SMF 1.1.21 | SMF © 2015, Simple Machines

Valid XHTML 1.0! Valid CSS! Dilber MC Theme by HarzeM
Page created in 0.307 seconds with 24 queries. (Pretty URLs adds 0.019s, 2q)