{"id":936,"date":"2012-04-06T21:47:27","date_gmt":"2012-04-06T13:47:27","guid":{"rendered":"http:\/\/www.magicandlove.com\/blog\/?p=936"},"modified":"2012-04-06T22:54:34","modified_gmt":"2012-04-06T14:54:34","slug":"video-playback-performance-processing","status":"publish","type":"post","link":"http:\/\/www.magicandlove.com\/blog\/2012\/04\/06\/video-playback-performance-processing\/","title":{"rendered":"Video Playback Performance – Processing"},"content":{"rendered":"

I try out different video playback mechanism in the Processing<\/a> to compare their performance. The digital video is the one I used in the last post. It is the trailer of the film Hugo<\/a>. The details are: 1280 x 692 H.264 AAC, bitrate 2,093.<\/p>\n

The computer I am using is iMac 3.06 GHz Intel Core 2 Duo, 4 GB RAM, ATI Radeon HD 4670 256 MB graphic card. Processing is the latest 1.5.1 version.<\/p>\n

For the video playback classes, I tested the default QuickTime Video<\/a> library, a FasterMovie<\/a> class, the GSVideo<\/a> library, and the JMCVideo<\/a> library with JavaFX 1.2 SDK.<\/p>\n

To render the video, I start with the standard image()<\/a> function, and proceed to test with various OpenGL texturing methods, including the GLGraphics<\/a> library.<\/p>\n

Again, I sample the CPU and Memory usage with the Activity Monitor from the Mac OSX utilities, in an interval of 30 seconds. The results are the average of 5 samples.<\/p>\n

Performance with 2D image function<\/strong><\/p>\n\n\n\n\n\n\n\n
<\/td>\nCPU (%)<\/td>\nMemory (Mb)<\/td>\n<\/tr>\n
QuickTime<\/td>\n175<\/td>\n221<\/td>\n<\/tr>\n
FasterMovie<\/td>\n137<\/td>\n275<\/td>\n<\/tr>\n
GSVideo<\/td>\n151<\/td>\n118<\/td>\n<\/tr>\n
JMCVideo<\/td>\n147<\/td>\n87<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

The OpenGL and QuickTime video libraries have problem working together. The program stops at the size() statement. I have to either put the first video related command before the size() or a dummy line<\/p>\n

\r\nprintln(Capture.list());\r\nsize(1280, 692, OPENGL);\r\n<\/pre>\n
The second batch of tests use the standard OpenGL vertex and texture functions.<\/p>\n
Performance with OpenGL texture and vertex functions<\/strong><\/p>\n\n\n\n\n\n\n\n
<\/td>\nCPU (%)<\/td>\nMemory (Mb)<\/td>\n<\/tr>\n
QuickTime<\/td>\n158<\/td>\n430<\/td>\n<\/tr>\n
FasterMovie<\/td>\n143<\/td>\n610<\/td>\n<\/tr>\n
GSVideo<\/td>\n147<\/td>\n315<\/td>\n<\/tr>\n
JMCVideo<\/td>\n142<\/td>\n397<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n
The third batch of tests involve custom arrangement in OpenGL. Both GSVideo and JMCVideo come with their own functions to write directly to OpenGL texture. For the FasterMovie test, I combine it with the pixel buffer object I have shown in my previous post<\/a>.
\n 
\nPerformance with custom OpenGL texture method<\/strong><\/p>\n\n\n\n\n\n
 <\/td>\nCPU (%)<\/td>\nMemory (Mb)<\/td>\n<\/tr>\n
FasterMovie+PBO<\/td>\n69<\/td>\n275<\/td>\n<\/tr>\n
GSVideo+GLGraphics<\/td>\n58<\/td>\n120<\/td>\n<\/tr>\n
JMCVideo+OpenGL<\/td>\n57<\/td>\n91<\/td>\n<\/tr>\n<\/table>\n
 
\nSample code for GSVideo and GLGraphics (from codeanticode<\/a>)<\/p>\n
\r\nimport processing.opengl.*;\r\nimport codeanticode.glgraphics.*;\r\nimport codeanticode.gsvideo.*;\r\n\r\nGSMovie mov;\r\nGLTexture tex;\r\n\r\nvoid setup() \r\n{\r\n  size(1280, 692, GLConstants.GLGRAPHICS);\r\n  background(0);   \r\n  mov = new GSMovie(this, \"Hugo.mp4\");\r\n  tex = new GLTexture(this);\r\n  mov.setPixelDest(tex);  \r\n  mov.loop();\r\n}\r\n\r\nvoid draw() \r\n{\r\n  if (tex.putPixelsIntoTexture()) \r\n  {\r\n    image(tex, 0, 0);\r\n  }\r\n}\r\n\r\nvoid movieEvent(GSMovie _m) {\r\n  _m.read();\r\n}\r\n<\/pre>\n
 
\nSample code for JMCVideo (from Angus Forbes<\/a>)<\/p>\n
\r\nimport jmcvideo.*;\r\nimport processing.opengl.*;\r\nimport javax.media.opengl.*; \r\n\r\nJMCMovieGL mov;\r\nPGraphicsOpenGL pgl;\r\n\r\nvoid setup() \r\n{\r\n  size(1280, 692, OPENGL);\r\n  background(0);\r\n  mov = new JMCMovieGL(this, \"Hugo.mp4\", ARGB);\r\n  mov.loop();\r\n  \r\n  pgl = (PGraphicsOpenGL) g;\r\n  GL gl = pgl.beginGL();  \r\n  gl.glViewport(0, 0, width, height);\r\n  pgl.endGL();\r\n}\r\n\r\nvoid draw() \r\n{\r\n  GL gl = pgl.beginGL();  \r\n  mov.image(gl, 0, 0, width, height);\r\n  pgl.endGL();\r\n}  \r\n<\/pre>\n","protected":false},"excerpt":{"rendered":"
I try out different video playback mechanism in the Processing to compare their performance. The digital video is the one I used in the last post. It is the trailer of the film Hugo. The details are: 1280 x 692 H.264 AAC, bitrate 2,093. The computer I am using is iMac 3.06 GHz Intel Core […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[66],"tags":[62,101],"class_list":["post-936","post","type-post","status-publish","format-standard","hentry","category-testing","tag-processing-org","tag-video-playback"],"_links":{"self":[{"href":"http:\/\/www.magicandlove.com\/blog\/wp-json\/wp\/v2\/posts\/936","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/www.magicandlove.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/www.magicandlove.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/www.magicandlove.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/www.magicandlove.com\/blog\/wp-json\/wp\/v2\/comments?post=936"}],"version-history":[{"count":15,"href":"http:\/\/www.magicandlove.com\/blog\/wp-json\/wp\/v2\/posts\/936\/revisions"}],"predecessor-version":[{"id":951,"href":"http:\/\/www.magicandlove.com\/blog\/wp-json\/wp\/v2\/posts\/936\/revisions\/951"}],"wp:attachment":[{"href":"http:\/\/www.magicandlove.com\/blog\/wp-json\/wp\/v2\/media?parent=936"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/www.magicandlove.com\/blog\/wp-json\/wp\/v2\/categories?post=936"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/www.magicandlove.com\/blog\/wp-json\/wp\/v2\/tags?post=936"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}