Plumi doesn't handle big files well

[anonymous]

Hi!

I'm tryng to download 50 megs file from plumi, and it takes ages, a lot of memory.

I think rc2 was better in this issue from final, but I don't understand why... I'm also using Cache-Fu and setted zope cache to 15.000.

[anonymous]

more info:

wmstat -n 2 shows bi and bo around 1500/3000 and over.

It happens clicking on "Download video", with or without CacheSetup?.

yurj@beethoven:~$ vmstat -n 2 procs -----------memory---------- ---swap-- -----io---- -system-- ----cpu----

r b swpd free buff cache si so bi bo in cs us sy id wa 0 8 382556 5104 400 28472 5 4 17 18 15 7 0 0 99 1 0 7 391448 5532 528 27436 150 4624 318 4624 300 933 11 4 0 86 3 4 400540 5940 552 24992 236 4812 398 4848 438 1416 32 6 0 63 0 10 408036 5356 568 23348 248 4198 348 4200 376 1207 22 5 0 74 0 11 412264 5036 656 22832 504 2378 926 2380 401 1237 20 3 0 78 3 9 417220 5980 676 23340 494 2810 964 2840 288 1079 21 2 0 77

maybe a problem with BlobFile??

[anonymous]

Uhm, I mean the ExternalStorage?, not BlobFile?.

[anonymous]

Hi

yes, this is a known issue with large file support inside Plone.

You should upgraded to Plone 2.5.4-2 , see  http://plone.org/products/plone/releases/2.5.4

which you will notice has ::

Made Plone use 1/10th of the memory on file uploads. Details in http://dev.plone.org/plone/ticket/7027 (also fixed in Plone 3.0.x) [zegor]

Also, in plumi 0.2 we will have a facility where you can use a download server, ie plumi will re-write the urls so that the download links go via a different URL, where you can serve the video files from a apache webserver, or something else, not plone.

[anonymous]

I've applied the patch in 2.5.4, and restarted zope, but it doesn't change.

The problem is NOT in the upload, but in download.

I'm serving flv files via apache, and I created fake 1 byte lenght file to upload in the content type (engage.py).

[andycat]

Without more infomation on what "doesnt change" , I cant help. You need to give information about whats the problem, obviously. Also, if you post information can you make sure you format it properly in this tracker, so that its disgestable (see the vmstat info above)

I may be wrong, but the fix in 2.5.4-2 applies to the situation of uploading or downloading, or anytime that the content type is being edited.

Also, I wasnt talking about serving FLV, which are handled differently using included HTML from indytube- I was talking about downloading the raw media files that are uploaded by the user.

[andycat]

http://plumi.org/ticket/87