librelist archives

« back to archive

Large messages in Resque, anyone ?

Large messages in Resque, anyone ?

Thibaut Barrère
2010-08-13 @ 12:11
I'm just curious to know how you deal with this, if you do.

I have daily jobs that process files in the 100mb range. I tend to push only
the file name in the message, while the file data itself is pushed via a
dropbox system to the worker machine or a network share.

But I'm wondering: now that there's VM in Redis, is there anyone pushing
directly large data inside the Resque message directly ?

-- Thibaut