librelist archives

« back to archive

Pub/Sub

Pub/Sub

From:
Guido Marucci Blas
Date:
2013-06-10 @ 15:22
Hi, sorry if this was allredy asked, but I would like to know if the 2.x
version of resque will use redis pub/sub instead of polling.

Thanks

-- 
| | | Guido Marucci Blas | | |

Re: [resque] Pub/Sub

From:
Steve Klabnik
Date:
2013-06-10 @ 18:10
Nope.

Re: [resque] Pub/Sub

From:
Emil Kampp
Date:
2013-06-10 @ 18:13
What is the reasons for using pub/sub opposed to polling? I'm not that 
familiar with the inner workings of Redis. 




Best regards / Venlig hilsen

Emil Kampp
Kampp Media
Baltorpvej 189, st.-1, DK 2750
emil.kampp.me | emil@kampp.me | +45 42427176 | CVR: DK30160983


On Monday, June 10, 2013 at 8:10 PM, Steve Klabnik wrote:

> Nope.
> 
> 

Re: [resque] Pub/Sub

From:
Guido Marucci Blas
Date:
2013-06-10 @ 19:23
Isn't pub/sub supposed to be a more performant option?

2013/6/10 Emil Kampp <emil@kampp.me>

>
>  What is the reasons for using pub/sub opposed to polling? I'm not that
> familiar with the inner workings of Redis.
>
>
> Best regards / Venlig hilsen
>
> Emil Kampp
> Kampp Media
> Baltorpvej 189, st.-1, DK 2750
> emil.kampp.me | emil@kampp.me | +45 42427176 | CVR: DK30160983
>
> On Monday, June 10, 2013 at 8:10 PM, Steve Klabnik wrote:
>
> Nope.
>
>
>


-- 
| | | Guido Marucci Blas | | |

Re: [resque] Pub/Sub

From:
Eoin Coffey
Date:
2013-06-10 @ 19:30
Pub/sub is a great tool for ephemeral one-to-many broadcast scenarios.

That does not work for a async job lib like Resque, because pub/sub
channels are ephemeral.

We want to make sure that if you have persistence turned on in redis we're
using an underlying redis data type that is persisted (like Lists).

Messages in pub/sub are also "fire and forget".  We have no way to
interrogate a channel and ask questions like "how many messages do you
hold?".

Pub/sub would also preclude us from doing things like failure queues, and
consistent auto-resubmit-on-failure.

In pub/sub if you submit a job and there are no workers actively running
then that job is silently dropped.

I think that about sums it up :-)


On Mon, Jun 10, 2013 at 1:23 PM, Guido Marucci Blas <guidomb@gmail.com>wrote:

> Isn't pub/sub supposed to be a more performant option?
>
>
> 2013/6/10 Emil Kampp <emil@kampp.me>
>
>>
>>  What is the reasons for using pub/sub opposed to polling? I'm not that
>> familiar with the inner workings of Redis.
>>
>>
>> Best regards / Venlig hilsen
>>
>> Emil Kampp
>> Kampp Media
>> Baltorpvej 189, st.-1, DK 2750
>> emil.kampp.me | emil@kampp.me | +45 42427176 | CVR: DK30160983
>>
>> On Monday, June 10, 2013 at 8:10 PM, Steve Klabnik wrote:
>>
>> Nope.
>>
>>
>>
>
>
> --
> | | | Guido Marucci Blas | | |
>

Re: [resque] Pub/Sub

From:
Guido Marucci Blas
Date:
2013-06-10 @ 21:08
Thanks! nice explanation


2013/6/10 Eoin Coffey <ecoffey@gmail.com>

> Pub/sub is a great tool for ephemeral one-to-many broadcast scenarios.
>
> That does not work for a async job lib like Resque, because pub/sub
> channels are ephemeral.
>
> We want to make sure that if you have persistence turned on in redis we're
> using an underlying redis data type that is persisted (like Lists).
>
> Messages in pub/sub are also "fire and forget".  We have no way to
> interrogate a channel and ask questions like "how many messages do you
> hold?".
>
> Pub/sub would also preclude us from doing things like failure queues, and
> consistent auto-resubmit-on-failure.
>
> In pub/sub if you submit a job and there are no workers actively running
> then that job is silently dropped.
>
> I think that about sums it up :-)
>
>
> On Mon, Jun 10, 2013 at 1:23 PM, Guido Marucci Blas <guidomb@gmail.com>wrote:
>
>> Isn't pub/sub supposed to be a more performant option?
>>
>>
>> 2013/6/10 Emil Kampp <emil@kampp.me>
>>
>>>
>>>  What is the reasons for using pub/sub opposed to polling? I'm not that
>>> familiar with the inner workings of Redis.
>>>
>>>
>>> Best regards / Venlig hilsen
>>>
>>> Emil Kampp
>>> Kampp Media
>>> Baltorpvej 189, st.-1, DK 2750
>>> emil.kampp.me | emil@kampp.me | +45 42427176 | CVR: DK30160983
>>>
>>> On Monday, June 10, 2013 at 8:10 PM, Steve Klabnik wrote:
>>>
>>> Nope.
>>>
>>>
>>>
>>
>>
>> --
>> | | | Guido Marucci Blas | | |
>>
>
>


-- 
| | | Guido Marucci Blas | | |

Re: [resque] Pub/Sub

From:
Emil Kampp
Date:
2013-06-10 @ 21:34
Cool. Great explanation.  


Best regards / Venlig hilsen

Emil Kampp
Kampp Media
Baltorpvej 189, st.-1, DK 2750
emil.kampp.me | emil@kampp.me | +45 42427176 | CVR: DK30160983


On Monday, June 10, 2013 at 11:08 PM, Guido Marucci Blas wrote:

> Thanks! nice explanation 
> 
> 
> 2013/6/10 Eoin Coffey <ecoffey@gmail.com (mailto:ecoffey@gmail.com)>
> > Pub/sub is a great tool for ephemeral one-to-many broadcast scenarios.
> > 
> > That does not work for a async job lib like Resque, because pub/sub 
channels are ephemeral. 
> > 
> > We want to make sure that if you have persistence turned on in redis 
we're using an underlying redis data type that is persisted (like Lists).
> > 
> > Messages in pub/sub are also "fire and forget".  We have no way to 
interrogate a channel and ask questions like "how many messages do you 
hold?". 
> > 
> > Pub/sub would also preclude us from doing things like failure queues, 
and consistent auto-resubmit-on-failure.
> > 
> > In pub/sub if you submit a job and there are no workers actively 
running then that job is silently dropped. 
> > 
> > I think that about sums it up :-)
> > 
> > 
> > On Mon, Jun 10, 2013 at 1:23 PM, Guido Marucci Blas <guidomb@gmail.com
(mailto:guidomb@gmail.com)> wrote:
> > > Isn't pub/sub supposed to be a more performant option?
> > > 
> > > 
> > > 2013/6/10 Emil Kampp <emil@kampp.me (mailto:emil@kampp.me)>
> > > > 
> > > > What is the reasons for using pub/sub opposed to polling? I'm not 
that familiar with the inner workings of Redis. 
> > > > 
> > > > 
> > > > Best regards / Venlig hilsen
> > > > 
> > > > Emil Kampp 
> > > > Kampp Media
> > > > Baltorpvej 189, st.-1, DK 2750
> > > > emil.kampp.me (http://emil.kampp.me) | emil@kampp.me 
(mailto:emil@kampp.me) | +45 42427176 (tel:%2B45%2042427176) | CVR: 
DK30160983
> > > > 
> > > > 
> > > > On Monday, June 10, 2013 at 8:10 PM, Steve Klabnik wrote:
> > > > 
> > > > > Nope.
> > > > > 
> > > > > 
> > > > > 
> > > > 
> > > > 
> > > 
> > > 
> > > 
> > > -- 
> > > | | | Guido Marucci Blas | | | 
> 
> 
> 
> -- 
> | | | Guido Marucci Blas | | |