11 Jan, 2010
Notes on Kestrel – the open source twitter queue
Posted by Bhavin Turakhia
Kestrel is a simplistic, high-performant, loosely ordered, reliable queue that twitter uses as the backbone of its messaging infrastructure. I spent sometime today morning studying it and here are my notes -
- Extremely small footprint (<2000 lines of scala code)
- JVM based (written in scala)
- Servers in a Kestrel cluster have no communication amongst one another. Clients simply pick a server at random for gets and puts. This results in a loose ordering of the messages which maybe quite ok for most messaging applications
- There is no replication
- While the queues are maintained entirely in memory, they are written to a journal file to prevent data-loss due to a server shutdown or failure (quite similar to redis)
- Supports a reliable read, where a client can fetch an item from the queue within an “open” and “close” block, and if the client disconnects before sending a “close” the item is re-enqueued
- NIO based using Apache MINA
- Supports item expiration
References
- Kestrel Home – http://github.com/robey/kestrel
- Kestrel Documentation - http://github.com/robey/kestrel/blob/master/docs/guide.md
Dear Bhavin
I am with directi since very long time. I used to purchase domain from directi now I have started selling hosting packages also. now problem is that mail.pw system is not working properly and since Jan 2nd 2010 My support ticket 412887 is open regarding email services.
Till date it is not resolved and it takes directi support team to response after 12-15 hours.
Directi should understand that This type of delay in support is not good for my business and same for Directi.
Email service is critical in any business and if problem is still there then nobody in directi cares to solve your problem for such a long time then user should search other options.
Please note that this ticket is open since 2nd of Jan and every other alternate day we are facing this problem.
I hope that someone will care to solve this problem today
Regards
Chirag
It was really nice post. And must say that you written it really well as you got so strong response. I had seen some other blogs also on the same topic but the content are so rich here. I am really impressed. Keep it up.
♥ Very useful article , all focus up to the point !
Hey Bhavin, your article appears on first page of Google India for this query , very impressive relevance from SEO point of view !
http://gog.is/kestrel+queue
Grassroots Indigenous Multimedia announces the launch of their new Ojibwe Language learning software, Ojibwemodaa.Best Way : Rosetta stone learning Tips. Available in more than 30 languages, the Rosetta stone language-learning solution is used by schools, the consumer will write a message on the Personal Rosetta Stone. Download free language software, play online games and start learning a language now.