[Spread-users] Thrudb - Document Oriented Database Services

Alex Jacobson alex at alexjacobson.com
Tue Nov 6 17:23:30 EST 2007


So then you are vulnerable to a failure of the coordinator?
(or are you actually implementing Paxos?)

-Alex-

Jake Luciani wrote:
> Hi,
> 
> Yes that's correct.  Since the actual document could be extremely large 
> it's not sent over Spread.
> 
> Instead, a transaction container is created, the document is compressed 
> and stored under that transaction id in memcached and the transaction id 
> is sent. Memcached becomes kind of a network IPC.
> 
> Each node receives the message and pulls the document from memcached, 
> once all nodes are ready to process they message the transaction 
> origionator and and says its ready to commit or its failed.
> 
> Once all messages are recieved then the final commit message is sent 
> otherwise children are told to fail the transaction altogether.
> 
> also libevent is used to monitor the spread socket.
> 
> -Jake
>  
> On Nov 6, 2007 10:50 AM, John Schultz <jschultz at spreadconcepts.com 
> <mailto:jschultz at spreadconcepts.com> > wrote:
> 
>     Just out of curiosity, you implement your multi-master replication using
>     a 2-phase commit protocol over Spread?
> 
>     Cheers!
> 
>     ---
>     John Schultz
>     Spread Concepts
>     Phn: 443 838 2200
> 
>     On Mon, 5 Nov 2007, Jake Luciani wrote:
> 
>      > Hi,
>      >
>      > I'm writing to announce the open source release of a project I've
>     built
>      > which incorporates spread.
>      >
>      >
>     ------------------------------------------------------------------------------------------------------------------
>      >
>      > Thrudb is a set of simple services built on top of Facebook's Thrift
>      > framework
>      > that provides indexing and document storage services for building and
>      > scaling websites.
>      > Its purpose is to offer web developers flexible, fast and easy-to-use
>      > services
>      > which can enhance or replace traditional data storage and access
>     layers.
>      >
>      > *Thrudb Features:*
>      >
>      >   - Client libraries for most languages
>      >   - Multi-master replication
>      >   - Incremental backups and redo logging
>      >   - Multiple storage backends (S3 included)
>      >   - Built for horizontal scalability
>      >   - Simple and powerful search api (Lucene)
>      >
>      > http://thrudb.googlecode.com
>      >
>     --------------------------------------------------------------------------------------------------------------------
>      >
>      >
>      > I've also written up a blog post about it here <
>     http://3.rdrail.net/blog>
>      >
>      > Spread provides multi-master replication with atomic writes.
>      > I've used this to deploy my site reliably on Amazon EC2.
>      >
>      > Cheers,
>      >
>      > Jake
>      >
> 
>     _______________________________________________
>     Spread-users mailing list
>     Spread-users at lists.spread.org <mailto:Spread-users at lists.spread.org>
>     http://lists.spread.org/mailman/listinfo/spread-users
> 
> 
> 
> ------------------------------------------------------------------------
> 
> _______________________________________________
> Spread-users mailing list
> Spread-users at lists.spread.org
> http://lists.spread.org/mailman/listinfo/spread-users





More information about the Spread-users mailing list