Package org.jgroups.protocols
Class BATCH2
- java.lang.Object
-
- org.jgroups.stack.Protocol
-
- org.jgroups.protocols.BATCH2
-
- All Implemented Interfaces:
Lifecycle
public class BATCH2 extends Protocol
Batches messages near the top of the stack. This reduces the work done on the IO thread and reduces overhead, greatly increasing throughput for smaller message sizes (<1k in test configurations). Also reduces the amount of header data by having one header for each batch. Conceptually, down messages are buffered then put in a wrapper message, so lower protocols only interact with the wrapper. On the receiving end, the batch is unwrapped when it reaches this protocol and then forwarded to higher protocols as individual messages in a loop.- Since:
- 5.x
- Author:
- Chris Johnson
-
-
Nested Class Summary
Nested Classes Modifier and Type Class Description static class
BATCH2.Batch2Header
protected class
BATCH2.Buffer
-
Field Summary
Fields Modifier and Type Field Description protected java.util.concurrent.BlockingQueue<Message>
down_queue
protected long
flush_interval
protected static BATCH2.Batch2Header
HEADER
int
max_batch_size
protected java.util.Map<Address,BATCH2.Buffer>
msgMap
protected NullAddress
nullAddress
protected long
num_ebs_sent
protected long
num_ebs_sent_due_to_full_queue
protected long
num_ebs_sent_due_to_max_number_of_msgs
protected long
num_ebs_sent_due_to_timeout
protected long
num_msgs_sent
protected long
poll_timeout
protected java.util.List<Message>
remove_queue
protected Runner
runner
protected boolean
running
protected TimeScheduler
timer
-
Fields inherited from class org.jgroups.stack.Protocol
after_creation_hook, down_prot, ergonomics, id, local_addr, log, policies, stack, stats, up_prot
-
-
Constructor Summary
Constructors Constructor Description BATCH2()
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description protected java.lang.Object
_down(Message msg)
double
avgBatchSize()
java.lang.Object
down(Event evt)
An event is to be sent down the stack.java.lang.Object
down(Message msg)
A message is sent down the stack.protected void
handleViewChange(java.util.List<Address> mbrs)
void
init()
Called after a protocol has been created and before the protocol is started.protected void
processDownMessage()
void
resetStats()
void
start()
This method is called on aJChannel.connect(String)
; starts work.void
stop()
Called on aJChannel.disconnect()
; stops work (e.g.java.lang.Object
up(Event evt)
An event was received from the protocol below.java.lang.Object
up(Message msg)
A single message was received.void
up(MessageBatch batch)
Sends up a multiple messages in aMessageBatch
.-
Methods inherited from class org.jgroups.stack.Protocol
accept, addPolicy, addr, addr, afterCreationHook, destroy, down, enableStats, getAddress, getComponents, getDownProtocol, getDownServices, getId, getIdsAbove, getLevel, getLog, getName, getPolicies, getProtocolStack, getSocketFactory, getThreadFactory, getTransport, getUpProtocol, getUpServices, getValue, isErgonomics, level, parse, policies, providedDownServices, providedUpServices, removePolicy, requiredDownServices, requiredUpServices, resetStatistics, setAddress, setDownProtocol, setErgonomics, setId, setLevel, setPolicies, setProtocolStack, setSocketFactory, setUpProtocol, setValue, statsEnabled, toString
-
-
-
-
Field Detail
-
flush_interval
protected long flush_interval
-
max_batch_size
public int max_batch_size
-
poll_timeout
protected long poll_timeout
-
num_msgs_sent
protected long num_msgs_sent
-
num_ebs_sent
protected long num_ebs_sent
-
num_ebs_sent_due_to_full_queue
protected long num_ebs_sent_due_to_full_queue
-
num_ebs_sent_due_to_max_number_of_msgs
protected long num_ebs_sent_due_to_max_number_of_msgs
-
num_ebs_sent_due_to_timeout
protected long num_ebs_sent_due_to_timeout
-
nullAddress
protected final NullAddress nullAddress
-
timer
protected TimeScheduler timer
-
running
protected volatile boolean running
-
msgMap
protected java.util.Map<Address,BATCH2.Buffer> msgMap
-
HEADER
protected static BATCH2.Batch2Header HEADER
-
down_queue
protected final java.util.concurrent.BlockingQueue<Message> down_queue
-
remove_queue
protected final java.util.List<Message> remove_queue
-
runner
protected final Runner runner
-
-
Method Detail
-
avgBatchSize
public double avgBatchSize()
-
init
public void init() throws java.lang.Exception
Description copied from class:Protocol
Called after a protocol has been created and before the protocol is started. Attributes are already set. Other protocols are not yet connected and events cannot yet be sent.
-
resetStats
public void resetStats()
- Overrides:
resetStats
in classProtocol
-
down
public java.lang.Object down(Event evt)
Description copied from class:Protocol
An event is to be sent down the stack. A protocol may want to examine its type and perform some action on it, depending on the event's type. If the event is a message MSG, then the protocol may need to add a header to it (or do nothing at all) before sending it down the stack usingdown_prot.down()
.
-
up
public java.lang.Object up(Event evt)
Description copied from class:Protocol
An event was received from the protocol below. Usually the current protocol will want to examine the event type and - depending on its type - perform some computation (e.g. removing headers from a MSG event type, or updating the internal membership list when receiving a VIEW_CHANGE event). Finally, the event is either a) discarded, or b) an event is sent down the stack usingdown_prot.down()
or c) the event (or another event) is sent up the stack usingup_prot.up()
.
-
handleViewChange
protected void handleViewChange(java.util.List<Address> mbrs)
-
down
public java.lang.Object down(Message msg)
Description copied from class:Protocol
A message is sent down the stack. Protocols may examine the message and do something (e.g. add a header) with it, before passing it down.
-
processDownMessage
protected void processDownMessage()
-
_down
protected java.lang.Object _down(Message msg)
-
up
public java.lang.Object up(Message msg)
Description copied from class:Protocol
A single message was received. Protocols may examine the message and do something (e.g. add a header) with it before passing it up.
-
up
public void up(MessageBatch batch)
Description copied from class:Protocol
Sends up a multiple messages in aMessageBatch
. The sender of the batch is always the same, and so is the destination (null == multicast messages). Messages in a batch can be OOB messages, regular messages, or mixed messages, although the transport itself will create initial MessageBatches that contain only either OOB or regular messages. The default processing below sends messages up the stack individually, based on a matching criteria (callingProtocol.accept(Message)
), and - if true - callsProtocol.up(org.jgroups.Event)
for that message and removes the message. If the batch is not empty, it is passed up, or else it is dropped. Subclasses should check if there are any messages destined for them (e.g. usingMessageBatch.iterator(Predicate)
), then possibly remove and process them and finally pass the batch up to the next protocol. Protocols can also modify messages in place, e.g. ENCRYPT could decrypt all encrypted messages in the batch, not remove them, and pass the batch up when done.
-
start
public void start() throws java.lang.Exception
Description copied from class:Protocol
This method is called on aJChannel.connect(String)
; starts work. Protocols are connected ready to receive events. Will be called from bottom to top.- Specified by:
start
in interfaceLifecycle
- Overrides:
start
in classProtocol
- Throws:
java.lang.Exception
- Thrown if protocol cannot be started successfully. This will cause the ProtocolStack to fail, soJChannel.connect(String)
will throw an exception
-
-