I'm using the Google Pub Sub input, it works nicely but compared to RabbitMQ it uses a large amount of CPU with only one topic, pushing my load averages very high.
Using the RabbitMQ plugin, multiple queues uses a fraction of Pub Sub. Is what I;m seeing 'normal'
52% compared o .3% ?
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
24344 logstash 39 19 5873500 1.254g 15592 S 52.5 33.9 88:02.57 [main]<google_p
24270 logstash 39 19 5873500 1.254g 15592 S 31.6 33.9 79:20.65 java
24269 logstash 39 19 5873500 1.254g 15592 S 16.6 33.9 26:37.58 java
24267 logstash 39 19 5873500 1.254g 15592 S 15.0 33.9 26:38.49 java
24268 logstash 39 19 5873500 1.254g 15592 S 14.3 33.9 26:36.84 java
24271 logstash 39 19 5873500 1.254g 15592 S 3.3 33.9 4:56.71 java
24335 logstash 39 19 5873500 1.254g 15592 S 1.0 33.9 2:19.62 [main]>worker0
24336 logstash 39 19 5873500 1.254g 15592 S 0.7 33.9 2:20.50 [main]>worker1
24345 logstash 39 19 5873500 1.254g 15592 S 0.3 33.9 0:12.97 [main]<rabbitmq
24362 logstash 39 19 5873500 1.254g 15592 S 0.3 33.9 0:12.26 [main]<rabbitmq
24364 logstash 39 19 5873500 1.254g 15592 S 0.3 33.9 0:12.44 [main]<rabbitmq
24365 logstash 39 19 5873500 1.254g 15592 S 0.3 33.9 0:12.60 [main]<rabbitmq
24370 logstash 39 19 5873500 1.254g 15592 S 0.3 33.9 0:12.36 [main]<rabbitmq
24377 logstash 39 19 5873500 1.254g 15592 S 0.3 33.9 0:12.30 [main]<rabbitmq
24378 logstash 39 19 5873500 1.254g 15592 S 0.3 33.9 0:12.42 [main]<rabbitmq
24379 logstash 39 19 5873500 1.254g 15592 S 0.3 33.9 0:13.11 [main]<rabbitmq
24381 logstash 39 19 5873500 1.254g 15592 S 0.3 33.9 0:16.62 [main]<rabbitmq
24385 logstash 39 19 5873500 1.254g 15592 S 0.3 33.9 0:06.23 [main]-pipeline
24414 logstash 39 19 5873500 1.254g 15592 S 0.3 33.9 0:00.64 [main]<rabbitmq
24247 logstash 39 19 5873500 1.254g 15592 S 0.0 33.9 0:00.01 java
24266 logstash 39 19 5873500 1.254g 15592 S 0.0 33.9 0:12.11 LogStash::Runne