Google pub sub high cpu


(Simon Lane) #1

I'm using the Google Pub Sub input, it works nicely but compared to RabbitMQ it uses a large amount of CPU with only one topic, pushing my load averages very high.

Using the RabbitMQ plugin, multiple queues uses a fraction of Pub Sub. Is what I;m seeing 'normal'
52% compared o .3% ?

  PID USER      PR  NI    VIRT    RES    SHR S %CPU %MEM     TIME+ COMMAND
24344 logstash  39  19 5873500 1.254g  15592 S 52.5 33.9  88:02.57 [main]<google_p
24270 logstash  39  19 5873500 1.254g  15592 S 31.6 33.9  79:20.65 java
24269 logstash  39  19 5873500 1.254g  15592 S 16.6 33.9  26:37.58 java
24267 logstash  39  19 5873500 1.254g  15592 S 15.0 33.9  26:38.49 java
24268 logstash  39  19 5873500 1.254g  15592 S 14.3 33.9  26:36.84 java
24271 logstash  39  19 5873500 1.254g  15592 S  3.3 33.9   4:56.71 java
24335 logstash  39  19 5873500 1.254g  15592 S  1.0 33.9   2:19.62 [main]>worker0
24336 logstash  39  19 5873500 1.254g  15592 S  0.7 33.9   2:20.50 [main]>worker1
24345 logstash  39  19 5873500 1.254g  15592 S  0.3 33.9   0:12.97 [main]<rabbitmq
24362 logstash  39  19 5873500 1.254g  15592 S  0.3 33.9   0:12.26 [main]<rabbitmq
24364 logstash  39  19 5873500 1.254g  15592 S  0.3 33.9   0:12.44 [main]<rabbitmq
24365 logstash  39  19 5873500 1.254g  15592 S  0.3 33.9   0:12.60 [main]<rabbitmq
24370 logstash  39  19 5873500 1.254g  15592 S  0.3 33.9   0:12.36 [main]<rabbitmq
24377 logstash  39  19 5873500 1.254g  15592 S  0.3 33.9   0:12.30 [main]<rabbitmq
24378 logstash  39  19 5873500 1.254g  15592 S  0.3 33.9   0:12.42 [main]<rabbitmq
24379 logstash  39  19 5873500 1.254g  15592 S  0.3 33.9   0:13.11 [main]<rabbitmq
24381 logstash  39  19 5873500 1.254g  15592 S  0.3 33.9   0:16.62 [main]<rabbitmq
24385 logstash  39  19 5873500 1.254g  15592 S  0.3 33.9   0:06.23 [main]-pipeline
24414 logstash  39  19 5873500 1.254g  15592 S  0.3 33.9   0:00.64 [main]<rabbitmq
24247 logstash  39  19 5873500 1.254g  15592 S  0.0 33.9   0:00.01 java
24266 logstash  39  19 5873500 1.254g  15592 S  0.0 33.9   0:12.11 LogStash::Runne

(system) #2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.