You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-27 - 08:10
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot4.osadl.org (updated Sat Jul 27, 2024 00:49:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
228292620chrt46250irq/120-QMan09:24:361
228292620chrt46250irq/120-QMan09:24:361
228292620chrt46250irq/120-QMan09:24:361
71610rcu_preempt0-21swapper/021:35:090
71610rcu_preempt0-21swapper/021:35:090
46050530irq/122-QManpo20876-2109:24:360
46050470irq/122-QManpo0-210
2785299472cyclictest12887-21snmpd21:49:213
2785299472cyclictest12887-21snmpd21:49:213
2785199472cyclictest21537-21runrttasks00:06:402
2785199472cyclictest21537-21runrttasks00:06:402
71460rcu_preempt0-21swapper/000:35:570
71460rcu_preempt0-21swapper/000:35:570
71460rcu_preempt0-21swapper/000:35:570
2785199464cyclictest0-21swapper/220:24:012
2785199464cyclictest0-21swapper/220:24:012
2785199463cyclictest12887-21snmpd00:18:222
2785199463cyclictest12887-21snmpd00:18:222
2785199462cyclictest13528-1kworker/2:2H20:39:082
2785199462cyclictest13528-1kworker/2:2H20:39:082
2785199462cyclictest13528-1kworker/2:2H20:39:082
27852994519cyclictest22715-21meminfo21:08:593
27852994519cyclictest22715-21meminfo21:08:593
27852994519cyclictest22715-21meminfo21:08:593
71440rcu_preempt0-21swapper/021:08:470
71440rcu_preempt0-21swapper/021:08:470
71440rcu_preempt0-21swapper/021:08:470
2785299443cyclictest0-21swapper/322:38:543
2785299443cyclictest0-21swapper/322:38:543
2785299443cyclictest0-21swapper/322:38:543
27852994422cyclictest0-21swapper/322:18:453
27852994422cyclictest0-21swapper/322:18:453
2785199444cyclictest0-21swapper/223:28:382
2785199444cyclictest0-21swapper/223:28:382
2785199444cyclictest0-21swapper/222:13:472
2785199444cyclictest0-21swapper/222:13:472
2785199444cyclictest0-21swapper/222:13:472
2785199441cyclictest9781-21ntp_states22:49:032
2785199441cyclictest9781-21ntp_states22:49:032
71430rcu_preempt0-21swapper/120:55:041
71430rcu_preempt0-21swapper/120:55:041
71430rcu_preempt0-21swapper/120:55:041
46450430irq/118-QManpo20886-2109:24:362
27852994319cyclictest0-21swapper/321:53:523
27852994319cyclictest0-21swapper/321:53:523
27852994319cyclictest0-21swapper/321:53:523
27852994317cyclictest0-21swapper/323:21:223
27852994317cyclictest0-21swapper/323:21:223
27852994313cyclictest16745-21/usr/sbin/munin23:58:553
27852994313cyclictest16745-21/usr/sbin/munin23:58:553
27852994313cyclictest12449-21ssh00:48:483
27852994313cyclictest12449-21ssh00:48:483
27852994313cyclictest12449-21ssh00:48:483
2785199434cyclictest0-21swapper/223:34:022
2785199434cyclictest0-21swapper/223:34:022
2785199434cyclictest0-21swapper/222:40:072
2785199434cyclictest0-21swapper/222:40:072
2785199434cyclictest0-21swapper/222:40:072
2785199434cyclictest0-21swapper/220:44:062
2785199434cyclictest0-21swapper/220:44:062
2785199434cyclictest0-21swapper/219:49:062
2785199434cyclictest0-21swapper/219:49:062
2785199433cyclictest0-21swapper/222:09:102
2785199433cyclictest0-21swapper/222:09:102
2785199433cyclictest0-21swapper/222:01:042
2785199433cyclictest0-21swapper/222:01:042
2785199433cyclictest0-21swapper/222:01:042
2785199432cyclictest30808-1kworker/2:0H22:38:382
2785199432cyclictest30808-1kworker/2:0H22:38:382
2785199432cyclictest24261-21sort23:14:092
2785199432cyclictest24261-21sort23:14:092
2785199432cyclictest24261-21sort23:14:092
2785199432cyclictest22343-21aten_r4power_cu21:08:502
2785199432cyclictest22343-21aten_r4power_cu21:08:502
2785199432cyclictest22343-21aten_r4power_cu21:08:502
2785199432cyclictest12809-21ssh22:54:102
2785199432cyclictest12809-21ssh22:54:102
2785199431cyclictest5496-21latency_hist20:08:402
2785199431cyclictest5496-21latency_hist20:08:402
2785199431cyclictest19536-21/usr/sbin/munin20:59:052
2785199431cyclictest19536-21/usr/sbin/munin20:59:052
71420rcu_preempt0-21swapper/121:47:031
71420rcu_preempt0-21swapper/121:47:031
71420rcu_preempt0-21swapper/121:47:031
71420rcu_preempt0-21swapper/000:18:260
71420rcu_preempt0-21swapper/000:18:260
2785299424cyclictest0-21swapper/300:18:253
2785299424cyclictest0-21swapper/300:18:253
2785299423cyclictest0-21swapper/322:53:543
2785299423cyclictest0-21swapper/322:53:543
2785299422cyclictest6410-21aten_r4power_cu22:43:523
2785299422cyclictest6410-21aten_r4power_cu22:43:523
2785299422cyclictest2846-21/usr/sbin/munin19:59:073
2785299422cyclictest2846-21/usr/sbin/munin19:59:073
2785299422cyclictest2846-21/usr/sbin/munin19:59:073
2785299422cyclictest27748-21diskmemload23:43:593
2785299422cyclictest27748-21diskmemload23:43:593
2785299422cyclictest0-21swapper/323:23:573
2785299422cyclictest0-21swapper/323:23:573
2785199425cyclictest28073-1kworker/2:1H00:18:532
2785199425cyclictest28073-1kworker/2:1H00:18:532
2785199423cyclictest0-21swapper/222:28:192
2785199423cyclictest0-21swapper/222:28:192
2785199423cyclictest0-21swapper/222:28:192
2785199423cyclictest0-21swapper/219:54:012
2785199423cyclictest0-21swapper/219:54:012
2785199423cyclictest0-21swapper/200:29:102
2785199423cyclictest0-21swapper/200:29:102
2785199422cyclictest4637-21/usr/sbin/munin00:34:022
2785199422cyclictest4637-21/usr/sbin/munin00:34:022
2785199422cyclictest4637-21/usr/sbin/munin00:34:022
2785199422cyclictest4186-21/usr/sbin/munin21:44:252
2785199422cyclictest4186-21/usr/sbin/munin21:44:252
2785199422cyclictest4186-21/usr/sbin/munin21:44:252
2785199422cyclictest27272-21users23:19:082
2785199422cyclictest27272-21users23:19:082
2785199422cyclictest15973-21diskstats22:03:512
2785199422cyclictest15973-21diskstats22:03:512
2785199422cyclictest0-21swapper/200:59:522
71410rcu_preempt28194-21kworker/3:201:03:283
71410rcu_preempt28194-21kworker/3:201:03:283
2785299414cyclictest0-21swapper/323:08:463
2785299414cyclictest0-21swapper/323:08:463
2785299413cyclictest0-21swapper/323:55:123
2785299413cyclictest0-21swapper/323:55:123
2785299413cyclictest0-21swapper/323:29:093
2785299413cyclictest0-21swapper/323:29:093
2785299413cyclictest0-21swapper/321:29:473
2785299413cyclictest0-21swapper/321:29:473
2785299413cyclictest0-21swapper/321:29:473
2785299413cyclictest0-21swapper/321:24:053
2785299413cyclictest0-21swapper/321:24:053
2785299413cyclictest0-21swapper/300:39:083
2785299413cyclictest0-21swapper/300:39:083
2785299413cyclictest0-21swapper/300:19:103
2785299413cyclictest0-21swapper/300:19:103
2785299413cyclictest0-21swapper/300:05:373
2785299413cyclictest0-21swapper/300:05:373
2785299412cyclictest18135-21/usr/sbin/munin20:53:593
2785299412cyclictest18135-21/usr/sbin/munin20:53:593
2785299412cyclictest18135-21/usr/sbin/munin20:53:593
2785299412cyclictest13829-21users21:59:143
2785299412cyclictest13829-21users21:59:143
2785299412cyclictest13829-21users21:59:143
2785299412cyclictest1283-21/usr/sbin/munin21:39:043
2785299412cyclictest1283-21/usr/sbin/munin21:39:043
2785299411cyclictest12887-21snmpd23:37:013
2785299411cyclictest12887-21snmpd23:37:013
27852994117cyclictest0-21swapper/322:36:043
27852994117cyclictest0-21swapper/322:36:043
27852994116cyclictest0-21swapper/300:33:403
27852994116cyclictest0-21swapper/300:33:403
27852994115cyclictest0-21swapper/322:27:453
27852994115cyclictest0-21swapper/322:27:453
27852994115cyclictest0-21swapper/322:27:453
2785199413cyclictest0-21swapper/223:49:122
2785199413cyclictest0-21swapper/223:49:122
2785199413cyclictest0-21swapper/223:49:122
2785199413cyclictest0-21swapper/221:49:202
2785199413cyclictest0-21swapper/221:49:202
2785199413cyclictest0-21swapper/221:28:492
2785199413cyclictest0-21swapper/221:28:492
2785199413cyclictest0-21swapper/221:28:492
2785199413cyclictest0-21swapper/221:19:072
2785199413cyclictest0-21swapper/221:19:072
2785199413cyclictest0-21swapper/220:14:042
2785199413cyclictest0-21swapper/220:14:042
2785199413cyclictest0-21swapper/200:01:122
2785199413cyclictest0-21swapper/200:01:122
2785199412cyclictest5338-21/usr/sbin/munin23:39:062
2785199412cyclictest5338-21/usr/sbin/munin23:39:062
2785199412cyclictest10878-21latency_hist23:48:422
2785199412cyclictest10878-21latency_hist23:48:422
2785199411cyclictest22445-21/usr/sbin/munin00:08:492
2785199411cyclictest22445-21/usr/sbin/munin00:08:492
2785199411cyclictest17568-21rm00:58:402
2785199411cyclictest17568-21rm00:58:402
2785199411cyclictest0-21swapper/200:43:482
2785199411cyclictest0-21swapper/200:43:482
2785199411cyclictest0-21swapper/200:43:482
71400rcu_preempt0-21swapper/222:33:252
71400rcu_preempt0-21swapper/222:33:252
71400rcu_preempt0-21swapper/222:33:252
2785299403cyclictest0-21swapper/322:30:133
2785299403cyclictest0-21swapper/322:30:133
2785299403cyclictest0-21swapper/322:30:133
2785299403cyclictest0-21swapper/322:17:453
2785299403cyclictest0-21swapper/322:17:453
2785299403cyclictest0-21swapper/322:17:453
2785299403cyclictest0-21swapper/300:34:033
2785299403cyclictest0-21swapper/300:34:033
2785299403cyclictest0-21swapper/300:34:033
2785299402cyclictest31922-21vmstat00:24:113
2785299402cyclictest31922-21vmstat00:24:113
2785299402cyclictest15296-21diskstats00:53:523
2785299402cyclictest15296-21diskstats00:53:523
27852994016cyclictest0-21swapper/322:50:423
27852994016cyclictest0-21swapper/322:50:423
27852994016cyclictest0-21swapper/300:09:043
27852994016cyclictest0-21swapper/300:09:043
2785199404cyclictest0-21swapper/223:53:562
2785199404cyclictest0-21swapper/223:53:562
2785199403cyclictest0-21swapper/223:01:442
2785199403cyclictest0-21swapper/223:01:442
2785199403cyclictest0-21swapper/220:19:032
2785199403cyclictest0-21swapper/220:19:032
2785199403cyclictest0-21swapper/220:13:372
2785199403cyclictest0-21swapper/220:13:372
2785199403cyclictest0-21swapper/200:49:042
2785199403cyclictest0-21swapper/200:49:042
2785199403cyclictest0-21swapper/200:49:042
2785199403cyclictest0-21swapper/200:23:552
2785199403cyclictest0-21swapper/200:23:552
2785199402cyclictest7191-21irqstats00:38:572
2785199402cyclictest7191-21irqstats00:38:572
2785199402cyclictest1883-21ntp_states21:39:022
2785199402cyclictest1883-21ntp_states21:39:022
2785199402cyclictest0-21swapper/223:08:552
2785199402cyclictest0-21swapper/223:08:552
71390rcu_preempt0-21swapper/321:34:043
71390rcu_preempt0-21swapper/321:34:043
71390rcu_preempt0-21swapper/320:38:583
71390rcu_preempt0-21swapper/320:38:583
71390rcu_preempt0-21swapper/320:38:583
71390rcu_preempt0-21swapper/122:56:211
71390rcu_preempt0-21swapper/122:56:211
71390rcu_preempt0-21swapper/100:42:181
71390rcu_preempt0-21swapper/100:42:181
71390rcu_preempt0-21swapper/100:34:321
71390rcu_preempt0-21swapper/100:34:321
71390rcu_preempt0-21swapper/100:34:321
71390rcu_preempt0-21swapper/000:19:090
71390rcu_preempt0-21swapper/000:19:090
2785299393cyclictest0-21swapper/323:06:153
2785299393cyclictest0-21swapper/323:06:153
2785299393cyclictest0-21swapper/322:09:473
2785299393cyclictest0-21swapper/322:09:473
2785299393cyclictest0-21swapper/322:08:373
2785299393cyclictest0-21swapper/322:08:373
2785299393cyclictest0-21swapper/321:19:053
2785299393cyclictest0-21swapper/321:19:053
2785199393cyclictest0-21swapper/223:04:112
2785199393cyclictest0-21swapper/223:04:112
2785199393cyclictest0-21swapper/222:22:472
2785199393cyclictest0-21swapper/222:22:472
2785199393cyclictest0-21swapper/221:58:342
2785199393cyclictest0-21swapper/221:58:342
2785199393cyclictest0-21swapper/221:58:342
2785199392cyclictest31768-21users21:34:092
2785199392cyclictest31768-21users21:34:092
2785199392cyclictest0-21swapper/222:45:152
2785199392cyclictest0-21swapper/222:45:152
71380rcu_preempt24119-21meminfo21:14:001
71380rcu_preempt24119-21meminfo21:14:001
71380rcu_preempt23843-21sh22:17:441
71380rcu_preempt23843-21sh22:17:441
71380rcu_preempt23843-21sh22:17:441
71380rcu_preempt13782-21copy23:53:550
71380rcu_preempt13782-21copy23:53:550
71380rcu_preempt0-21swapper/320:44:053
71380rcu_preempt0-21swapper/320:44:053
71380rcu_preempt0-21swapper/123:34:241
71380rcu_preempt0-21swapper/123:34:241
71380rcu_preempt0-21swapper/122:23:211
71380rcu_preempt0-21swapper/122:23:211
71380rcu_preempt0-21swapper/120:03:421
71380rcu_preempt0-21swapper/120:03:421
71380rcu_preempt0-21swapper/120:03:421
71380rcu_preempt0-21swapper/100:14:391
71380rcu_preempt0-21swapper/100:14:391
71380rcu_preempt0-21swapper/100:04:551
71380rcu_preempt0-21swapper/100:04:551
71380rcu_preempt0-21swapper/022:24:000
71380rcu_preempt0-21swapper/022:24:000
71380rcu_preempt0-21swapper/022:24:000
71380rcu_preempt0-21swapper/022:12:170
71380rcu_preempt0-21swapper/022:12:170
71380rcu_preempt0-21swapper/022:06:010
71380rcu_preempt0-21swapper/022:06:010
2785299384cyclictest0-21swapper/323:53:313
2785299384cyclictest0-21swapper/323:53:313
2785299384cyclictest0-21swapper/323:53:313
2785299384cyclictest0-21swapper/323:40:183
2785299384cyclictest0-21swapper/323:40:183
2785299383cyclictest0-21swapper/300:47:493
2785299383cyclictest0-21swapper/300:47:493
2785299383cyclictest0-21swapper/300:47:493
27852993817cyclictest0-21swapper/320:23:413
27852993817cyclictest0-21swapper/320:23:413
2785199383cyclictest0-21swapper/220:53:372
2785199383cyclictest0-21swapper/220:53:372
2785199381cyclictest31081-21/usr/sbin/munin19:44:052
2785199381cyclictest31081-21/usr/sbin/munin19:44:052
2785199381cyclictest1258-21runrttasks23:30:562
2785199381cyclictest1258-21runrttasks23:30:562
71370rcu_preempt31929-21ssh23:28:410
71370rcu_preempt31929-21ssh23:28:410
71370rcu_preempt27743-21cron21:28:371
71370rcu_preempt27743-21cron21:28:371
71370rcu_preempt0-21swapper/123:44:331
71370rcu_preempt0-21swapper/123:44:331
71370rcu_preempt0-21swapper/123:14:481
71370rcu_preempt0-21swapper/123:14:481
71370rcu_preempt0-21swapper/123:14:481
71370rcu_preempt0-21swapper/123:01:131
71370rcu_preempt0-21swapper/123:01:131
71370rcu_preempt0-21swapper/122:48:521
71370rcu_preempt0-21swapper/122:48:521
71370rcu_preempt0-21swapper/122:33:481
71370rcu_preempt0-21swapper/122:33:481
71370rcu_preempt0-21swapper/122:27:221
71370rcu_preempt0-21swapper/122:27:221
71370rcu_preempt0-21swapper/122:27:221
71370rcu_preempt0-21swapper/100:31:271
71370rcu_preempt0-21swapper/100:31:271
71370rcu_preempt0-21swapper/100:13:361
71370rcu_preempt0-21swapper/100:13:361
71370rcu_preempt0-21swapper/023:39:330
71370rcu_preempt0-21swapper/023:39:330
71370rcu_preempt0-21swapper/023:11:020
71370rcu_preempt0-21swapper/023:11:020
71370rcu_preempt0-21swapper/023:06:510
71370rcu_preempt0-21swapper/023:06:510
71370rcu_preempt0-21swapper/022:54:570
71370rcu_preempt0-21swapper/022:54:570
71370rcu_preempt0-21swapper/022:49:460
71370rcu_preempt0-21swapper/022:49:460
71370rcu_preempt0-21swapper/022:37:230
71370rcu_preempt0-21swapper/022:37:230
71370rcu_preempt0-21swapper/000:44:460
71370rcu_preempt0-21swapper/000:44:460
71370rcu_preempt0-21swapper/000:44:460
71370rcu_preempt0-21swapper/000:04:030
71370rcu_preempt0-21swapper/000:04:030
46050370irq/122-QManpo14510-2109:24:360
46050370irq/122-QManpo14510-2109:24:360
46050370irq/122-QManpo14510-2109:24:360
46050370irq/122-QManpo10534-2109:24:360
46050370irq/122-QManpo10534-2109:24:360
46050370irq/122-QManpo10534-2109:24:360
2785299373cyclictest0-21swapper/323:15:443
2785299373cyclictest0-21swapper/323:15:443
2785299373cyclictest0-21swapper/323:15:443
2785199373cyclictest0-21swapper/220:33:582
2785199373cyclictest0-21swapper/220:33:582
2785199372cyclictest23709-21/usr/sbin/munin21:14:092
2785199372cyclictest23709-21/usr/sbin/munin21:14:092
2785199372cyclictest20911-21/usr/sbin/munin21:04:032
2785199372cyclictest20911-21/usr/sbin/munin21:04:032
2785199372cyclictest20911-21/usr/sbin/munin21:04:032
2785199371cyclictest2846-21/usr/sbin/munin19:58:582
2785199371cyclictest2846-21/usr/sbin/munin19:58:582
2785199371cyclictest2846-21/usr/sbin/munin19:58:582
2785199371cyclictest0-21swapper/221:24:052
2785199371cyclictest0-21swapper/221:24:052
27851993712cyclictest11925-21sshd20:29:072
27851993712cyclictest11925-21sshd20:29:072
71360rcu_preempt6216-21copy22:43:470
71360rcu_preempt6216-21copy22:43:470
71360rcu_preempt5338-21ssh22:41:251
71360rcu_preempt5338-21ssh22:41:251
71360rcu_preempt5338-21ssh22:41:251
71360rcu_preempt16161-21runrttasks22:03:561
71360rcu_preempt16161-21runrttasks22:03:561
71360rcu_preempt0-21swapper/123:54:001
71360rcu_preempt0-21swapper/123:54:001
71360rcu_preempt0-21swapper/123:42:171
71360rcu_preempt0-21swapper/123:42:171
71360rcu_preempt0-21swapper/123:29:291
71360rcu_preempt0-21swapper/123:29:291
71360rcu_preempt0-21swapper/123:19:101
71360rcu_preempt0-21swapper/123:19:101
71360rcu_preempt0-21swapper/123:03:511
71360rcu_preempt0-21swapper/123:03:511
71360rcu_preempt0-21swapper/121:53:481
71360rcu_preempt0-21swapper/121:53:481
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional