You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-04 - 11:02
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3.osadl.org (updated Fri Sep 04, 2026 00:46:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
5109210996sleep80-21swapper/819:06:1210
30549501050irq/53-eth0-rx-0-21swapper/1119:07:193
30549501010irq/53-eth0-rx-0-21swapper/119:09:471
12250980irq/42-ahci0-21swapper/219:08:504
3054950970irq/53-eth0-rx-0-21swapper/719:05:219
12250950irq/42-ahci0-21swapper/319:07:385
3054950890irq/53-eth0-rx-0-21swapper/519:05:097
3054950880irq/53-eth0-rx-0-21swapper/1019:06:512
12250740irq/42-ahci0-21swapper/419:05:266
514627262sleep90-21swapper/919:06:3711
520326757sleep60-21swapper/619:07:228
3054950600irq/53-eth0-rx-0-21swapper/019:06:590
5600992221cyclictest0-21swapper/1121:17:583
5600992218cyclictest0-21swapper/1119:20:013
5600992214cyclictest0-21swapper/1120:28:403
5600992214cyclictest0-21swapper/1119:19:513
560099209cyclictest0-21swapper/1120:24:023
559999192cyclictest3054950irq/53-eth0-rx-23:12:332
559999192cyclictest3054950irq/53-eth0-rx-23:03:102
559999192cyclictest3054950irq/53-eth0-rx-21:41:492
559999192cyclictest3054950irq/53-eth0-rx-21:11:552
559999192cyclictest3054950irq/53-eth0-rx-21:11:552
559999192cyclictest3054950irq/53-eth0-rx-00:11:452
559999192cyclictest3054950irq/53-eth0-rx-00:01:532
5600991817cyclictest0-21swapper/1121:11:493
5600991817cyclictest0-21swapper/1121:11:493
5599991817cyclictest3559-21kworker/10:022:44:362
5599991817cyclictest0-21swapper/1023:28:182
5599991817cyclictest0-21swapper/1000:22:042
5599991817cyclictest0-21swapper/1000:22:042
559999181cyclictest3055050irq/54-eth0-tx-23:55:072
559999181cyclictest3055050irq/54-eth0-tx-22:35:262
559999181cyclictest3055050irq/54-eth0-tx-21:17:222
559999181cyclictest3054950irq/53-eth0-rx-23:41:272
559999181cyclictest3054950irq/53-eth0-rx-23:30:322
559999181cyclictest3054950irq/53-eth0-rx-23:07:292
559999181cyclictest3054950irq/53-eth0-rx-22:56:322
559999181cyclictest3054950irq/53-eth0-rx-22:53:452
559999181cyclictest3054950irq/53-eth0-rx-22:34:542
559999181cyclictest3054950irq/53-eth0-rx-22:20:082
559999181cyclictest3054950irq/53-eth0-rx-22:15:472
559999181cyclictest3054950irq/53-eth0-rx-22:08:522
559999181cyclictest3054950irq/53-eth0-rx-22:03:482
559999181cyclictest3054950irq/53-eth0-rx-21:27:112
559999181cyclictest3054950irq/53-eth0-rx-20:40:072
559999181cyclictest3054950irq/53-eth0-rx-19:11:032
559999181cyclictest3054950irq/53-eth0-rx-00:18:062
559999181cyclictest3054950irq/53-eth0-rx-00:05:062
559999180cyclictest3054950irq/53-eth0-rx-22:10:412
559899181cyclictest3055050irq/54-eth0-tx-22:13:1911
559899181cyclictest0-21swapper/923:44:3911
559899181cyclictest0-21swapper/923:36:4111
559899181cyclictest0-21swapper/921:33:3311
559899181cyclictest0-21swapper/900:15:3611
559899181cyclictest0-21swapper/900:13:2811
5585991816cyclictest8575-21snmp_easybox.os23:25:254
5585991816cyclictest4913-21snmp_rack3slot921:40:184
5585991816cyclictest4129-21snmp_easybox.os22:30:284
5585991816cyclictest31824-21snmp_rack3slot921:10:154
5585991816cyclictest31824-21snmp_rack3slot921:10:154
5585991816cyclictest30953-21snmp_rack3slot921:35:154
5585991816cyclictest20008-21snmp_rack3slot920:10:134
5564991817cyclictest3054950irq/53-eth0-rx-21:24:420
556499180cyclictest0-21swapper/020:14:370
5599991716cyclictest3559-21kworker/10:019:30:012
5599991716cyclictest0-21swapper/1023:50:142
5599991716cyclictest0-21swapper/1021:45:182
5599991716cyclictest0-21swapper/1019:50:342
559999170cyclictest78232chrt19:55:072
559999170cyclictest69322sleep1020:35:222
559999170cyclictest40042sleep1020:32:232
559999170cyclictest322512sleep1019:43:542
559999170cyclictest3055050irq/54-eth0-tx-23:15:162
559999170cyclictest3055050irq/54-eth0-tx-21:55:042
559999170cyclictest3054950irq/53-eth0-rx-23:46:072
559999170cyclictest3054950irq/53-eth0-rx-23:20:212
559999170cyclictest3054950irq/53-eth0-rx-22:25:272
559999170cyclictest3054950irq/53-eth0-rx-21:50:192
559999170cyclictest3054950irq/53-eth0-rx-21:36:102
559999170cyclictest3054950irq/53-eth0-rx-21:30:132
559999170cyclictest3054950irq/53-eth0-rx-20:51:002
559999170cyclictest3054950irq/53-eth0-rx-20:20:152
559999170cyclictest3054950irq/53-eth0-rx-20:15:402
559999170cyclictest3054950irq/53-eth0-rx-19:36:152
559999170cyclictest3054950irq/53-eth0-rx-19:25:212
559999170cyclictest3054950irq/53-eth0-rx-19:15:212
559999170cyclictest3054950irq/53-eth0-rx-00:35:072
559999170cyclictest3054950irq/53-eth0-rx-00:30:412
559999170cyclictest3054950irq/53-eth0-rx-00:30:412
559999170cyclictest295092sleep1021:06:382
559999170cyclictest295092sleep1021:06:382
559999170cyclictest241602chrt22:46:272
559999170cyclictest229652sleep1021:00:032
559999170cyclictest220042chrt23:35:572
559999170cyclictest210262sleep1000:27:282
559999170cyclictest179762chrt20:06:202
559999170cyclictest158062sleep1019:20:132
559999170cyclictest142722sleep1020:00:442
559999170cyclictest124742sleep1020:45:142
559999170cyclictest12250irq/42-ahci20:26:592
559999170cyclictest120712sleep1021:20:162
559899171cyclictest0-21swapper/922:34:0211
559899170cyclictest1930-21ssh21:12:0811
559899170cyclictest1930-21ssh21:12:0811
559899170cyclictest0-21swapper/923:51:3111
559899170cyclictest0-21swapper/923:03:3411
559899170cyclictest0-21swapper/922:06:5311
559899170cyclictest0-21swapper/921:59:2311
559899170cyclictest0-21swapper/921:47:5711
559899170cyclictest0-21swapper/921:36:5511
559899170cyclictest0-21swapper/921:25:5511
559799171cyclictest0-21swapper/821:40:1410
559799170cyclictest0-21swapper/800:16:3710
559599175cyclictest0-21swapper/621:18:388
5594991716cyclictest7230-21qemu-kvm22:14:067
5585991715cyclictest7612-21snmp_rack3slot900:16:004
5585991715cyclictest6912-21diskstats19:10:124
5585991715cyclictest32701-21ssh22:02:164
5585991715cyclictest25367-21perl00:05:144
5585991715cyclictest2305-21snmpd00:35:434
5585991715cyclictest18749-21snmp_rack3slot919:25:124
5585991715cyclictest14786-21users20:45:284
5585991715cyclictest11895-21ntp_states21:45:214
13450170irq/18-ehci_hcd0-21swapper/023:00:230
559899161cyclictest0-21swapper/921:50:0511
559799165cyclictest0-21swapper/819:44:5910
5597991615cyclictest20200-21smartctl20:10:1410
5595991615cyclictest18172-21qemu-kvm20:47:308
5595991614cyclictest5314-21qemu-kvm19:10:468
559599160cyclictest0-21swapper/620:50:368
5594991615cyclictest32064-21iostat_ios00:10:177
5594991615cyclictest14238-21snmp_easybox.os20:45:267
5585991615cyclictest2502-21ssh22:05:044
5585991614cyclictest715-21df_inode23:20:134
5585991614cyclictest441-21ssh22:29:034
5585991614cyclictest29505-21snmp_rack3slot921:06:364
5585991614cyclictest29505-21snmp_rack3slot921:06:364
5585991614cyclictest29326-21snmp_easybox.os22:50:314
5585991614cyclictest27788-21snmp_easybox.os19:35:244
5585991614cyclictest2305-21snmpd20:53:574
5585991614cyclictest2305-21snmpd20:23:274
5585991614cyclictest11898-21users22:10:314
5585991614cyclictest10033-21snmp_easybox.os19:55:284
13450160irq/18-ehci_hcd0-21swapper/019:36:250
5600991514cyclictest0-21swapper/1120:15:113
5600991513cyclictest18264-21chrt20:09:213
5598991514cyclictest3055050irq/54-eth0-tx-21:16:2811
5598991514cyclictest0-21swapper/900:04:5211
559799154cyclictest0-21swapper/822:05:0210
559799153cyclictest0-21swapper/821:10:0110
559799153cyclictest0-21swapper/821:10:0110
5595991514cyclictest5314-21qemu-kvm19:40:298
5594991514cyclictest25884-21snmp_rack3slot921:01:507
5594991514cyclictest21627-21snmp_rack3slot900:01:487
5594991513cyclictest7230-21qemu-kvm22:08:397
5585991514cyclictest8256-21yum23:50:314
5585991514cyclictest22148-21ssh22:45:164
5585991513cyclictest9738-21snmp_rack3slot920:40:124
5585991513cyclictest6392-21snmp_easybox.os19:50:284
5585991513cyclictest30642-21diskstats20:25:144
5585991513cyclictest25861-21snmp_rack3slot921:56:254
5585991513cyclictest24510-21ntp_states20:15:194
5585991513cyclictest17095-21snmp_rack3slot923:06:354
5575991514cyclictest29826-21diskmemload23:07:091
5575991514cyclictest29826-21diskmemload21:52:371
5575991514cyclictest29826-21diskmemload21:14:191
5575991514cyclictest29826-21diskmemload21:14:191
5564991514cyclictest3054950irq/53-eth0-rx-20:17:210
5564991513cyclictest35522chrt21:14:420
5564991513cyclictest35522chrt21:14:420
13450150irq/18-ehci_hcd0-21swapper/022:30:250
13450150irq/18-ehci_hcd0-21swapper/019:31:250
560099144cyclictest0-21swapper/1121:00:013
560099143cyclictest0-21swapper/1122:02:573
5600991411cyclictest0-21swapper/1122:08:413
560099140cyclictest0-21swapper/1100:24:563
560099140cyclictest0-21swapper/1100:24:563
559799140cyclictest17586-21sh23:07:2510
559799140cyclictest0-21swapper/823:17:2810
5594991413cyclictest9104-21snmp_rack3slot920:40:117
5594991413cyclictest5314-21qemu-kvm19:23:147
5585991413cyclictest20271-21snmp_rack3slot900:26:124
5585991413cyclictest18148-21users22:15:274
5585991412cyclictest19981-21snmp_rack3slot923:10:154
5585991412cyclictest17254-21munin-run00:00:014
5585991412cyclictest11764-21snmp_rack3slot919:15:114
557599143cyclictest0-21swapper/119:43:401
5575991413cyclictest29826-21diskmemload22:10:401
5564991412cyclictest0-21swapper/019:17:180
3055050140irq/54-eth0-tx-4460-21ssh22:56:317
31140ksoftirqd/00-21swapper/020:21:330
14750140irq/18-uhci_hcd0-21swapper/000:05:220
13450140irq/18-ehci_hcd0-21swapper/023:27:060
560099134cyclictest0-21swapper/1121:55:453
560099134cyclictest0-21swapper/1120:00:003
560099133cyclictest0-21swapper/1123:56:433
560099133cyclictest0-21swapper/1123:42:123
560099133cyclictest0-21swapper/1123:39:133
560099133cyclictest0-21swapper/1123:30:493
560099133cyclictest0-21swapper/1123:19:123
560099133cyclictest0-21swapper/1122:51:113
560099133cyclictest0-21swapper/1122:47:433
560099133cyclictest0-21swapper/1121:07:093
560099133cyclictest0-21swapper/1121:07:093
560099133cyclictest0-21swapper/1120:36:093
560099133cyclictest0-21swapper/1119:40:013
560099133cyclictest0-21swapper/1119:34:093
560099133cyclictest0-21swapper/1100:33:133
560099133cyclictest0-21swapper/1100:33:133
560099133cyclictest0-21swapper/1100:26:293
560099133cyclictest0-21swapper/1100:07:133
560099133cyclictest0-21swapper/1100:02:343
559999133cyclictest0-21swapper/1019:49:272
559999130cyclictest221062sleep1020:55:382
559999130cyclictest218692chrt20:13:432
559799138cyclictest0-21swapper/800:25:2710
559799137cyclictest0-21swapper/822:21:5710
559799133cyclictest0-21swapper/823:55:0110
559799133cyclictest0-21swapper/823:46:1310
559799133cyclictest0-21swapper/823:43:2810
559799133cyclictest0-21swapper/823:35:3910
559799133cyclictest0-21swapper/823:10:5810
559799133cyclictest0-21swapper/823:00:5810
559799133cyclictest0-21swapper/822:51:4110
559799133cyclictest0-21swapper/822:35:4210
559799133cyclictest0-21swapper/822:30:4210
559799133cyclictest0-21swapper/822:17:4310
559799133cyclictest0-21swapper/821:30:1310
559799133cyclictest0-21swapper/820:51:5310
559799133cyclictest0-21swapper/820:40:3910
559799133cyclictest0-21swapper/820:30:3810
559799133cyclictest0-21swapper/820:19:4310
559799133cyclictest0-21swapper/819:45:0010
559799133cyclictest0-21swapper/819:33:5210
559799133cyclictest0-21swapper/800:09:4310
559799130cyclictest0-21swapper/822:25:1310
559799130cyclictest0-21swapper/820:00:1410
559799130cyclictest0-21swapper/819:57:1910
559799130cyclictest0-21swapper/800:34:0710
559799130cyclictest0-21swapper/800:34:0710
559699133cyclictest0-21swapper/722:20:189
559699130cyclictest0-21swapper/720:52:129
559599133cyclictest0-21swapper/623:48:428
559599133cyclictest0-21swapper/623:29:048
559599133cyclictest0-21swapper/623:05:128
559599133cyclictest0-21swapper/622:49:038
559599133cyclictest0-21swapper/621:53:418
559599133cyclictest0-21swapper/621:07:278
559599133cyclictest0-21swapper/621:07:268
559599133cyclictest0-21swapper/620:34:398
559599133cyclictest0-21swapper/619:24:098
559599133cyclictest0-21swapper/600:37:498
559599133cyclictest0-21swapper/600:29:438
559599133cyclictest0-21swapper/600:10:138
559599133cyclictest0-21swapper/600:05:148
559599131cyclictest0-21swapper/620:10:178
5594991312cyclictest4242-21ssh23:49:187
559399133cyclictest0-21swapper/422:40:006
559399133cyclictest0-21swapper/419:35:156
558599133cyclictest0-21swapper/221:00:014
5585991311cyclictest5592-21diskstats20:35:144
5585991311cyclictest18458-21snmp_easybox.os21:50:274
5585991311cyclictest15763-21snmp_rack3slot922:40:174
557599131cyclictest0-21swapper/119:45:041
556499134cyclictest0-21swapper/020:30:410
556499133cyclictest0-21swapper/023:15:170
556499133cyclictest0-21swapper/021:25:180
556499133cyclictest0-21swapper/020:30:010
3055050130irq/54-eth0-tx-0-21swapper/923:17:3711
3055050130irq/54-eth0-tx-0-21swapper/922:36:0811
31130ksoftirqd/00-21swapper/021:30:270
13450130irq/18-ehci_hcd0-21swapper/022:36:580
13450130irq/18-ehci_hcd0-21swapper/021:06:410
13450130irq/18-ehci_hcd0-21swapper/021:06:410
13450130irq/18-ehci_hcd0-21swapper/020:51:380
621120ksoftirqd/70-21swapper/722:08:169
560099124cyclictest0-21swapper/1120:32:343
560099124cyclictest0-21swapper/1120:10:343
560099124cyclictest0-21swapper/1119:58:343
560099123cyclictest0-21swapper/1123:10:333
560099123cyclictest0-21swapper/1122:42:303
560099123cyclictest0-21swapper/1121:04:573
560099122cyclictest0-21swapper/1123:46:423
560099122cyclictest0-21swapper/1123:23:333
560099122cyclictest0-21swapper/1123:01:423
560099122cyclictest0-21swapper/1122:56:113
560099122cyclictest0-21swapper/1122:36:423
560099122cyclictest0-21swapper/1122:19:033
560099122cyclictest0-21swapper/1121:40:413
560099122cyclictest0-21swapper/1121:35:223
560099122cyclictest0-21swapper/1120:45:103
560099122cyclictest0-21swapper/1100:37:433
560099122cyclictest0-21swapper/1100:12:433
5600991211cyclictest0-21swapper/1123:26:123
5600991210cyclictest0-21swapper/1121:32:393
560099121cyclictest0-21swapper/1122:10:253
559899120cyclictest0-21swapper/919:40:0111
559799126cyclictest0-21swapper/821:25:0910
559799124cyclictest14750-21grep22:40:1410
559799124cyclictest0-21swapper/821:35:0110
559799122cyclictest0-21swapper/823:59:4210
559799122cyclictest0-21swapper/822:58:4210
559799122cyclictest0-21swapper/822:10:1310
559799122cyclictest0-21swapper/821:49:3810
559799122cyclictest0-21swapper/819:38:3910
559799122cyclictest0-21swapper/800:36:1310
559799122cyclictest0-21swapper/800:21:5910
559799122cyclictest0-21swapper/800:21:5910
559799121cyclictest0-21swapper/823:32:0410
559799121cyclictest0-21swapper/823:20:2610
559799121cyclictest0-21swapper/822:00:2310
559799121cyclictest0-21swapper/821:57:0110
559799121cyclictest0-21swapper/821:50:2910
559799121cyclictest0-21swapper/821:20:1310
559799121cyclictest0-21swapper/821:15:1210
559799121cyclictest0-21swapper/820:35:2210
559799121cyclictest0-21swapper/819:25:1310
559799121cyclictest0-21swapper/819:20:1310
559799121cyclictest0-21swapper/800:10:3510
559799121cyclictest0-21swapper/800:00:2110
559799120cyclictest0-21swapper/821:01:1510
559799120cyclictest0-21swapper/820:59:3110
559799120cyclictest0-21swapper/820:46:3410
559799120cyclictest0-21swapper/819:54:5610
559799120cyclictest0-21swapper/819:15:2310
559799120cyclictest0-21swapper/819:10:0410
559699124cyclictest0-21swapper/720:21:289
559699122cyclictest0-21swapper/723:59:449
559699122cyclictest0-21swapper/723:48:139
559699122cyclictest0-21swapper/721:49:289
559699122cyclictest0-21swapper/720:59:569
559699122cyclictest0-21swapper/719:49:129
559699122cyclictest0-21swapper/719:32:129
559599124cyclictest0-21swapper/623:40:188
559599124cyclictest0-21swapper/621:00:018
559599123cyclictest0-21swapper/622:16:428
559599122cyclictest0-21swapper/623:03:128
559599122cyclictest0-21swapper/622:57:118
559599122cyclictest0-21swapper/622:51:188
559599122cyclictest0-21swapper/622:04:428
559599122cyclictest0-21swapper/621:46:118
559599122cyclictest0-21swapper/621:40:118
559599122cyclictest0-21swapper/621:31:408
559599122cyclictest0-21swapper/619:37:088
559599122cyclictest0-21swapper/600:00:138
559499122cyclictest0-21swapper/521:30:217
5594991211cyclictest4895-21snmp_rack3slot921:40:177
5590991210cyclictest2305-21snmpd20:58:275
5585991211cyclictest24087-21df21:30:174
5585991211cyclictest23854-21python22:20:234
5585991211cyclictest13075-21ssh22:38:554
5585991210cyclictest4734-21snmp_rack3slot922:57:004
5585991210cyclictest31545-21snmp_rack3slot923:45:114
5585991210cyclictest29774-21snmp_rack3slot923:16:494
5585991210cyclictest26129-21munin-run21:05:014
5585991210cyclictest23293-21snmp_rack3slot919:30:164
5585991210cyclictest13008-21python21:20:264
557599123cyclictest0-21swapper/123:44:421
5575991211cyclictest29826-21diskmemload23:15:021
556499122cyclictest0-21swapper/020:10:000
556499122cyclictest0-21swapper/019:45:170
556499120cyclictest0-21swapper/022:21:550
556499120cyclictest0-21swapper/022:08:330
556499120cyclictest0-21swapper/000:35:240
3199120watchdog/30-21swapper/300:02:045
3055050120irq/54-eth0-tx-0-21swapper/923:20:1611
3055050120irq/54-eth0-tx-0-21swapper/922:44:1611
3055050120irq/54-eth0-tx-0-21swapper/922:16:1011
3055050120irq/54-eth0-tx-0-21swapper/023:06:470
3055050120irq/54-eth0-tx-0-21swapper/022:44:560
3054950120irq/53-eth0-rx-0-21swapper/622:05:538
31120ksoftirqd/00-21swapper/019:11:220
201120ksoftirqd/10-21swapper/122:08:161
14750120irq/18-uhci_hcd0-21swapper/019:56:280
14750120irq/18-uhci_hcd0-21swapper/000:10:220
13450120irq/18-ehci_hcd0-21swapper/020:55:210
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional