You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-28 - 07:10
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3.osadl.org (updated Sat Mar 28, 2026 00:46:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
128501070irq/42-ahci0-21swapper/719:09:029
15267210593sleep10-21swapper/119:07:291
991850960irq/53-eth0-rx-0-21swapper/819:08:2410
991850950irq/53-eth0-rx-0-21swapper/219:07:124
991850910irq/53-eth0-rx-0-21swapper/419:07:366
991850890irq/53-eth0-rx-0-21swapper/1119:06:143
991850870irq/53-eth0-rx-0-21swapper/519:05:327
12850810irq/42-ahci0-21swapper/319:08:375
1548328076sleep90-21swapper/919:09:3711
1548426765sleep100-21swapper/1019:09:382
1516826753sleep00-21swapper/019:06:160
1511625955sleep60-21swapper/619:05:348
1561399330cyclictest0-21swapper/021:10:310
1565599320cyclictest0-21swapper/1122:18:043
1565599320cyclictest0-21swapper/1120:13:203
991950300irq/54-eth0-tx-0-21swapper/421:10:296
15655993028cyclictest991850irq/53-eth0-rx-21:10:243
15654993013cyclictest831ksoftirqd/1023:07:592
15653993029cyclictest991850irq/53-eth0-rx-21:10:3111
15633992928cyclictest991850irq/53-eth0-rx-21:10:255
15654992811cyclictest831ksoftirqd/1023:44:072
15654992811cyclictest831ksoftirqd/1021:44:242
15655992726cyclictest991850irq/53-eth0-rx-22:23:353
15617992726cyclictest991950irq/54-eth0-tx-21:10:301
15655992524cyclictest0-21swapper/1119:17:253
15613992118cyclictest0-21swapper/022:19:230
1565499203cyclictest831ksoftirqd/1000:14:092
1565499203cyclictest831ksoftirqd/1000:14:092
15653992019cyclictest18547-21vmstat22:10:2711
1565499192cyclictest991850irq/53-eth0-rx-21:39:142
1565499192cyclictest991850irq/53-eth0-rx-00:05:092
1565499192cyclictest831ksoftirqd/1023:53:202
1565499192cyclictest831ksoftirqd/1023:45:172
1565499192cyclictest831ksoftirqd/1023:33:092
1565499192cyclictest831ksoftirqd/1022:43:382
1565499192cyclictest831ksoftirqd/1022:35:212
1565499192cyclictest831ksoftirqd/1022:30:232
1565499192cyclictest831ksoftirqd/1022:20:552
1565499192cyclictest831ksoftirqd/1021:50:232
1565499192cyclictest831ksoftirqd/1021:30:172
1565499192cyclictest831ksoftirqd/1000:28:552
1565599180cyclictest0-21swapper/1122:08:153
15654991817cyclictest831ksoftirqd/1021:55:282
15654991817cyclictest831ksoftirqd/1021:25:102
15654991817cyclictest0-21swapper/1023:35:252
15654991817cyclictest0-21swapper/1020:25:272
1565499181cyclictest991850irq/53-eth0-rx-22:15:122
1565499181cyclictest831ksoftirqd/1023:55:382
1565499181cyclictest831ksoftirqd/1023:55:382
1565499181cyclictest831ksoftirqd/1023:25:252
1565499181cyclictest831ksoftirqd/1023:22:342
1565499181cyclictest831ksoftirqd/1023:15:182
1565499181cyclictest831ksoftirqd/1023:12:052
1565499181cyclictest831ksoftirqd/1023:00:132
1565499181cyclictest831ksoftirqd/1022:55:252
1565499181cyclictest831ksoftirqd/1022:50:152
1565499181cyclictest831ksoftirqd/1022:45:392
1565499181cyclictest831ksoftirqd/1022:25:562
1565499181cyclictest831ksoftirqd/1022:11:272
1565499181cyclictest831ksoftirqd/1022:09:182
1565499181cyclictest831ksoftirqd/1022:01:142
1565499181cyclictest831ksoftirqd/1021:45:132
1565499181cyclictest831ksoftirqd/1021:20:372
1565499181cyclictest831ksoftirqd/1021:10:332
1565499181cyclictest831ksoftirqd/1021:05:232
1565499181cyclictest831ksoftirqd/1020:45:212
1565499181cyclictest831ksoftirqd/1020:20:122
1565499181cyclictest831ksoftirqd/1020:15:012
1565499181cyclictest831ksoftirqd/1020:10:162
1565499181cyclictest831ksoftirqd/1020:06:242
1565499181cyclictest831ksoftirqd/1020:00:252
1565499181cyclictest831ksoftirqd/1019:55:142
1565499181cyclictest831ksoftirqd/1019:45:182
1565499181cyclictest831ksoftirqd/1019:35:162
1565499181cyclictest831ksoftirqd/1019:25:132
1565499181cyclictest831ksoftirqd/1019:10:252
1565499181cyclictest831ksoftirqd/1000:35:392
1565499181cyclictest831ksoftirqd/1000:31:232
1565499181cyclictest831ksoftirqd/1000:21:272
1565499181cyclictest831ksoftirqd/1000:00:132
1565499181cyclictest831ksoftirqd/1000:00:122
1565499181cyclictest12850irq/42-ahci21:16:092
1565499181cyclictest12850irq/42-ahci00:15:442
15650991816cyclictest13957-21qemu-kvm22:08:458
15648991816cyclictest21898-21ssh23:33:457
15654991716cyclictest831ksoftirqd/1020:30:162
15654991716cyclictest0-21swapper/1020:55:252
1565499170cyclictest991850irq/53-eth0-rx-19:15:132
1565499170cyclictest831ksoftirqd/1021:00:202
1565499170cyclictest831ksoftirqd/1021:00:202
1565499170cyclictest831ksoftirqd/1020:50:162
1565499170cyclictest831ksoftirqd/1020:40:162
1565499170cyclictest831ksoftirqd/1020:35:012
1565499170cyclictest831ksoftirqd/1019:50:142
1565499170cyclictest831ksoftirqd/1019:30:132
1565499170cyclictest831ksoftirqd/1019:20:212
1565499170cyclictest68992chrt19:40:042
1565299174cyclictest0-21swapper/819:15:2310
15648991715cyclictest28218-21qemu-kvm20:45:157
15648991715cyclictest28218-21qemu-kvm20:08:157
15648991715cyclictest1311-21ssh21:57:547
15628991715cyclictest2308-21snmpd22:05:104
1561399170cyclictest0-21swapper/021:19:530
991850160irq/53-eth0-rx-2308-21snmpd22:00:094
1565599165cyclictest0-21swapper/1120:00:233
1565199165cyclictest0-21swapper/723:30:439
1565199165cyclictest0-21swapper/722:15:029
1565199164cyclictest0-21swapper/721:20:019
1565199164cyclictest0-21swapper/720:30:019
1565199163cyclictest0-21swapper/722:30:009
15648991614cyclictest1469-21ssh00:10:047
15648991614cyclictest1469-21ssh00:10:037
15628991615cyclictest12850irq/42-ahci21:10:314
1562899160cyclictest14480-21ssh21:15:114
15617991614cyclictest10590-21turbostat20:30:011
7399150watchdog/90-21swapper/900:31:0211
31150ksoftirqd/00-21swapper/020:35:220
1565599150cyclictest2990-21taskset20:15:573
15650991514cyclictest7341-21qemu-kvm21:08:168
15648991514cyclictest3789-21ssh23:19:247
15648991513cyclictest11827-21ssh22:59:577
15641991514cyclictest991850irq/53-eth0-rx-20:51:486
1563399152cyclictest0-21swapper/300:00:005
1563399152cyclictest0-21swapper/300:00:005
1562899156cyclictest7494-21diskmemload23:33:094
1562899150cyclictest0-21swapper/223:43:114
1562899150cyclictest0-21swapper/223:20:384
1562899150cyclictest0-21swapper/221:46:374
1562899150cyclictest0-21swapper/219:15:304
1562899150cyclictest0-21swapper/200:27:294
15613991514cyclictest991850irq/53-eth0-rx-22:12:030
15613991513cyclictest991850irq/53-eth0-rx-21:23:570
14050150irq/18-ehci_hcd0-21swapper/019:14:080
761140ksoftirqd/90-21swapper/923:40:1511
761140ksoftirqd/90-21swapper/900:06:2911
551140ksoftirqd/60-21swapper/623:40:158
481140ksoftirqd/50-21swapper/500:06:297
341140ksoftirqd/30-21swapper/323:40:165
31140ksoftirqd/00-21swapper/022:35:210
201140ksoftirqd/10-21swapper/123:26:401
201140ksoftirqd/10-21swapper/100:20:161
201140ksoftirqd/10-21swapper/100:17:571
1565199144cyclictest0-21swapper/722:10:029
1565199144cyclictest0-21swapper/720:45:019
1565199144cyclictest0-21swapper/719:20:009
1565199144cyclictest0-21swapper/719:15:009
1565199143cyclictest0-21swapper/723:50:439
1565199143cyclictest0-21swapper/720:30:019
15650991412cyclictest13317-21python20:30:258
15648991412cyclictest6133-21ssh23:45:337
15648991412cyclictest12530-21ssh00:18:407
15641991413cyclictest991850irq/53-eth0-rx-20:39:276
1562899147cyclictest0-21swapper/222:35:594
1562899147cyclictest0-21swapper/220:10:164
1562899146cyclictest0-21swapper/223:45:294
1562899145cyclictest0-21swapper/222:19:194
1562899140cyclictest0-21swapper/223:56:124
1562899140cyclictest0-21swapper/223:56:124
1562899140cyclictest0-21swapper/223:52:264
1562899140cyclictest0-21swapper/220:40:164
1562899140cyclictest0-21swapper/200:31:164
1562899140cyclictest0-21swapper/200:14:384
1562899140cyclictest0-21swapper/200:14:384
1561799140cyclictest0-21swapper/122:41:391
14050140irq/18-ehci_hcd0-21swapper/020:05:220
991950130irq/54-eth0-tx-0-21swapper/923:10:4111
991950130irq/54-eth0-tx-0-21swapper/923:00:2211
991950130irq/54-eth0-tx-0-21swapper/922:59:0311
991950130irq/54-eth0-tx-0-21swapper/922:21:4811
991950130irq/54-eth0-tx-0-21swapper/922:05:3711
991950130irq/54-eth0-tx-0-21swapper/921:33:4211
991950130irq/54-eth0-tx-0-21swapper/921:15:5011
991850130irq/53-eth0-rx-0-21swapper/022:27:110
991850130irq/53-eth0-rx-0-21swapper/021:41:020
901130ksoftirqd/110-21swapper/1123:40:153
761130ksoftirqd/90-21swapper/900:18:0711
691130ksoftirqd/80-21swapper/800:06:2910
621130ksoftirqd/70-21swapper/723:27:019
551130ksoftirqd/60-21swapper/600:06:308
411130ksoftirqd/40-21swapper/423:40:256
411130ksoftirqd/40-21swapper/400:06:296
341130ksoftirqd/30-21swapper/300:18:075
3199130watchdog/30-21swapper/320:53:345
201130ksoftirqd/10-21swapper/123:40:251
15655991312cyclictest233722sleep1121:21:543
1565299133cyclictest0-21swapper/819:40:2410
1565199134cyclictest0-21swapper/719:24:439
1565199133cyclictest0-21swapper/722:20:439
1565199133cyclictest0-21swapper/721:25:029
1565199133cyclictest0-21swapper/721:13:029
1565199132cyclictest0-21swapper/700:16:449
15651991312cyclictest0-21swapper/700:10:149
15651991312cyclictest0-21swapper/700:10:149
15651991311cyclictest0-21swapper/700:09:379
1565199130cyclictest0-21swapper/700:28:099
1565099133cyclictest0-21swapper/623:00:018
1565099132cyclictest0-21swapper/622:50:018
15650991312cyclictest551ksoftirqd/623:38:088
1564899133cyclictest0-21swapper/500:30:177
15648991311cyclictest7276-21ssh22:02:227
15648991311cyclictest3560-21ssh21:32:187
15648991311cyclictest26639-21ssh23:36:187
15648991311cyclictest26372-21ssh21:50:467
1564199130cyclictest0-21swapper/400:35:566
1563399130cyclictest0-21swapper/323:47:075
1563399130cyclictest0-21swapper/322:03:095
1562899137cyclictest0-21swapper/222:53:464
1562899137cyclictest0-21swapper/222:23:554
1562899136cyclictest7494-21diskmemload22:10:034
1562899136cyclictest0-21swapper/220:58:094
1562899136cyclictest0-21swapper/220:46:054
1562899136cyclictest0-21swapper/219:31:344
1562899136cyclictest0-21swapper/200:37:314
1562899135cyclictest0-21swapper/223:36:464
1562899135cyclictest0-21swapper/222:29:024
1562899135cyclictest0-21swapper/221:03:274
1562899135cyclictest0-21swapper/221:03:274
1562899135cyclictest0-21swapper/220:19:164
1562899135cyclictest0-21swapper/219:42:334
1562899134cyclictest0-21swapper/220:34:384
1562899133cyclictest7494-21diskmemload00:15:274
15628991311cyclictest2308-21snmpd22:55:244
1562899131cyclictest0-21swapper/221:20:104
1562899130cyclictest0-21swapper/223:27:334
1562899130cyclictest0-21swapper/223:11:154
1562899130cyclictest0-21swapper/223:07:184
1562899130cyclictest0-21swapper/223:03:404
1562899130cyclictest0-21swapper/221:56:174
1562899130cyclictest0-21swapper/221:42:114
1562899130cyclictest0-21swapper/220:54:564
1562899130cyclictest0-21swapper/220:38:584
1562899130cyclictest0-21swapper/220:20:234
1562899130cyclictest0-21swapper/220:09:394
1562899130cyclictest0-21swapper/220:01:224
1562899130cyclictest0-21swapper/219:51:034
1562899130cyclictest0-21swapper/219:24:004
1562899130cyclictest0-21swapper/200:21:534
1562899130cyclictest0-21swapper/200:05:354
1561799130cyclictest0-21swapper/123:46:511
1561399133cyclictest0-21swapper/023:20:000
15613991312cyclictest991850irq/53-eth0-rx-19:30:080
15613991311cyclictest31733-21chrt20:11:220
15613991310cyclictest0-21swapper/023:47:550
14050130irq/18-ehci_hcd0-21swapper/019:44:140
991950120irq/54-eth0-tx-0-21swapper/921:40:1611
991950120irq/54-eth0-tx-0-21swapper/921:25:2811
991950120irq/54-eth0-tx-0-21swapper/023:07:130
901120ksoftirqd/110-21swapper/1100:18:073
901120ksoftirqd/110-21swapper/1100:06:393
761120ksoftirqd/90-21swapper/923:30:5411
691120ksoftirqd/80-21swapper/823:38:0710
691120ksoftirqd/80-21swapper/823:30:5410
691120ksoftirqd/80-21swapper/800:20:1510
551120ksoftirqd/60-21swapper/623:30:548
551120ksoftirqd/60-21swapper/600:18:078
551120ksoftirqd/60-21swapper/600:10:548
551120ksoftirqd/60-21swapper/600:10:548
481120ksoftirqd/50-21swapper/500:20:257
411120ksoftirqd/40-21swapper/400:20:266
31120ksoftirqd/00-21swapper/023:30:540
31120ksoftirqd/00-21swapper/022:45:220
31120ksoftirqd/00-21swapper/020:24:220
1799120watchdog/10-21swapper/122:08:431
1565599122cyclictest0-21swapper/1123:45:013
15655991211cyclictest991850irq/53-eth0-rx-19:13:173
15653991210cyclictest991850irq/53-eth0-rx-21:35:1411
15653991210cyclictest991850irq/53-eth0-rx-21:21:0911
15653991210cyclictest761ksoftirqd/923:50:0111
15653991210cyclictest761ksoftirqd/922:01:1511
15653991210cyclictest761ksoftirqd/920:25:1211
15653991210cyclictest761ksoftirqd/920:15:0011
15653991210cyclictest761ksoftirqd/900:10:1811
15653991210cyclictest761ksoftirqd/900:10:1811
15653991210cyclictest741rcuc/919:36:1511
15653991210cyclictest4549-21kworker/9:021:45:5811
15653991210cyclictest4549-21kworker/9:000:35:2911
15653991210cyclictest4549-21kworker/9:000:26:0311
15653991210cyclictest28771-21chrt20:54:1211
15653991210cyclictest12850irq/42-ahci21:55:0111
15653991210cyclictest0-21swapper/923:51:2711
15653991210cyclictest0-21swapper/923:05:3111
15653991210cyclictest0-21swapper/922:46:1911
15653991210cyclictest0-21swapper/922:26:2111
15653991210cyclictest0-21swapper/921:04:0911
15653991210cyclictest0-21swapper/921:04:0911
15653991210cyclictest0-21swapper/920:32:1211
15653991210cyclictest0-21swapper/920:13:3011
15653991210cyclictest0-21swapper/919:14:3111
15653991210cyclictest0-21swapper/900:20:1311
15653991210cyclictest0-21swapper/900:03:4011
15653991210cyclictest0-21swapper/900:03:3911
1565299123cyclictest0-21swapper/819:32:5410
1565299122cyclictest0-21swapper/823:58:4410
1565299122cyclictest0-21swapper/823:58:4310
1565199125cyclictest0-21swapper/721:36:439
1565199125cyclictest0-21swapper/719:48:439
1565199125cyclictest0-21swapper/719:36:439
1565199124cyclictest0-21swapper/723:38:439
1565199124cyclictest0-21swapper/723:04:449
1565199124cyclictest0-21swapper/722:52:439
1565199124cyclictest0-21swapper/722:40:439
1565199124cyclictest0-21swapper/721:44:439
1565199124cyclictest0-21swapper/720:00:439
1565199124cyclictest0-21swapper/700:25:019
1565199123cyclictest0-21swapper/723:18:439
1565199123cyclictest0-21swapper/720:20:439
1565199123cyclictest0-21swapper/720:15:019
1565199123cyclictest0-21swapper/720:13:249
1565199123cyclictest0-21swapper/720:00:019
1565199122cyclictest0-21swapper/720:08:399
15651991211cyclictest0-21swapper/700:31:239
15651991210cyclictest0-21swapper/700:00:379
15651991210cyclictest0-21swapper/700:00:379
1565199121cyclictest0-21swapper/700:36:189
1565199120cyclictest0-21swapper/723:56:599
1565199120cyclictest0-21swapper/723:56:599
1565199120cyclictest0-21swapper/723:49:159
1565099125cyclictest0-21swapper/622:50:008
1565099123cyclictest0-21swapper/621:30:548
15650991211cyclictest13957-21qemu-kvm22:13:398
15650991210cyclictest6945-21awk20:25:018
15650991210cyclictest28218-21qemu-kvm20:08:408
1565099121cyclictest0-21swapper/621:40:038
1565099120cyclictest0-21swapper/621:50:018
15648991211cyclictest17432-21ssh23:03:537
15648991210cyclictest19971-21ssh23:58:087
15648991210cyclictest19971-21ssh23:58:087
1563399124cyclictest0-21swapper/322:25:175
1563399124cyclictest0-21swapper/320:29:095
1563399124cyclictest0-21swapper/319:50:195
1563399123cyclictest0-21swapper/320:35:175
1563399122cyclictest991850irq/53-eth0-rx-00:32:425
1563399122cyclictest24590-21ssh00:00:315
1563399122cyclictest24590-21ssh00:00:305
15633991211cyclictest5771-21timerwakeupswit19:35:265
15633991211cyclictest22478-21fschecks_count20:00:135
1563399121cyclictest21007-21snmp_rack3slot921:20:145
1562899126cyclictest0-21swapper/222:48:014
1562899126cyclictest0-21swapper/219:48:504
1562899124cyclictest0-21swapper/222:40:264
1562899124cyclictest0-21swapper/221:52:224
1562899124cyclictest0-21swapper/221:32:484
1562899123cyclictest9108-21fschecks_time22:30:134
1562899121cyclictest0-21swapper/223:15:134
1562899121cyclictest0-21swapper/221:25:124
1562899121cyclictest0-21swapper/221:05:114
1562899121cyclictest0-21swapper/219:35:144
1562899121cyclictest0-21swapper/219:10:134
1562899121cyclictest0-21swapper/200:00:144
1562899121cyclictest0-21swapper/200:00:144
1562899120cyclictest0-21swapper/220:26:274
1562899120cyclictest0-21swapper/219:25:354
15617991211cyclictest0-21swapper/123:55:201
15617991211cyclictest0-21swapper/123:55:191
15617991211cyclictest0-21swapper/100:09:281
1561799120cyclictest0-21swapper/123:30:151
1561799120cyclictest0-21swapper/123:23:351
1561799120cyclictest0-21swapper/100:34:481
1561799120cyclictest0-21swapper/100:26:051
1561799120cyclictest0-21swapper/100:14:431
1561799120cyclictest0-21swapper/100:14:431
1561799120cyclictest0-21swapper/100:00:171
1561799120cyclictest0-21swapper/100:00:171
15613991210cyclictest25552-21python23:35:240
15613991210cyclictest0-21swapper/000:26:260
1561399120cyclictest0-21swapper/021:35:210
14050120irq/18-ehci_hcd0-21swapper/023:29:570
991950110irq/54-eth0-tx-0-21swapper/023:01:470
901110ksoftirqd/110-21swapper/1100:20:153
901110ksoftirqd/110-21swapper/1100:10:543
901110ksoftirqd/110-21swapper/1100:10:543
8999110migration/1124598-21munin-node21:50:153
691110ksoftirqd/80-21swapper/823:49:2510
691110ksoftirqd/80-21swapper/823:26:4010
691110ksoftirqd/80-21swapper/823:15:4010
691110ksoftirqd/80-21swapper/800:30:1010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional