You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-31 - 14:49
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3.osadl.org (updated Tue Mar 31, 2026 12:46:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3054210691sleep110-21swapper/1107:06:123
3143210593sleep60-21swapper/607:07:208
128501050irq/42-ahci0-21swapper/707:08:409
9918501020irq/53-eth0-rx-0-21swapper/207:08:154
128501020irq/42-ahci0-21swapper/107:08:501
9918501010irq/53-eth0-rx-0-21swapper/407:09:256
9918501000irq/53-eth0-rx-0-21swapper/307:08:165
991850920irq/53-eth0-rx-0-21swapper/807:05:0410
991850890irq/53-eth0-rx-0-21swapper/507:07:517
336427671sleep90-21swapper/907:09:3411
991850740irq/53-eth0-rx-0-21swapper/1007:06:222
302125853sleep00-21swapper/007:05:480
3541993015cyclictest831ksoftirqd/1011:42:472
3541992912cyclictest831ksoftirqd/1012:20:222
3541992912cyclictest831ksoftirqd/1008:58:352
3541992710cyclictest831ksoftirqd/1008:43:332
3541992710cyclictest831ksoftirqd/1008:14:492
354199269cyclictest831ksoftirqd/1011:09:032
354199269cyclictest831ksoftirqd/1011:01:532
354199269cyclictest831ksoftirqd/1009:57:122
354199269cyclictest831ksoftirqd/1009:10:572
354199258cyclictest831ksoftirqd/1010:21:552
354799230cyclictest0-21swapper/1107:25:213
354199192cyclictest991850irq/53-eth0-rx-12:36:542
354199192cyclictest991850irq/53-eth0-rx-12:06:012
354199192cyclictest991850irq/53-eth0-rx-11:52:562
354199192cyclictest991850irq/53-eth0-rx-11:38:122
354199192cyclictest991850irq/53-eth0-rx-11:34:252
354199192cyclictest991850irq/53-eth0-rx-10:17:552
354199192cyclictest991850irq/53-eth0-rx-10:10:502
354199192cyclictest991850irq/53-eth0-rx-09:53:242
354199192cyclictest991850irq/53-eth0-rx-09:16:312
354199192cyclictest831ksoftirqd/1010:00:072
354199192cyclictest831ksoftirqd/1010:00:072
354199192cyclictest831ksoftirqd/1009:25:272
354199192cyclictest831ksoftirqd/1007:50:132
3541991918cyclictest0-21swapper/1010:55:302
354099192cyclictest0-21swapper/911:58:3211
354099192cyclictest0-21swapper/910:34:4511
354099192cyclictest0-21swapper/910:13:2811
3541991817cyclictest0-21swapper/1010:25:272
3541991817cyclictest0-21swapper/1009:46:192
3541991817cyclictest0-21swapper/1009:46:182
3541991817cyclictest0-21swapper/1009:44:452
3541991817cyclictest0-21swapper/1007:33:512
354199181cyclictest991850irq/53-eth0-rx-12:25:202
354199181cyclictest991850irq/53-eth0-rx-12:10:272
354199181cyclictest991850irq/53-eth0-rx-12:00:142
354199181cyclictest991850irq/53-eth0-rx-11:15:462
354199181cyclictest991850irq/53-eth0-rx-10:40:172
354199181cyclictest991850irq/53-eth0-rx-09:20:152
354199181cyclictest991850irq/53-eth0-rx-08:45:422
354199181cyclictest991850irq/53-eth0-rx-08:30:232
354199181cyclictest991850irq/53-eth0-rx-08:22:352
354199181cyclictest831ksoftirqd/1012:33:192
354199181cyclictest831ksoftirqd/1012:15:142
354199181cyclictest831ksoftirqd/1011:47:512
354199181cyclictest831ksoftirqd/1011:28:052
354199181cyclictest831ksoftirqd/1011:22:432
354199181cyclictest831ksoftirqd/1011:10:022
354199181cyclictest831ksoftirqd/1010:50:192
354199181cyclictest831ksoftirqd/1010:35:012
354199181cyclictest831ksoftirqd/1010:30:122
354199181cyclictest831ksoftirqd/1010:05:302
354199181cyclictest831ksoftirqd/1009:35:262
354199181cyclictest831ksoftirqd/1009:35:262
354199181cyclictest831ksoftirqd/1009:30:122
354199181cyclictest831ksoftirqd/1008:00:252
354199181cyclictest831ksoftirqd/1007:45:012
354199181cyclictest831ksoftirqd/1007:20:152
354199181cyclictest831ksoftirqd/1007:15:142
354199181cyclictest831ksoftirqd/1007:10:212
354199181cyclictest811rcuc/1010:46:352
354199181cyclictest12850irq/42-ahci07:40:012
354199181cyclictest12850irq/42-ahci07:25:312
354099181cyclictest991950irq/54-eth0-tx-11:17:1311
354099181cyclictest991950irq/54-eth0-tx-10:00:0211
354099181cyclictest991950irq/54-eth0-tx-10:00:0211
354099181cyclictest18100-21ssh09:26:3911
354099181cyclictest0-21swapper/912:22:5811
354099181cyclictest0-21swapper/912:07:0711
354099181cyclictest0-21swapper/911:29:4911
354099181cyclictest0-21swapper/910:58:4811
354099181cyclictest0-21swapper/910:46:3611
354099181cyclictest0-21swapper/910:42:0511
354099181cyclictest0-21swapper/910:39:0611
354099181cyclictest0-21swapper/910:05:3411
354099181cyclictest0-21swapper/909:21:1111
354099181cyclictest0-21swapper/908:50:1111
354099181cyclictest0-21swapper/907:57:5111
354099181cyclictest0-21swapper/907:11:5411
3541991716cyclictest0-21swapper/1011:55:302
3541991716cyclictest0-21swapper/1009:05:082
3541991716cyclictest0-21swapper/1008:26:322
354199170cyclictest991850irq/53-eth0-rx-08:51:082
354199170cyclictest991850irq/53-eth0-rx-07:55:132
354199170cyclictest831ksoftirqd/1009:00:142
354199170cyclictest831ksoftirqd/1008:15:252
354199170cyclictest831ksoftirqd/1007:45:012
354199170cyclictest54882sleep1008:36:072
354199170cyclictest130642sleep1008:05:042
3540991716cyclictest0-21swapper/912:35:1511
3540991716cyclictest0-21swapper/911:44:5211
3540991716cyclictest0-21swapper/910:15:3211
3540991715cyclictest3652-21awk07:50:1711
354099170cyclictest991950irq/54-eth0-tx-12:11:3611
354099170cyclictest15911-21ssh09:50:3011
354099170cyclictest0-21swapper/912:34:0511
354099170cyclictest0-21swapper/911:31:1011
354099170cyclictest0-21swapper/911:20:4211
354099170cyclictest0-21swapper/911:13:1411
354099170cyclictest0-21swapper/911:05:1511
354099170cyclictest0-21swapper/910:54:1811
354099170cyclictest0-21swapper/909:45:2611
354099170cyclictest0-21swapper/909:45:2511
354099170cyclictest0-21swapper/909:37:5011
354099170cyclictest0-21swapper/909:37:5011
354099170cyclictest0-21swapper/909:30:0811
354099170cyclictest0-21swapper/909:19:1411
354099170cyclictest0-21swapper/909:05:1111
354099170cyclictest0-21swapper/907:34:5611
3536991716cyclictest3257-21qemu-kvm07:41:497
3536991715cyclictest16108-21qemu-kvm08:35:127
353299170cyclictest0-21swapper/412:12:256
3519991715cyclictest2308-21snmpd09:16:034
3519991715cyclictest2308-21snmpd08:41:324
350399172cyclictest0-21swapper/010:24:370
350399172cyclictest0-21swapper/009:21:200
354799161cyclictest0-21swapper/1108:08:413
3540991615cyclictest991850irq/53-eth0-rx-10:20:1911
3540991615cyclictest0-21swapper/912:29:5411
3540991615cyclictest0-21swapper/911:04:1311
3540991615cyclictest0-21swapper/910:29:0511
3540991615cyclictest0-21swapper/909:43:1911
3540991615cyclictest0-21swapper/908:10:1511
3540991615cyclictest0-21swapper/907:26:4411
3537991614cyclictest16108-21qemu-kvm08:08:408
3536991615cyclictest6832-21ssh10:35:417
3536991615cyclictest3256-21qemu-kvm07:11:037
3536991615cyclictest16109-21qemu-kvm08:47:277
3536991615cyclictest16108-21qemu-kvm08:08:177
3536991615cyclictest14649-21ssh12:01:147
3536991615cyclictest10928-21ssh09:47:327
3536991615cyclictest10928-21ssh09:47:317
3519991614cyclictest2308-21snmpd11:43:184
3519991614cyclictest2308-21snmpd07:38:164
350399162cyclictest0-21swapper/009:14:370
3547991514cyclictest22966-21sh10:24:373
354799150cyclictest0-21swapper/1109:24:273
3540991514cyclictest0-21swapper/912:18:1011
3540991514cyclictest0-21swapper/912:04:4911
3540991514cyclictest0-21swapper/909:03:4211
3540991514cyclictest0-21swapper/908:45:0111
354099151cyclictest0-21swapper/911:45:1311
353899155cyclictest0-21swapper/707:20:029
3537991513cyclictest27596-21qemu-kvm09:08:278
3536991514cyclictest24143-21ssh11:44:187
3536991514cyclictest17995-21ssh11:11:317
353299158cyclictest0-21swapper/410:01:076
353299158cyclictest0-21swapper/410:01:076
353299151cyclictest0-21swapper/411:49:346
353299150cyclictest0-21swapper/412:31:566
353299150cyclictest0-21swapper/412:06:586
353299150cyclictest0-21swapper/411:33:396
353299150cyclictest0-21swapper/410:47:136
353299150cyclictest0-21swapper/409:40:056
353299150cyclictest0-21swapper/409:13:036
352599150cyclictest0-21swapper/311:08:025
351999151cyclictest0-21swapper/212:33:334
351299150cyclictest0-21swapper/112:20:221
351299150cyclictest0-21swapper/111:49:421
3547991413cyclictest991850irq/53-eth0-rx-10:09:593
354799140cyclictest0-21swapper/1111:20:043
354799140cyclictest0-21swapper/1110:45:173
354799140cyclictest0-21swapper/1110:43:573
354799140cyclictest0-21swapper/1110:28:413
354799140cyclictest0-21swapper/1110:15:403
354799140cyclictest0-21swapper/1109:16:553
3540991413cyclictest20735-21kworker/9:111:53:2111
3540991413cyclictest0-21swapper/911:37:0911
3540991413cyclictest0-21swapper/908:02:4011
3540991413cyclictest0-21swapper/907:47:5511
354099140cyclictest0-21swapper/908:20:1411
353999145cyclictest0-21swapper/807:13:1710
353999143cyclictest0-21swapper/808:30:0010
353999140cyclictest0-21swapper/812:29:5510
353899144cyclictest0-21swapper/711:10:009
3537991412cyclictest22634-21python08:15:238
3536991413cyclictest3057-21ssh10:07:157
3536991413cyclictest16109-21qemu-kvm08:22:407
3536991413cyclictest16016-21ssh11:35:517
353299146cyclictest27749-21diskmemload12:00:206
353299146cyclictest0-21swapper/412:19:026
353299146cyclictest0-21swapper/411:59:106
353299146cyclictest0-21swapper/408:11:006
353299146cyclictest0-21swapper/407:13:106
353299145cyclictest0-21swapper/412:27:386
3532991413cyclictest991850irq/53-eth0-rx-08:18:156
353299140cyclictest28092-21ssh10:27:486
353299140cyclictest0-21swapper/411:42:076
353299140cyclictest0-21swapper/411:28:226
353299140cyclictest0-21swapper/411:17:436
353299140cyclictest0-21swapper/411:04:376
353299140cyclictest0-21swapper/410:58:396
353299140cyclictest0-21swapper/410:18:036
353299140cyclictest0-21swapper/410:07:356
353299140cyclictest0-21swapper/409:36:076
353299140cyclictest0-21swapper/409:36:066
353299140cyclictest0-21swapper/409:31:416
353299140cyclictest0-21swapper/409:06:306
353299140cyclictest0-21swapper/408:48:256
353299140cyclictest0-21swapper/408:21:506
353299140cyclictest0-21swapper/408:05:016
353299140cyclictest0-21swapper/407:59:226
353299140cyclictest0-21swapper/407:23:426
353299140cyclictest0-21swapper/407:15:126
351999140cyclictest0-21swapper/212:20:214
351299140cyclictest0-21swapper/112:34:301
3503991412cyclictest0-21swapper/010:15:090
354799130cyclictest0-21swapper/1112:34:443
354799130cyclictest0-21swapper/1112:28:403
354799130cyclictest0-21swapper/1112:21:263
354799130cyclictest0-21swapper/1112:19:053
354799130cyclictest0-21swapper/1112:06:183
354799130cyclictest0-21swapper/1112:02:583
354799130cyclictest0-21swapper/1111:55:043
354799130cyclictest0-21swapper/1111:47:593
354799130cyclictest0-21swapper/1111:40:373
354799130cyclictest0-21swapper/1111:38:543
354799130cyclictest0-21swapper/1111:26:463
354799130cyclictest0-21swapper/1111:15:123
354799130cyclictest0-21swapper/1111:03:363
354799130cyclictest0-21swapper/1110:59:533
354799130cyclictest0-21swapper/1110:50:593
354799130cyclictest0-21swapper/1110:12:183
354799130cyclictest0-21swapper/1109:56:513
354799130cyclictest0-21swapper/1109:50:043
354799130cyclictest0-21swapper/1109:32:153
354799130cyclictest0-21swapper/1109:25:193
354799130cyclictest0-21swapper/1109:12:073
354799130cyclictest0-21swapper/1108:59:303
354799130cyclictest0-21swapper/1108:41:073
354799130cyclictest0-21swapper/1108:26:543
354799130cyclictest0-21swapper/1108:19:593
354799130cyclictest0-21swapper/1107:46:153
354099134cyclictest0-21swapper/908:40:0011
354099133cyclictest0-21swapper/909:00:0011
354099133cyclictest0-21swapper/907:40:0111
3540991311cyclictest1995-21chrt08:34:1811
353999134cyclictest0-21swapper/811:30:0110
353899134cyclictest0-21swapper/709:45:189
353899134cyclictest0-21swapper/709:45:189
353899134cyclictest0-21swapper/707:42:469
353899133cyclictest0-21swapper/711:40:009
353899133cyclictest0-21swapper/710:45:019
3537991311cyclictest4313-21python07:50:248
3536991312cyclictest8761-21ssh12:24:287
3536991312cyclictest3550-21ssh09:40:287
3536991312cyclictest16108-21qemu-kvm08:40:137
353299137cyclictest0-21swapper/412:36:236
353299137cyclictest0-21swapper/409:59:586
353299137cyclictest0-21swapper/409:21:196
353299136cyclictest0-21swapper/411:05:266
353299136cyclictest0-21swapper/410:22:006
353299136cyclictest0-21swapper/409:48:326
353299136cyclictest0-21swapper/409:48:326
353299136cyclictest0-21swapper/408:52:526
353299135cyclictest0-21swapper/408:25:596
353299135cyclictest0-21swapper/407:28:536
353299131cyclictest0-21swapper/411:12:546
353299130cyclictest0-21swapper/411:54:336
353299130cyclictest0-21swapper/409:52:406
353299130cyclictest0-21swapper/408:59:396
353299130cyclictest0-21swapper/407:49:006
351999133cyclictest0-21swapper/212:15:164
351999133cyclictest0-21swapper/211:20:004
3519991311cyclictest2308-21snmpd08:13:164
351299133cyclictest0-21swapper/109:20:021
350399130cyclictest0-21swapper/008:20:230
31130ksoftirqd/00-21swapper/011:05:230
31130ksoftirqd/00-21swapper/009:37:460
31130ksoftirqd/00-21swapper/009:37:460
1699130watchdog/00-21swapper/007:58:580
15050130irq/18-uhci_hcd0-21swapper/008:55:210
354799120cyclictest0-21swapper/1112:35:483
354799120cyclictest0-21swapper/1112:10:243
354799120cyclictest0-21swapper/1111:50:253
354799120cyclictest0-21swapper/1111:30:033
354799120cyclictest0-21swapper/1111:10:113
354799120cyclictest0-21swapper/1111:07:283
354799120cyclictest0-21swapper/1110:36:463
354799120cyclictest0-21swapper/1110:32:043
354799120cyclictest0-21swapper/1110:00:543
354799120cyclictest0-21swapper/1110:00:533
354799120cyclictest0-21swapper/1109:40:403
354799120cyclictest0-21swapper/1109:35:293
354799120cyclictest0-21swapper/1109:35:293
354799120cyclictest0-21swapper/1109:00:123
354799120cyclictest0-21swapper/1108:51:023
354799120cyclictest0-21swapper/1108:22:503
354799120cyclictest0-21swapper/1108:11:193
354799120cyclictest0-21swapper/1108:03:153
354799120cyclictest0-21swapper/1107:55:433
354799120cyclictest0-21swapper/1107:51:093
354799120cyclictest0-21swapper/1107:30:083
354799120cyclictest0-21swapper/1107:13:143
3540991211cyclictest0-21swapper/909:57:1811
3540991211cyclictest0-21swapper/909:10:5711
3540991211cyclictest0-21swapper/908:28:2011
3540991211cyclictest0-21swapper/907:35:2211
353999124cyclictest0-21swapper/811:50:0110
353999124cyclictest0-21swapper/808:00:0010
353999123cyclictest0-21swapper/810:20:0210
353999123cyclictest0-21swapper/809:35:0010
353999123cyclictest0-21swapper/809:15:1910
353999123cyclictest0-21swapper/808:15:0010
353999122cyclictest0-21swapper/812:05:0110
353899122cyclictest0-21swapper/709:25:029
3537991210cyclictest12272-21munin-run11:35:018
3536991211cyclictest28321-21ssh10:55:077
353299126cyclictest0-21swapper/409:25:566
353299126cyclictest0-21swapper/409:02:216
353299125cyclictest0-21swapper/408:39:586
353299125cyclictest0-21swapper/407:31:346
353299122cyclictest0-21swapper/411:20:156
353299121cyclictest0-21swapper/409:16:386
352599122cyclictest2242-40kipmi008:22:055
352599121cyclictest0-21swapper/311:33:135
351999123cyclictest0-21swapper/208:45:194
351999122cyclictest0-21swapper/210:20:154
351299124cyclictest0-21swapper/111:25:161
351299120cyclictest0-21swapper/111:11:241
351299120cyclictest0-21swapper/109:13:091
350399129cyclictest0-21swapper/007:12:140
3503991211cyclictest0-21swapper/012:18:160
3503991210cyclictest0-21swapper/010:08:180
350399120cyclictest0-21swapper/011:50:210
350399120cyclictest0-21swapper/009:55:220
31120ksoftirqd/00-21swapper/012:35:200
31120ksoftirqd/00-21swapper/010:35:220
31120ksoftirqd/00-21swapper/007:15:270
2499120watchdog/22345-21lldpd07:34:234
201120ksoftirqd/10-21swapper/108:45:131
1699120watchdog/00-21swapper/011:24:230
115050120irq/18-i801_smb0-21swapper/610:55:228
991950110irq/54-eth0-tx-9913-21ssh10:13:195
991950110irq/54-eth0-tx-0-21swapper/110:37:561
991850110irq/53-eth0-rx-0-21swapper/010:54:590
691110ksoftirqd/80-21swapper/808:45:1310
6899110migration/822256-21runrttasks11:15:1610
6199110migration/719553-21munin-node08:10:279
551110ksoftirqd/627596-21qemu-kvm09:24:268
481110ksoftirqd/50-21swapper/509:24:277
354799110cyclictest0-21swapper/1109:45:173
354799110cyclictest0-21swapper/1109:45:173
354799110cyclictest0-21swapper/1109:05:153
354799110cyclictest0-21swapper/1108:47:323
354799110cyclictest0-21swapper/1108:35:383
354799110cyclictest0-21swapper/1108:32:113
354799110cyclictest0-21swapper/1107:40:563
354799110cyclictest0-21swapper/1107:36:353
354799110cyclictest0-21swapper/1107:15:083
354099113cyclictest0-21swapper/907:19:5111
3540991110cyclictest0-21swapper/908:35:1111
353999113cyclictest0-21swapper/812:16:5010
353999113cyclictest0-21swapper/811:38:4010
353999113cyclictest0-21swapper/810:55:0110
353999113cyclictest0-21swapper/810:20:4810
353999113cyclictest0-21swapper/808:57:3310
353999113cyclictest0-21swapper/808:05:0010
353999112cyclictest0-21swapper/811:00:0110
353999112cyclictest0-21swapper/810:30:1810
353999112cyclictest0-21swapper/808:20:1810
353899114cyclictest0-21swapper/710:55:029
353899114cyclictest0-21swapper/708:46:479
353899113cyclictest0-21swapper/712:17:189
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional