You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-27 - 18:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3.osadl.org (updated Thu Nov 27, 2025 12:46:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
14781210794sleep80-21swapper/807:07:4410
14639210594sleep60-21swapper/607:05:538
14705210492sleep70-21swapper/707:06:439
30664501020irq/53-eth0-tx-0-21swapper/107:07:161
14890210296sleep40-21swapper/407:08:286
12250980irq/42-ahci0-21swapper/207:08:364
3066350920irq/52-eth0-rx-0-21swapper/307:05:385
3066350910irq/52-eth0-rx-0-21swapper/1107:05:333
3066350880irq/52-eth0-rx-0-21swapper/507:07:037
1475328678sleep90-21swapper/907:07:2111
1461627868sleep00-21swapper/007:05:350
1183627266sleep100-21swapper/1007:05:092
1511999220cyclictest0-21swapper/010:15:570
15119992119cyclictest0-21swapper/008:08:290
1511999200cyclictest0-21swapper/009:14:380
1514999181cyclictest12250irq/42-ahci10:00:002
1514899184cyclictest0-21swapper/907:47:1111
1514899181cyclictest0-21swapper/912:20:2411
1514899181cyclictest0-21swapper/910:10:2311
1514899181cyclictest0-21swapper/910:09:0211
1514899181cyclictest0-21swapper/909:27:5911
1514899181cyclictest0-21swapper/909:13:2211
1514899181cyclictest0-21swapper/908:40:1411
15144991816cyclictest27649-21qemu-kvm08:09:018
1514999170cyclictest96892sleep1008:25:552
1514999170cyclictest96892sleep1008:25:552
1514999170cyclictest91812sleep1007:40:482
1514999170cyclictest8972sleep1011:56:052
1514999170cyclictest8932sleep1008:15:172
1514999170cyclictest87802chrt11:25:132
1514999170cyclictest82672sleep1012:05:432
1514999170cyclictest65562sleep1009:06:462
1514999170cyclictest62752sleep1010:35:212
1514999170cyclictest60542sleep1008:20:532
1514999170cyclictest55082chrt09:50:152
1514999170cyclictest50622sleep1011:20:032
1514999170cyclictest50622sleep1011:20:022
1514999170cyclictest47162sleep1012:01:432
1514999170cyclictest43532sleep1011:17:022
1514999170cyclictest39082sleep1010:31:452
1514999170cyclictest33622chrt09:46:152
1514999170cyclictest327622chrt10:28:432
1514999170cyclictest323682sleep1011:10:242
1514999170cyclictest321052chrt09:41:382
1514999170cyclictest315242chrt08:55:452
1514999170cyclictest311432chrt08:11:042
1514999170cyclictest307062chrt07:26:592
1514999170cyclictest3066350irq/52-eth0-rx-11:30:222
1514999170cyclictest3066350irq/52-eth0-rx-10:40:122
1514999170cyclictest3066350irq/52-eth0-rx-10:20:222
1514999170cyclictest3066350irq/52-eth0-rx-09:15:232
1514999170cyclictest293732sleep1011:06:122
1514999170cyclictest293732sleep1011:06:122
1514999170cyclictest283942sleep1009:35:372
1514999170cyclictest27852sleep1009:00:332
1514999170cyclictest27852sleep1009:00:332
1514999170cyclictest270692chrt07:21:592
1514999170cyclictest261532sleep1011:46:522
1514999170cyclictest256812sleep1011:00:472
1514999170cyclictest255842sleep1012:30:222
1514999170cyclictest243332sleep1008:46:562
1514999170cyclictest243332sleep1008:46:562
1514999170cyclictest239942sleep1009:30:252
1514999170cyclictest239012sleep1008:02:152
1514999170cyclictest228652sleep1012:26:222
1514999170cyclictest219122chrt07:15:212
1514999170cyclictest216382sleep1010:10:542
1514999170cyclictest211762sleep1009:26:242
1514999170cyclictest207942chrt08:43:192
1514999170cyclictest192352sleep1010:55:102
1514999170cyclictest191842sleep1012:20:442
1514999170cyclictest19132sleep1007:32:002
1514999170cyclictest187892sleep1011:35:402
1514999170cyclictest184752sleep1010:51:462
1514999170cyclictest174872sleep1009:20:482
1514999170cyclictest171972sleep1008:38:552
1514999170cyclictest171972sleep1008:38:552
1514999170cyclictest166712sleep1007:53:262
1514999170cyclictest164772sleep1010:05:172
1514999170cyclictest157162sleep1012:17:562
1514999170cyclictest156042sleep1007:10:092
1514999170cyclictest147962sleep1010:46:342
1514999170cyclictest134352sleep1008:32:182
1514999170cyclictest128152sleep1007:45:492
1514999170cyclictest12250irq/42-ahci08:50:202
1514999170cyclictest12250irq/42-ahci08:05:312
1514999170cyclictest12250irq/42-ahci07:55:212
1514999170cyclictest12250irq/42-ahci07:36:442
1514999170cyclictest119472sleep1012:11:192
1514999170cyclictest106172sleep1009:56:052
1514999170cyclictest103762sleep1009:13:242
1514899175cyclictest0-21swapper/911:35:0111
1514899170cyclictest0-21swapper/910:20:1811
1514899170cyclictest0-21swapper/909:00:3011
1514899170cyclictest0-21swapper/909:00:3011
1514899170cyclictest0-21swapper/908:09:1111
15148991615cyclictest741rcuc/912:31:5611
15148991615cyclictest18036-21latency_hist09:25:0111
15148991615cyclictest0-21swapper/910:15:1911
15148991615cyclictest0-21swapper/910:00:2811
15148991614cyclictest29958-21snmp_rack3slot909:40:1411
15148991614cyclictest19070-21taskset11:39:3011
1514699165cyclictest0-21swapper/710:32:349
15144991614cyclictest18151-21qemu-kvm10:24:208
15144991614cyclictest14864-21qemu-kvm07:25:128
15142991614cyclictest1711-21sensors08:15:246
15126991615cyclictest3066350irq/52-eth0-rx-11:55:141
1512699161cyclictest0-21swapper/108:15:111
15119991614cyclictest19670-21snmp_rack3slot909:25:160
1511999160cyclictest0-21swapper/010:29:330
1515099150cyclictest0-21swapper/1110:11:463
1514899154cyclictest0-21swapper/912:05:0111
1514899154cyclictest0-21swapper/908:35:0111
15148991514cyclictest0-21swapper/912:15:1311
15148991514cyclictest0-21swapper/907:50:1611
1514499154cyclictest13137-21sadc07:50:018
1514499153cyclictest0-21swapper/612:00:188
15144991513cyclictest18152-21qemu-kvm10:19:268
15126991514cyclictest3066350irq/52-eth0-rx-10:46:241
15119991514cyclictest2443-21lldpd08:11:120
15119991513cyclictest68502sleep009:10:000
1514899145cyclictest0-21swapper/908:45:0111
1514899145cyclictest0-21swapper/908:45:0111
1514899144cyclictest0-21swapper/909:55:0011
1514899144cyclictest0-21swapper/909:55:0011
15148991413cyclictest0-21swapper/911:12:5111
15148991413cyclictest0-21swapper/909:31:3311
1514899141cyclictest0-21swapper/907:55:2411
1514899140cyclictest0-21swapper/911:00:3111
1514699143cyclictest0-21swapper/709:40:099
1514499144cyclictest0-21swapper/611:40:018
15144991413cyclictest18152-21qemu-kvm10:45:028
15144991412cyclictest18152-21qemu-kvm10:25:508
1512699143cyclictest0-21swapper/109:05:141
14850140irq/18-uhci_hcd0-21swapper/011:50:230
1514899134cyclictest0-21swapper/908:20:0111
1514899133cyclictest0-21swapper/911:54:5611
1514899133cyclictest0-21swapper/908:59:1411
15148991312cyclictest0-21swapper/911:20:0211
15148991312cyclictest0-21swapper/911:20:0111
15148991312cyclictest0-21swapper/910:45:2111
15148991312cyclictest0-21swapper/908:10:0111
15148991311cyclictest32314-21df_inode07:30:1311
1514899131cyclictest0-21swapper/909:05:1211
1514699133cyclictest0-21swapper/707:40:119
1514699130cyclictest0-21swapper/708:45:159
1514699130cyclictest0-21swapper/708:45:159
1514499135cyclictest0-21swapper/610:35:048
1514499135cyclictest0-21swapper/608:23:398
1514499135cyclictest0-21swapper/608:13:188
1514499133cyclictest0-21swapper/609:54:178
1514499133cyclictest0-21swapper/608:51:148
15142991311cyclictest9071-21sensors08:25:236
15142991311cyclictest9071-21sensors08:25:236
1512699133cyclictest0-21swapper/112:35:171
1512699133cyclictest0-21swapper/109:10:161
1512699133cyclictest0-21swapper/108:45:201
1512699133cyclictest0-21swapper/108:45:201
1512699133cyclictest0-21swapper/107:40:191
15126991312cyclictest3066350irq/52-eth0-rx-12:05:331
15126991312cyclictest3066350irq/52-eth0-rx-09:42:591
15126991312cyclictest3066350irq/52-eth0-rx-08:30:281
15119991311cyclictest314482sleep007:30:020
3199120watchdog/30-21swapper/309:38:035
31120ksoftirqd/00-21swapper/009:50:270
1514999123cyclictest0-21swapper/1010:20:002
1514899123cyclictest0-21swapper/911:45:0111
1514899123cyclictest0-21swapper/910:30:0011
1514899122cyclictest0-21swapper/911:49:2411
1514899122cyclictest0-21swapper/908:51:5411
15148991211cyclictest21662-1kworker/9:0H11:05:0911
15148991211cyclictest21662-1kworker/9:0H11:05:0911
15148991211cyclictest0-21swapper/910:36:4511
1514699129cyclictest0-21swapper/710:52:599
1514699124cyclictest0-21swapper/708:45:029
1514699122cyclictest0-21swapper/711:44:249
1514699122cyclictest0-21swapper/711:38:249
1514699122cyclictest0-21swapper/711:15:549
1514699122cyclictest0-21swapper/711:04:559
1514699122cyclictest0-21swapper/709:12:099
1514699122cyclictest0-21swapper/707:34:119
15146991210cyclictest0-21swapper/707:30:009
1514499125cyclictest0-21swapper/612:26:208
1514499124cyclictest6710-21qemu-kvm09:29:168
1514499122cyclictest0-21swapper/609:04:088
1514499122cyclictest0-21swapper/609:04:088
15144991210cyclictest18151-21qemu-kvm10:08:428
15142991211cyclictest293672sleep411:06:076
15142991211cyclictest293672sleep411:06:066
1514199123cyclictest0-21swapper/307:20:175
15133991210cyclictest6863-21turbostat09:14:564
1512699123cyclictest0-21swapper/110:05:191
1512699122cyclictest0-21swapper/108:25:161
1512699122cyclictest0-21swapper/108:25:161
1511999123cyclictest0-21swapper/008:25:190
1511999123cyclictest0-21swapper/008:25:190
1511999121cyclictest0-21swapper/008:45:240
1511999121cyclictest0-21swapper/008:45:240
1511999120cyclictest0-21swapper/010:00:240
901110ksoftirqd/110-21swapper/1107:40:253
8999110migration/112555-21fschecks_time11:15:153
6899110migration/814849-21munin-node11:30:3110
31110ksoftirqd/00-21swapper/008:50:180
201110ksoftirqd/10-21swapper/108:50:181
1514999113cyclictest0-21swapper/1011:40:012
1514899119cyclictest6065-21taskset07:40:0011
1514899117cyclictest0-21swapper/912:35:1811
1514899113cyclictest0-21swapper/910:43:1811
15148991110cyclictest0-21swapper/908:35:1211
15148991110cyclictest0-21swapper/908:35:1211
15148991110cyclictest0-21swapper/907:16:0511
1514699113cyclictest0-21swapper/712:25:509
1514699113cyclictest0-21swapper/712:24:509
1514699113cyclictest0-21swapper/711:49:179
1514699113cyclictest0-21swapper/711:27:569
1514699113cyclictest0-21swapper/711:23:479
1514699113cyclictest0-21swapper/711:23:479
1514699113cyclictest0-21swapper/710:24:179
1514699113cyclictest0-21swapper/710:10:399
1514699113cyclictest0-21swapper/710:09:049
1514699113cyclictest0-21swapper/709:30:099
1514699113cyclictest0-21swapper/709:25:399
1514699113cyclictest0-21swapper/709:24:549
1514699113cyclictest0-21swapper/709:15:029
1514699113cyclictest0-21swapper/709:08:149
1514699113cyclictest0-21swapper/708:21:249
1514699113cyclictest0-21swapper/708:08:129
1514699113cyclictest0-21swapper/708:00:129
1514699113cyclictest0-21swapper/707:22:089
1514699113cyclictest0-21swapper/707:12:409
1514699111cyclictest0-21swapper/712:35:189
1514699111cyclictest0-21swapper/711:11:489
1514699111cyclictest0-21swapper/710:25:099
1514699111cyclictest0-21swapper/709:50:399
1514699111cyclictest0-21swapper/707:48:389
1514499115cyclictest0-21swapper/612:36:208
1514499113cyclictest0-21swapper/610:34:108
1514499113cyclictest0-21swapper/609:42:398
1514499113cyclictest0-21swapper/609:33:168
1514499113cyclictest0-21swapper/607:38:088
1514499113cyclictest0-21swapper/607:32:538
1514499113cyclictest0-21swapper/607:17:108
1514499112cyclictest0-21swapper/612:30:018
1514499112cyclictest0-21swapper/612:05:018
1514499111cyclictest0-21swapper/608:03:428
1514499110cyclictest0-21swapper/608:45:198
1514499110cyclictest0-21swapper/608:45:198
1514299113cyclictest0-21swapper/410:45:196
1514299113cyclictest0-21swapper/410:40:186
1514299113cyclictest0-21swapper/409:45:176
1514299113cyclictest0-21swapper/409:40:206
1514199113cyclictest0-21swapper/308:50:215
1513399119cyclictest0-21swapper/207:24:364
1512699113cyclictest0-21swapper/111:10:171
1512699113cyclictest0-21swapper/109:50:191
1512699113cyclictest0-21swapper/109:20:191
1512699113cyclictest0-21swapper/108:00:151
15126991110cyclictest3066350irq/52-eth0-rx-11:30:051
15126991110cyclictest3066350irq/52-eth0-rx-09:30:271
1511999118cyclictest0-21swapper/011:00:270
1511999118cyclictest0-21swapper/010:35:150
1511999113cyclictest0-21swapper/012:00:160
1511999113cyclictest0-21swapper/011:35:180
1511999113cyclictest0-21swapper/011:25:200
1511999113cyclictest0-21swapper/009:50:000
1511999113cyclictest0-21swapper/009:00:010
1511999113cyclictest0-21swapper/007:25:570
1511999111cyclictest0-21swapper/007:55:010
901100ksoftirqd/110-21swapper/1111:00:203
901100ksoftirqd/110-21swapper/1107:20:193
8999100migration/1117187-21munin-node09:20:313
8999100migration/1112325-21munin-node10:00:133
8999100migration/1111640-21kernelversion07:45:193
7599100migration/925048-21munin-node07:20:1411
7399100watchdog/90-21swapper/908:15:0211
691100ksoftirqd/80-21swapper/807:10:0210
6899100migration/85770-21fschecks_time10:35:1510
6899100migration/83511-21taskset09:48:1110
6899100migration/827775-21taskset08:09:5110
6899100migration/81707-21unixbench_multi07:30:2910
6899100migration/810981-21latency_hist09:15:0210
6699100watchdog/80-21swapper/807:37:5910
551100ksoftirqd/60-21swapper/611:00:208
5499100migration/618291-21unixbench_multi10:50:288
531100rcuc/620875-21fschecks_time11:40:158
481100ksoftirqd/50-21swapper/511:00:207
481100ksoftirqd/50-21swapper/510:45:117
481100ksoftirqd/50-21swapper/510:41:457
481100ksoftirqd/50-21swapper/508:35:287
481100ksoftirqd/50-21swapper/508:35:287
481100ksoftirqd/50-21swapper/508:11:457
481100ksoftirqd/50-21swapper/507:30:107
411100ksoftirqd/42340-40kipmi011:00:206
411100ksoftirqd/40-21swapper/408:50:186
341100ksoftirqd/30-21swapper/308:25:205
341100ksoftirqd/30-21swapper/308:25:205
341100ksoftirqd/30-21swapper/307:10:125
3199100watchdog/30-21swapper/310:45:275
31100ksoftirqd/00-21swapper/012:05:240
31100ksoftirqd/00-21swapper/010:50:230
31100ksoftirqd/00-21swapper/010:45:110
31100ksoftirqd/00-21swapper/010:40:250
31100ksoftirqd/00-21swapper/009:35:220
31100ksoftirqd/00-21swapper/008:35:280
31100ksoftirqd/00-21swapper/008:35:280
31100ksoftirqd/00-21swapper/007:20:190
31100ksoftirqd/00-21swapper/007:10:020
271100ksoftirqd/20-21swapper/208:50:184
2499100watchdog/20-21swapper/209:56:184
2499100watchdog/20-21swapper/208:41:384
1699100watchdog/00-21swapper/012:30:190
1699100watchdog/00-21swapper/011:58:390
1699100watchdog/00-21swapper/011:45:460
1699100watchdog/00-21swapper/011:40:340
1699100watchdog/00-21swapper/011:20:580
1699100watchdog/00-21swapper/011:20:580
1699100watchdog/00-21swapper/011:10:270
1699100watchdog/00-21swapper/011:07:030
1699100watchdog/00-21swapper/011:07:030
1699100watchdog/00-21swapper/010:31:340
1699100watchdog/00-21swapper/009:57:260
1699100watchdog/00-21swapper/009:00:100
1699100watchdog/00-21swapper/009:00:100
1699100watchdog/00-21swapper/008:02:350
1515099100cyclictest0-21swapper/1110:20:293
1514999102cyclictest0-21swapper/1012:38:402
1514999102cyclictest0-21swapper/1011:51:552
1514899103cyclictest0-21swapper/912:08:2011
1514899103cyclictest0-21swapper/910:56:1711
1514899103cyclictest0-21swapper/909:39:0911
1514899103cyclictest0-21swapper/907:26:4111
1514899101cyclictest0-21swapper/910:50:1411
1514799102cyclictest25761-21kworker/8:107:23:1010
1514799100cyclictest0-21swapper/809:20:1610
1514699109cyclictest0-21swapper/710:35:139
1514699103cyclictest0-21swapper/708:38:439
1514699103cyclictest0-21swapper/708:38:439
1514699102cyclictest0-21swapper/710:47:259
1514699102cyclictest0-21swapper/709:47:479
1514699102cyclictest0-21swapper/707:53:129
1514699102cyclictest0-21swapper/707:35:119
1514699102cyclictest0-21swapper/707:15:409
1514699101cyclictest0-21swapper/712:32:409
1514699101cyclictest0-21swapper/710:00:009
1514699100cyclictest0-21swapper/710:40:169
1514699100cyclictest0-21swapper/709:55:199
1514699100cyclictest0-21swapper/708:56:299
1514699100cyclictest0-21swapper/708:30:139
1514499108cyclictest14864-21qemu-kvm07:10:148
1514499105cyclictest0-21swapper/608:34:558
1514499104cyclictest0-21swapper/608:16:438
1514499104cyclictest0-21swapper/607:51:398
1514499103cyclictest0-21swapper/611:55:068
1514499102cyclictest0-21swapper/611:46:398
1514499102cyclictest0-21swapper/611:10:018
1514499102cyclictest0-21swapper/609:05:088
1514499102cyclictest0-21swapper/608:41:388
1514499102cyclictest0-21swapper/608:38:238
1514499102cyclictest0-21swapper/608:38:238
1514499102cyclictest0-21swapper/607:41:118
1514499101cyclictest0-21swapper/612:11:398
1514499100cyclictest0-21swapper/610:55:148
1514399109cyclictest0-21swapper/508:08:237
1514399108cyclictest7290-21python11:20:267
1514399108cyclictest7290-21python11:20:267
1514399108cyclictest0-21swapper/512:00:137
1514399100cyclictest0-21swapper/507:45:007
1514299102cyclictest21447-21turbostat09:30:026
1514299102cyclictest0-21swapper/409:35:146
1514299102cyclictest0-21swapper/409:10:006
1514199108cyclictest0-21swapper/312:35:115
1514199104cyclictest0-21swapper/307:25:175
1514199102cyclictest0-21swapper/310:20:005
1514199100cyclictest0-21swapper/311:40:185
1514199100cyclictest0-21swapper/311:05:115
1514199100cyclictest0-21swapper/311:05:115
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional