You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-12 - 03:36
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3.osadl.org (updated Tue May 12, 2026 00:46:25)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9918501180irq/53-eth0-rx-0-21swapper/119:09:451
9918501100irq/53-eth0-rx-0-21swapper/219:09:384
9918501040irq/53-eth0-rx-0-21swapper/719:08:399
991850960irq/53-eth0-rx-0-21swapper/819:05:3910
991850940irq/53-eth0-rx-0-21swapper/919:05:4411
991850930irq/53-eth0-rx-0-21swapper/1019:07:352
991850920irq/53-eth0-rx-0-21swapper/419:08:026
991850920irq/53-eth0-rx-0-21swapper/319:06:395
991850900irq/53-eth0-rx-0-21swapper/519:07:317
974026653sleep00-21swapper/019:07:040
961726353sleep60-21swapper/619:05:348
973825955sleep110-21swapper/1119:07:033
1016899370cyclictest0-21swapper/1121:08:293
1016899370cyclictest0-21swapper/1121:08:293
1011899320cyclictest0-21swapper/022:28:450
10165992510cyclictest10823-21snmp_rack3slot922:10:1510
1011899220cyclictest0-21swapper/023:27:510
1016799192cyclictest991850irq/53-eth0-rx-23:40:002
1016799192cyclictest991850irq/53-eth0-rx-22:52:112
1016799192cyclictest991850irq/53-eth0-rx-22:33:542
1016799192cyclictest991850irq/53-eth0-rx-00:28:062
1016799192cyclictest991850irq/53-eth0-rx-00:08:392
1016799192cyclictest12850irq/42-ahci21:25:262
1016799192cyclictest0-21swapper/1023:50:372
10118991917cyclictest0-21swapper/021:08:440
10118991917cyclictest0-21swapper/021:08:440
10167991817cyclictest9973-21kworker/10:022:24:512
10167991817cyclictest0-21swapper/1023:25:022
10167991817cyclictest0-21swapper/1023:22:452
10167991817cyclictest0-21swapper/1019:41:112
10167991817cyclictest0-21swapper/1000:32:262
10167991816cyclictest31899-21ssh00:15:522
10167991816cyclictest25095-21munin-node00:10:252
10167991816cyclictest18090-21ssh22:44:462
10167991816cyclictest0-21swapper/1021:50:182
1016799181cyclictest991950irq/54-eth0-tx-23:44:072
1016799181cyclictest991950irq/54-eth0-tx-22:26:112
1016799181cyclictest991950irq/54-eth0-tx-22:09:532
1016799181cyclictest991950irq/54-eth0-tx-22:01:362
1016799181cyclictest991950irq/54-eth0-tx-00:20:132
1016799181cyclictest991950irq/54-eth0-tx-00:20:132
1016799181cyclictest991850irq/53-eth0-rx-23:31:422
1016799181cyclictest991850irq/53-eth0-rx-23:01:482
1016799181cyclictest991850irq/53-eth0-rx-22:56:572
1016799181cyclictest991850irq/53-eth0-rx-22:46:012
1016799181cyclictest991850irq/53-eth0-rx-22:11:312
1016799181cyclictest991850irq/53-eth0-rx-21:58:212
1016799181cyclictest991850irq/53-eth0-rx-21:47:052
1016799181cyclictest991850irq/53-eth0-rx-21:20:362
1016799181cyclictest991850irq/53-eth0-rx-21:15:212
1016799181cyclictest991850irq/53-eth0-rx-20:55:232
1016799181cyclictest991850irq/53-eth0-rx-20:32:562
1016799181cyclictest991850irq/53-eth0-rx-00:02:362
1016799181cyclictest12850irq/42-ahci19:46:062
1016799181cyclictest10512sleep1020:20:472
10143991816cyclictest2308-21snmpd22:46:514
10118991816cyclictest14539-21kworker/0:221:14:380
10168991715cyclictest22146-21chrt19:22:413
1016899170cyclictest0-21swapper/1119:11:033
10167991716cyclictest0-21swapper/1019:31:362
1016799171cyclictest991850irq/53-eth0-rx-19:15:112
1016799170cyclictest991850irq/53-eth0-rx-23:45:042
1016799170cyclictest991850irq/53-eth0-rx-23:15:242
1016799170cyclictest991850irq/53-eth0-rx-23:10:462
1016799170cyclictest991850irq/53-eth0-rx-23:05:232
1016799170cyclictest991850irq/53-eth0-rx-22:35:572
1016799170cyclictest991850irq/53-eth0-rx-21:35:022
1016799170cyclictest991850irq/53-eth0-rx-21:30:082
1016799170cyclictest991850irq/53-eth0-rx-21:10:302
1016799170cyclictest991850irq/53-eth0-rx-20:40:162
1016799170cyclictest991850irq/53-eth0-rx-20:11:012
1016799170cyclictest991850irq/53-eth0-rx-20:05:052
1016799170cyclictest991850irq/53-eth0-rx-19:56:022
1016799170cyclictest991850irq/53-eth0-rx-19:12:362
1016799170cyclictest991850irq/53-eth0-rx-00:36:312
1016799170cyclictest87162chrt19:50:072
1016799170cyclictest831ksoftirqd/1023:55:192
1016799170cyclictest75892sleep1021:40:202
1016799170cyclictest75892sleep1021:40:202
1016799170cyclictest5712sleep1019:37:052
1016799170cyclictest50872sleep1020:29:362
1016799170cyclictest306092sleep1021:03:502
1016799170cyclictest270552sleep1020:15:092
1016799170cyclictest233092sleep1020:54:142
1016799170cyclictest219712sleep1019:20:282
1016799170cyclictest188922sleep1020:01:082
1016799170cyclictest15642chrt21:05:382
1016799170cyclictest15642chrt21:05:382
1016799170cyclictest12850irq/42-ahci22:15:132
1016799170cyclictest12850irq/42-ahci20:46:132
1016799170cyclictest12850irq/42-ahci19:25:252
1016799170cyclictest123762sleep1020:39:232
1015699173cyclictest0-21swapper/622:20:018
10156991715cyclictest24420-21python23:15:228
10155991715cyclictest9870-21qemu-kvm19:30:397
1015499171cyclictest0-21swapper/400:05:146
10143991715cyclictest2308-21snmpd23:14:374
10143991715cyclictest2308-21snmpd22:21:214
10118991716cyclictest14539-21kworker/0:221:22:320
14050160irq/18-ehci_hcd0-21swapper/022:11:090
10166991615cyclictest27352-21entropy19:30:1311
10166991615cyclictest14555-21latency22:40:1811
1015899165cyclictest0-21swapper/721:13:329
1015899164cyclictest0-21swapper/700:15:029
10156991614cyclictest824-21snmp_rack3slot921:35:138
10155991615cyclictest9076-21ssh23:03:547
10155991615cyclictest27874-21ssh21:57:307
10155991615cyclictest15145-21ssh00:03:047
1015599161cyclictest0-21swapper/523:45:207
1015599160cyclictest0-21swapper/523:14:437
1015599160cyclictest0-21swapper/522:35:177
1015499161cyclictest0-21swapper/422:22:436
1015499160cyclictest0-21swapper/420:35:166
1013199161cyclictest0-21swapper/122:48:361
1013199161cyclictest0-21swapper/122:23:041
10118991610cyclictest0-21swapper/023:45:170
1011899161cyclictest0-21swapper/022:48:350
1011899161cyclictest0-21swapper/022:22:440
1011899160cyclictest0-21swapper/023:44:180
1011899160cyclictest0-21swapper/000:20:230
1011899160cyclictest0-21swapper/000:20:230
991850150irq/53-eth0-rx-0-21swapper/923:09:4711
5299150watchdog/60-21swapper/623:32:238
14050150irq/18-ehci_hcd0-21swapper/019:15:340
10166991514cyclictest6187-21fschecks_time19:45:1411
10166991514cyclictest3412-21netstat19:40:1911
10166991514cyclictest27465-21cpuspeed_turbos20:15:1311
10166991514cyclictest24425-21sh22:20:3711
10166991514cyclictest23729-21fschecks_count19:25:1411
10166991514cyclictest10940-21sh22:37:3811
1015899155cyclictest0-21swapper/723:05:019
1015899154cyclictest0-21swapper/723:40:019
1015899154cyclictest0-21swapper/723:25:009
1015899153cyclictest0-21swapper/720:40:009
10155991514cyclictest12226-21ssh00:27:107
1015599150cyclictest0-21swapper/523:25:317
1015599150cyclictest0-21swapper/523:20:017
1015599150cyclictest0-21swapper/522:13:097
1015499150cyclictest0-21swapper/423:46:096
1015499150cyclictest0-21swapper/423:43:116
1015499150cyclictest0-21swapper/423:25:486
1015499150cyclictest0-21swapper/423:14:356
1015499150cyclictest0-21swapper/422:30:036
1015499150cyclictest0-21swapper/422:25:216
10143991513cyclictest2308-21snmpd19:25:504
1014399150cyclictest0-21swapper/223:45:224
1014399150cyclictest0-21swapper/223:40:194
1014399150cyclictest0-21swapper/222:35:154
1013199150cyclictest0-21swapper/123:45:161
1013199150cyclictest0-21swapper/123:25:271
1013199150cyclictest0-21swapper/123:18:391
1013199150cyclictest0-21swapper/123:14:201
1013199150cyclictest0-21swapper/122:25:131
1013199150cyclictest0-21swapper/122:15:241
1013199150cyclictest0-21swapper/122:13:101
1013199150cyclictest0-21swapper/121:51:201
1011899150cyclictest0-21swapper/023:20:210
1011899150cyclictest0-21swapper/023:18:390
1011899150cyclictest0-21swapper/023:13:560
1011899150cyclictest0-21swapper/022:36:330
1011899150cyclictest0-21swapper/021:55:220
1011899150cyclictest0-21swapper/021:00:260
2499140watchdog/20-21swapper/200:09:344
14050140irq/18-ehci_hcd0-21swapper/021:30:220
1016899144cyclictest0-21swapper/1123:55:013
10168991413cyclictest28185-21kworker/11:221:19:293
10168991412cyclictest280982sleep1119:30:173
10168991412cyclictest13570-21chrt22:12:363
1015899145cyclictest0-21swapper/721:33:329
1015899144cyclictest0-21swapper/722:00:019
1015899144cyclictest0-21swapper/719:15:019
1015899144cyclictest0-21swapper/700:10:019
1015899143cyclictest0-21swapper/722:35:019
1015899143cyclictest0-21swapper/720:29:329
1015699145cyclictest0-21swapper/622:25:328
10156991412cyclictest29739-21python21:00:228
10155991413cyclictest21235-21ssh21:51:137
1014399141cyclictest0-21swapper/220:50:014
10118991413cyclictest559-21md0_raid120:19:160
10118991413cyclictest12850irq/42-ahci20:28:030
10118991410cyclictest991850irq/53-eth0-rx-21:28:410
991950130irq/54-eth0-tx-0-21swapper/021:16:250
3899130watchdog/40-21swapper/420:27:186
1799130watchdog/10-21swapper/119:11:221
15050130irq/18-uhci_hcd32115-21ssh22:00:240
15050130irq/18-uhci_hcd0-21swapper/023:00:230
15050130irq/18-uhci_hcd0-21swapper/022:40:220
1016899134cyclictest0-21swapper/1121:50:013
1016899133cyclictest0-21swapper/1100:30:013
1016599139cyclictest0-21swapper/800:35:4310
1016599134cyclictest0-21swapper/823:30:1810
1016599134cyclictest0-21swapper/822:25:0010
1016599134cyclictest0-21swapper/821:45:0110
1016599133cyclictest0-21swapper/821:55:0210
1015899133cyclictest0-21swapper/719:25:329
1015899133cyclictest0-21swapper/700:35:019
1015899133cyclictest0-21swapper/700:25:019
1015899133cyclictest0-21swapper/700:25:019
1015899131cyclictest0-21swapper/722:55:179
1015699134cyclictest0-21swapper/619:13:328
1015699133cyclictest0-21swapper/621:50:028
1015699133cyclictest0-21swapper/600:18:468
10155991312cyclictest21481-21ssh00:08:457
10155991311cyclictest22739-21qemu-kvm20:10:137
1013199133cyclictest0-21swapper/100:25:181
1011899139cyclictest0-21swapper/022:08:270
10118991311cyclictest21999-21chrt19:20:410
1011899130cyclictest0-21swapper/000:27:140
991950120irq/54-eth0-tx-0-21swapper/921:23:3111
991950120irq/54-eth0-tx-0-21swapper/1121:38:593
991950120irq/54-eth0-tx-0-21swapper/023:05:590
991950120irq/54-eth0-tx-0-21swapper/021:41:120
991950120irq/54-eth0-tx-0-21swapper/021:41:110
991950120irq/54-eth0-tx-0-21swapper/000:34:050
991850120irq/53-eth0-rx-8045-21snmp_rack3slot923:56:010
991850120irq/53-eth0-rx-0-21swapper/000:16:470
3199120watchdog/30-21swapper/319:18:425
15050120irq/18-uhci_hcd0-21swapper/019:45:230
14050120irq/18-ehci_hcd0-21swapper/021:46:030
1016899124cyclictest0-21swapper/1121:45:013
1016899124cyclictest0-21swapper/1121:45:013
1016899123cyclictest0-21swapper/1122:50:003
1016899122cyclictest0-21swapper/1122:05:013
10168991211cyclictest252582sleep1122:22:133
10168991211cyclictest12850irq/42-ahci21:12:383
10168991210cyclictest19007-21chrt21:23:183
1016599129cyclictest0-21swapper/819:53:3210
1016599124cyclictest0-21swapper/820:09:3210
1016599123cyclictest0-21swapper/822:09:3210
1016599122cyclictest0-21swapper/819:47:3210
1015899124cyclictest0-21swapper/722:14:459
10158991210cyclictest22327-21latency_hist00:10:019
1015699126cyclictest22739-21qemu-kvm20:36:158
1015699124cyclictest0-21swapper/621:19:328
1015699124cyclictest0-21swapper/600:00:018
1015699123cyclictest0-21swapper/622:45:008
1015699123cyclictest0-21swapper/619:50:028
1015699123cyclictest0-21swapper/619:35:018
1015699121cyclictest0-21swapper/623:20:028
1015699120cyclictest0-21swapper/620:55:018
10155991210cyclictest10487-21ssh23:30:427
10154991210cyclictest0-21swapper/420:20:186
10151991211cyclictest1966-21diskmemload23:59:045
10151991211cyclictest11862-21latency_hist19:55:005
1014399122cyclictest0-21swapper/220:35:164
1011899122cyclictest0-21swapper/020:35:170
10118991211cyclictest12850irq/42-ahci20:20:010
10118991210cyclictest0-21swapper/000:36:360
1011899120cyclictest0-21swapper/019:55:230
1011899120cyclictest0-21swapper/019:12:050
991950110irq/54-eth0-tx-0-21swapper/922:15:2411
991950110irq/54-eth0-tx-0-21swapper/021:37:370
991950110irq/54-eth0-tx-0-21swapper/000:00:160
991850110irq/53-eth0-rx-0-21swapper/221:16:274
761110ksoftirqd/90-21swapper/922:45:1911
761110ksoftirqd/90-21swapper/921:49:0511
761110ksoftirqd/90-21swapper/921:30:5611
7599110migration/928959-21sh22:52:5511
7599110migration/92857-21hwlatdetect23:25:1611
7599110migration/927821-21cpuspeed_turbos21:00:1211
7599110migration/921774-21latency_hist23:15:0011
691110ksoftirqd/80-21swapper/821:35:1910
6899110migration/825065-21cpuspeed_turbos22:50:1310
621110ksoftirqd/70-21swapper/722:45:209
621110ksoftirqd/70-21swapper/721:49:059
551110ksoftirqd/68225-21snmp_rack3slot922:35:168
551110ksoftirqd/622739-21qemu-kvm20:28:408
551110ksoftirqd/60-21swapper/622:45:198
551110ksoftirqd/60-21swapper/621:57:218
551110ksoftirqd/60-21swapper/600:25:158
481110ksoftirqd/57858-21qemu-kvm22:22:047
481110ksoftirqd/522740-21qemu-kvm20:28:407
481110ksoftirqd/50-21swapper/522:45:197
481110ksoftirqd/50-21swapper/521:35:197
481110ksoftirqd/50-21swapper/521:30:567
411110ksoftirqd/41966-21diskmemload22:35:166
411110ksoftirqd/40-21swapper/423:56:486
411110ksoftirqd/40-21swapper/400:30:586
341110ksoftirqd/30-21swapper/322:45:195
341110ksoftirqd/30-21swapper/322:22:045
31110ksoftirqd/00-21swapper/019:30:380
271110ksoftirqd/20-21swapper/221:35:194
271110ksoftirqd/20-21swapper/200:21:064
271110ksoftirqd/20-21swapper/200:21:064
201110ksoftirqd/11966-21diskmemload21:11:491
201110ksoftirqd/10-21swapper/121:49:051
1699110watchdog/00-21swapper/020:01:460
15050110irq/18-uhci_hcd0-21swapper/022:31:120
15050110irq/18-uhci_hcd0-21swapper/019:40:390
1016899119cyclictest184642sleep1119:17:153
1016899119cyclictest0-21swapper/1121:30:423
1016899115cyclictest49702chrt20:28:003
1016899113cyclictest0-21swapper/1121:04:203
1016899113cyclictest0-21swapper/1120:46:143
10168991110cyclictest258842sleep1119:28:543
1016899110cyclictest0-21swapper/1122:08:333
1016699110cyclictest0-21swapper/922:25:1711
1016599114cyclictest0-21swapper/823:10:0110
1016599113cyclictest0-21swapper/823:52:3810
1016599113cyclictest0-21swapper/823:28:4310
1016599113cyclictest0-21swapper/821:05:3210
1016599113cyclictest0-21swapper/821:05:3210
1016599113cyclictest0-21swapper/819:12:5110
1016599113cyclictest0-21swapper/800:09:0810
1016599113cyclictest0-21swapper/800:02:0710
1016599112cyclictest0-21swapper/823:01:3310
1016599112cyclictest0-21swapper/800:23:3210
1016599112cyclictest0-21swapper/800:23:3210
1016599111cyclictest0-21swapper/822:40:0110
1015899113cyclictest0-21swapper/723:10:379
1015899113cyclictest0-21swapper/721:53:459
1015899113cyclictest0-21swapper/721:29:329
1015899113cyclictest0-21swapper/721:22:519
1015899113cyclictest0-21swapper/720:24:159
1015899113cyclictest0-21swapper/719:58:059
1015899112cyclictest0-21swapper/722:30:009
1015899111cyclictest0-21swapper/719:23:149
1015699113cyclictest0-21swapper/622:10:018
1015699113cyclictest0-21swapper/621:00:008
1015699113cyclictest0-21swapper/620:17:458
1015699113cyclictest0-21swapper/620:05:008
10156991110cyclictest7857-21qemu-kvm22:17:268
10156991110cyclictest16676-21python00:30:268
1015699110cyclictest0-21swapper/621:35:008
1015599119cyclictest0-21swapper/521:45:177
1015599113cyclictest0-21swapper/523:50:167
10155991110cyclictest26002-21ssh00:11:047
1015499113cyclictest0-21swapper/423:20:156
10151991110cyclictest754-21latency_hist23:25:005
10151991110cyclictest29039-21timerandwakeup21:30:265
10151991110cyclictest1966-21diskmemload21:58:015
10151991110cyclictest1966-21diskmemload00:28:485
10151991110cyclictest1966-21diskmemload00:16:515
1014399119cyclictest0-21swapper/219:55:154
1014399114cyclictest0-21swapper/221:10:194
1014399110cyclictest0-21swapper/222:40:204
1013199113cyclictest0-21swapper/123:32:471
1013199113cyclictest0-21swapper/123:20:151
1013199113cyclictest0-21swapper/121:35:161
1013199113cyclictest0-21swapper/120:45:171
1011899118cyclictest0-21swapper/000:05:230
1011899113cyclictest0-21swapper/022:50:180
1011899113cyclictest0-21swapper/020:55:170
1011899113cyclictest0-21swapper/020:10:240
1011899110cyclictest0-21swapper/023:33:530
1011899110cyclictest0-21swapper/022:18:040
1011899110cyclictest0-21swapper/021:50:200
1011899110cyclictest0-21swapper/020:45:520
1011899110cyclictest0-21swapper/020:05:420
991950100irq/54-eth0-tx-0-21swapper/822:00:3510
991950100irq/54-eth0-tx-0-21swapper/821:42:0610
991950100irq/54-eth0-tx-0-21swapper/821:42:0610
991950100irq/54-eth0-tx-0-21swapper/623:10:288
991950100irq/54-eth0-tx-0-21swapper/422:04:196
991950100irq/54-eth0-tx-0-21swapper/322:55:055
991950100irq/54-eth0-tx-0-21swapper/223:25:414
991950100irq/54-eth0-tx-0-21swapper/1123:31:213
991850100irq/53-eth0-rx-0-21swapper/822:18:1710
991850100irq/53-eth0-rx-0-21swapper/623:26:318
991850100irq/53-eth0-rx-0-21swapper/622:59:028
991850100irq/53-eth0-rx-0-21swapper/600:20:338
991850100irq/53-eth0-rx-0-21swapper/600:20:328
991850100irq/53-eth0-rx-0-21swapper/422:52:506
991850100irq/53-eth0-rx-0-21swapper/421:45:216
991850100irq/53-eth0-rx-0-21swapper/323:10:135
991850100irq/53-eth0-rx-0-21swapper/223:58:574
991850100irq/53-eth0-rx-0-21swapper/222:30:204
991850100irq/53-eth0-rx-0-21swapper/222:19:004
991850100irq/53-eth0-rx-0-21swapper/1122:54:433
991850100irq/53-eth0-rx-0-21swapper/121:59:301
991850100irq/53-eth0-rx-0-21swapper/022:55:420
901100ksoftirqd/110-21swapper/1123:56:483
901100ksoftirqd/110-21swapper/1123:11:373
901100ksoftirqd/110-21swapper/1123:06:363
901100ksoftirqd/110-21swapper/1122:41:393
901100ksoftirqd/110-21swapper/1122:33:363
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional