You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-10 - 02:46
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3.osadl.org (updated Wed Dec 10, 2025 00:46:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
122501220irq/42-ahci0-21swapper/319:08:235
23331210794sleep80-21swapper/819:06:5810
122501010irq/42-ahci0-21swapper/219:08:524
3066350960irq/52-eth0-rx-0-21swapper/419:06:096
2360229287sleep70-21swapper/719:09:589
12250900irq/42-ahci0-21swapper/119:05:101
3066350880irq/52-eth0-rx-0-21swapper/519:05:257
2044728274sleep100-21swapper/1019:05:112
23709996950cyclictest0-21swapper/022:10:270
2327526753sleep00-21swapper/019:06:140
2337326353sleep60-21swapper/619:07:338
2347826253sleep110-21swapper/1119:08:133
2328526253sleep90-21swapper/919:06:2311
2370999480cyclictest0-21swapper/022:09:570
2370999440cyclictest0-21swapper/022:16:280
23709992918cyclictest0-21swapper/000:30:000
23709992914cyclictest0-21swapper/020:11:440
2370999290cyclictest27484-21munin-node19:20:370
23709992816cyclictest0-21swapper/000:30:010
23758992714cyclictest0-21swapper/1120:11:493
23758992711cyclictest0-21swapper/1122:15:543
2375899260cyclictest0-21swapper/1122:10:323
23746992216cyclictest12249-21awk21:50:008
23757991817cyclictest12920-21kworker/10:221:15:022
2375799181cyclictest3066450irq/53-eth0-tx-21:16:192
2375799181cyclictest3066350irq/52-eth0-rx-22:45:002
2375799181cyclictest3066350irq/52-eth0-rx-21:35:552
2375799181cyclictest3066350irq/52-eth0-rx-20:05:202
2375799181cyclictest3066350irq/52-eth0-rx-19:40:202
2375799181cyclictest3066350irq/52-eth0-rx-19:14:212
2375799181cyclictest3066350irq/52-eth0-rx-00:09:172
2375799181cyclictest12250irq/42-ahci22:08:272
2375799181cyclictest12250irq/42-ahci22:04:442
2375099181cyclictest761ksoftirqd/923:10:3311
2375099181cyclictest761ksoftirqd/922:20:3211
2375099181cyclictest761ksoftirqd/921:45:1611
2375099181cyclictest761ksoftirqd/921:25:3311
2375099181cyclictest761ksoftirqd/920:15:0011
2375099181cyclictest761ksoftirqd/919:20:1211
2375099181cyclictest3523-21munin-node20:50:3011
2375099181cyclictest30298-21munin-node23:40:2611
2375099181cyclictest30298-21munin-node23:40:2511
2375099181cyclictest0-21swapper/923:53:5411
2375099181cyclictest0-21swapper/923:29:0411
2375099181cyclictest0-21swapper/923:29:0311
2375099181cyclictest0-21swapper/923:18:1411
2375099181cyclictest0-21swapper/923:18:1411
2375099181cyclictest0-21swapper/923:05:2311
2375099181cyclictest0-21swapper/923:01:0111
2375099181cyclictest0-21swapper/922:00:1711
2375099181cyclictest0-21swapper/921:10:3611
2375099181cyclictest0-21swapper/921:05:1611
2375099181cyclictest0-21swapper/920:24:1111
2375099181cyclictest0-21swapper/920:00:1711
2375099181cyclictest0-21swapper/919:39:1111
2375099181cyclictest0-21swapper/900:28:2511
2375099181cyclictest0-21swapper/900:05:1611
23746991816cyclictest15322-21qemu-kvm21:11:018
23743991816cyclictest26756-21qemu-kvm22:08:397
2370999180cyclictest0-21swapper/022:20:020
23757991716cyclictest25575-1kworker/10:2H00:01:492
2375799170cyclictest93422chrt23:12:152
2375799170cyclictest84222sleep1021:42:402
2375799170cyclictest831ksoftirqd/1021:25:242
2375799170cyclictest81882sleep1020:15:072
2375799170cyclictest74012sleep1020:11:182
2375799170cyclictest67922sleep1023:55:082
2375799170cyclictest59952sleep1023:51:182
2375799170cyclictest51232sleep1022:20:332
2375799170cyclictest48922chrt23:05:262
2375799170cyclictest43082chrt20:52:592
2375799170cyclictest32172sleep1019:20:362
2375799170cyclictest3066450irq/53-eth0-tx-21:30:202
2375799170cyclictest3066350irq/52-eth0-rx-23:30:152
2375799170cyclictest3066350irq/52-eth0-rx-23:30:152
2375799170cyclictest3066350irq/52-eth0-rx-23:15:142
2375799170cyclictest3066350irq/52-eth0-rx-23:15:142
2375799170cyclictest3066350irq/52-eth0-rx-21:50:242
2375799170cyclictest3066350irq/52-eth0-rx-21:05:122
2375799170cyclictest3066350irq/52-eth0-rx-20:45:282
2375799170cyclictest3066350irq/52-eth0-rx-20:20:322
2375799170cyclictest3066350irq/52-eth0-rx-19:51:192
2375799170cyclictest3066350irq/52-eth0-rx-19:35:332
2375799170cyclictest3066350irq/52-eth0-rx-19:30:172
2375799170cyclictest306362sleep1022:55:492
2375799170cyclictest296312sleep1023:40:192
2375799170cyclictest296312sleep1023:40:182
2375799170cyclictest295432sleep1020:00:052
2375799170cyclictest286962sleep1019:55:402
2375799170cyclictest280252sleep1020:40:222
2375799170cyclictest279432sleep1019:15:122
2375799170cyclictest274162chrt22:10:072
2375799170cyclictest270352chrt22:51:122
2375799170cyclictest266202sleep1000:20:232
2375799170cyclictest232612sleep1021:20:022
2375799170cyclictest219742sleep1020:31:202
2375799170cyclictest213642sleep1000:15:102
2375799170cyclictest193382sleep1000:10:212
2375799170cyclictest182872sleep1020:25:452
2375799170cyclictest166982sleep1023:23:282
2375799170cyclictest162502sleep1022:38:112
2375799170cyclictest124962sleep1022:31:352
2375799170cyclictest12250irq/42-ahci23:47:522
2375799170cyclictest12250irq/42-ahci23:35:082
2375799170cyclictest12250irq/42-ahci23:28:182
2375799170cyclictest12250irq/42-ahci23:28:172
2375799170cyclictest12250irq/42-ahci23:00:012
2375799170cyclictest12250irq/42-ahci22:45:172
2375799170cyclictest12250irq/42-ahci22:25:302
2375799170cyclictest12250irq/42-ahci22:17:072
2375799170cyclictest12250irq/42-ahci21:55:212
2375799170cyclictest12250irq/42-ahci21:45:322
2375799170cyclictest12250irq/42-ahci20:55:202
2375799170cyclictest12250irq/42-ahci20:55:192
2375799170cyclictest12250irq/42-ahci20:35:342
2375799170cyclictest12250irq/42-ahci20:35:332
2375799170cyclictest12250irq/42-ahci19:45:292
2375799170cyclictest12250irq/42-ahci19:26:192
2375799170cyclictest12250irq/42-ahci00:35:192
2375799170cyclictest12250irq/42-ahci00:30:302
2375799170cyclictest12250irq/42-ahci00:25:012
2375799170cyclictest114072sleep1021:00:352
23750991716cyclictest0-21swapper/919:51:0011
2375099171cyclictest0-21swapper/919:15:3511
2375099170cyclictest761ksoftirqd/922:15:3111
2375099170cyclictest15513-21snmp_rack3slot919:40:1111
2375099170cyclictest12-21rcu_preempt19:49:2211
2375099170cyclictest0-21swapper/923:20:2811
2375099170cyclictest0-21swapper/922:50:3211
2375099170cyclictest0-21swapper/922:48:2011
2375099170cyclictest0-21swapper/922:25:1611
2375099170cyclictest0-21swapper/922:05:2911
2375099170cyclictest0-21swapper/921:37:1511
2375099170cyclictest0-21swapper/921:20:0211
2375099170cyclictest0-21swapper/920:48:1511
2375099170cyclictest0-21swapper/920:40:5611
2375099170cyclictest0-21swapper/920:30:1211
2375099170cyclictest0-21swapper/900:39:2911
2375099170cyclictest0-21swapper/900:33:5211
2375099170cyclictest0-21swapper/900:20:2511
23746991716cyclictest23470-21qemu-kvm19:30:298
23746991715cyclictest27727-21awk23:40:018
23758991614cyclictest226482sleep1121:18:403
23750991615cyclictest0-21swapper/922:59:1611
23750991615cyclictest0-21swapper/922:41:3211
23750991615cyclictest0-21swapper/922:30:2011
23750991615cyclictest0-21swapper/921:53:2411
23750991615cyclictest0-21swapper/921:43:4611
23750991615cyclictest0-21swapper/921:32:1111
23750991615cyclictest0-21swapper/921:15:2011
23750991615cyclictest0-21swapper/921:01:0111
23750991615cyclictest0-21swapper/920:19:2611
23750991615cyclictest0-21swapper/920:05:3011
23750991615cyclictest0-21swapper/919:56:0911
23750991615cyclictest0-21swapper/919:25:2311
23750991615cyclictest0-21swapper/900:17:5911
23750991615cyclictest0-21swapper/900:10:1911
23748991615cyclictest691ksoftirqd/822:17:5910
23746991615cyclictest3892-21qemu-kvm20:08:388
23746991615cyclictest26757-21qemu-kvm22:26:368
23743991615cyclictest26815-21python23:35:297
23743991615cyclictest24074-21missed_timers19:50:247
23743991615cyclictest15651-21cpuspeed20:25:157
23743991615cyclictest13559-21python19:35:317
2374399160cyclictest0-21swapper/500:15:227
2373799160cyclictest0-21swapper/400:15:196
23716991615cyclictest3066350irq/52-eth0-rx-22:15:271
3066350150irq/52-eth0-rx-0-21swapper/000:18:060
23758991514cyclictest15991-21kworker/11:121:13:113
23750991514cyclictest0-21swapper/923:57:1711
23750991514cyclictest0-21swapper/923:47:4811
23750991514cyclictest0-21swapper/923:35:4111
23750991514cyclictest0-21swapper/923:30:4411
23750991514cyclictest0-21swapper/923:30:4411
23750991514cyclictest0-21swapper/922:35:0911
23750991514cyclictest0-21swapper/921:55:1411
23750991514cyclictest0-21swapper/920:56:2311
23750991514cyclictest0-21swapper/920:56:2211
23750991514cyclictest0-21swapper/920:35:1411
23750991514cyclictest0-21swapper/920:35:1311
23750991514cyclictest0-21swapper/919:30:0911
23750991514cyclictest0-21swapper/919:10:1211
23748991514cyclictest10898-21snmp_rack3slot922:30:1710
2374699152cyclictest0-21swapper/621:17:568
23743991514cyclictest17451-21fschecks_time21:55:167
2374399150cyclictest23465-21qemu-kvm19:30:227
2374399150cyclictest0-21swapper/522:40:247
2373799150cyclictest0-21swapper/422:00:316
23716991514cyclictest3066350irq/52-eth0-rx-19:20:231
2371699150cyclictest0-21swapper/119:15:181
2370999150cyclictest0-21swapper/023:05:130
3066350140irq/52-eth0-rx-0-21swapper/422:09:526
2375899145cyclictest0-21swapper/1120:00:003
2375899145cyclictest0-21swapper/1100:35:213
2375899144cyclictest0-21swapper/1122:55:013
2375899143cyclictest0-21swapper/1100:05:013
23758991413cyclictest11769-21turbostat21:09:553
23750991413cyclictest0-21swapper/920:25:0111
23750991413cyclictest0-21swapper/900:00:5111
2375099141cyclictest761ksoftirqd/922:15:0011
2374699144cyclictest0-21swapper/621:10:028
2374699144cyclictest0-21swapper/600:20:028
23743991413cyclictest5912-21turbostat23:10:007
23743991413cyclictest31753-21latency_hist00:30:017
23743991413cyclictest15322-21qemu-kvm21:08:257
2373799143cyclictest0-21swapper/400:35:186
2373799143cyclictest0-21swapper/400:00:026
2373799141cyclictest0-21swapper/420:45:346
2373099146cyclictest0-21swapper/322:07:125
2373099141cyclictest0-21swapper/320:50:195
2373099140cyclictest0-21swapper/322:57:545
2373099140cyclictest0-21swapper/322:53:255
2373099140cyclictest0-21swapper/322:32:425
23725991412cyclictest2406-21snmpd22:30:104
23725991412cyclictest2406-21snmpd22:29:254
23725991412cyclictest2406-21snmpd22:22:114
23725991412cyclictest2406-21snmpd21:28:254
23725991412cyclictest2406-21snmpd20:15:384
23725991412cyclictest2406-21snmpd19:31:384
2370999140cyclictest0-21swapper/021:35:140
2375899134cyclictest0-21swapper/1100:30:013
2375899133cyclictest0-21swapper/1123:45:013
2375899133cyclictest0-21swapper/1120:42:183
2375899133cyclictest0-21swapper/1120:32:183
2375899133cyclictest0-21swapper/1100:23:583
23758991312cyclictest15991-21kworker/11:121:28:053
23758991312cyclictest15991-21kworker/11:119:22:393
23758991311cyclictest18518-21chrt20:28:583
2374899134cyclictest0-21swapper/822:10:2010
2374899131cyclictest0-21swapper/820:38:4910
2374899131cyclictest0-21swapper/820:38:4910
2374799133cyclictest0-21swapper/722:30:009
2374799133cyclictest0-21swapper/719:28:099
2374799133cyclictest0-21swapper/719:22:389
2374799133cyclictest0-21swapper/700:00:169
2374699133cyclictest0-21swapper/619:51:188
2374699131cyclictest0-21swapper/620:17:148
2373799133cyclictest0-21swapper/423:15:186
2373799133cyclictest0-21swapper/423:15:186
2373799133cyclictest0-21swapper/422:40:216
2373799133cyclictest0-21swapper/421:45:206
2373099137cyclictest0-21swapper/323:00:245
2373099136cyclictest0-21swapper/320:36:045
2373099136cyclictest0-21swapper/320:36:045
2373099135cyclictest0-21swapper/322:19:295
2373099131cyclictest0-21swapper/323:36:015
2373099131cyclictest0-21swapper/322:20:115
2373099131cyclictest0-21swapper/322:10:165
2373099131cyclictest0-21swapper/321:15:135
2373099131cyclictest0-21swapper/320:25:235
2373099131cyclictest0-21swapper/319:25:165
2373099131cyclictest0-21swapper/300:00:185
2373099130cyclictest0-21swapper/323:50:475
2373099130cyclictest0-21swapper/323:32:285
2373099130cyclictest0-21swapper/323:32:275
2373099130cyclictest0-21swapper/322:43:385
2373099130cyclictest0-21swapper/321:58:225
2373099130cyclictest0-21swapper/321:47:295
2373099130cyclictest0-21swapper/319:42:055
2371699133cyclictest0-21swapper/119:35:201
2370999134cyclictest0-21swapper/022:30:000
2370999130cyclictest0-21swapper/021:25:290
2370999130cyclictest0-21swapper/000:00:250
124050130irq/18-i801_smb0-21swapper/622:35:308
2375899124cyclictest0-21swapper/1123:05:013
2375899123cyclictest0-21swapper/1122:40:003
2375899122cyclictest0-21swapper/1122:50:353
2375899122cyclictest0-21swapper/1120:47:193
2375899122cyclictest0-21swapper/1119:46:163
2375899121cyclictest0-21swapper/1100:15:203
2374899123cyclictest0-21swapper/823:43:2710
2374899123cyclictest0-21swapper/823:43:2710
2374899123cyclictest0-21swapper/820:56:5010
2374899123cyclictest0-21swapper/820:56:5010
2374899123cyclictest0-21swapper/800:16:2610
2374899122cyclictest0-21swapper/819:21:4610
2374899120cyclictest32256-21idleruntime-cro19:20:0110
2374799124cyclictest0-21swapper/723:40:219
2374799124cyclictest0-21swapper/723:40:209
2374799123cyclictest0-21swapper/700:30:009
2374799122cyclictest0-21swapper/720:20:099
2374799122cyclictest0-21swapper/719:40:099
2374699124cyclictest0-21swapper/622:05:028
2374699123cyclictest0-21swapper/621:30:018
2374699122cyclictest0-21swapper/623:03:268
2374699122cyclictest0-21swapper/622:53:548
23746991211cyclictest23470-21qemu-kvm19:14:228
23737991210cyclictest4058-21sensors21:35:306
2373099126cyclictest0-21swapper/323:15:055
2373099126cyclictest0-21swapper/323:15:045
2373099123cyclictest12736-21fschecks_count20:20:165
2373099121cyclictest0-21swapper/323:55:165
2373099121cyclictest0-21swapper/323:45:145
2373099121cyclictest0-21swapper/323:40:165
2373099121cyclictest0-21swapper/323:40:155
2373099121cyclictest0-21swapper/323:30:025
2373099121cyclictest0-21swapper/323:30:015
2373099121cyclictest0-21swapper/323:20:245
2373099121cyclictest0-21swapper/322:45:015
2373099121cyclictest0-21swapper/322:35:165
2373099121cyclictest0-21swapper/322:25:145
2373099121cyclictest0-21swapper/322:00:485
2373099121cyclictest0-21swapper/321:40:125
2373099121cyclictest0-21swapper/321:35:135
2373099121cyclictest0-21swapper/321:30:125
2373099121cyclictest0-21swapper/321:25:155
2373099121cyclictest0-21swapper/321:20:155
2373099121cyclictest0-21swapper/321:10:145
2373099121cyclictest0-21swapper/321:06:265
2373099121cyclictest0-21swapper/321:00:195
2373099121cyclictest0-21swapper/320:55:155
2373099121cyclictest0-21swapper/320:55:145
2373099121cyclictest0-21swapper/320:45:145
2373099121cyclictest0-21swapper/320:40:135
2373099121cyclictest0-21swapper/320:30:135
2373099121cyclictest0-21swapper/320:15:175
2373099121cyclictest0-21swapper/320:10:155
2373099121cyclictest0-21swapper/320:05:225
2373099121cyclictest0-21swapper/320:00:155
2373099121cyclictest0-21swapper/319:55:365
2373099121cyclictest0-21swapper/319:52:145
2373099121cyclictest0-21swapper/319:45:175
2373099121cyclictest0-21swapper/319:30:145
2373099121cyclictest0-21swapper/319:20:135
2373099121cyclictest0-21swapper/319:15:145
2373099121cyclictest0-21swapper/300:35:145
2373099121cyclictest0-21swapper/300:30:155
2373099121cyclictest0-21swapper/300:25:155
2373099121cyclictest0-21swapper/300:20:225
2373099121cyclictest0-21swapper/300:15:245
2373099121cyclictest0-21swapper/300:10:205
2373099121cyclictest0-21swapper/300:06:055
2373099120cyclictest0-21swapper/323:10:155
2373099120cyclictest0-21swapper/323:05:035
2373099120cyclictest0-21swapper/319:10:185
23725991210cyclictest2406-21snmpd20:03:084
23725991210cyclictest2406-21snmpd00:09:574
2372599121cyclictest0-21swapper/223:55:024
2371699124cyclictest0-21swapper/119:45:201
2370999122cyclictest0-21swapper/000:05:230
2370999121cyclictest0-21swapper/020:00:180
2370999120cyclictest0-21swapper/021:20:290
2370999120cyclictest0-21swapper/020:20:300
14850120irq/18-uhci_hcd0-21swapper/019:40:270
6899110migration/827409-21taskset23:35:5210
6899110migration/81003-21fschecks_time00:30:1610
5999110watchdog/70-21swapper/721:48:429
5499110migration/64807-21munin-node00:35:168
481110ksoftirqd/50-21swapper/519:24:247
411110ksoftirqd/40-21swapper/420:35:146
411110ksoftirqd/40-21swapper/420:35:136
31110ksoftirqd/00-21swapper/020:05:270
2375899119cyclictest0-21swapper/1120:08:193
2375899118cyclictest0-21swapper/1119:55:213
2375899115cyclictest0-21swapper/1122:25:393
2375899113cyclictest0-21swapper/1122:47:263
2375899113cyclictest0-21swapper/1121:40:453
2375899113cyclictest0-21swapper/1120:57:143
2375899113cyclictest0-21swapper/1120:57:143
2375899113cyclictest0-21swapper/1120:15:083
2375899113cyclictest0-21swapper/1119:28:293
2375899112cyclictest0-21swapper/1123:00:213
23758991110cyclictest15991-21kworker/11:122:21:193
2375899110cyclictest0-21swapper/1122:00:203
2374899115cyclictest0-21swapper/800:38:1010
2374899113cyclictest0-21swapper/823:46:5610
2374899113cyclictest0-21swapper/823:15:1610
2374899113cyclictest0-21swapper/823:15:1510
2374899113cyclictest0-21swapper/823:01:4110
2374899113cyclictest0-21swapper/822:56:1010
2374899113cyclictest0-21swapper/822:24:4910
2374899113cyclictest0-21swapper/822:00:4010
2374899113cyclictest0-21swapper/821:50:1010
2374899113cyclictest0-21swapper/821:25:2210
2374899113cyclictest0-21swapper/821:18:3510
2374899113cyclictest0-21swapper/820:51:1410
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional