You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-15 - 05:33
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3.osadl.org (updated Mon Sep 15, 2025 00:46:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8954210895sleep40-21swapper/419:07:356
8038210893sleep20-21swapper/219:05:454
7410210793sleep10-21swapper/119:05:321
915929588sleep80-21swapper/819:09:3910
3066350940irq/52-eth0-rx-0-21swapper/1119:05:413
3066350910irq/52-eth0-rx-0-21swapper/519:05:507
12250890irq/42-ahci0-21swapper/319:09:595
907428785sleep90-21swapper/919:08:2811
905727570sleep100-21swapper/1019:08:172
886427566sleep70-21swapper/719:06:269
884026553sleep00-21swapper/019:06:070
601926553sleep60-21swapper/619:05:138
9334993316cyclictest811rcuc/1019:43:202
9308993029cyclictest3066350irq/52-eth0-rx-20:16:001
9331992625cyclictest3066350irq/52-eth0-rx-20:15:589
9297992625cyclictest0-21swapper/020:15:580
929799238cyclictest120652chrt19:11:420
933499181cyclictest831ksoftirqd/1019:21:012
933499181cyclictest221172chrt22:53:052
933399181cyclictest29402-21sensors00:30:2611
9332991816cyclictest740-21users23:50:3210
9332991816cyclictest4196-21snmp_rack3slot923:11:1410
9332991816cyclictest3222-21yum21:40:4110
9332991816cyclictest30003-21snmp_rack3slot920:25:3010
9332991816cyclictest27048-21snmp_rack3slot922:15:1410
9332991816cyclictest26242-21snmp_easybox.os20:20:1610
9332991816cyclictest24003-21perl22:55:1510
9332991816cyclictest23239-21snmp_rack3slot922:10:1810
9332991816cyclictest22095-21snmp_rack3slot921:25:1410
9332991816cyclictest20473-21snmp_rack3slot920:10:1810
9332991816cyclictest18824-21snmp_rack3slot923:32:1410
9332991816cyclictest10201-21irqstats19:55:3110
933199183cyclictest0-21swapper/720:09:589
933599170cyclictest22005-21chrt19:27:203
9334991716cyclictest1225-1kworker/10:1H21:40:502
933499170cyclictest90282sleep1020:56:042
933499170cyclictest82622sleep1000:01:372
933499170cyclictest79992sleep1023:18:322
933499170cyclictest78182chrt19:51:572
933499170cyclictest76672sleep1022:34:532
933499170cyclictest68652chrt21:45:472
933499170cyclictest46072sleep1023:56:492
933499170cyclictest4392chrt23:06:072
933499170cyclictest41262sleep1019:46:202
933499170cyclictest39412sleep1022:28:382
933499170cyclictest35592sleep1020:50:052
933499170cyclictest324532chrt22:20:502
933499170cyclictest321922sleep1020:35:022
933499170cyclictest320582chrt21:37:202
933499170cyclictest314052sleep1020:31:142
933499170cyclictest302382chrt20:28:372
933499170cyclictest300442chrt00:31:162
933499170cyclictest295892sleep1023:45:352
933499170cyclictest287942sleep1022:15:382
933499170cyclictest283262chrt21:30:562
933499170cyclictest276722sleep1020:20:492
933499170cyclictest263862sleep1000:25:522
933499170cyclictest259632sleep1023:40:352
933499170cyclictest256922sleep1022:57:172
933499170cyclictest254022sleep1022:14:012
933499170cyclictest247322sleep1021:26:322
933499170cyclictest229622sleep1000:23:402
933499170cyclictest227262sleep1019:30:072
933499170cyclictest224832sleep1020:11:592
933499170cyclictest223732chrt23:36:102
933499170cyclictest219062sleep1019:25:542
933499170cyclictest191232sleep1000:15:502
933499170cyclictest190142sleep1020:09:232
933499170cyclictest189042sleep1023:33:222
933499170cyclictest185062sleep1022:48:292
933499170cyclictest182192chrt21:20:072
933499170cyclictest18162sleep1020:44:512
933499170cyclictest178792sleep1022:01:232
933499170cyclictest176042sleep1021:18:432
933499170cyclictest159652chrt19:16:052
933499170cyclictest157812sleep1021:12:552
933499170cyclictest154722sleep1000:10:392
933499170cyclictest152342chrt20:03:102
933499170cyclictest151352chrt23:26:342
933499170cyclictest144912sleep1021:05:412
933499170cyclictest141812sleep1021:56:112
933499170cyclictest128462sleep1021:01:532
933499170cyclictest12522sleep1000:36:412
933499170cyclictest12522sleep1000:36:412
933499170cyclictest12250irq/42-ahci22:08:372
933499170cyclictest12250irq/42-ahci20:47:312
933499170cyclictest121022sleep1019:12:162
933499170cyclictest118772sleep1000:06:142
933499170cyclictest116772sleep1023:23:562
933499170cyclictest116382sleep1019:59:102
933499170cyclictest110742sleep1022:36:282
9333991715cyclictest4691-21perl20:50:3111
9333991715cyclictest25572-21snmp_easybox.os21:30:1311
933399170cyclictest6937-1kworker/9:0H22:08:5511
933399170cyclictest0-21swapper/900:00:2311
9332991716cyclictest23933-21snmp_rack3slot920:15:1910
9332991716cyclictest14272-21iostat_ios00:10:2110
9332991715cyclictest8829-21iostat_ios20:55:5510
9332991715cyclictest8217-21snmp_rack3slot900:01:0210
9332991715cyclictest604-21diskstats20:35:2510
9332991715cyclictest3522-21memory23:55:2210
9332991715cyclictest30760-21snmp_easybox.os21:35:2410
9332991715cyclictest30367-21snmp_rack3slot922:20:1410
9332991715cyclictest28412-21irqstats23:45:2210
9332991715cyclictest26381-21snmp_rack3slot921:30:1610
9332991715cyclictest24036-21diskstats23:40:1310
9332991715cyclictest22427-21snmp_rack3slot923:36:4910
9332991715cyclictest19071-21munin-run20:10:0010
9332991715cyclictest16482-21snmp_rack3slot900:15:1310
9332991715cyclictest15457-21snmp_easybox.os21:10:1610
9332991715cyclictest13658-21snmp_easybox.os21:05:1510
9332991715cyclictest13134-21diskstats23:25:1510
9332991715cyclictest12495-21snmp_rack3slot921:00:5610
9332991715cyclictest1212-21snmp_rack3slot900:36:1410
9332991715cyclictest1212-21snmp_rack3slot900:36:1410
9330991715cyclictest18921-21qemu-kvm20:20:168
929799170cyclictest0-21swapper/022:08:290
9333991615cyclictest0-21swapper/923:30:2811
9333991615cyclictest0-21swapper/921:08:3911
9332991614cyclictest8979-21df22:35:1410
9332991614cyclictest8488-21df21:50:1510
9332991614cyclictest8488-21df21:50:1510
9332991614cyclictest8045-21munin-run19:55:0010
9332991614cyclictest6588-21snmp_easybox.os22:30:2410
9332991614cyclictest31205-21perl19:40:1910
9332991614cyclictest30075-21snmp_rack3slot900:31:3710
9332991614cyclictest25678-21snmp_easybox.os00:25:2610
9332991614cyclictest23609-21diskstats19:30:2310
9332991614cyclictest19745-21perl22:05:1610
9332991614cyclictest19323-21snmp_rack3slot922:50:1410
9332991614cyclictest17871-21snmp_rack3slot919:20:1310
9332991614cyclictest16233-21perl22:00:1610
933199162cyclictest0-21swapper/723:25:019
9314991614cyclictest2406-21snmpd21:18:584
9314991614cyclictest2406-21snmpd21:08:284
13450160irq/18-ehci_hcd0-21swapper/023:25:300
933599154cyclictest0-21swapper/1119:55:013
933599153cyclictest0-21swapper/1120:38:003
9335991513cyclictest25462-21chrt20:17:253
933499152cyclictest0-21swapper/1023:13:002
933399155cyclictest0-21swapper/922:00:0111
933399155cyclictest0-21swapper/900:25:0111
933399154cyclictest0-21swapper/919:35:0111
9333991514cyclictest0-21swapper/921:50:2911
9333991514cyclictest0-21swapper/921:50:2911
9333991514cyclictest0-21swapper/919:51:3311
9333991513cyclictest32151-21sshd21:38:3811
9333991513cyclictest31434-21chrt20:31:3611
933299154cyclictest0-21swapper/800:05:0110
9332991514cyclictest16262-21df22:45:1310
9332991513cyclictest7829-21snmp_rack3slot923:16:1510
9332991513cyclictest4346-21df20:50:2110
9332991513cyclictest30932-21snmp_easybox.os20:30:1610
9332991513cyclictest2613-21snmp_easybox.os19:45:2510
9332991513cyclictest14123-21snmp_easybox.os19:15:1910
9332991513cyclictest12945-21iostat_ios21:55:2110
9332991513cyclictest10654-21df_inode19:10:2210
933199153cyclictest0-21swapper/722:40:009
933199153cyclictest0-21swapper/721:10:029
9330991513cyclictest18920-21qemu-kvm20:31:288
9323991514cyclictest23463-21cpuspeed_turbos23:40:127
9314991513cyclictest2406-21snmpd19:39:134
931499150cyclictest0-21swapper/222:10:324
931499150cyclictest0-21swapper/221:34:524
9308991514cyclictest3066350irq/52-eth0-rx-19:55:171
9308991514cyclictest3066350irq/52-eth0-rx-19:41:131
9308991514cyclictest3066350irq/52-eth0-rx-00:36:331
9308991514cyclictest3066350irq/52-eth0-rx-00:36:321
9297991514cyclictest301962sleep020:28:030
933499143cyclictest0-21swapper/1020:17:232
933499140cyclictest0-21swapper/1023:50:232
933499140cyclictest0-21swapper/1022:43:332
933499140cyclictest0-21swapper/1021:54:422
933499140cyclictest0-21swapper/1021:54:422
933499140cyclictest0-21swapper/1019:35:592
933399144cyclictest0-21swapper/923:00:0111
933399144cyclictest0-21swapper/922:50:0011
933399144cyclictest0-21swapper/922:45:0011
933399144cyclictest0-21swapper/920:15:0011
9333991413cyclictest6937-1kworker/9:0H22:26:1711
9333991413cyclictest0-21swapper/920:21:1711
933299144cyclictest0-21swapper/819:35:0110
9332991412cyclictest4917-21diskstats21:45:1510
9332991412cyclictest31694-21irqstats23:05:2210
9332991412cyclictest11435-21snmp_rack3slot923:20:3810
933099143cyclictest0-21swapper/621:43:288
9323991413cyclictest3136-21idleruntime23:55:197
932199140cyclictest0-21swapper/422:15:136
931499145cyclictest0-21swapper/223:15:234
931499145cyclictest0-21swapper/221:00:534
931499145cyclictest0-21swapper/220:43:264
931499143cyclictest0-21swapper/223:59:314
931499143cyclictest0-21swapper/223:50:044
931499143cyclictest0-21swapper/223:45:144
931499143cyclictest0-21swapper/223:25:184
931499143cyclictest0-21swapper/223:24:304
931499143cyclictest0-21swapper/222:22:494
931499143cyclictest0-21swapper/220:25:034
931499143cyclictest0-21swapper/220:21:014
931499143cyclictest0-21swapper/200:35:284
931499143cyclictest0-21swapper/200:35:274
931499143cyclictest0-21swapper/200:20:404
931499143cyclictest0-21swapper/200:07:234
931499142cyclictest0-21swapper/221:37:464
9314991412cyclictest2406-21snmpd19:23:134
9308991413cyclictest7575-21python00:00:291
9308991413cyclictest3066350irq/52-eth0-rx-20:34:371
933599134cyclictest0-21swapper/1123:30:193
933599134cyclictest0-21swapper/1121:55:013
933599133cyclictest0-21swapper/1123:56:593
933599133cyclictest0-21swapper/1121:05:323
933599133cyclictest0-21swapper/1121:02:133
933599133cyclictest0-21swapper/1120:46:023
933599133cyclictest0-21swapper/1120:12:183
933599133cyclictest0-21swapper/1100:16:403
933599133cyclictest0-21swapper/1100:08:193
933399133cyclictest0-21swapper/923:50:0011
933399133cyclictest0-21swapper/923:06:0711
933399133cyclictest0-21swapper/921:57:0411
933399133cyclictest0-21swapper/920:10:0011
933399133cyclictest0-21swapper/920:01:3711
933399133cyclictest0-21swapper/920:00:0011
933399133cyclictest0-21swapper/900:05:0111
933399132cyclictest0-21swapper/919:20:0111
9333991312cyclictest0-21swapper/922:30:1811
9333991312cyclictest0-21swapper/919:35:4011
9333991310cyclictest0-21swapper/923:25:2311
933299133cyclictest0-21swapper/820:00:5810
933299133cyclictest0-21swapper/800:24:1410
9332991311cyclictest2475-21snmp_easybox.os20:45:2410
9332991311cyclictest1935-21snmp_rack3slot922:25:1610
9332991311cyclictest16471-21snmp_rack3slot921:15:1710
9332991311cyclictest12711-21diskstats22:40:1610
933099135cyclictest0-21swapper/620:03:378
933099133cyclictest9046-21qemu-kvm19:14:568
933099133cyclictest0-21swapper/622:57:288
933099133cyclictest0-21swapper/621:53:298
933099133cyclictest0-21swapper/621:53:288
933099133cyclictest0-21swapper/619:54:138
933099133cyclictest0-21swapper/600:32:448
9330991312cyclictest18921-21qemu-kvm20:39:258
9330991311cyclictest18920-21qemu-kvm20:08:278
932399133cyclictest0-21swapper/522:45:197
9323991312cyclictest11317-21cstates21:00:217
932099133cyclictest0-21swapper/321:20:015
931499135cyclictest0-21swapper/221:20:294
931499134cyclictest0-21swapper/222:55:204
931499134cyclictest0-21swapper/220:00:254
931499133cyclictest0-21swapper/223:31:194
931499133cyclictest0-21swapper/223:08:254
931499133cyclictest0-21swapper/223:01:314
931499133cyclictest0-21swapper/222:51:124
931499133cyclictest0-21swapper/222:48:514
931499133cyclictest0-21swapper/222:27:024
931499133cyclictest0-21swapper/221:50:214
931499133cyclictest0-21swapper/221:50:214
931499133cyclictest0-21swapper/221:47:394
931499133cyclictest0-21swapper/221:41:294
931499133cyclictest0-21swapper/220:59:494
931499133cyclictest0-21swapper/220:53:034
931499133cyclictest0-21swapper/220:46:574
931499133cyclictest0-21swapper/220:31:274
931499133cyclictest0-21swapper/220:16:064
931499133cyclictest0-21swapper/219:58:254
931499133cyclictest0-21swapper/219:54:454
931499133cyclictest0-21swapper/219:19:044
931499133cyclictest0-21swapper/219:12:134
931499133cyclictest0-21swapper/200:11:544
931499133cyclictest0-21swapper/200:04:494
931499132cyclictest0-21swapper/223:40:194
931499132cyclictest0-21swapper/222:07:234
931499132cyclictest0-21swapper/221:25:234
931499130cyclictest0-21swapper/221:11:554
931499130cyclictest0-21swapper/200:27:174
929799130cyclictest0-21swapper/023:05:270
929799130cyclictest0-21swapper/022:50:290
929799130cyclictest0-21swapper/022:45:260
929799130cyclictest0-21swapper/019:31:060
5999130watchdog/70-21swapper/721:26:239
933599124cyclictest0-21swapper/1100:30:013
933599122cyclictest0-21swapper/1123:25:443
933599122cyclictest0-21swapper/1123:02:143
933599122cyclictest0-21swapper/1122:07:383
933599122cyclictest0-21swapper/1121:37:123
933599122cyclictest0-21swapper/1121:30:033
933599122cyclictest0-21swapper/1120:26:073
933599122cyclictest0-21swapper/1100:10:403
9335991211cyclictest3999-21taskset22:29:273
9335991210cyclictest118612chrt19:11:173
933499122cyclictest0-21swapper/1023:01:142
933399124cyclictest0-21swapper/920:35:0011
933399123cyclictest0-21swapper/922:40:0111
933399123cyclictest0-21swapper/922:40:0011
933399123cyclictest0-21swapper/921:45:2411
933399122cyclictest0-21swapper/922:58:1411
933399122cyclictest0-21swapper/921:20:0311
933199124cyclictest0-21swapper/721:20:019
933199122cyclictest0-21swapper/722:29:289
933199122cyclictest0-21swapper/722:24:289
933199122cyclictest0-21swapper/721:14:339
933099123cyclictest0-21swapper/623:18:148
933099123cyclictest0-21swapper/620:30:008
933099123cyclictest0-21swapper/619:50:018
933099122cyclictest0-21swapper/623:09:148
933099122cyclictest0-21swapper/622:21:138
9330991211cyclictest18921-21qemu-kvm20:41:228
9330991210cyclictest18921-21qemu-kvm20:10:598
932399122cyclictest0-21swapper/521:50:217
932399122cyclictest0-21swapper/521:50:217
932399122cyclictest0-21swapper/519:40:237
932199129cyclictest0-21swapper/421:44:196
932099120cyclictest0-21swapper/321:47:255
931499125cyclictest0-21swapper/219:40:114
931499123cyclictest0-21swapper/223:10:054
931499123cyclictest0-21swapper/222:43:074
931499123cyclictest0-21swapper/222:37:414
931499123cyclictest0-21swapper/222:16:294
931499123cyclictest0-21swapper/222:00:324
931499123cyclictest0-21swapper/221:56:464
931499123cyclictest0-21swapper/220:35:524
931499123cyclictest0-21swapper/220:10:224
931499123cyclictest0-21swapper/220:05:274
931499123cyclictest0-21swapper/219:45:484
931499123cyclictest0-21swapper/219:31:074
931499123cyclictest0-21swapper/200:30:374
931499123cyclictest0-21swapper/200:15:464
931499122cyclictest0-21swapper/222:30:104
931499121cyclictest0-21swapper/223:35:014
930899123cyclictest0-21swapper/123:35:181
930899123cyclictest0-21swapper/100:10:001
930899122cyclictest0-21swapper/122:15:171
930899122cyclictest0-21swapper/119:30:371
930899120cyclictest0-21swapper/119:15:201
929799124cyclictest0-21swapper/021:25:200
4599120watchdog/50-21swapper/523:50:467
933599115cyclictest0-21swapper/1123:35:443
933599115cyclictest0-21swapper/1122:34:363
933599113cyclictest0-21swapper/1123:52:493
933599113cyclictest0-21swapper/1123:42:083
933599113cyclictest0-21swapper/1123:16:533
933599113cyclictest0-21swapper/1122:46:363
933599113cyclictest0-21swapper/1122:41:183
933599113cyclictest0-21swapper/1122:12:333
933599113cyclictest0-21swapper/1121:45:483
933599113cyclictest0-21swapper/1121:20:333
933599113cyclictest0-21swapper/1121:16:043
933599113cyclictest0-21swapper/1120:59:473
933599113cyclictest0-21swapper/1120:53:233
933599113cyclictest0-21swapper/1120:32:293
933599113cyclictest0-21swapper/1120:22:533
933599113cyclictest0-21swapper/1120:09:573
933599113cyclictest0-21swapper/1120:02:583
933599113cyclictest0-21swapper/1119:48:283
933599113cyclictest0-21swapper/1100:25:443
933599112cyclictest0-21swapper/1123:23:433
933599112cyclictest0-21swapper/1119:34:133
933599110cyclictest0-21swapper/1121:50:233
933599110cyclictest0-21swapper/1121:50:233
933399113cyclictest0-21swapper/922:15:2911
933399113cyclictest0-21swapper/921:29:3711
933399113cyclictest0-21swapper/920:44:0311
933399113cyclictest0-21swapper/919:45:4311
933399113cyclictest0-21swapper/900:14:2811
9333991110cyclictest0-21swapper/923:20:1911
933399111cyclictest0-21swapper/920:27:2911
933299113cyclictest0-21swapper/823:02:4410
933199114cyclictest0-21swapper/719:20:589
933199113cyclictest0-21swapper/723:26:259
933199113cyclictest0-21swapper/722:35:019
933199113cyclictest0-21swapper/722:12:369
933199113cyclictest0-21swapper/722:07:359
933199113cyclictest0-21swapper/722:01:339
933199113cyclictest0-21swapper/721:41:339
933199113cyclictest0-21swapper/721:24:299
933199113cyclictest0-21swapper/720:23:189
933199113cyclictest0-21swapper/719:25:299
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional