You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-03 - 07:14
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot2.osadl.org (updated Thu Sep 03, 2026 00:44:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
251052196180,11sleep10-21swapper/119:09:521
249632190173,12sleep30-21swapper/319:08:053
250802185169,12sleep00-21swapper/019:09:340
248452180162,13sleep20-21swapper/219:06:312
270542490,0sleep10-21swapper/119:10:191
308322420,0sleep10-21swapper/122:35:201
288582420,0sleep10-21swapper/121:45:201
26408290,0sleep026411-21cpuspeed22:50:120
22011290,0sleep30-21swapper/323:53:293
253739980,6cyclictest0-21swapper/322:20:113
253339982,3cyclictest9059-21munin-run21:20:010
2142280,0sleep20-21swapper/222:20:562
253339972,5cyclictest28967-21munin-run21:30:010
253339970,6cyclictest61-21kswapd000:35:120
253739960,5cyclictest20556-21apt-get23:20:023
253339960,3cyclictest21499-21diskmemload23:30:010
253339960,3cyclictest1162-21awk19:25:010
7264250,0sleep00-21swapper/022:40:170
253739955,0cyclictest6990-21kworker/3:223:37:013
253739955,0cyclictest6990-21kworker/3:223:03:273
253739955,0cyclictest6990-21kworker/3:221:45:043
253739955,0cyclictest6990-21kworker/3:221:33:533
253739955,0cyclictest6990-21kworker/3:200:21:483
253739955,0cyclictest12921-21ssh00:05:173
253739954,1cyclictest40-21ksoftirqd/323:00:013
253739954,1cyclictest40-21ksoftirqd/320:15:013
253739952,2cyclictest0-21swapper/319:15:113
253739951,2cyclictest0-21swapper/322:50:113
253739950,5cyclictest19352-21ssh22:45:593
253739950,5cyclictest0-21swapper/323:45:473
253739950,5cyclictest0-21swapper/323:06:573
253739950,5cyclictest0-21swapper/322:35:133
253739950,5cyclictest0-21swapper/321:25:233
253739950,4cyclictest6498-21apt-get20:40:113
253739950,0cyclictest0-21swapper/300:25:313
253609955,0cyclictest0-21swapper/223:13:282
253609950,5cyclictest0-21swapper/223:52:182
253609950,5cyclictest0-21swapper/223:25:412
253609950,5cyclictest0-21swapper/222:15:112
253609950,5cyclictest0-21swapper/221:19:062
253609950,4cyclictest31290-21apt-get20:25:092
253499955,0cyclictest0-21swapper/123:48:261
253499950,5cyclictest0-21swapper/121:53:561
253499950,5cyclictest0-21swapper/121:36:541
253499950,5cyclictest0-21swapper/121:11:531
253339952,3cyclictest28075-21kworker/0:123:44:490
253339952,3cyclictest28075-21kworker/0:119:25:170
253339952,2cyclictest28075-21kworker/0:122:12:370
253739944,0cyclictest6990-21kworker/3:223:25:493
253739944,0cyclictest6990-21kworker/3:222:41:043
253739944,0cyclictest6990-21kworker/3:221:22:413
253739944,0cyclictest6990-21kworker/3:219:41:553
253739944,0cyclictest6990-21kworker/3:219:30:423
253739943,1cyclictest16756-21cpuspeed_turbos19:55:133
253739943,1cyclictest15844-21sed20:55:183
253739942,1cyclictest4702-21ssh00:00:333
253739942,1cyclictest22990-21ssh00:10:163
253739942,1cyclictest16864-21ssh21:40:103
253739941,3cyclictest0-21swapper/321:00:113
253739941,2cyclictest0-21swapper/320:30:113
253739941,2cyclictest0-21swapper/320:25:093
253739941,2cyclictest0-21swapper/319:10:123
253739940,4cyclictest800-21ssh00:15:193
253739940,4cyclictest27835-21apt-get23:40:113
253739940,4cyclictest21499-21diskmemload23:55:113
253739940,4cyclictest1066-21ntp_states21:15:213
253739940,4cyclictest0-21swapper/323:15:093
253739940,4cyclictest0-21swapper/323:15:093
253739940,4cyclictest0-21swapper/322:10:053
253739940,4cyclictest0-21swapper/322:07:003
253739940,4cyclictest0-21swapper/321:55:123
253739940,4cyclictest0-21swapper/321:50:153
253739940,4cyclictest0-21swapper/321:35:133
253739940,4cyclictest0-21swapper/321:10:123
253739940,4cyclictest0-21swapper/320:35:113
253739940,4cyclictest0-21swapper/320:20:173
253739940,4cyclictest0-21swapper/320:00:103
253739940,4cyclictest0-21swapper/319:20:123
253739940,4cyclictest0-21swapper/300:35:133
253739940,4cyclictest0-21swapper/300:30:123
253739940,3cyclictest725-21ssh23:10:093
253739940,3cyclictest26677-21grep20:15:123
253739940,3cyclictest21734-21/usr/sbin/munin22:15:103
253739940,3cyclictest18669-21ssh22:30:013
253739940,3cyclictest11323-21latency_hist20:50:003
253739940,3cyclictest11201-21sshd22:25:243
253739940,3cyclictest0-21swapper/322:00:073
253739940,1cyclictest16182-21latency_hist19:55:013
253739940,1cyclictest0-21swapper/320:55:003
253609944,0cyclictest0-21swapper/222:41:442
253609944,0cyclictest0-21swapper/221:26:142
253609943,1cyclictest28529-21grep23:40:132
253609941,2cyclictest0-21swapper/223:05:112
253609940,4cyclictest4519-21apt-get21:50:172
253609940,4cyclictest24009-21users00:10:212
253609940,4cyclictest11334-21ssh00:37:192
253609940,4cyclictest0-21swapper/223:45:112
253609940,4cyclictest0-21swapper/223:30:122
253609940,4cyclictest0-21swapper/223:20:132
253609940,4cyclictest0-21swapper/223:19:402
253609940,4cyclictest0-21swapper/223:19:402
253609940,4cyclictest0-21swapper/222:51:272
253609940,4cyclictest0-21swapper/222:45:122
253609940,4cyclictest0-21swapper/222:30:112
253609940,4cyclictest0-21swapper/222:09:432
253609940,4cyclictest0-21swapper/221:55:122
253609940,4cyclictest0-21swapper/221:35:132
253609940,4cyclictest0-21swapper/221:31:242
253609940,4cyclictest0-21swapper/221:22:442
253609940,4cyclictest0-21swapper/221:10:142
253609940,4cyclictest0-21swapper/220:32:312
253609940,4cyclictest0-21swapper/220:23:562
253609940,4cyclictest0-21swapper/220:15:102
253609940,4cyclictest0-21swapper/219:29:402
253609940,4cyclictest0-21swapper/200:30:122
253609940,4cyclictest0-21swapper/200:25:122
253609940,4cyclictest0-21swapper/200:15:222
253609940,4cyclictest0-21swapper/200:05:302
253609940,4cyclictest0-21swapper/200:00:092
253609940,3cyclictest6199-21ls19:35:022
253609940,3cyclictest28278-21ntp_states21:45:172
253609940,3cyclictest21499-21diskmemload22:55:022
253609940,3cyclictest19794-21diskstats21:05:142
253609940,3cyclictest19012-21date21:05:012
253609940,3cyclictest17972-21ssh23:35:102
253609940,3cyclictest15792-21users19:50:202
253609940,3cyclictest11498-21ssh22:10:022
253609940,3cyclictest0-21swapper/219:15:112
253609940,3cyclictest0-21swapper/219:10:012
253499944,0cyclictest0-21swapper/123:29:401
253499944,0cyclictest0-21swapper/122:32:381
253499944,0cyclictest0-21swapper/121:30:311
253499944,0cyclictest0-21swapper/121:22:391
253499941,2cyclictest0-21swapper/120:25:091
253499941,2cyclictest0-21swapper/100:20:091
253499941,1cyclictest0-21swapper/121:40:121
253499940,4cyclictest0-21swapper/100:15:561
253499940,2cyclictest0-21swapper/121:15:141
253339944,0cyclictest31121-21sendmail-msp19:20:010
253339944,0cyclictest0-21swapper/022:57:190
253339944,0cyclictest0-21swapper/000:01:200
253339943,1cyclictest9020-21/usr/sbin/munin22:25:190
253339943,1cyclictest28075-21kworker/0:120:25:330
253339943,1cyclictest16594-21/usr/sbin/munin21:00:140
253339943,1cyclictest1414-21cut20:30:110
253339942,2cyclictest31844-21aten2_r5power_p00:15:130
253339942,2cyclictest0-21swapper/023:55:110
253339942,2cyclictest0-21swapper/023:23:040
253339941,3cyclictest25385-21kworker/0:019:10:010
253339941,2cyclictest0-21swapper/000:10:130
253339940,4cyclictest7590-21ntp_states19:35:170
253339940,4cyclictest6488-21munin-run21:35:010
253339940,4cyclictest0-21swapper/022:22:290
253339940,4cyclictest0-21swapper/021:56:230
253339940,4cyclictest0-21swapper/021:10:150
253339940,4cyclictest0-21swapper/021:05:010
253339940,4cyclictest0-21swapper/000:25:010
253339940,4cyclictest0-21swapper/000:08:120
253339940,3cyclictest9115-21ssh00:20:090
253339940,3cyclictest7487-21irqstats20:40:150
253339940,3cyclictest4844-21hddtemp_smartct20:35:140
253339940,3cyclictest32111-21sh21:47:220
253339940,3cyclictest30221-21rm00:30:170
253339940,3cyclictest30022-21memory22:35:160
253339940,3cyclictest29336-21df20:20:120
253339940,3cyclictest26374-21users22:00:200
253339940,3cyclictest25212-21rm22:33:020
253339940,3cyclictest22648-21ntp_states20:05:210
253339940,3cyclictest17569-21sh23:01:380
253339940,3cyclictest16602-21pmu-power23:50:180
253339940,3cyclictest16593-21cut21:40:010
253339940,3cyclictest12343-21idleruntime19:45:170
253339940,3cyclictest12038-21ntp_states23:15:150
253339940,3cyclictest12038-21ntp_states23:15:150
253339940,1cyclictest9769-21tr21:20:150
253339940,1cyclictest9585-21ntp_states23:30:170
253339940,1cyclictest5256-21/usr/sbin/munin23:45:110
253339940,1cyclictest23900-21df_inode23:05:120
253339940,1cyclictest23841-21/usr/sbin/munin20:10:170
253339940,1cyclictest18903-21/usr/sbin/munin20:00:200
253339940,0cyclictest0-21swapper/021:42:310
253739930,3cyclictest0-21swapper/323:30:053
253739930,3cyclictest0-21swapper/321:05:003
253739930,3cyclictest0-21swapper/320:05:153
253739930,3cyclictest0-21swapper/319:45:123
253739930,3cyclictest0-21swapper/319:35:053
253739930,3cyclictest0-21swapper/319:25:023
253609931,2cyclictest802-21snmpd23:55:012
253609931,1cyclictest0-21swapper/220:35:122
253609931,1cyclictest0-21swapper/220:10:102
253609930,3cyclictest8925-21sh00:20:032
253609930,3cyclictest31777-21expr19:20:132
253609930,3cyclictest16935-21df19:55:132
253609930,3cyclictest14159-21grep20:55:102
253609930,3cyclictest13450-21apt-get23:00:102
253609930,3cyclictest0-21swapper/222:35:112
253609930,3cyclictest0-21swapper/222:25:102
253609930,3cyclictest0-21swapper/222:00:032
253609930,3cyclictest0-21swapper/220:50:002
253609930,3cyclictest0-21swapper/220:45:102
253609930,3cyclictest0-21swapper/220:40:112
253609930,3cyclictest0-21swapper/220:05:052
253609930,3cyclictest0-21swapper/220:00:122
253609930,3cyclictest0-21swapper/219:45:052
253609930,3cyclictest0-21swapper/219:40:012
253609930,3cyclictest0-21swapper/219:35:112
253609930,2cyclictest16849-21ssh21:40:092
253499932,1cyclictest311742chrt23:58:031
253499931,2cyclictest0-21swapper/122:00:121
253499931,1cyclictest0-21swapper/123:15:101
253499931,1cyclictest0-21swapper/123:15:091
253499931,1cyclictest0-21swapper/123:05:111
253499931,1cyclictest0-21swapper/123:00:101
253499931,1cyclictest0-21swapper/122:50:121
253499931,1cyclictest0-21swapper/122:40:131
253499931,1cyclictest0-21swapper/122:20:111
253499931,1cyclictest0-21swapper/122:10:161
253499931,1cyclictest0-21swapper/120:45:101
253499931,1cyclictest0-21swapper/120:05:161
253499931,1cyclictest0-21swapper/120:00:101
253499931,1cyclictest0-21swapper/119:55:121
253499931,1cyclictest0-21swapper/119:30:111
253499931,1cyclictest0-21swapper/100:35:121
253499931,1cyclictest0-21swapper/100:30:111
253499931,1cyclictest0-21swapper/100:00:091
253499930,3cyclictest0-21swapper/121:08:591
253499930,3cyclictest0-21swapper/120:40:091
253499930,3cyclictest0-21swapper/119:48:121
253499930,2cyclictest407-21taskset23:42:141
253499930,2cyclictest0-21swapper/123:10:161
253499930,2cyclictest0-21swapper/122:45:121
253499930,2cyclictest0-21swapper/122:15:091
253499930,2cyclictest0-21swapper/121:55:131
253499930,2cyclictest0-21swapper/120:55:091
253499930,2cyclictest0-21swapper/120:35:011
253499930,2cyclictest0-21swapper/119:20:121
253499930,2cyclictest0-21swapper/119:15:111
253499930,1cyclictest0-21swapper/123:53:011
253499930,1cyclictest0-21swapper/123:35:121
253339933,0cyclictest28075-21kworker/0:121:50:090
253339932,1cyclictest802-21snmpd19:30:110
253339930,3cyclictest16838-21diskstats22:45:140
253339930,3cyclictest0-21swapper/022:15:100
253339930,3cyclictest0-21swapper/020:55:090
253339930,3cyclictest0-21swapper/020:50:000
253339930,3cyclictest0-21swapper/020:15:120
253339930,3cyclictest0-21swapper/019:55:120
253339930,3cyclictest0-21swapper/019:50:110
253339930,3cyclictest0-21swapper/019:40:010
253339930,2cyclictest8965-21apt20:45:110
253339930,2cyclictest2141-21sort22:05:120
253339930,2cyclictest17760-21sh23:35:020
253339930,1cyclictest647-21ssh23:10:060
253499921,1cyclictest0-21swapper/123:30:071
253499921,1cyclictest0-21swapper/123:20:021
253499921,1cyclictest0-21swapper/120:50:001
253499921,1cyclictest0-21swapper/119:40:011
253499921,1cyclictest0-21swapper/119:35:111
253499921,1cyclictest0-21swapper/100:10:121
253499921,1cyclictest0-21swapper/100:05:151
253499920,1cyclictest19391-21taskset21:25:061
253499920,1cyclictest0-21swapper/122:55:121
253499920,1cyclictest0-21swapper/122:25:111
253499920,1cyclictest0-21swapper/122:05:111
253499920,1cyclictest0-21swapper/121:00:111
253499920,1cyclictest0-21swapper/120:30:101
253499920,1cyclictest0-21swapper/120:20:111
253499920,1cyclictest0-21swapper/120:15:101
253499920,1cyclictest0-21swapper/120:10:021
253499920,1cyclictest0-21swapper/119:50:111
253499920,1cyclictest0-21swapper/119:25:111
253499920,1cyclictest0-21swapper/100:25:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional