You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-30 - 10:22
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack1slot1.osadl.org (updated Tue Dec 30, 2025 00:45:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
191112202148,42sleep10-21swapper/119:07:081
190442198158,27sleep30-21swapper/319:06:193
172222198159,26sleep20-21swapper/219:05:092
192072197159,24sleep00-21swapper/019:08:250
110222620,0sleep121-21ksoftirqd/121:05:151
19420991817,1cyclictest28-21ksoftirqd/221:40:192
19420991816,1cyclictest28-21ksoftirqd/221:25:232
19420991615,1cyclictest28-21ksoftirqd/200:30:212
19420991514,1cyclictest28-21ksoftirqd/221:35:002
19420991513,1cyclictest28-21ksoftirqd/223:40:012
19420991513,1cyclictest28-21ksoftirqd/222:59:592
19420991414,0cyclictest28-21ksoftirqd/223:50:182
19420991413,1cyclictest28-21ksoftirqd/223:10:132
19420991413,1cyclictest28-21ksoftirqd/222:05:162
19420991413,1cyclictest28-21ksoftirqd/200:05:142
19420991412,1cyclictest28-21ksoftirqd/220:30:092
19420991412,1cyclictest28-21ksoftirqd/220:05:002
19420991412,1cyclictest17033-21turbostat23:35:002
19420991411,1cyclictest28-21ksoftirqd/220:40:002
19420991313,0cyclictest28-21ksoftirqd/200:25:212
19420991312,1cyclictest28-21ksoftirqd/222:15:132
19420991312,1cyclictest28-21ksoftirqd/221:50:212
19420991312,1cyclictest28-21ksoftirqd/221:50:012
19420991312,1cyclictest28-21ksoftirqd/221:15:002
19420991312,1cyclictest28-21ksoftirqd/220:45:022
19420991312,1cyclictest28-21ksoftirqd/219:45:202
19420991312,1cyclictest28-21ksoftirqd/219:30:132
19420991312,1cyclictest28-21ksoftirqd/200:00:232
19420991311,1cyclictest28-21ksoftirqd/223:45:012
19420991311,1cyclictest28-21ksoftirqd/223:25:112
19420991311,1cyclictest28-21ksoftirqd/221:10:002
19420991311,1cyclictest28-21ksoftirqd/220:50:192
19420991311,1cyclictest28-21ksoftirqd/220:45:012
19420991311,1cyclictest28-21ksoftirqd/219:40:002
19420991311,1cyclictest28-21ksoftirqd/219:29:592
19420991311,1cyclictest28-21ksoftirqd/219:20:002
1940799130,12cyclictest0-21swapper/120:05:151
1942099126,4cyclictest1886-21kworker/2:119:52:312
19420991211,1cyclictest28-21ksoftirqd/222:30:002
19420991211,1cyclictest28-21ksoftirqd/220:55:012
19420991211,1cyclictest28-21ksoftirqd/220:10:002
19420991211,1cyclictest28-21ksoftirqd/219:55:152
19420991210,1cyclictest28-21ksoftirqd/222:45:012
19420991210,1cyclictest28-21ksoftirqd/221:05:002
19420991210,1cyclictest28-21ksoftirqd/200:40:012
19420991210,1cyclictest28-21ksoftirqd/200:15:002
1940399124,4cyclictest14709-21perf23:30:000
1942099119,1cyclictest28-21ksoftirqd/223:49:592
1942099119,1cyclictest28-21ksoftirqd/223:15:222
1942099119,1cyclictest28-21ksoftirqd/222:50:142
1942099119,1cyclictest28-21ksoftirqd/222:45:142
1942099119,1cyclictest28-21ksoftirqd/222:40:012
1942099119,1cyclictest28-21ksoftirqd/222:40:012
1942099119,1cyclictest28-21ksoftirqd/222:35:002
1942099119,1cyclictest28-21ksoftirqd/222:05:002
1942099119,1cyclictest28-21ksoftirqd/222:00:002
1942099119,1cyclictest28-21ksoftirqd/221:25:002
1942099119,1cyclictest28-21ksoftirqd/220:25:002
1942099119,1cyclictest28-21ksoftirqd/220:20:002
1942099119,1cyclictest28-21ksoftirqd/219:24:592
1942099119,1cyclictest28-21ksoftirqd/219:15:002
1942099116,4cyclictest28-21ksoftirqd/220:10:182
19420991111,0cyclictest28-21ksoftirqd/223:00:142
19420991110,1cyclictest28-21ksoftirqd/223:20:002
19420991110,1cyclictest28-21ksoftirqd/222:20:222
19420991110,1cyclictest28-21ksoftirqd/222:10:222
19420991110,1cyclictest28-21ksoftirqd/219:45:002
19420991110,1cyclictest28-21ksoftirqd/219:45:002
1940399119,1cyclictest9-21ksoftirqd/021:55:000
1940399119,1cyclictest9-21ksoftirqd/021:35:000
1940399119,1cyclictest9-21ksoftirqd/021:15:000
19403991110,1cyclictest9-21ksoftirqd/022:45:010
19403991110,1cyclictest9-21ksoftirqd/022:25:000
1942799100,3cyclictest0-21swapper/300:15:143
1942099109,1cyclictest28-21ksoftirqd/200:24:592
1942099109,1cyclictest28-21ksoftirqd/200:15:132
1942099108,1cyclictest28-21ksoftirqd/223:55:172
1942099108,1cyclictest28-21ksoftirqd/223:05:142
1942099108,1cyclictest28-21ksoftirqd/221:35:142
1942099108,1cyclictest28-21ksoftirqd/221:20:002
1942099108,1cyclictest28-21ksoftirqd/220:29:592
1940399109,1cyclictest9-21ksoftirqd/021:10:000
1940399108,1cyclictest9-21ksoftirqd/019:45:010
1940399108,1cyclictest9-21ksoftirqd/019:45:010
194279998,1cyclictest35-21ksoftirqd/319:20:003
194079990,5cyclictest0-21swapper/120:00:121
194039999,0cyclictest9-21ksoftirqd/023:35:000
194039997,1cyclictest9-21ksoftirqd/022:35:000
194039997,1cyclictest9-21ksoftirqd/020:55:000
194039995,2cyclictest240-21systemd-journal19:29:590
194039991,4cyclictest6787-21latency_hist19:50:010
194279987,1cyclictest35-21ksoftirqd/322:00:003
194279986,1cyclictest707-21snmpd23:57:573
194279986,1cyclictest707-21snmpd22:17:213
194279986,1cyclictest707-21snmpd00:22:523
194279982,5cyclictest707-21snmpd21:46:213
194279980,6cyclictest0-21swapper/319:40:113
194279980,6cyclictest0-21swapper/319:40:113
194079980,7cyclictest0-21swapper/119:20:151
194079980,6cyclictest0-21swapper/120:40:131
194039988,0cyclictest9-21ksoftirqd/023:35:140
194039988,0cyclictest9-21ksoftirqd/022:45:150
194039987,1cyclictest9-21ksoftirqd/023:50:000
194039987,1cyclictest9-21ksoftirqd/022:05:000
194039987,1cyclictest9-21ksoftirqd/020:40:160
194039986,1cyclictest9-21ksoftirqd/022:40:010
194039986,1cyclictest9-21ksoftirqd/022:40:010
194039986,1cyclictest707-21snmpd21:46:000
194039986,1cyclictest707-21snmpd00:33:410
194039980,7cyclictest0-21swapper/000:37:490
194039980,4cyclictest13514-21latency_hist22:20:000
23834270,0sleep10-21swapper/120:25:151
194279976,1cyclictest561-21nscd22:45:203
194279976,1cyclictest35-21ksoftirqd/320:50:013
194279976,1cyclictest35-21ksoftirqd/319:26:323
194279975,1cyclictest707-21snmpd23:45:303
194279975,1cyclictest707-21snmpd23:37:393
194279975,1cyclictest707-21snmpd23:26:323
194279975,1cyclictest707-21snmpd23:17:353
194279975,1cyclictest707-21snmpd21:51:093
194279975,1cyclictest707-21snmpd21:38:233
194279975,1cyclictest707-21snmpd21:26:173
194279975,1cyclictest707-21snmpd20:50:373
194279975,1cyclictest707-21snmpd20:16:243
194279975,1cyclictest707-21snmpd19:50:583
194279975,1cyclictest707-21snmpd19:38:323
194279975,1cyclictest35-21ksoftirqd/300:30:003
194279973,2cyclictest240-21systemd-journal19:25:003
194279972,1cyclictest31019-21tail19:30:183
194279970,1cyclictest0-21swapper/321:43:003
194079971,6cyclictest0-21swapper/122:25:431
194079971,1cyclictest0-21swapper/123:46:121
194079970,4cyclictest203-21jbd2/sda2-822:20:051
194079970,4cyclictest0-21swapper/119:40:171
194079970,4cyclictest0-21swapper/119:40:171
194079970,4cyclictest0-21swapper/119:10:181
194079970,3cyclictest0-21swapper/121:30:121
194079970,1cyclictest0-21swapper/122:56:051
194039977,0cyclictest9-21ksoftirqd/019:50:200
194039977,0cyclictest101rcuc/021:40:130
194039976,1cyclictest9-21ksoftirqd/022:10:130
194039976,1cyclictest9-21ksoftirqd/021:20:200
194039976,1cyclictest9-21ksoftirqd/020:10:160
194039976,1cyclictest707-21snmpd23:21:380
194039976,1cyclictest707-21snmpd21:36:170
194039976,1cyclictest707-21snmpd20:32:290
194039976,1cyclictest0-21swapper/022:08:510
194039975,1cyclictest9-21ksoftirqd/023:05:110
194039975,1cyclictest9-21ksoftirqd/020:20:140
194039975,1cyclictest9-21ksoftirqd/000:15:000
194039975,1cyclictest707-21snmpd23:02:560
194039975,1cyclictest707-21snmpd22:56:490
194039974,1cyclictest2033-21sendmail19:40:000
194039970,7cyclictest0-21swapper/023:55:170
194039970,7cyclictest0-21swapper/000:25:150
194039970,7cyclictest0-21swapper/000:15:140
194039970,6cyclictest24512-21taskset23:50:130
194039970,6cyclictest19916-21ntp_states20:15:190
194039970,6cyclictest10312-21munin-run21:05:000
194039970,1cyclictest5727-21cat23:10:130
194279965,1cyclictest707-21snmpd22:00:033
194279965,1cyclictest3402-21sshd00:11:313
194279965,1cyclictest24371-21sshd21:31:313
194279964,1cyclictest707-21snmpd21:24:533
194279964,1cyclictest707-21snmpd20:44:583
194279964,1cyclictest707-21snmpd20:35:153
194279964,1cyclictest707-21snmpd19:56:463
194279964,1cyclictest707-21snmpd00:07:453
194279963,1cyclictest240-21systemd-journal19:50:003
194279961,3cyclictest30617-21apt-get22:55:123
194279961,3cyclictest24901-21sendmail_mailst22:40:203
194279961,3cyclictest20982-21apt-get22:35:133
194279961,3cyclictest20982-21apt-get22:35:133
194279961,3cyclictest1887-21awk23:00:203
194279961,3cyclictest0-21swapper/320:25:183
194279961,2cyclictest12014-21cstates20:00:133
194279960,4cyclictest707-21snmpd22:10:263
194279960,4cyclictest5809-21apt-get20:55:123
194079961,2cyclictest0-21swapper/121:40:141
194079960,6cyclictest0-21swapper/123:23:401
194079960,6cyclictest0-21swapper/120:50:011
194079960,6cyclictest0-21swapper/120:24:361
194079960,6cyclictest0-21swapper/119:48:501
194079960,6cyclictest0-21swapper/119:19:101
194079960,5cyclictest0-21swapper/120:30:141
194079960,4cyclictest0-21swapper/120:55:201
194079960,3cyclictest0-21swapper/122:50:121
194079960,3cyclictest0-21swapper/121:20:101
194079960,3cyclictest0-21swapper/120:10:131
194079960,1cyclictest0-21swapper/123:40:161
194079960,1cyclictest0-21swapper/123:09:051
194079960,1cyclictest0-21swapper/122:40:161
194079960,1cyclictest0-21swapper/120:35:221
194079960,1cyclictest0-21swapper/100:06:341
194039966,0cyclictest9-21ksoftirqd/020:35:010
194039965,1cyclictest9-21ksoftirqd/021:55:150
194039965,1cyclictest9-21ksoftirqd/021:25:170
194039964,1cyclictest9-21ksoftirqd/000:20:150
194039964,1cyclictest707-21snmpd19:34:540
194039961,1cyclictest28260-21/usr/sbin/munin22:50:140
194039960,6cyclictest0-21swapper/022:27:560
194039960,6cyclictest0-21swapper/020:06:480
194039960,6cyclictest0-21swapper/019:24:520
194039960,5cyclictest22095-21munin-node19:15:000
194039960,1cyclictest76232sleep023:15:100
194039960,1cyclictest19937-21cstates19:10:150
194039960,0cyclictest0-21swapper/020:50:190
194039960,0cyclictest0-21swapper/020:25:310
194039960,0cyclictest0-21swapper/019:55:430
30327250,0sleep30-21swapper/322:54:323
194279954,1cyclictest707-21snmpd23:40:123
194279954,1cyclictest707-21snmpd23:33:093
194279954,1cyclictest707-21snmpd21:04:433
194279954,1cyclictest707-21snmpd20:09:273
194279954,1cyclictest29970-21cat00:00:183
194279954,1cyclictest11006-21apt-get00:30:133
194279953,1cyclictest23247-21latency_hist20:25:003
194279953,1cyclictest12891-21apt-get21:10:113
194279952,2cyclictest0-21swapper/300:35:153
194279952,1cyclictest25831-21/usr/sbin/munin20:30:153
194279952,1cyclictest10534-21/usr/sbin/munin21:05:243
194279952,0cyclictest6405-21/usr/sbin/munin23:10:173
194279951,2cyclictest19620-21apt-get19:10:133
194279951,1cyclictest240-21systemd-journal21:20:003
194279950,1cyclictest16865-21hddtemp_smartct22:25:163
194079955,0cyclictest0-21swapper/122:35:131
194079955,0cyclictest0-21swapper/122:35:131
194079950,5cyclictest0-21swapper/123:58:031
194079950,5cyclictest0-21swapper/123:30:231
194079950,5cyclictest0-21swapper/123:01:421
194079950,5cyclictest0-21swapper/122:16:541
194079950,5cyclictest0-21swapper/122:01:211
194079950,5cyclictest0-21swapper/121:50:061
194079950,5cyclictest0-21swapper/120:47:221
194079950,5cyclictest0-21swapper/100:00:171
194079950,3cyclictest0-21swapper/122:45:121
194079950,3cyclictest0-21swapper/100:31:391
194079950,2cyclictest0-21swapper/122:10:121
194079950,0cyclictest0-21swapper/123:50:211
194079950,0cyclictest0-21swapper/121:25:191
194079950,0cyclictest0-21swapper/121:01:471
194079950,0cyclictest0-21swapper/119:27:431
194039955,0cyclictest9-21ksoftirqd/020:45:010
194039954,1cyclictest9-21ksoftirqd/023:40:140
194039954,1cyclictest9-21ksoftirqd/020:00:130
194039954,1cyclictest9-21ksoftirqd/000:05:000
194039952,1cyclictest240-21systemd-journal23:59:590
194039950,5cyclictest0-21swapper/021:15:110
194279944,0cyclictest707-21snmpd23:50:133
194279944,0cyclictest707-21snmpd23:05:053
194279943,1cyclictest35-21ksoftirqd/322:30:043
194279942,1cyclictest16390-21/usr/sbin/munin20:10:163
194279942,1cyclictest14801-21cut22:20:193
194279941,1cyclictest7635-21memory22:05:193
194279940,1cyclictest240-21systemd-journal23:20:003
194079944,0cyclictest0-21swapper/121:56:181
194079941,1cyclictest0-21swapper/123:10:151
194079941,1cyclictest0-21swapper/121:20:001
194079940,4cyclictest0-21swapper/122:30:201
194079940,4cyclictest0-21swapper/120:15:471
194079940,4cyclictest0-21swapper/119:36:131
194079940,4cyclictest0-21swapper/100:15:161
194079940,3cyclictest0-21swapper/121:10:191
194079940,3cyclictest0-21swapper/100:25:121
194079940,2cyclictest0-21swapper/123:35:121
194079940,2cyclictest0-21swapper/123:15:131
194079940,2cyclictest0-21swapper/100:20:191
194079940,1cyclictest0-21swapper/122:05:161
194079940,1cyclictest0-21swapper/119:30:181
194079940,1cyclictest0-21swapper/100:35:151
194079940,0cyclictest0-21swapper/123:25:081
194079940,0cyclictest0-21swapper/121:47:021
194079940,0cyclictest0-21swapper/119:55:191
194079940,0cyclictest0-21swapper/100:10:161
194079931,1cyclictest0-21swapper/119:50:101
194079930,0cyclictest0-21swapper/121:35:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional