You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-12 - 10:11
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackaslot8.osadl.org (updated Fri Dec 12, 2025 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
221292308276,20sleep20-21swapper/219:05:492
224752299271,18sleep10-21swapper/119:09:581
222002278245,21sleep00-21swapper/019:06:390
221982260225,22sleep30-21swapper/319:06:383
303452650,0sleep20-21swapper/222:10:132
46342590,0sleep10-21swapper/100:39:311
227072530,0sleep00-21swapper/023:39:250
68712520,0sleep00-21swapper/023:03:560
290902170,0sleep00-21swapper/000:31:500
206482160,0sleep00-21swapper/022:02:510
249492150,0sleep00-21swapper/023:16:460
2259799141,4cyclictest12574-21ls21:10:013
156762140,0sleep30-21swapper/300:21:083
307672130,0sleep20-21swapper/220:35:232
22593991211,1cyclictest28-21ksoftirqd/200:00:002
162422110,5sleep1211rcuc/120:05:141
254092100,0sleep10-21swapper/122:30:181
2259799102,3cyclictest13460-21cat20:00:013
2259799101,6cyclictest27830-21wc20:30:163
2259799101,6cyclictest25248-21ssh21:18:493
225979996,1cyclictest32384-21apt-get19:30:123
225979992,3cyclictest763-21ssh23:23:013
225979991,6cyclictest28847-21ssh22:08:593
225979991,5cyclictest5805-21sh23:02:543
225979991,3cyclictest29251-21expr21:45:163
225979990,8cyclictest2773-21sh23:48:063
225979990,6cyclictest25332-21ssh22:53:383
225979990,6cyclictest14133-21ssh22:21:283
225979990,6cyclictest1236-21sh22:35:323
225979990,6cyclictest12170-21ssh21:32:363
225939997,2cyclictest28-21ksoftirqd/223:30:122
225909994,3cyclictest19982-21systemd-journal19:14:251
225869996,2cyclictest12-21ksoftirqd/023:59:590
19857290,1sleep20-21swapper/222:02:002
225979985,2cyclictest12397-21apt-get23:55:023
225979983,4cyclictest6399-21munin-plugin-st19:45:003
225979982,2cyclictest14960-21wc20:00:193
225979981,5cyclictest20005-21ssh23:36:443
225979981,3cyclictest6972-21cat20:55:173
225979981,3cyclictest5597-21rm23:26:053
225979981,3cyclictest26013-21ssh22:30:223
225979981,3cyclictest18535-21/usr/sbin/munin22:25:153
225979981,3cyclictest16778-21cstates22:00:143
225979981,3cyclictest13879-21ssh23:32:313
225979980,6cyclictest7675-21ssh21:29:523
225979980,6cyclictest12160-21ssh22:44:343
225979980,6cyclictest12112-21sh21:56:033
225979980,5cyclictest9335-21ssh00:16:143
225979980,5cyclictest30043-21ssh22:56:253
225979980,5cyclictest26009-21ssh00:30:113
225979980,5cyclictest24576-21ssh23:16:243
225979980,5cyclictest21680-21ssh00:00:483
225979980,5cyclictest20594-21ssh23:14:133
225979980,5cyclictest17137-21ssh21:12:413
225979980,5cyclictest1352-21sh22:12:083
225979980,5cyclictest11697-21taskset23:07:043
225939985,2cyclictest508-21dbus-daemon21:54:142
225939984,3cyclictest19982-21systemd-journal00:16:552
225939984,3cyclictest11736-21in:imuxsock20:12:262
225939984,1cyclictest28786-21/usr/sbin/munin23:20:252
225939983,4cyclictest0-21swapper/223:35:122
225939983,3cyclictest19982-21systemd-journal19:31:302
225909985,2cyclictest24220-21ssh00:28:321
225909985,2cyclictest19982-21systemd-journal21:51:441
225909983,3cyclictest19982-21systemd-journal21:59:401
225909983,3cyclictest19982-21systemd-journal21:36:171
225909983,3cyclictest19982-21systemd-journal20:54:341
225909983,3cyclictest19982-21systemd-journal20:47:031
225909982,3cyclictest32130-21awk19:30:011
225909980,6cyclictest19982-21systemd-journal23:58:581
225909980,3cyclictest7997-21perf23:05:011
225869986,1cyclictest12-21ksoftirqd/023:15:010
225869986,1cyclictest12-21ksoftirqd/021:35:000
225869984,3cyclictest19982-21systemd-journal22:50:010
225869984,2cyclictest19982-21systemd-journal21:44:370
225869982,3cyclictest17562-21ls22:25:010
16539280,0sleep30-21swapper/320:05:173
4479270,0sleep10-21swapper/122:15:041
225979975,1cyclictest1664-21apt-get20:45:143
225979974,2cyclictest25320-21grep23:40:193
225979974,2cyclictest11736-21in:imuxsock19:45:013
225979973,3cyclictest9047-21cat21:00:183
225979973,3cyclictest508-21dbus-daemon20:15:213
225979973,3cyclictest3565-21tail21:50:193
225979973,3cyclictest327-21awk20:40:153
225979973,3cyclictest32663-21wc00:35:163
225979973,3cyclictest30654-21snmpd21:41:013
225979973,3cyclictest26460-21ssh00:05:143
225979973,3cyclictest20083-21gltestperf00:25:173
225979973,3cyclictest18097-21basename20:10:133
225979973,3cyclictest16380-21/usr/sbin/munin21:35:173
225979973,3cyclictest13304-21expr22:45:113
225979972,4cyclictest7107-21rm23:50:343
225979972,4cyclictest0-21swapper/320:25:153
225979972,3cyclictest29658-21sshd19:22:233
225979972,3cyclictest19982-21systemd-journal20:21:413
225979972,3cyclictest19982-21systemd-journal19:52:303
225979972,3cyclictest19982-21systemd-journal19:16:323
225979971,2cyclictest7422-21sh22:16:293
225979971,2cyclictest27606-21ssh21:20:183
225939976,1cyclictest28-21ksoftirqd/222:00:012
225939974,2cyclictest508-21dbus-daemon19:36:582
225939974,2cyclictest11736-21in:imuxsock22:23:002
225939974,0cyclictest707-21/usr/sbin/munin00:10:192
225939973,3cyclictest508-21dbus-daemon22:55:092
225939973,3cyclictest508-21dbus-daemon22:17:362
225939973,3cyclictest21239-21ntpq22:50:222
225939973,3cyclictest19982-21systemd-journal23:10:012
225939973,3cyclictest19982-21systemd-journal21:30:262
225939973,3cyclictest19982-21systemd-journal21:15:492
225939973,3cyclictest19982-21systemd-journal20:42:032
225939973,3cyclictest12356-21ntpq19:55:182
225939973,3cyclictest0-21swapper/223:53:262
225939973,1cyclictest6398-21apt-get19:45:012
225939973,1cyclictest5877-21idleruntime-cro20:55:012
225939973,1cyclictest0-21swapper/223:42:072
225939973,1cyclictest0-21swapper/222:49:062
225939973,1cyclictest0-21swapper/200:28:152
225939972,3cyclictest28252-21perf21:45:012
225939972,3cyclictest19982-21systemd-journal21:47:522
225939972,3cyclictest19982-21systemd-journal21:10:242
225939972,1cyclictest141rcu_preempt22:06:202
225939971,3cyclictest15636-21latency_hist20:05:012
225909974,2cyclictest19982-21systemd-journal20:39:081
225909974,2cyclictest1-21systemd22:50:081
225909973,3cyclictest28678-21apt-get21:45:141
225909973,3cyclictest19982-21systemd-journal19:39:281
225909973,3cyclictest19982-21systemd-journal00:04:491
225909973,3cyclictest0-21swapper/122:25:431
225909973,2cyclictest7661-21lldpd23:52:201
225909973,2cyclictest20441-21sshd23:37:131
225909973,2cyclictest19982-21systemd-journal19:47:491
225909973,1cyclictest0-21swapper/123:49:461
225909973,1cyclictest0-21swapper/121:27:101
225909972,3cyclictest19982-21systemd-journal20:31:121
225909971,2cyclictest12957-21awk00:19:591
225909970,5cyclictest19982-21systemd-journal20:20:001
225869974,2cyclictest19982-21systemd-journal20:24:310
225869974,2cyclictest12-21ksoftirqd/019:50:000
225869974,2cyclictest11736-21in:imuxsock22:30:200
225869973,3cyclictest508-21dbus-daemon22:10:010
225869973,3cyclictest30654-21snmpd21:53:420
225869973,3cyclictest27186-21ssh00:05:160
225869973,3cyclictest19982-21systemd-journal22:38:300
225869973,3cyclictest0-21swapper/023:42:030
225869973,3cyclictest0-21swapper/023:32:070
225869973,1cyclictest0-21swapper/021:56:060
225869973,1cyclictest0-21swapper/021:21:240
225869973,1cyclictest0-21swapper/021:12:070
225869973,1cyclictest0-21swapper/000:16:510
225869972,3cyclictest19982-21systemd-journal00:38:360
225869970,1cyclictest1670-21ssh22:12:280
11413270,1sleep011589-21cpuspeed_turbos19:55:130
225979963,2cyclictest30340-21expr19:25:133
225979963,2cyclictest2468-21cat19:35:123
225979963,2cyclictest24136-21cat19:10:213
225979962,3cyclictest560-21ssh00:10:063
225979962,3cyclictest4110-21expr20:50:153
225979962,3cyclictest29031-21cron20:35:003
225939964,2cyclictest1-21systemd20:22:502
225939963,2cyclictest7074-21ntp_states20:55:182
225939963,2cyclictest508-21dbus-daemon20:33:172
225939963,2cyclictest30654-21snmpd22:30:582
225939963,2cyclictest22661-21sh23:15:162
225939963,2cyclictest2090-21fschecks_count20:45:162
225939963,2cyclictest15574-21grep23:10:172
225939963,1cyclictest0-21swapper/223:45:042
225939962,3cyclictest7661-21lldpd20:08:212
225939962,3cyclictest6908-21cat22:40:172
225939962,3cyclictest508-21dbus-daemon21:27:062
225939962,3cyclictest30654-21snmpd00:00:102
225939962,3cyclictest2243-21tune2fs23:00:182
225939962,3cyclictest18245-21ls22:25:132
225939962,1cyclictest0-21swapper/223:29:482
225939962,1cyclictest0-21swapper/221:35:282
225939962,1cyclictest0-21swapper/200:39:232
225939962,1cyclictest0-21swapper/200:21:062
225939962,1cyclictest0-21swapper/200:07:002
225939961,3cyclictest19982-21systemd-journal21:07:412
225939961,3cyclictest19982-21systemd-journal19:55:012
225939961,3cyclictest19982-21systemd-journal00:30:162
225939961,1cyclictest141rcu_preempt19:20:162
225939960,6cyclictest28-21ksoftirqd/222:35:122
225939960,5cyclictest25077-21acpi19:15:022
225909966,0cyclictest0-21swapper/121:21:371
225909964,1cyclictest17581-21grep22:00:171
225909964,1cyclictest123362sleep121:07:291
225909963,2cyclictest6791-21cat20:55:151
225909963,2cyclictest668-21runrttasks23:40:291
225909963,2cyclictest32621-21cat19:30:131
225909963,2cyclictest31661-21ssh22:35:061
225909963,2cyclictest30654-21snmpd19:54:511
225909963,2cyclictest26089-21tune2fs19:15:141
225909963,2cyclictest22551-21ssh23:15:151
225909963,2cyclictest21554-21ssh21:40:021
225909963,2cyclictest15110-21ssh23:10:141
225909963,2cyclictest14378-21ssh21:34:521
225909963,2cyclictest11736-21in:imuxsock00:31:551
225909963,1cyclictest0-21swapper/100:22:301
225909962,3cyclictest9092-21if_err_enp4s023:05:171
225909962,3cyclictest4169-21ntp_kernel_err23:25:191
225909962,3cyclictest30654-21snmpd22:41:591
225909962,3cyclictest30654-21snmpd22:20:131
225909962,3cyclictest30654-21snmpd21:01:491
225909962,3cyclictest30654-21snmpd20:20:041
225909962,3cyclictest30654-21snmpd20:12:261
225909962,3cyclictest30654-21snmpd19:56:471
225909962,3cyclictest30654-21snmpd19:44:001
225909962,3cyclictest28816-21apt-get23:20:141
225909962,3cyclictest28140-21expr19:20:161
225909962,3cyclictest20684-21cat21:15:171
225909962,3cyclictest15017-21date20:00:181
225909962,3cyclictest13712-21cat21:10:161
225909962,1cyclictest0-21swapper/122:45:541
225909962,1cyclictest0-21swapper/100:10:091
225909961,4cyclictest0-21swapper/122:07:041
225909961,2cyclictest30851-21ssh22:57:131
225909960,6cyclictest0-21swapper/100:05:561
225909960,5cyclictest1-21systemd22:13:501
225909960,2cyclictest10883-21memory23:30:171
225869966,0cyclictest0-21swapper/021:00:020
225869964,1cyclictest27604-21df_inode22:55:140
225869963,2cyclictest3423-21cstates23:25:150
225869963,2cyclictest30654-21snmpd20:26:310
225869963,2cyclictest30654-21snmpd20:00:480
225869963,2cyclictest30633-21pmu-power20:35:220
225869963,2cyclictest29872-21ntp_states23:20:230
225869963,2cyclictest27689-21cat20:30:160
225869963,2cyclictest25109-21wc19:15:020
225869963,2cyclictest20901-21basename22:50:190
225869963,2cyclictest19982-21systemd-journal21:00:000
225869963,2cyclictest18936-21cat22:25:170
225869963,2cyclictest0-21swapper/000:26:140
225869963,1cyclictest0-21swapper/021:26:010
225869962,3cyclictest9596-21forks19:50:140
225869962,3cyclictest715-21sed19:30:160
225869962,3cyclictest5730-21grep23:50:150
225869962,3cyclictest31071-21fschecks_count23:45:140
225869962,3cyclictest30654-21snmpd21:05:590
225869962,3cyclictest30654-21snmpd20:16:180
225869962,3cyclictest30654-21snmpd20:08:000
225869962,3cyclictest30654-21snmpd19:27:470
225869962,3cyclictest15480-21perl21:35:120
225869962,3cyclictest15003-21sed00:20:220
225869962,3cyclictest1-21systemd00:00:000
225869962,3cyclictest0-21swapper/000:12:260
225869962,1cyclictest0-21swapper/022:41:070
225869961,3cyclictest19982-21systemd-journal19:12:450
225869960,3cyclictest11906-21rm23:07:150
225869960,2cyclictest3867-21/usr/sbin/munin20:50:140
225869960,0cyclictest0-21swapper/022:16:260
225869960,0cyclictest0-21swapper/021:15:120
225939953,1cyclictest23192-21entropy19:10:152
225939953,1cyclictest0-21swapper/219:25:012
225939952,2cyclictest668-21runrttasks19:45:122
225939952,2cyclictest26996-21/usr/sbin/munin21:20:142
225939951,3cyclictest25502-21cat20:25:172
225939951,3cyclictest20629-21expr20:15:122
225939950,3cyclictest19982-21systemd-journal21:00:242
225909951,3cyclictest30654-21snmpd20:25:101
225909950,3cyclictest19982-21systemd-journal20:40:061
225869952,2cyclictest31967-21cpuspeed_turbos20:40:120
225869952,2cyclictest28977-21expr21:45:140
225869952,2cyclictest28043-21tr19:20:160
225869952,2cyclictest2182-21cpu19:35:130
225869952,2cyclictest1863-21cat20:45:140
225869951,3cyclictest4943-21expr19:40:160
225869951,3cyclictest18331-21cat20:10:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional