You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-02 - 06:18
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Sun Nov 02, 2025 00:45:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
101122234158,26sleep20-21swapper/219:06:192
103502228156,25sleep00-21swapper/019:09:220
101922207154,20sleep10-21swapper/119:07:181
103332202154,23sleep30-21swapper/319:09:093
271462740,0sleep00-21swapper/021:40:170
201832150,0sleep20-21swapper/219:25:222
10517991313,0cyclictest0-21swapper/223:02:032
10526991210,1cyclictest35-21ksoftirqd/321:05:003
10517991211,1cyclictest28-21ksoftirqd/223:00:012
10493991211,1cyclictest9-21ksoftirqd/020:30:000
10493991211,1cyclictest9-21ksoftirqd/000:05:010
10493991211,1cyclictest9-21ksoftirqd/000:05:000
10526991110,1cyclictest35-21ksoftirqd/323:50:003
10526991110,1cyclictest35-21ksoftirqd/323:04:593
10526991110,1cyclictest35-21ksoftirqd/322:20:003
10526991110,1cyclictest35-21ksoftirqd/321:15:003
10526991110,1cyclictest35-21ksoftirqd/320:50:013
10526991110,1cyclictest35-21ksoftirqd/320:30:003
10526991110,1cyclictest35-21ksoftirqd/319:45:003
10526991110,1cyclictest35-21ksoftirqd/300:40:003
10517991110,1cyclictest1824-21unixbench_singl00:05:232
1049399113,5cyclictest22010-21telnet23:05:140
258422100,0sleep00-21swapper/021:39:570
1052699100,5cyclictest3675-21apt-get00:10:143
1052699100,5cyclictest254-21systemd-journal23:19:553
1052699100,4cyclictest742-21runrttasks22:45:033
1051799109,1cyclictest28-21ksoftirqd/223:50:002
1051799100,9cyclictest19110-21snmpd00:24:102
1049399109,1cyclictest9-21ksoftirqd/023:47:180
1049399108,1cyclictest9-21ksoftirqd/020:45:010
1049399101,8cyclictest8213-21fschecks_time22:45:150
6590290,1sleep10-21swapper/121:56:251
105269997,1cyclictest35-21ksoftirqd/319:15:003
105269990,1cyclictest0-21swapper/322:00:213
105179998,1cyclictest28-21ksoftirqd/219:40:012
105179997,1cyclictest19702-21grep22:15:172
105049992,6cyclictest7012-21taskset20:06:541
105049990,8cyclictest0-21swapper/123:25:181
23597280,0sleep00-21swapper/000:35:440
105269988,0cyclictest35-21ksoftirqd/300:25:163
105269987,1cyclictest35-21ksoftirqd/321:15:163
105269986,1cyclictest35-21ksoftirqd/323:10:003
105269986,1cyclictest19110-21snmpd20:33:323
105269982,2cyclictest3415-21diskmemload23:44:443
105269981,3cyclictest3415-21diskmemload21:25:003
105269980,7cyclictest4034-21ssh22:40:123
105269980,2cyclictest0-21swapper/323:20:123
105179988,0cyclictest28-21ksoftirqd/222:20:192
105179987,1cyclictest7298-21ssh21:58:382
105179987,1cyclictest28-21ksoftirqd/221:40:122
105179987,1cyclictest28-21ksoftirqd/200:20:002
105179987,1cyclictest14521-21/usr/sbin/munin23:40:182
105179986,1cyclictest60950irq/123-eno122:30:152
105179986,1cyclictest60950irq/123-eno120:00:192
105179986,1cyclictest28-21ksoftirqd/223:35:142
105179983,2cyclictest0-21swapper/223:52:212
105179982,5cyclictest3415-21diskmemload23:05:202
105179981,5cyclictest28-21ksoftirqd/223:18:422
105049986,1cyclictest0-21swapper/100:10:581
105049981,3cyclictest0-21swapper/123:00:141
105049980,7cyclictest0-21swapper/121:15:181
105049980,4cyclictest0-21swapper/122:32:441
105049980,4cyclictest0-21swapper/119:20:111
105049980,2cyclictest0-21swapper/123:55:111
105049980,1cyclictest0-21swapper/119:45:141
104939987,1cyclictest9-21ksoftirqd/022:03:140
104939987,1cyclictest742-21runrttasks23:52:200
104939986,1cyclictest19110-21snmpd23:36:280
104939983,4cyclictest3388-21/usr/sbin/munin00:10:010
104939980,6cyclictest12842-21munin-node23:23:200
105269977,0cyclictest35-21ksoftirqd/322:55:163
105269976,1cyclictest35-21ksoftirqd/323:30:183
105269976,1cyclictest35-21ksoftirqd/323:15:003
105269976,1cyclictest35-21ksoftirqd/320:59:593
105269976,1cyclictest35-21ksoftirqd/320:55:003
105269976,1cyclictest35-21ksoftirqd/320:00:003
105269976,1cyclictest35-21ksoftirqd/319:50:003
105269976,1cyclictest35-21ksoftirqd/319:15:013
105269976,1cyclictest35-21ksoftirqd/300:00:013
105269976,1cyclictest26729-21cat22:25:173
105269975,1cyclictest35-21ksoftirqd/321:20:163
105269975,1cyclictest30765-21cat22:30:213
105269972,2cyclictest3415-21diskmemload22:52:113
105269972,2cyclictest3415-21diskmemload00:18:483
105269971,4cyclictest0-21swapper/321:44:153
105269971,3cyclictest0-21swapper/300:30:243
105269970,5cyclictest12855-21kworker/3:222:10:143
105269970,1cyclictest0-21swapper/323:29:413
105179976,1cyclictest60950irq/123-eno123:20:382
105179976,1cyclictest60950irq/123-eno123:10:212
105179976,1cyclictest60950irq/123-eno122:50:142
105179976,1cyclictest28-21ksoftirqd/222:50:012
105179976,1cyclictest28-21ksoftirqd/222:25:012
105179976,1cyclictest28-21ksoftirqd/220:55:122
105179976,1cyclictest28-21ksoftirqd/200:40:012
105179976,1cyclictest19871-21ntpq21:30:182
105179976,1cyclictest19110-21snmpd23:31:132
105179976,1cyclictest19110-21snmpd23:26:162
105179976,1cyclictest19110-21snmpd19:22:482
105179976,0cyclictest60950irq/123-eno122:35:022
105179976,0cyclictest60950irq/123-eno121:26:282
105179976,0cyclictest60950irq/123-eno100:30:002
105179975,1cyclictest60950irq/123-eno120:25:132
105179975,1cyclictest13553-21ssh22:05:502
105179970,6cyclictest0-21swapper/219:41:282
105179970,2cyclictest0-21swapper/221:24:382
105049970,7cyclictest0-21swapper/122:55:001
105049970,7cyclictest0-21swapper/122:20:471
105049970,7cyclictest0-21swapper/100:04:551
105049970,7cyclictest0-21swapper/100:04:551
105049970,4cyclictest0-21swapper/123:07:491
105049970,4cyclictest0-21swapper/100:05:111
105049970,3cyclictest0-21swapper/123:51:221
105049970,3cyclictest0-21swapper/123:46:271
105049970,2cyclictest0-21swapper/121:00:141
105049970,1cyclictest0-21swapper/123:19:321
105049970,1cyclictest0-21swapper/122:40:151
105049970,1cyclictest0-21swapper/121:09:131
104939976,1cyclictest9-21ksoftirqd/020:00:000
104939976,1cyclictest9-21ksoftirqd/000:19:090
104939975,1cyclictest30064-21cat23:15:160
104939975,1cyclictest17776-21ssh00:30:000
104939974,2cyclictest12125-21ssh22:05:160
104939971,3cyclictest254-21systemd-journal22:30:000
104939971,1cyclictest13101-21taskset00:21:480
104939970,2cyclictest0-21swapper/020:30:150
104939970,1cyclictest278-21systemd-udevd20:59:090
104939970,1cyclictest18395-21telnet23:00:140
104939970,1cyclictest0-21swapper/023:25:180
104939970,1cyclictest0-21swapper/022:55:160
104939970,1cyclictest0-21swapper/021:15:120
104939970,0cyclictest0-21swapper/023:33:300
105269965,1cyclictest35-21ksoftirqd/319:40:013
105269965,1cyclictest31289-21ssh00:02:043
105269965,1cyclictest31289-21ssh00:02:033
105269965,1cyclictest22378-21ssh21:35:073
105269965,1cyclictest19110-21snmpd21:07:243
105269965,1cyclictest19110-21snmpd20:23:443
105269965,1cyclictest19110-21snmpd20:17:593
105269965,1cyclictest19110-21snmpd20:13:473
105269964,1cyclictest3415-21diskmemload23:39:453
105269964,1cyclictest341rcuc/320:35:163
105269964,1cyclictest21309-21tr19:30:143
105269964,1cyclictest21309-21tr19:30:143
105269964,0cyclictest3415-21diskmemload23:54:183
105269964,0cyclictest3415-21diskmemload22:38:313
105269964,0cyclictest3415-21diskmemload00:20:043
105269963,1cyclictest3415-21diskmemload22:23:193
105269963,1cyclictest3415-21diskmemload21:55:223
105269963,1cyclictest20807-21sh21:31:153
105269961,4cyclictest0-21swapper/320:40:173
105269961,3cyclictest2423-21sh00:07:023
105269961,0cyclictest3415-21diskmemload22:05:163
105269960,6cyclictest0-21swapper/321:50:183
105269960,4cyclictest0-21swapper/321:47:073
105179966,0cyclictest60950irq/123-eno123:55:592
105179966,0cyclictest60950irq/123-eno122:40:112
105179966,0cyclictest60950irq/123-eno122:10:032
105179966,0cyclictest60950irq/123-eno121:50:132
105179966,0cyclictest60950irq/123-eno121:45:162
105179966,0cyclictest60950irq/123-eno121:35:102
105179966,0cyclictest60950irq/123-eno121:15:132
105179966,0cyclictest60950irq/123-eno120:40:142
105179966,0cyclictest60950irq/123-eno120:20:492
105179966,0cyclictest60950irq/123-eno120:15:132
105179966,0cyclictest60950irq/123-eno119:59:512
105179966,0cyclictest60950irq/123-eno119:51:342
105179966,0cyclictest60950irq/123-eno100:30:332
105179966,0cyclictest60950irq/123-eno100:10:022
105179966,0cyclictest60950irq/123-eno100:00:212
105179966,0cyclictest60950irq/123-eno100:00:202
105179965,1cyclictest60950irq/123-eno120:10:172
105179965,1cyclictest28-21ksoftirqd/221:10:002
105179965,1cyclictest28-21ksoftirqd/221:00:002
105179965,1cyclictest28-21ksoftirqd/220:45:122
105179965,1cyclictest28-21ksoftirqd/220:35:142
105179965,1cyclictest19110-21snmpd19:45:272
105179965,1cyclictest10500-21ssh22:02:272
105179965,0cyclictest60950irq/123-eno119:15:012
105179964,1cyclictest60950irq/123-eno120:50:142
105179961,1cyclictest0-21swapper/220:30:242
105049966,0cyclictest0-21swapper/123:12:041
105049963,1cyclictest0-21swapper/121:35:071
105049961,3cyclictest0-21swapper/122:58:461
105049961,3cyclictest0-21swapper/100:35:141
105049960,6cyclictest0-21swapper/120:14:051
105049960,5cyclictest0-21swapper/122:25:161
105049960,5cyclictest0-21swapper/121:49:561
105049960,5cyclictest0-21swapper/120:48:511
105049960,5cyclictest0-21swapper/119:27:511
105049960,5cyclictest0-21swapper/119:15:211
105049960,4cyclictest0-21swapper/123:20:051
105049960,4cyclictest0-21swapper/121:50:491
105049960,4cyclictest0-21swapper/100:30:021
105049960,3cyclictest0-21swapper/123:35:211
105049960,3cyclictest0-21swapper/122:45:031
105049960,3cyclictest0-21swapper/122:37:131
105049960,3cyclictest0-21swapper/122:12:501
105049960,3cyclictest0-21swapper/100:15:221
105049960,2cyclictest0-21swapper/123:40:151
105049960,2cyclictest0-21swapper/122:05:151
105049960,2cyclictest0-21swapper/121:25:211
105049960,2cyclictest0-21swapper/100:25:161
105049960,2cyclictest0-21swapper/100:20:131
105049960,1cyclictest0-21swapper/121:40:161
105049960,0cyclictest0-21swapper/121:30:111
105049960,0cyclictest0-21swapper/120:00:221
104939965,1cyclictest9-21ksoftirqd/021:22:210
104939965,1cyclictest9-21ksoftirqd/019:15:010
104939965,1cyclictest31154-21ssh22:30:260
104939965,1cyclictest26768-21ssh23:10:200
104939965,1cyclictest19110-21snmpd21:13:160
104939965,1cyclictest19110-21snmpd21:01:510
104939965,1cyclictest19110-21snmpd20:48:180
104939965,1cyclictest19110-21snmpd19:10:440
104939965,1cyclictest17635-1kworker/u9:122:16:210
104939965,1cyclictest17029-21ssh21:26:140
104939965,1cyclictest16738-1kworker/u9:023:41:460
104939965,1cyclictest13137-21ssh22:50:590
104939964,1cyclictest19110-21snmpd21:45:160
104939964,1cyclictest15662-21df22:10:120
104939963,2cyclictest742-21runrttasks00:12:520
104939963,2cyclictest558-21dbus-daemon19:20:190
104939963,1cyclictest25536-21munin-run22:25:010
104939963,1cyclictest254-21systemd-journal19:50:000
104939961,3cyclictest0-21swapper/020:15:130
104939960,6cyclictest0-21swapper/021:50:170
104939960,5cyclictest3415-21diskmemload22:41:110
104939960,5cyclictest27360-21ssh23:55:590
104939960,3cyclictest18082-21/usr/sbin/munin00:30:170
104939960,1cyclictest254-21systemd-journal20:24:540
105269954,1cyclictest35-21ksoftirqd/320:05:343
105179955,0cyclictest60950irq/123-eno120:07:142
105179954,1cyclictest60950irq/123-eno121:10:012
105179950,5cyclictest0-21swapper/219:10:432
105179950,1cyclictest254-21systemd-journal19:33:092
105179950,1cyclictest254-21systemd-journal19:33:092
105049955,0cyclictest0-21swapper/120:59:421
105049955,0cyclictest0-21swapper/119:40:051
105049954,1cyclictest0-21swapper/120:30:131
105049953,1cyclictest8233-21chrt23:30:201
105049951,3cyclictest0-21swapper/119:50:111
105049951,2cyclictest0-21swapper/119:10:121
105049950,5cyclictest0-21swapper/122:17:171
105049950,5cyclictest0-21swapper/122:01:561
105049950,4cyclictest0-21swapper/120:50:191
105049950,4cyclictest0-21swapper/120:35:171
105049950,2cyclictest0-21swapper/120:20:211
105049950,1cyclictest0-21swapper/120:25:161
105049950,1cyclictest0-21swapper/119:35:191
105049950,0cyclictest0-21swapper/121:23:111
105049950,0cyclictest0-21swapper/121:11:581
105049950,0cyclictest0-21swapper/119:34:171
105049950,0cyclictest0-21swapper/119:34:171
104939954,1cyclictest9-21ksoftirqd/021:06:390
104939954,1cyclictest9-21ksoftirqd/020:09:090
104939954,1cyclictest9-21ksoftirqd/019:45:000
104939954,1cyclictest6504-21ssh21:56:060
104939954,1cyclictest32030-1kworker/u9:122:35:020
104939954,1cyclictest19110-21snmpd20:38:000
104939953,1cyclictest9-21ksoftirqd/020:50:110
104939953,1cyclictest30479-21apt-get19:50:120
104939952,1cyclictest570-21systemd-logind21:30:200
104939951,3cyclictest21031-21apt-get19:30:130
104939951,3cyclictest21031-21apt-get19:30:120
104939950,2cyclictest0-21swapper/019:25:120
104939950,1cyclictest254-21systemd-journal20:12:080
105269943,1cyclictest17718-21sensors19:20:193
105269942,1cyclictest742-21runrttasks19:54:063
105269942,1cyclictest3523-21gltestperf20:00:163
105269941,1cyclictest278-21systemd-udevd19:27:083
105049941,2cyclictest0-21swapper/120:15:121
105049940,1cyclictest0-21swapper/119:55:231
105049940,0cyclictest0-21swapper/120:40:131
104939941,1cyclictest0-21swapper/019:35:130
104939940,4cyclictest3765-21sort20:00:180
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional