You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-08-31 - 02:37
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Sun Aug 31, 2025 00:45:11)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
277562228172,22sleep10-21swapper/119:06:081
279972211160,25sleep00-21swapper/019:09:220
277422202162,27sleep20-21swapper/219:05:572
279852200160,26sleep30-21swapper/319:09:133
4362600,0sleep10-21swapper/100:05:151
37522160,1sleep03753-21unixbench_singl21:55:210
2812199128,3cyclictest9-21ksoftirqd/000:00:150
28121991211,1cyclictest9-21ksoftirqd/000:00:010
2814399111,6cyclictest6201-21apt-get22:45:123
28121991110,1cyclictest9-21ksoftirqd/022:40:000
28121991110,1cyclictest9-21ksoftirqd/021:55:000
28121991110,1cyclictest9-21ksoftirqd/021:15:010
160592110,0sleep10-21swapper/122:57:351
2814399100,7cyclictest6430-1kworker/u9:200:15:473
2812199109,1cyclictest9-21ksoftirqd/023:35:130
2812199109,1cyclictest9-21ksoftirqd/022:50:170
250812100,0sleep032273-21diskmemload21:41:000
281439998,1cyclictest35-21ksoftirqd/300:11:553
281439990,0cyclictest0-21swapper/322:22:143
281349997,1cyclictest28-21ksoftirqd/220:20:012
281349995,2cyclictest254-21systemd-journal20:50:012
281349994,2cyclictest254-21systemd-journal23:12:552
281349990,9cyclictest0-21swapper/200:37:222
281219998,1cyclictest9-21ksoftirqd/022:45:210
281219998,1cyclictest9-21ksoftirqd/022:10:000
281219998,1cyclictest9-21ksoftirqd/021:30:090
281219998,1cyclictest9-21ksoftirqd/021:15:120
281219998,1cyclictest9-21ksoftirqd/019:45:000
281219998,1cyclictest148142sleep022:10:330
281219998,1cyclictest148142sleep022:10:320
281219991,4cyclictest22884-21cat20:50:000
281219990,8cyclictest28737-21munin-node20:35:390
281219990,2cyclictest32542-21ssh00:05:130
281439987,1cyclictest35-21ksoftirqd/300:38:493
281439986,1cyclictest35-21ksoftirqd/320:55:113
281439982,4cyclictest32273-21diskmemload23:01:243
281439982,2cyclictest11278-21apt-get20:25:123
281439980,5cyclictest0-21swapper/321:20:133
281349987,1cyclictest28-21ksoftirqd/223:21:282
281349987,1cyclictest0-21swapper/223:25:162
281349986,1cyclictest60950irq/123-eno123:19:462
281349986,1cyclictest60950irq/123-eno123:19:452
281349986,1cyclictest60950irq/123-eno123:05:132
281349986,1cyclictest60950irq/123-eno122:52:252
281349986,1cyclictest60950irq/123-eno122:29:592
281349986,1cyclictest28-21ksoftirqd/219:55:012
281349986,1cyclictest1259-21ssh21:54:172
281349984,2cyclictest254-21systemd-journal23:57:422
281349984,1cyclictest254-21systemd-journal22:31:412
281349980,4cyclictest254-21systemd-journal19:15:012
281219986,1cyclictest9-21ksoftirqd/021:35:140
281219986,1cyclictest9-21ksoftirqd/000:30:000
281219981,5cyclictest20326-21apt-get22:20:130
281219980,7cyclictest9831-21ssh21:21:150
281219980,7cyclictest4928-21ssh23:25:400
281219980,7cyclictest25989-21ssh00:39:230
281219980,4cyclictest22559-21latency_hist00:35:010
281219980,1cyclictest18906-21ssh22:16:470
281439976,1cyclictest8297-21ssh22:02:513
281439976,1cyclictest23955-21cat20:50:163
281439975,1cyclictest17597-21ssh00:26:403
281439975,1cyclictest1456-21ssh22:37:443
281439972,2cyclictest32273-21diskmemload23:57:193
281439972,2cyclictest32273-21diskmemload21:33:073
281439970,5cyclictest0-21swapper/300:30:113
281439970,1cyclictest0-21swapper/321:35:113
281349977,0cyclictest0-21swapper/200:20:372
281349976,1cyclictest60950irq/123-eno123:42:552
281349976,1cyclictest60950irq/123-eno122:55:162
281349976,1cyclictest60950irq/123-eno122:47:212
281349976,1cyclictest60950irq/123-eno122:17:572
281349976,1cyclictest60950irq/123-eno122:10:112
281349976,1cyclictest60950irq/123-eno122:10:112
281349976,1cyclictest60950irq/123-eno122:04:412
281349976,1cyclictest60950irq/123-eno121:30:152
281349976,1cyclictest60950irq/123-eno121:05:142
281349976,1cyclictest60950irq/123-eno100:30:182
281349976,1cyclictest60950irq/123-eno100:13:512
281349976,1cyclictest60950irq/123-eno100:06:392
281349976,0cyclictest60950irq/123-eno123:35:102
281349976,0cyclictest60950irq/123-eno123:00:112
281349976,0cyclictest60950irq/123-eno121:35:162
281349976,0cyclictest60950irq/123-eno121:15:122
281349975,1cyclictest60950irq/123-eno123:31:562
281349975,1cyclictest60950irq/123-eno121:20:142
281349975,1cyclictest60950irq/123-eno100:25:192
281349975,1cyclictest60950irq/123-eno100:05:002
281349975,1cyclictest28-21ksoftirqd/220:25:002
281349973,3cyclictest0-21swapper/222:05:192
281349973,2cyclictest3055-21ssh21:14:022
281349973,2cyclictest254-21systemd-journal23:53:262
281349973,2cyclictest0-21swapper/200:17:132
281349973,1cyclictest254-21systemd-journal21:50:012
281349971,1cyclictest0-21swapper/221:25:142
281349970,1cyclictest5562-21proc_pri20:11:362
281299970,4cyclictest0-21swapper/122:35:151
281219977,0cyclictest9-21ksoftirqd/000:15:180
281219975,1cyclictest9-21ksoftirqd/020:25:000
281219975,1cyclictest31870-21perf19:34:590
281219975,1cyclictest26741-21ssh23:11:390
281219975,0cyclictest32273-21diskmemload23:30:370
281219973,4cyclictest557-21nscd23:02:170
281219973,2cyclictest254-21systemd-journal19:17:520
281219973,2cyclictest254-21systemd-journal19:17:510
281219972,4cyclictest32273-21diskmemload22:01:140
281219971,5cyclictest32157-21taskset21:08:430
281219971,1cyclictest32273-21diskmemload22:30:130
281219970,6cyclictest2492-21ssh22:40:040
281219970,6cyclictest14785-21ssh00:24:190
281219970,6cyclictest12903-1kworker/u9:022:56:120
281219970,6cyclictest0-21swapper/023:50:000
281219970,6cyclictest0-21swapper/019:39:590
281219970,4cyclictest0-21swapper/020:25:120
281219970,1cyclictest32273-21diskmemload00:11:230
281219970,1cyclictest26696-21ssh21:45:040
281219970,1cyclictest26238-21ssh22:26:460
281219970,1cyclictest13456-21ssh21:25:430
281219970,1cyclictest0-21swapper/023:49:170
281219970,1cyclictest0-21swapper/023:15:180
281219970,1cyclictest0-21swapper/023:15:180
281219970,1cyclictest0-21swapper/023:05:150
281219970,1cyclictest0-21swapper/020:53:370
19825270,0sleep30-21swapper/323:46:273
281439965,1cyclictest6241-21ssh21:17:113
281439965,1cyclictest5446-21ssh23:27:143
281439965,1cyclictest4570-21ssh22:41:053
281439965,1cyclictest23320-21ssh23:50:583
281439965,1cyclictest23071-21ssh23:06:383
281439965,1cyclictest13788-21ssh21:26:373
281439965,1cyclictest10728-21ssh22:50:183
281439964,1cyclictest35-21ksoftirqd/320:15:523
281439964,1cyclictest35-21ksoftirqd/319:40:003
281439964,1cyclictest35-21ksoftirqd/319:33:153
281439964,1cyclictest12298-21ssh23:35:523
281439964,0cyclictest32273-21diskmemload23:20:403
281439964,0cyclictest32273-21diskmemload21:48:093
281439963,1cyclictest254-21systemd-journal23:42:113
281439963,0cyclictest32273-21diskmemload23:12:173
281439962,3cyclictest27618-21/usr/sbin/munin22:30:193
281439961,4cyclictest32554-21aten_r1power_cu21:10:143
281439961,3cyclictest6679-21apt-get23:30:113
281439961,1cyclictest32273-21diskmemload00:00:423
281439961,1cyclictest0-21swapper/319:59:203
281439960,5cyclictest30160-21apt-get21:05:143
281439960,4cyclictest28409-21cpuspeed_turbos23:15:143
281439960,4cyclictest28409-21cpuspeed_turbos23:15:143
281439960,4cyclictest18650-21sh22:16:013
281439960,4cyclictest0-21swapper/322:55:123
281439960,4cyclictest0-21swapper/322:28:433
281439960,3cyclictest0-21swapper/322:07:543
281439960,2cyclictest32273-21diskmemload21:55:123
281439960,2cyclictest0-21swapper/300:06:043
281439960,1cyclictest0-21swapper/300:22:073
281349966,0cyclictest60950irq/123-eno122:40:182
281349966,0cyclictest60950irq/123-eno122:35:042
281349966,0cyclictest60950irq/123-eno122:20:192
281349966,0cyclictest60950irq/123-eno121:01:332
281349966,0cyclictest60950irq/123-eno120:35:042
281349966,0cyclictest60950irq/123-eno120:25:042
281349966,0cyclictest60950irq/123-eno119:59:172
281349966,0cyclictest60950irq/123-eno119:41:412
281349966,0cyclictest60950irq/123-eno119:25:012
281349965,1cyclictest60950irq/123-eno119:32:042
281349965,0cyclictest60950irq/123-eno123:45:102
281349963,3cyclictest0-21swapper/221:55:192
281349962,2cyclictest254-21systemd-journal20:06:072
281349962,1cyclictest254-21systemd-journal20:55:002
281349960,6cyclictest0-21swapper/219:45:382
281349960,6cyclictest0-21swapper/219:23:142
281349960,5cyclictest25421-21apt-get20:55:122
281349960,3cyclictest0-21swapper/220:40:122
281349960,1cyclictest0-21swapper/221:40:132
281299966,0cyclictest0-21swapper/122:17:201
281299961,4cyclictest0-21swapper/123:25:111
281299961,3cyclictest0-21swapper/123:45:101
281299961,3cyclictest0-21swapper/100:14:591
281299960,6cyclictest0-21swapper/123:56:571
281299960,6cyclictest0-21swapper/123:45:001
281299960,6cyclictest0-21swapper/122:34:441
281299960,5cyclictest0-21swapper/121:10:231
281299960,5cyclictest0-21swapper/120:25:161
281299960,4cyclictest0-21swapper/123:23:291
281299960,4cyclictest0-21swapper/122:11:261
281299960,4cyclictest0-21swapper/122:11:251
281299960,4cyclictest0-21swapper/121:42:051
281299960,4cyclictest0-21swapper/100:20:091
281299960,3cyclictest0-21swapper/121:55:471
281299960,3cyclictest0-21swapper/121:54:021
281299960,3cyclictest0-21swapper/100:36:441
281299960,3cyclictest0-21swapper/100:30:021
281299960,2cyclictest0-21swapper/122:53:531
281299960,1cyclictest0-21swapper/121:35:151
281299960,0cyclictest0-21swapper/123:15:431
281299960,0cyclictest0-21swapper/123:15:421
281299960,0cyclictest0-21swapper/121:29:081
281219965,1cyclictest9-21ksoftirqd/020:45:010
281219965,1cyclictest14087-21ssh23:40:120
281219964,1cyclictest9-21ksoftirqd/020:30:180
281219962,1cyclictest254-21systemd-journal19:15:000
281219961,1cyclictest0-21swapper/021:00:090
281219960,6cyclictest0-21swapper/020:02:420
281219960,6cyclictest0-21swapper/019:29:260
281219960,5cyclictest0-21swapper/020:55:120
281219960,2cyclictest0-21swapper/020:10:090
281219960,0cyclictest32273-21diskmemload23:20:050
281219960,0cyclictest0-21swapper/020:15:090
281439954,1cyclictest32509-21ssh21:50:483
281439954,1cyclictest24445-21systemctl21:40:213
281439953,1cyclictest21714-21/usr/sbin/munin20:45:163
281439952,1cyclictest14191-21/usr/sbin/munin22:10:193
281439952,1cyclictest14191-21/usr/sbin/munin22:10:183
281439950,3cyclictest27915-21aten_r1power_po21:00:103
281439950,1cyclictest0-21swapper/319:45:013
281349955,0cyclictest60950irq/123-eno120:01:062
281349955,0cyclictest60950irq/123-eno119:35:302
281349955,0cyclictest60950irq/123-eno119:15:012
281349955,0cyclictest60950irq/123-eno119:15:002
281349950,4cyclictest14132-21df20:30:172
281299955,0cyclictest0-21swapper/123:32:051
281299955,0cyclictest0-21swapper/100:28:011
281299952,2cyclictest0-21swapper/120:30:161
281299950,5cyclictest0-21swapper/121:31:491
281299950,4cyclictest0-21swapper/123:07:521
281299950,4cyclictest0-21swapper/122:40:201
281299950,3cyclictest0-21swapper/123:51:171
281299950,3cyclictest0-21swapper/123:39:251
281299950,3cyclictest0-21swapper/123:00:161
281299950,2cyclictest0-21swapper/122:47:161
281299950,2cyclictest0-21swapper/122:27:451
281299950,2cyclictest0-21swapper/122:21:011
281299950,2cyclictest0-21swapper/122:07:041
281299950,2cyclictest0-21swapper/122:01:511
281299950,2cyclictest0-21swapper/121:20:131
281299950,2cyclictest0-21swapper/100:15:091
281299950,1cyclictest0-21swapper/121:45:161
281299950,0cyclictest0-21swapper/120:50:191
281299950,0cyclictest0-21swapper/100:01:121
281219953,1cyclictest4024-21wc20:10:010
281219950,5cyclictest0-21swapper/019:20:300
281219950,2cyclictest254-21systemd-journal20:00:000
281219950,0cyclictest0-21swapper/019:50:490
281219950,0cyclictest0-21swapper/019:44:350
281439944,0cyclictest5694-21sensors20:11:413
281439942,1cyclictest9444-21fschecks_count20:20:123
281439942,1cyclictest29568-21ntp_states19:15:013
281439942,1cyclictest29568-21ntp_states19:15:013
281439942,1cyclictest19571-21cut20:40:193
281439942,1cyclictest15980-21/usr/sbin/munin20:35:123
281439941,0cyclictest13636-21apt-get20:30:163
281439940,2cyclictest254-21systemd-journal20:08:373
281439940,1cyclictest254-21systemd-journal20:02:073
281439940,1cyclictest254-21systemd-journal19:53:063
281439940,1cyclictest254-21systemd-journal19:29:063
281439940,1cyclictest254-21systemd-journal19:20:213
281439940,1cyclictest254-21systemd-journal19:10:513
281439940,0cyclictest0-21swapper/319:42:023
281299944,0cyclictest0-21swapper/119:24:391
281299941,0cyclictest0-21swapper/120:35:111
281299940,4cyclictest0-21swapper/121:08:161
281299940,4cyclictest0-21swapper/120:41:351
281299940,3cyclictest0-21swapper/121:15:151
281299940,3cyclictest0-21swapper/120:10:101
281299940,2cyclictest0-21swapper/121:00:091
281299940,2cyclictest0-21swapper/120:55:131
281299940,2cyclictest0-21swapper/120:20:091
281299940,2cyclictest0-21swapper/120:10:001
281299940,1cyclictest0-21swapper/120:46:011
281299940,1cyclictest0-21swapper/120:15:081
281299940,1cyclictest0-21swapper/119:45:011
281299940,1cyclictest0-21swapper/119:41:541
281299940,0cyclictest0-21swapper/123:10:131
281299933,0cyclictest0-21swapper/119:37:021
281299933,0cyclictest0-21swapper/119:31:281
281299932,1cyclictest28495-21chrt19:12:231
281299931,1cyclictest0-21swapper/119:15:021
281299931,1cyclictest0-21swapper/119:15:011
281299930,2cyclictest1990-21chrt19:53:431
281299930,1cyclictest0-21swapper/120:03:561
281299920,1cyclictest2322-21taskset19:55:031
281299920,1cyclictest0-21swapper/119:25:031
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional