You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-27 - 10:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rack1slot1.osadl.org (updated Thu Nov 27, 2025 00:45:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
113962214149,23sleep00-21swapper/019:06:400
116222203148,42sleep10-21swapper/119:09:351
114082203146,44sleep20-21swapper/219:06:512
113942199161,24sleep30-21swapper/319:06:393
11789991918,0cyclictest35-21ksoftirqd/322:05:143
253092180,0sleep10-21swapper/121:40:221
253092180,0sleep10-21swapper/121:40:211
11789991817,1cyclictest35-21ksoftirqd/322:25:163
11789991717,0cyclictest35-21ksoftirqd/322:30:223
11789991717,0cyclictest35-21ksoftirqd/322:10:133
11789991717,0cyclictest35-21ksoftirqd/300:00:153
11789991616,0cyclictest35-21ksoftirqd/323:20:113
11789991616,0cyclictest35-21ksoftirqd/322:18:093
11789991615,1cyclictest35-21ksoftirqd/322:55:003
11789991615,1cyclictest35-21ksoftirqd/321:10:133
11789991515,0cyclictest35-21ksoftirqd/323:43:403
11789991515,0cyclictest35-21ksoftirqd/321:20:143
11789991515,0cyclictest35-21ksoftirqd/300:36:503
1178999149,2cyclictest35-21ksoftirqd/300:25:213
11789991414,0cyclictest35-21ksoftirqd/323:35:163
11789991414,0cyclictest35-21ksoftirqd/321:26:033
11789991414,0cyclictest35-21ksoftirqd/320:00:153
11789991313,0cyclictest35-21ksoftirqd/322:23:263
11789991313,0cyclictest35-21ksoftirqd/319:40:023
11789991311,1cyclictest35-21ksoftirqd/323:55:133
11789991311,1cyclictest35-21ksoftirqd/322:45:183
11789991311,1cyclictest35-21ksoftirqd/322:35:183
11789991310,1cyclictest35-21ksoftirqd/319:55:003
11789991212,0cyclictest35-21ksoftirqd/323:16:533
11789991212,0cyclictest35-21ksoftirqd/323:10:003
11789991212,0cyclictest35-21ksoftirqd/321:50:003
11789991212,0cyclictest35-21ksoftirqd/321:32:483
11789991212,0cyclictest35-21ksoftirqd/321:00:003
11789991212,0cyclictest35-21ksoftirqd/300:10:153
11789991211,1cyclictest35-21ksoftirqd/323:30:143
11789991211,1cyclictest35-21ksoftirqd/323:10:143
11789991211,1cyclictest35-21ksoftirqd/323:00:113
11789991211,1cyclictest35-21ksoftirqd/321:55:143
11789991211,1cyclictest35-21ksoftirqd/321:40:123
11789991211,1cyclictest35-21ksoftirqd/321:40:113
11789991211,1cyclictest35-21ksoftirqd/321:15:183
11789991211,0cyclictest35-21ksoftirqd/323:50:013
11789991210,1cyclictest35-21ksoftirqd/322:55:213
11789991210,1cyclictest35-21ksoftirqd/319:45:183
11789991210,1cyclictest35-21ksoftirqd/319:15:003
11789991210,1cyclictest35-21ksoftirqd/300:30:153
11789991210,1cyclictest35-21ksoftirqd/300:05:173
11764991210,1cyclictest9-21ksoftirqd/019:25:000
1178999119,1cyclictest35-21ksoftirqd/323:50:153
1178999119,1cyclictest35-21ksoftirqd/323:25:143
1178999119,1cyclictest35-21ksoftirqd/320:30:003
1178999119,1cyclictest35-21ksoftirqd/320:15:143
11789991111,0cyclictest35-21ksoftirqd/322:40:143
11789991111,0cyclictest35-21ksoftirqd/320:00:013
11789991111,0cyclictest35-21ksoftirqd/319:29:593
11789991111,0cyclictest35-21ksoftirqd/319:20:003
11789991110,1cyclictest35-21ksoftirqd/322:00:143
11789991110,1cyclictest35-21ksoftirqd/321:50:213
11789991110,1cyclictest35-21ksoftirqd/321:35:113
11789991110,1cyclictest35-21ksoftirqd/320:55:013
11789991110,1cyclictest35-21ksoftirqd/320:45:013
11789991110,1cyclictest35-21ksoftirqd/320:30:093
11789991110,1cyclictest35-21ksoftirqd/320:10:013
11789991110,1cyclictest35-21ksoftirqd/319:40:003
11789991110,1cyclictest35-21ksoftirqd/319:25:013
11789991110,1cyclictest35-21ksoftirqd/300:20:123
11789991110,1cyclictest35-21ksoftirqd/300:15:003
1177299110,11cyclictest0-21swapper/119:20:001
1176499111,5cyclictest7084-21cut00:20:010
1178999109,1cyclictest35-21ksoftirqd/320:40:003
1178999109,1cyclictest35-21ksoftirqd/320:20:103
1178999109,1cyclictest35-21ksoftirqd/320:15:003
1178999108,1cyclictest35-21ksoftirqd/321:00:163
1178999108,1cyclictest35-21ksoftirqd/320:50:003
1178999108,1cyclictest35-21ksoftirqd/319:30:203
1178299108,1cyclictest28-21ksoftirqd/223:47:222
1178299108,1cyclictest28-21ksoftirqd/221:39:302
1178299108,1cyclictest28-21ksoftirqd/220:15:012
1178299100,8cyclictest8415-21/usr/sbin/munin22:50:162
1178299100,1cyclictest254-21systemd-journal21:32:052
1177299100,3cyclictest0-21swapper/121:55:111
1176499108,1cyclictest9-21ksoftirqd/020:40:070
1176499108,1cyclictest9-21ksoftirqd/020:15:130
1176499103,4cyclictest3842-21sort20:00:000
26722298,0sleep228-21ksoftirqd/221:44:472
26722298,0sleep228-21ksoftirqd/221:44:472
117899998,1cyclictest35-21ksoftirqd/321:05:113
117829997,1cyclictest28-21ksoftirqd/220:10:002
117829991,6cyclictest14106-21munin-node19:39:002
117649997,1cyclictest9-21ksoftirqd/000:01:420
117649993,5cyclictest14216-21perf00:30:010
117649991,3cyclictest0-21swapper/000:10:190
117649990,3cyclictest0-21swapper/021:24:540
117649990,1cyclictest254-21systemd-journal23:59:530
117829986,1cyclictest60950irq/123-eno122:30:182
117829986,1cyclictest60950irq/123-eno121:51:192
117829986,1cyclictest60950irq/123-eno100:35:162
117829986,1cyclictest28-21ksoftirqd/223:22:562
117829984,1cyclictest28-21ksoftirqd/223:30:062
117829980,5cyclictest0-21swapper/221:25:232
117829980,3cyclictest0-21swapper/222:20:152
117829980,1cyclictest0-21swapper/223:35:102
117649987,1cyclictest1181-21diskmemload21:32:560
117649986,1cyclictest1889-21/usr/sbin/munin21:55:170
117649980,7cyclictest21697-21cut23:55:000
117649980,7cyclictest19614-21ssh23:05:150
117649980,7cyclictest1168-21cron21:10:000
117829976,1cyclictest60950irq/123-eno123:42:172
117829976,1cyclictest60950irq/123-eno123:00:122
117829976,1cyclictest60950irq/123-eno122:25:492
117829976,1cyclictest60950irq/123-eno122:18:282
117829976,1cyclictest60950irq/123-eno122:05:122
117829976,1cyclictest60950irq/123-eno121:10:192
117829976,1cyclictest60950irq/123-eno100:17:012
117829976,1cyclictest60950irq/123-eno100:14:372
117829976,1cyclictest60950irq/123-eno100:01:182
117829976,0cyclictest60950irq/123-eno100:05:162
117829975,1cyclictest60950irq/123-eno123:50:152
117829975,1cyclictest60950irq/123-eno121:20:192
117829975,1cyclictest60950irq/123-eno120:00:202
117829975,1cyclictest28-21ksoftirqd/223:15:132
117829975,1cyclictest28-21ksoftirqd/220:29:592
117829975,1cyclictest28-21ksoftirqd/200:35:002
117829975,1cyclictest25288-21cat20:50:142
117829975,1cyclictest11927-21ssh00:25:182
117829973,4cyclictest28-21ksoftirqd/223:57:232
117829973,2cyclictest28-21ksoftirqd/200:20:162
117829973,2cyclictest254-21systemd-journal19:20:012
117829970,5cyclictest0-21swapper/221:48:322
117829970,4cyclictest1-21systemd21:55:192
117829970,4cyclictest0-21swapper/221:15:022
117729971,4cyclictest0-21swapper/100:21:501
117729970,6cyclictest0-21swapper/123:15:231
117729970,5cyclictest0-21swapper/100:10:171
117729970,4cyclictest0-21swapper/122:14:301
117729970,3cyclictest0-21swapper/122:20:001
117729970,3cyclictest0-21swapper/122:00:141
117729970,3cyclictest0-21swapper/120:00:001
117729970,2cyclictest0-21swapper/123:05:111
117649976,1cyclictest31462-21ssh23:20:440
117649976,1cyclictest20097-21telnet21:35:110
117649975,1cyclictest26575-21apt19:39:590
117649975,1cyclictest1181-21diskmemload23:04:470
117649973,2cyclictest17132-21turbostat.cron19:20:000
117649973,2cyclictest1181-21diskmemload22:31:390
117649973,1cyclictest254-21systemd-journal22:50:060
117649971,6cyclictest25803-1kworker/u9:021:43:450
117649971,6cyclictest25803-1kworker/u9:021:43:440
117649970,6cyclictest9614-21tune2fs22:05:150
117649970,6cyclictest7730-21ssh21:17:220
117649970,6cyclictest4244-21ssh21:13:340
117649970,6cyclictest31994-21ntp_states21:50:170
117649970,6cyclictest3072-1kworker/u9:223:30:180
117649970,6cyclictest27529-21/usr/sbin/munin19:40:140
117649970,6cyclictest24788-21ssh23:12:010
117649970,6cyclictest20778-21ssh00:37:490
117649970,6cyclictest14792-21ssh22:12:000
117649970,6cyclictest1181-21diskmemload22:35:130
117649970,6cyclictest1181-21diskmemload00:20:160
117649970,6cyclictest0-21swapper/023:40:130
117649970,6cyclictest0-21swapper/023:35:120
117649970,6cyclictest0-21swapper/022:40:100
117649970,6cyclictest0-21swapper/022:20:120
117649970,6cyclictest0-21swapper/021:45:130
117649970,6cyclictest0-21swapper/021:25:120
117649970,6cyclictest0-21swapper/019:30:110
117649970,6cyclictest0-21swapper/019:25:200
117649970,1cyclictest28553-21ssh23:17:450
117649970,1cyclictest254-21systemd-journal20:08:320
117649970,1cyclictest25082-21ssh22:25:290
117649970,1cyclictest14972-21diskstats00:30:140
117649970,1cyclictest14049-21ssh22:56:240
117649970,1cyclictest1181-21diskmemload22:45:190
117649970,1cyclictest1181-21diskmemload22:15:480
117649970,1cyclictest0-21swapper/000:05:180
117829966,0cyclictest60950irq/123-eno123:10:122
117829966,0cyclictest60950irq/123-eno123:06:322
117829966,0cyclictest60950irq/123-eno122:55:102
117829966,0cyclictest60950irq/123-eno122:40:112
117829966,0cyclictest60950irq/123-eno122:10:042
117829966,0cyclictest60950irq/123-eno121:00:512
117829966,0cyclictest60950irq/123-eno120:38:392
117829966,0cyclictest60950irq/123-eno120:30:412
117829966,0cyclictest60950irq/123-eno120:19:022
117829966,0cyclictest60950irq/123-eno119:55:172
117829966,0cyclictest60950irq/123-eno119:45:112
117829966,0cyclictest60950irq/123-eno119:25:112
117829965,1cyclictest60950irq/123-eno122:00:172
117829965,1cyclictest28-21ksoftirqd/220:40:072
117829964,2cyclictest28-21ksoftirqd/220:45:132
117829964,1cyclictest60950irq/123-eno121:05:152
117829964,1cyclictest60950irq/123-eno119:50:132
117829964,1cyclictest60950irq/123-eno119:30:142
117829964,1cyclictest27423-21fschecks_time20:55:132
117829963,2cyclictest4911-21apt-get22:45:122
117829963,1cyclictest28-21ksoftirqd/219:40:012
117829962,1cyclictest30357-21aten_r1power_fr22:35:132
117829960,4cyclictest17586-21cpuspeed_turbos19:20:152
117829960,3cyclictest674-21apt-get23:25:142
117729963,3cyclictest0-21swapper/100:05:201
117729961,2cyclictest145322sleep121:25:481
117729961,2cyclictest0-21swapper/122:31:341
117729960,6cyclictest0-21swapper/119:10:161
117729960,4cyclictest0-21swapper/100:16:531
117729960,3cyclictest0-21swapper/123:55:071
117729960,3cyclictest0-21swapper/123:45:351
117729960,3cyclictest0-21swapper/123:35:121
117729960,3cyclictest0-21swapper/122:53:421
117729960,3cyclictest0-21swapper/121:19:061
117729960,3cyclictest0-21swapper/100:39:591
117729960,2cyclictest0-21swapper/123:10:121
117729960,2cyclictest0-21swapper/121:05:141
117729960,1cyclictest0-21swapper/122:40:161
117649964,1cyclictest9-21ksoftirqd/020:30:060
117649964,1cyclictest15945-21sshd20:26:200
117649960,6cyclictest1181-21diskmemload23:45:150
117649960,6cyclictest0-21swapper/020:24:500
117649960,1cyclictest27093-21expr20:55:120
117649960,1cyclictest11945-21apt-get19:10:110
117649960,0cyclictest1181-21diskmemload23:25:130
117649960,0cyclictest1181-21diskmemload22:00:530
117649960,0cyclictest0-21swapper/021:02:500
117649960,0cyclictest0-21swapper/020:45:080
117649960,0cyclictest0-21swapper/019:53:410
117829951,3cyclictest0-21swapper/220:20:132
117829950,4cyclictest11942-21/usr/sbin/munin19:10:162
117729955,0cyclictest0-21swapper/121:21:041
117729955,0cyclictest0-21swapper/121:13:291
117729955,0cyclictest0-21swapper/120:40:071
117729954,1cyclictest0-21swapper/119:35:161
117729951,2cyclictest0-21swapper/121:02:441
117729950,5cyclictest0-21swapper/120:36:371
117729950,5cyclictest0-21swapper/120:29:391
117729950,4cyclictest0-21swapper/122:08:501
117729950,4cyclictest0-21swapper/120:05:001
117729950,3cyclictest0-21swapper/123:29:201
117729950,3cyclictest0-21swapper/123:20:111
117729950,3cyclictest0-21swapper/122:55:041
117729950,3cyclictest0-21swapper/121:49:151
117729950,3cyclictest0-21swapper/121:35:111
117729950,2cyclictest0-21swapper/122:29:071
117729950,2cyclictest0-21swapper/122:24:101
117729950,2cyclictest0-21swapper/121:54:131
117729950,2cyclictest0-21swapper/100:30:201
117729950,1cyclictest0-21swapper/123:31:161
117729950,1cyclictest0-21swapper/123:00:171
117729950,1cyclictest0-21swapper/119:20:131
117729950,0cyclictest0-21swapper/123:43:211
117729950,0cyclictest0-21swapper/120:59:561
117729950,0cyclictest0-21swapper/120:08:231
117649954,1cyclictest5494-21switchtime20:00:210
117649950,5cyclictest0-21swapper/020:10:140
117649950,4cyclictest24394-21/usr/sbin/munin20:50:130
117649950,0cyclictest0-21swapper/020:35:210
117649950,0cyclictest0-21swapper/019:45:160
20064240,0sleep10-21swapper/119:25:121
117729944,0cyclictest0-21swapper/119:50:361
117729940,3cyclictest0-21swapper/122:45:181
117729940,3cyclictest0-21swapper/100:25:231
117729940,2cyclictest0-21swapper/120:50:121
117729940,2cyclictest0-21swapper/120:30:131
117729940,2cyclictest0-21swapper/119:45:181
117729940,1cyclictest0-21swapper/123:52:271
117729940,1cyclictest0-21swapper/122:35:151
117729940,1cyclictest0-21swapper/120:15:131
117729940,0cyclictest0-21swapper/121:30:031
117729940,0cyclictest0-21swapper/119:40:001
117729940,0cyclictest0-21swapper/100:00:201
117729931,1cyclictest0-21swapper/120:45:111
117729931,1cyclictest0-21swapper/120:10:171
117729930,2cyclictest0-21swapper/120:20:121
117729930,1cyclictest0-21swapper/119:30:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional