You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-03 - 07:40
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack1slot1.osadl.org (updated Wed Dec 03, 2025 00:45:09)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
85572224157,53sleep20-21swapper/219:05:102
106002209157,26sleep30-21swapper/319:09:103
83152207156,25sleep00-21swapper/019:05:000
104792203164,26sleep10-21swapper/119:07:351
65172670,0sleep10-21swapper/120:05:131
11492640,0sleep00-21swapper/021:48:460
136252200,1sleep24870-21diskmemload22:05:182
202892150,0sleep04870-21diskmemload22:15:160
10774991413,1cyclictest9-21ksoftirqd/023:40:140
10774991412,1cyclictest9-21ksoftirqd/020:00:000
10807991211,1cyclictest35-21ksoftirqd/319:25:003
10807991211,1cyclictest35-21ksoftirqd/300:00:133
10807991210,1cyclictest35-21ksoftirqd/322:40:153
1079599129,1cyclictest28-21ksoftirqd/220:20:002
10795991210,1cyclictest28-21ksoftirqd/200:30:002
1079599120,12cyclictest0-21swapper/223:55:302
1079599120,12cyclictest0-21swapper/223:21:582
10774991211,1cyclictest9-21ksoftirqd/022:40:000
10774991210,1cyclictest950ksoftirqd/019:55:000
10774991210,1cyclictest9-21ksoftirqd/022:30:000
10774991210,1cyclictest9-21ksoftirqd/022:00:000
1077499120,9cyclictest0-21swapper/019:25:210
1080799119,1cyclictest35-21ksoftirqd/321:50:003
10807991111,0cyclictest35-21ksoftirqd/322:10:183
10807991111,0cyclictest0-21swapper/319:26:053
10807991110,1cyclictest9160-21grep22:45:163
10807991110,1cyclictest35-21ksoftirqd/323:05:213
10807991110,1cyclictest35-21ksoftirqd/322:05:143
10807991110,1cyclictest35-21ksoftirqd/320:35:193
10807991110,1cyclictest35-21ksoftirqd/320:30:143
10807991110,1cyclictest35-21ksoftirqd/300:30:163
10795991110,1cyclictest60950irq/123-eno122:23:052
1077499119,1cyclictest9-21ksoftirqd/021:15:010
1077499110,10cyclictest4870-21diskmemload22:34:500
1077499110,10cyclictest0-21swapper/020:20:130
1077499110,10cyclictest0-21swapper/020:20:120
1080799109,1cyclictest35-21ksoftirqd/323:50:233
1080799109,1cyclictest35-21ksoftirqd/300:35:133
1080799109,1cyclictest35-21ksoftirqd/300:25:213
1080799109,0cyclictest35-21ksoftirqd/323:00:163
1080799108,1cyclictest35-21ksoftirqd/322:55:203
1080799108,1cyclictest35-21ksoftirqd/322:20:213
1080799108,1cyclictest35-21ksoftirqd/322:00:213
1080799108,1cyclictest35-21ksoftirqd/321:50:213
1080799108,1cyclictest35-21ksoftirqd/319:50:183
10807991010,0cyclictest35-21ksoftirqd/323:10:153
10807991010,0cyclictest35-21ksoftirqd/323:10:153
10807991010,0cyclictest35-21ksoftirqd/321:55:163
10807991010,0cyclictest35-21ksoftirqd/321:30:133
1080799100,4cyclictest1275-21apt-get22:35:143
1079599101,5cyclictest27295-21/usr/sbin/munin23:10:192
1079599101,5cyclictest27295-21/usr/sbin/munin23:10:182
1079599100,0cyclictest0-21swapper/223:45:212
1079599100,0cyclictest0-21swapper/223:01:122
1077499109,0cyclictest9-21ksoftirqd/023:10:000
1077499108,1cyclictest9-21ksoftirqd/023:25:130
1077499108,1cyclictest9-21ksoftirqd/023:20:120
108079999,0cyclictest35-21ksoftirqd/322:17:063
108079999,0cyclictest35-21ksoftirqd/321:28:443
108079999,0cyclictest35-21ksoftirqd/321:19:143
108079999,0cyclictest35-21ksoftirqd/319:15:013
108079999,0cyclictest35-21ksoftirqd/300:11:413
108079998,1cyclictest4870-21diskmemload23:43:043
108079998,1cyclictest35-21ksoftirqd/323:30:223
108079998,1cyclictest35-21ksoftirqd/322:30:173
108079998,1cyclictest35-21ksoftirqd/321:10:543
108079998,1cyclictest35-21ksoftirqd/300:05:223
108079997,1cyclictest35-21ksoftirqd/323:45:183
108079997,1cyclictest35-21ksoftirqd/320:54:593
108079997,1cyclictest35-21ksoftirqd/300:15:213
107959998,1cyclictest28-21ksoftirqd/223:05:002
107959996,1cyclictest28-21ksoftirqd/222:19:202
107749999,0cyclictest9-21ksoftirqd/023:35:000
107749998,1cyclictest9-21ksoftirqd/021:40:230
107749998,1cyclictest9-21ksoftirqd/000:20:140
107749997,1cyclictest9-21ksoftirqd/023:50:000
107749997,1cyclictest9-21ksoftirqd/020:10:000
107749997,1cyclictest17136-21cat21:25:180
107749997,1cyclictest101rcuc/021:35:000
107749993,3cyclictest254-21systemd-journal21:05:000
107749991,4cyclictest24843-21sed00:40:000
17079280,0sleep10-21swapper/120:25:211
108079988,0cyclictest35-21ksoftirqd/323:55:133
108079988,0cyclictest35-21ksoftirqd/323:35:073
108079988,0cyclictest35-21ksoftirqd/319:50:003
108079987,1cyclictest35-21ksoftirqd/323:25:143
108079987,1cyclictest35-21ksoftirqd/323:15:113
108079987,1cyclictest35-21ksoftirqd/323:15:103
108079987,1cyclictest35-21ksoftirqd/321:20:213
108079987,1cyclictest35-21ksoftirqd/320:55:123
108079987,1cyclictest35-21ksoftirqd/320:00:143
108079987,1cyclictest35-21ksoftirqd/319:35:223
108079986,1cyclictest35-21ksoftirqd/321:40:173
108079984,0cyclictest4870-21diskmemload21:39:143
108079983,4cyclictest4870-21diskmemload00:23:423
108079980,4cyclictest0-21swapper/322:51:273
107959988,0cyclictest28-21ksoftirqd/221:35:212
107959987,1cyclictest28-21ksoftirqd/223:28:512
107959987,1cyclictest28-21ksoftirqd/221:21:012
107959987,1cyclictest28-21ksoftirqd/220:10:002
107959987,1cyclictest28-21ksoftirqd/200:15:142
107959987,1cyclictest17701-21sh23:43:072
107959985,1cyclictest28-21ksoftirqd/222:43:212
107749987,1cyclictest9-21ksoftirqd/022:59:590
107749986,1cyclictest7304-21ssh22:42:420
107749985,0cyclictest4870-21diskmemload00:07:560
107749982,5cyclictest23868-21cat19:35:010
107749980,7cyclictest9982-21ssh00:18:000
107749980,7cyclictest28302-21ssh23:58:150
107749980,7cyclictest20028-21ssh00:31:080
107749980,7cyclictest15504-21ssh21:23:560
107749980,7cyclictest10806-21ssh22:47:360
107749980,7cyclictest0-21swapper/000:27:410
107749980,2cyclictest3990-21grep00:10:110
5800270,0sleep20-21swapper/200:11:002
17859275,1sleep09-21ksoftirqd/019:20:210
108079976,1cyclictest35-21ksoftirqd/323:20:103
108079976,1cyclictest35-21ksoftirqd/322:25:203
108079976,1cyclictest35-21ksoftirqd/319:30:153
108079976,1cyclictest35-21ksoftirqd/319:10:143
108079972,4cyclictest14368-21kworker/u8:120:15:353
108079970,2cyclictest0-21swapper/320:10:133
107959977,0cyclictest28-21ksoftirqd/200:20:162
107959977,0cyclictest13273-21sensors22:50:212
107959976,1cyclictest60950irq/123-eno123:35:132
107959976,1cyclictest60950irq/123-eno122:59:242
107959976,1cyclictest60950irq/123-eno122:36:002
107959976,1cyclictest60950irq/123-eno121:45:142
107959976,1cyclictest60950irq/123-eno121:41:252
107959976,1cyclictest60950irq/123-eno121:10:112
107959976,1cyclictest60950irq/123-eno100:32:072
107959976,1cyclictest28-21ksoftirqd/222:45:002
107959976,1cyclictest28-21ksoftirqd/219:40:002
107959976,1cyclictest28-21ksoftirqd/219:15:002
107959976,0cyclictest60950irq/123-eno123:50:192
107959976,0cyclictest60950irq/123-eno123:30:222
107959976,0cyclictest60950irq/123-eno121:16:462
107959976,0cyclictest28-21ksoftirqd/200:08:422
107959975,1cyclictest28-21ksoftirqd/219:50:002
107959975,1cyclictest18916-21grep19:25:002
107959974,2cyclictest27944-21nscd23:19:412
107959974,2cyclictest27944-21nscd23:19:402
107959972,1cyclictest254-21systemd-journal00:02:372
107959970,4cyclictest0-21swapper/220:05:122
107959970,0cyclictest0-21swapper/222:10:302
107879970,6cyclictest0-21swapper/122:25:031
107879970,5cyclictest0-21swapper/121:44:581
107879970,4cyclictest0-21swapper/123:20:131
107879970,4cyclictest0-21swapper/120:45:201
107879970,4cyclictest0-21swapper/119:40:131
107879970,0cyclictest0-21swapper/122:11:361
107749976,1cyclictest9-21ksoftirqd/023:10:140
107749976,1cyclictest9-21ksoftirqd/023:10:140
107749976,1cyclictest9-21ksoftirqd/021:50:220
107749976,1cyclictest9-21ksoftirqd/020:40:000
107749976,1cyclictest25001-21ssh23:53:560
107749975,1cyclictest9-21ksoftirqd/022:05:130
107749975,1cyclictest9-21ksoftirqd/020:55:190
107749975,1cyclictest9-21ksoftirqd/020:10:150
107749975,1cyclictest9-21ksoftirqd/020:00:130
107749975,1cyclictest9-21ksoftirqd/019:20:010
107749975,1cyclictest10506-21ssh21:15:210
107749972,1cyclictest12317-21ntp_states19:10:190
107749971,5cyclictest22249-1kworker/u9:122:20:020
107749970,6cyclictest29805-21ssh23:15:120
107749970,6cyclictest29805-21ssh23:15:120
107749970,6cyclictest17980-21ssh22:11:180
107749970,6cyclictest16369-1kworker/u9:223:00:130
107749970,6cyclictest0-21swapper/022:50:050
107749970,6cyclictest0-21swapper/021:35:200
107749970,1cyclictest4870-21diskmemload22:00:140
107749970,1cyclictest31492-21ssh00:02:090
107749970,1cyclictest10974-21ssh23:34:080
31510260,0sleep10-21swapper/100:02:131
108079965,1cyclictest35-21ksoftirqd/320:45:003
108079965,1cyclictest35-21ksoftirqd/320:25:173
108079965,1cyclictest35-21ksoftirqd/319:55:163
108079964,1cyclictest35-21ksoftirqd/320:45:223
108079964,1cyclictest35-21ksoftirqd/319:40:183
108079963,1cyclictest6144-21dpkg20:05:003
108079960,4cyclictest0-21swapper/321:00:163
108079960,0cyclictest0-21swapper/320:20:133
108079960,0cyclictest0-21swapper/320:20:123
107959966,0cyclictest60950irq/123-eno122:30:052
107959966,0cyclictest60950irq/123-eno122:00:132
107959966,0cyclictest60950irq/123-eno121:55:092
107959966,0cyclictest60950irq/123-eno121:30:222
107959966,0cyclictest60950irq/123-eno121:25:312
107959966,0cyclictest60950irq/123-eno120:45:152
107959966,0cyclictest60950irq/123-eno120:40:082
107959966,0cyclictest60950irq/123-eno120:31:302
107959966,0cyclictest60950irq/123-eno120:03:192
107959966,0cyclictest60950irq/123-eno119:51:032
107959966,0cyclictest60950irq/123-eno100:35:122
107959965,1cyclictest60950irq/123-eno122:25:252
107959965,1cyclictest60950irq/123-eno120:50:152
107959965,1cyclictest3027-21ntpq21:50:212
107959965,1cyclictest27602-21ntpq19:40:192
107959964,1cyclictest60950irq/123-eno120:35:152
107959964,1cyclictest28-21ksoftirqd/221:00:002
107959960,6cyclictest0-21swapper/219:55:132
107959960,3cyclictest32469-21gpgv21:00:002
107959960,2cyclictest0-21swapper/219:25:132
107879960,6cyclictest0-21swapper/123:49:351
107879960,6cyclictest0-21swapper/122:00:161
107879960,6cyclictest0-21swapper/121:55:541
107879960,5cyclictest0-21swapper/120:55:151
107879960,4cyclictest0-21swapper/123:15:111
107879960,4cyclictest0-21swapper/123:15:111
107879960,4cyclictest0-21swapper/122:57:461
107879960,4cyclictest0-21swapper/122:16:511
107879960,4cyclictest0-21swapper/100:38:271
107879960,3cyclictest0-21swapper/123:10:121
107879960,3cyclictest0-21swapper/123:10:121
107879960,3cyclictest0-21swapper/120:10:131
107879960,2cyclictest0-21swapper/121:15:201
107749965,1cyclictest9-21ksoftirqd/020:45:140
107749965,1cyclictest9-21ksoftirqd/019:44:590
107749965,1cyclictest12306-21ntp_states20:15:190
107749963,1cyclictest9-21ksoftirqd/020:31:480
107749960,6cyclictest0-21swapper/020:26:190
107749960,6cyclictest0-21swapper/019:36:350
107749960,3cyclictest0-21swapper/019:45:110
108079954,1cyclictest3627-21cat21:05:163
107959955,0cyclictest60950irq/123-eno120:25:482
107959955,0cyclictest60950irq/123-eno119:11:462
107959953,1cyclictest14677-21ntpq20:20:192
107959953,1cyclictest14677-21ntpq20:20:192
107959950,5cyclictest0-21swapper/221:07:352
107959950,3cyclictest0-21swapper/219:30:122
107879955,0cyclictest0-21swapper/123:52:331
107879955,0cyclictest0-21swapper/123:43:391
107879955,0cyclictest0-21swapper/123:26:541
107879955,0cyclictest0-21swapper/121:35:561
107879955,0cyclictest0-21swapper/121:33:141
107879955,0cyclictest0-21swapper/119:16:541
107879953,2cyclictest0-21swapper/123:05:121
107879952,1cyclictest0-21swapper/123:00:221
107879951,1cyclictest0-21swapper/100:12:521
107879950,5cyclictest0-21swapper/122:50:111
107879950,5cyclictest0-21swapper/100:25:181
107879950,4cyclictest0-21swapper/122:36:031
107879950,4cyclictest0-21swapper/100:15:211
107879950,3cyclictest0-21swapper/123:30:191
107879950,3cyclictest0-21swapper/122:30:121
107879950,2cyclictest0-21swapper/121:45:231
107879950,2cyclictest0-21swapper/121:20:031
107879950,1cyclictest0-21swapper/122:45:121
107879950,1cyclictest0-21swapper/122:20:171
107879950,1cyclictest0-21swapper/122:05:101
107879950,1cyclictest0-21swapper/121:50:141
107879950,1cyclictest0-21swapper/121:25:131
107879950,1cyclictest0-21swapper/121:14:571
107879950,1cyclictest0-21swapper/100:35:011
107879950,1cyclictest0-21swapper/100:05:131
107879950,0cyclictest0-21swapper/123:37:051
107879950,0cyclictest0-21swapper/120:50:131
107879950,0cyclictest0-21swapper/119:57:371
107879950,0cyclictest0-21swapper/119:20:221
107749950,5cyclictest0-21swapper/021:08:310
107749950,4cyclictest28267-21expr20:50:140
107749950,2cyclictest254-21systemd-journal20:36:480
107879943,1cyclictest200-21jbd2/sda2-820:25:001
107879943,1cyclictest200-21jbd2/sda2-820:25:001
107879943,1cyclictest13224-21chrt20:19:401
107879943,1cyclictest0-21swapper/121:00:151
107879942,2cyclictest0-21swapper/119:30:121
107879941,2cyclictest0-21swapper/119:45:111
107879941,2cyclictest0-21swapper/119:25:121
107879941,1cyclictest0-21swapper/120:40:191
107879940,2cyclictest0-21swapper/120:00:161
107879940,1cyclictest0-21swapper/123:55:021
107879940,1cyclictest0-21swapper/100:21:151
107879940,0cyclictest0-21swapper/122:40:121
107879940,0cyclictest0-21swapper/121:08:451
107879931,1cyclictest0-21swapper/120:30:121
107879931,1cyclictest0-21swapper/119:35:141
107879930,3cyclictest0-21swapper/120:36:221
107879930,1cyclictest0-21swapper/119:50:141
107879930,1cyclictest0-21swapper/119:10:201
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional