You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-02 - 03:32
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Wed Jul 02, 2025 00:45:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
59412227156,56sleep00-21swapper/019:09:180
58002226157,23sleep30-21swapper/319:07:283
59432203162,27sleep20-21swapper/219:09:192
58952199162,24sleep10-21swapper/119:08:431
177562740,0sleep217760-21cpuspeed_turbos20:40:132
192192650,0sleep10-21swapper/121:35:111
224132620,1sleep222417-21pmu-power00:30:202
297392610,0sleep00-21swapper/023:57:340
29622550,0sleep10-21swapper/122:40:001
6104991514,1cyclictest28-21ksoftirqd/223:10:162
6104991513,1cyclictest28-21ksoftirqd/219:15:182
609099159,6cyclictest0-21swapper/000:03:340
6111991414,0cyclictest35-21ksoftirqd/322:10:213
6111991414,0cyclictest35-21ksoftirqd/322:05:233
6111991413,1cyclictest35-21ksoftirqd/300:15:193
6111991413,0cyclictest35-21ksoftirqd/323:35:193
610499148,2cyclictest28-21ksoftirqd/223:08:242
6104991413,1cyclictest28-21ksoftirqd/223:35:182
6104991413,1cyclictest28-21ksoftirqd/220:15:012
6104991413,1cyclictest28-21ksoftirqd/220:10:222
6104991412,1cyclictest28-21ksoftirqd/222:55:012
6104991412,1cyclictest28-21ksoftirqd/222:09:592
6090991414,0cyclictest9-21ksoftirqd/021:36:530
6090991413,1cyclictest9-21ksoftirqd/023:09:000
322932140,0sleep30-21swapper/323:19:163
322932140,0sleep30-21swapper/323:19:153
6111991313,0cyclictest35-21ksoftirqd/323:50:173
6111991313,0cyclictest35-21ksoftirqd/320:10:223
6111991313,0cyclictest35-21ksoftirqd/319:15:183
6111991313,0cyclictest35-21ksoftirqd/300:39:483
6111991312,1cyclictest35-21ksoftirqd/323:40:193
6111991312,1cyclictest35-21ksoftirqd/322:50:193
610499139,4cyclictest0-21swapper/200:39:132
6104991312,1cyclictest28-21ksoftirqd/220:30:002
6104991311,1cyclictest28-21ksoftirqd/220:05:012
6104991311,1cyclictest28-21ksoftirqd/220:05:012
609799130,13cyclictest0-21swapper/123:07:451
609099132,5cyclictest2739-21latency_hist22:40:010
611199129,2cyclictest35-21ksoftirqd/323:05:253
6111991212,0cyclictest35-21ksoftirqd/320:15:003
6111991211,1cyclictest35-21ksoftirqd/323:25:013
6111991211,1cyclictest35-21ksoftirqd/322:33:193
6111991211,1cyclictest35-21ksoftirqd/321:15:003
6111991211,1cyclictest35-21ksoftirqd/320:50:163
6111991211,1cyclictest35-21ksoftirqd/319:35:183
610499124,7cyclictest28-21ksoftirqd/219:45:222
6104991211,1cyclictest28-21ksoftirqd/223:30:002
6104991211,1cyclictest28-21ksoftirqd/220:50:152
6104991211,1cyclictest28-21ksoftirqd/219:10:142
6104991210,1cyclictest28-21ksoftirqd/222:10:142
609099124,4cyclictest23320-21latency_hist19:45:010
6090991210,1cyclictest5864-21sed23:25:250
611199119,1cyclictest35-21ksoftirqd/323:00:173
611199119,1cyclictest35-21ksoftirqd/322:40:203
611199119,1cyclictest35-21ksoftirqd/321:55:163
611199116,3cyclictest35-21ksoftirqd/322:20:143
6111991111,0cyclictest35-21ksoftirqd/323:30:013
6111991111,0cyclictest35-21ksoftirqd/321:53:523
6111991111,0cyclictest35-21ksoftirqd/321:32:003
6111991111,0cyclictest35-21ksoftirqd/319:10:133
6111991110,1cyclictest35-21ksoftirqd/323:30:163
6111991110,1cyclictest35-21ksoftirqd/322:55:203
6111991110,1cyclictest35-21ksoftirqd/322:36:413
6111991110,1cyclictest35-21ksoftirqd/322:25:183
6111991110,1cyclictest35-21ksoftirqd/320:45:173
6111991110,0cyclictest35-21ksoftirqd/323:15:003
6111991110,0cyclictest35-21ksoftirqd/321:00:143
610499119,1cyclictest28-21ksoftirqd/220:20:142
6104991111,0cyclictest28-21ksoftirqd/222:30:332
6104991110,1cyclictest28-21ksoftirqd/221:40:202
6104991110,1cyclictest28-21ksoftirqd/221:40:202
6104991110,1cyclictest28-21ksoftirqd/221:00:152
6104991110,1cyclictest28-21ksoftirqd/220:45:182
6104991110,1cyclictest28-21ksoftirqd/220:10:002
6104991110,1cyclictest28-21ksoftirqd/219:35:192
6104991110,1cyclictest28-21ksoftirqd/219:20:132
6104991110,1cyclictest26710-21tr21:00:002
609099119,2cyclictest2316-21aten_r1power_en00:05:140
609099119,1cyclictest364-21grub-editenv21:10:180
609099119,1cyclictest31417-21diskmemload21:20:220
609099119,1cyclictest2972-21date20:10:010
609099113,4cyclictest26913-21latency_hist23:55:000
609099112,6cyclictest9489-21apt00:15:000
6090991110,1cyclictest4357-21awk22:40:260
6090991110,1cyclictest31417-21diskmemload23:42:000
6090991110,1cyclictest31417-21diskmemload22:05:030
6090991110,1cyclictest23169-21ssh00:30:580
611199109,1cyclictest35-21ksoftirqd/322:45:183
611199109,1cyclictest35-21ksoftirqd/322:15:283
611199109,1cyclictest35-21ksoftirqd/321:20:003
611199109,1cyclictest35-21ksoftirqd/300:00:133
611199108,1cyclictest35-21ksoftirqd/323:55:213
611199108,1cyclictest35-21ksoftirqd/321:20:183
611199108,1cyclictest35-21ksoftirqd/320:25:223
611199108,1cyclictest35-21ksoftirqd/300:30:193
6111991010,0cyclictest35-21ksoftirqd/319:50:133
6111991010,0cyclictest35-21ksoftirqd/300:10:233
610499109,1cyclictest28-21ksoftirqd/223:55:202
610499109,1cyclictest28-21ksoftirqd/223:03:112
610499109,1cyclictest28-21ksoftirqd/222:15:472
610499109,1cyclictest28-21ksoftirqd/221:50:192
610499109,1cyclictest28-21ksoftirqd/221:30:222
610499109,1cyclictest28-21ksoftirqd/221:25:202
610499109,1cyclictest28-21ksoftirqd/221:20:232
610499109,1cyclictest28-21ksoftirqd/221:10:172
610499109,1cyclictest28-21ksoftirqd/200:05:162
610499108,1cyclictest28-21ksoftirqd/222:59:592
610499108,1cyclictest28-21ksoftirqd/222:00:202
610499108,1cyclictest28-21ksoftirqd/221:35:202
610499108,1cyclictest28-21ksoftirqd/219:45:002
610499108,1cyclictest28-21ksoftirqd/219:30:002
610499108,1cyclictest28-21ksoftirqd/200:20:002
610499106,3cyclictest28-21ksoftirqd/200:24:592
6104991010,0cyclictest28-21ksoftirqd/223:50:012
6104991010,0cyclictest28-21ksoftirqd/223:20:182
610499100,10cyclictest0-21swapper/222:24:542
609099109,1cyclictest31417-21diskmemload22:10:180
609099109,1cyclictest0-21swapper/023:17:040
609099109,1cyclictest0-21swapper/023:17:030
609099109,1cyclictest0-21swapper/019:55:140
609099109,1cyclictest0-21swapper/000:35:150
609099108,2cyclictest0-21swapper/022:15:280
609099108,1cyclictest557-21nscd21:42:510
609099108,1cyclictest557-21nscd21:42:500
609099106,3cyclictest12676-21ssh22:51:260
609099103,6cyclictest101rcuc/021:26:390
609099101,8cyclictest31417-21diskmemload23:36:470
609099101,8cyclictest31417-21diskmemload22:20:190
609099101,8cyclictest31417-21diskmemload21:18:320
609099100,7cyclictest420-21apt-get23:20:130
609099100,2cyclictest19535-21apt-get23:45:150
61119999,0cyclictest35-21ksoftirqd/321:25:213
61119999,0cyclictest35-21ksoftirqd/300:25:133
61119999,0cyclictest35-21ksoftirqd/300:05:153
61119998,1cyclictest35-21ksoftirqd/323:45:183
61119998,1cyclictest35-21ksoftirqd/322:00:223
61119998,1cyclictest35-21ksoftirqd/321:45:173
61119998,1cyclictest35-21ksoftirqd/321:45:163
61119998,1cyclictest35-21ksoftirqd/321:35:133
61119998,1cyclictest35-21ksoftirqd/321:00:003
61119998,1cyclictest35-21ksoftirqd/320:30:153
61119998,1cyclictest35-21ksoftirqd/300:20:143
61119997,1cyclictest35-21ksoftirqd/321:40:163
61119997,1cyclictest35-21ksoftirqd/321:40:163
61119991,6cyclictest21477-21cstates19:40:153
61049999,0cyclictest28-21ksoftirqd/223:40:012
61049999,0cyclictest28-21ksoftirqd/221:58:532
61049999,0cyclictest28-21ksoftirqd/221:45:202
61049999,0cyclictest28-21ksoftirqd/221:45:192
61049998,1cyclictest28-21ksoftirqd/223:45:152
61049998,1cyclictest28-21ksoftirqd/222:45:182
61049998,1cyclictest28-21ksoftirqd/219:55:012
61049998,1cyclictest28-21ksoftirqd/200:25:252
61049997,1cyclictest28-21ksoftirqd/223:15:122
61049997,1cyclictest28-21ksoftirqd/223:15:112
61049997,1cyclictest28-21ksoftirqd/222:35:242
61049997,1cyclictest28-21ksoftirqd/220:40:002
61049997,1cyclictest28-21ksoftirqd/219:34:592
61049997,1cyclictest28-21ksoftirqd/200:10:162
61049996,3cyclictest309471ssh00:00:132
61049994,4cyclictest28-21ksoftirqd/219:55:212
60909998,1cyclictest31417-21diskmemload22:27:280
60909998,1cyclictest31417-21diskmemload00:29:020
60909998,1cyclictest31417-21diskmemload00:17:440
60909998,1cyclictest17604-21ssh21:32:130
60909998,1cyclictest0-21swapper/022:03:150
60909997,1cyclictest16049-21chrt22:55:250
60909993,4cyclictest101rcuc/000:21:080
60909990,1cyclictest10265-21ssh23:31:560
61119988,0cyclictest35-21ksoftirqd/321:05:163
61119988,0cyclictest35-21ksoftirqd/320:05:003
61119988,0cyclictest35-21ksoftirqd/320:05:003
61119988,0cyclictest35-21ksoftirqd/319:32:193
61119987,1cyclictest35-21ksoftirqd/320:05:013
61119987,1cyclictest35-21ksoftirqd/320:00:013
61119987,1cyclictest35-21ksoftirqd/319:20:203
61119986,1cyclictest35-21ksoftirqd/320:20:153
61119986,1cyclictest35-21ksoftirqd/319:25:213
61049987,1cyclictest81861rm23:30:182
61049987,1cyclictest28-21ksoftirqd/222:25:202
61049987,1cyclictest28-21ksoftirqd/221:17:012
61049987,1cyclictest28-21ksoftirqd/221:05:152
61049987,1cyclictest28-21ksoftirqd/220:34:592
61049986,1cyclictest28-21ksoftirqd/222:40:172
60979988,0cyclictest21-21ksoftirqd/122:30:241
60979988,0cyclictest21-21ksoftirqd/122:14:041
60979980,3cyclictest0-21swapper/123:25:171
60909987,1cyclictest31417-21diskmemload21:55:110
60909987,1cyclictest0-21swapper/020:15:120
60909981,1cyclictest17994-21/usr/sbin/munin23:00:180
60909980,8cyclictest9-21ksoftirqd/023:10:010
60909980,8cyclictest9-21ksoftirqd/022:45:350
60909980,8cyclictest9-21ksoftirqd/021:05:040
60909980,8cyclictest9-21ksoftirqd/021:00:280
60909980,8cyclictest9-21ksoftirqd/020:55:070
60909980,8cyclictest9-21ksoftirqd/020:45:010
60909980,8cyclictest9-21ksoftirqd/020:40:040
60909980,8cyclictest9-21ksoftirqd/020:35:010
60909980,8cyclictest9-21ksoftirqd/020:30:100
60909980,8cyclictest9-21ksoftirqd/020:25:110
60909980,8cyclictest9-21ksoftirqd/020:10:190
60909980,8cyclictest9-21ksoftirqd/020:00:040
60909980,8cyclictest9-21ksoftirqd/020:00:030
60909980,8cyclictest9-21ksoftirqd/019:50:020
60909980,8cyclictest9-21ksoftirqd/019:45:030
60909980,8cyclictest9-21ksoftirqd/019:35:070
60909980,8cyclictest9-21ksoftirqd/019:30:080
60909980,8cyclictest9-21ksoftirqd/019:25:010
60909980,8cyclictest9-21ksoftirqd/019:20:070
60909980,8cyclictest9-21ksoftirqd/019:15:080
60909980,8cyclictest9-21ksoftirqd/019:10:390
60909980,7cyclictest32276-21ssh21:50:430
60909980,0cyclictest9-21ksoftirqd/022:30:110
60909980,0cyclictest9-21ksoftirqd/021:47:300
60909980,0cyclictest9-21ksoftirqd/021:47:290
60909980,0cyclictest9-21ksoftirqd/020:50:120
60909980,0cyclictest9-21ksoftirqd/020:20:200
61119976,1cyclictest35-21ksoftirqd/320:40:203
61119976,1cyclictest35-21ksoftirqd/320:35:253
61119975,1cyclictest35-21ksoftirqd/319:45:243
60979977,0cyclictest21-21ksoftirqd/123:55:241
60979970,4cyclictest0-21swapper/122:50:131
60979970,3cyclictest0-21swapper/100:15:191
60979966,0cyclictest21-21ksoftirqd/122:00:361
60979966,0cyclictest21-21ksoftirqd/120:15:371
60979965,1cyclictest21-21ksoftirqd/120:10:141
60979960,6cyclictest0-21swapper/122:27:411
60979960,6cyclictest0-21swapper/122:05:081
60979960,6cyclictest0-21swapper/121:45:201
60979960,6cyclictest0-21swapper/121:45:191
60979960,4cyclictest0-21swapper/122:58:491
60979960,4cyclictest0-21swapper/121:12:431
60979960,2cyclictest0-21swapper/123:30:201
60979960,2cyclictest0-21swapper/121:59:341
60979960,1cyclictest0-21swapper/121:20:091
60979955,0cyclictest21-21ksoftirqd/123:45:221
60979955,0cyclictest21-21ksoftirqd/123:13:091
60979955,0cyclictest21-21ksoftirqd/122:16:361
60979951,3cyclictest111rcu_preempt19:20:001
60979951,1cyclictest0-21swapper/100:30:121
60979950,5cyclictest0-21swapper/123:22:191
60979950,5cyclictest0-21swapper/122:47:481
60979950,5cyclictest0-21swapper/121:28:471
60979950,5cyclictest0-21swapper/121:18:171
60979950,5cyclictest0-21swapper/121:05:211
60979950,3cyclictest0-21swapper/121:50:201
60979950,3cyclictest0-21swapper/120:55:121
60979950,3cyclictest0-21swapper/119:53:531
60979950,3cyclictest0-21swapper/100:20:131
60979950,1cyclictest0-21swapper/123:52:131
60979950,1cyclictest0-21swapper/121:40:131
60979950,1cyclictest0-21swapper/121:40:121
60979950,1cyclictest0-21swapper/120:45:191
60979950,0cyclictest111rcu_preempt23:40:191
60979950,0cyclictest0-21swapper/123:38:141
60979950,0cyclictest0-21swapper/100:38:531
60979950,0cyclictest0-21swapper/100:01:071
60979942,1cyclictest0-21swapper/121:00:121
60979941,3cyclictest111rcu_preempt19:35:191
60979941,1cyclictest0-21swapper/120:20:141
60979941,1cyclictest0-21swapper/119:20:181
60979940,4cyclictest0-21swapper/119:32:181
60979940,4cyclictest0-21swapper/119:25:221
60979940,4cyclictest0-21swapper/100:25:001
60979940,3cyclictest0-21swapper/119:45:171
60979940,2cyclictest0-21swapper/123:15:181
60979940,2cyclictest0-21swapper/123:15:171
60979940,2cyclictest0-21swapper/123:00:141
60979940,2cyclictest0-21swapper/121:30:151
60979940,2cyclictest0-21swapper/120:00:161
60979940,2cyclictest0-21swapper/120:00:151
60979940,2cyclictest0-21swapper/119:11:251
60979940,2cyclictest0-21swapper/100:11:211
60979940,1cyclictest0-21swapper/122:40:241
60979940,1cyclictest0-21swapper/100:05:141
60979940,0cyclictest111rcu_preempt22:20:221
60979940,0cyclictest0-21swapper/120:35:161
60979931,1cyclictest0-21swapper/119:55:141
60979931,0cyclictest0-21swapper/119:40:161
60979930,2cyclictest0-21swapper/120:50:001
60979930,2cyclictest0-21swapper/120:40:191
60979930,1cyclictest10370-21chrt20:25:111
60979930,1cyclictest0-21swapper/120:05:021
60979920,1cyclictest12713-21taskset20:30:031
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional