You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-03 - 22:35
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Wed Dec 03, 2025 12:45:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
55712225156,55sleep00-21swapper/007:05:110
55692210160,24sleep30-21swapper/307:05:103
73282204151,22sleep10-21swapper/107:05:281
75482199160,25sleep20-21swapper/207:08:222
250932740,0sleep2654-21diskmemload11:10:212
295102650,0sleep00-21swapper/012:03:060
133792210,0sleep10-21swapper/109:25:181
7782991817,1cyclictest28-21ksoftirqd/209:40:132
7782991614,1cyclictest28-21ksoftirqd/209:49:232
7782991613,1cyclictest28-21ksoftirqd/210:14:162
7782991515,0cyclictest28-21ksoftirqd/211:01:342
7782991513,1cyclictest28-21ksoftirqd/209:10:162
7793991412,1cyclictest654-21diskmemload09:56:153
7782991312,1cyclictest28-21ksoftirqd/210:49:472
7782991311,1cyclictest28-21ksoftirqd/210:50:202
7782991311,1cyclictest28-21ksoftirqd/210:50:202
7782991311,1cyclictest28-21ksoftirqd/207:45:002
778299130,12cyclictest25796-21cron08:55:002
7793991211,1cyclictest35-21ksoftirqd/311:50:003
7782991211,1cyclictest28-21ksoftirqd/211:35:212
7782991211,1cyclictest28-21ksoftirqd/209:36:192
7782991210,1cyclictest28-21ksoftirqd/212:31:332
7782991210,1cyclictest28-21ksoftirqd/212:20:172
7782991210,1cyclictest28-21ksoftirqd/212:10:172
7782991210,1cyclictest28-21ksoftirqd/208:15:002
7763991211,1cyclictest9-21ksoftirqd/010:30:000
7763991211,1cyclictest9-21ksoftirqd/009:10:140
7763991210,1cyclictest9-21ksoftirqd/011:10:000
7763991210,1cyclictest9-21ksoftirqd/009:00:000
7793991110,1cyclictest35-21ksoftirqd/312:00:003
7793991110,1cyclictest35-21ksoftirqd/309:20:003
778299119,1cyclictest28-21ksoftirqd/209:50:152
778299119,1cyclictest28-21ksoftirqd/207:40:002
778299118,0cyclictest0-21swapper/211:29:392
7782991110,1cyclictest28-21ksoftirqd/212:15:202
7782991110,1cyclictest28-21ksoftirqd/212:00:112
7782991110,1cyclictest28-21ksoftirqd/211:55:412
7782991110,1cyclictest28-21ksoftirqd/211:52:492
7782991110,1cyclictest28-21ksoftirqd/211:34:022
7782991110,1cyclictest28-21ksoftirqd/211:05:162
7782991110,1cyclictest28-21ksoftirqd/210:15:162
7782991110,1cyclictest28-21ksoftirqd/209:34:542
7782991110,1cyclictest28-21ksoftirqd/209:34:542
7782991110,1cyclictest28-21ksoftirqd/208:40:132
7782991110,1cyclictest28-21ksoftirqd/208:30:152
776399119,1cyclictest9-21ksoftirqd/011:50:000
776399119,1cyclictest9-21ksoftirqd/011:00:140
776399119,1cyclictest654-21diskmemload09:59:150
776399113,4cyclictest1760-21perf09:55:010
79712100,0sleep3654-21diskmemload11:33:063
779399109,1cyclictest35-21ksoftirqd/311:10:133
779399109,1cyclictest35-21ksoftirqd/310:55:203
779399109,1cyclictest35-21ksoftirqd/309:45:153
779399109,1cyclictest35-21ksoftirqd/307:45:003
779399108,1cyclictest35-21ksoftirqd/310:50:133
779399108,1cyclictest35-21ksoftirqd/310:50:133
778299109,1cyclictest28-21ksoftirqd/212:35:162
778299109,1cyclictest28-21ksoftirqd/212:25:222
778299109,1cyclictest28-21ksoftirqd/211:20:242
778299109,1cyclictest28-21ksoftirqd/211:15:182
778299109,1cyclictest28-21ksoftirqd/210:55:162
778299109,1cyclictest28-21ksoftirqd/210:30:202
778299109,1cyclictest28-21ksoftirqd/210:05:112
778299109,1cyclictest28-21ksoftirqd/210:00:222
778299109,1cyclictest28-21ksoftirqd/209:55:232
778299109,1cyclictest28-21ksoftirqd/209:25:182
778299109,1cyclictest28-21ksoftirqd/209:15:462
778299109,1cyclictest28-21ksoftirqd/208:05:192
778299108,1cyclictest28-21ksoftirqd/210:20:152
778299108,1cyclictest28-21ksoftirqd/209:20:142
778299108,1cyclictest18721-21ls08:40:002
7782991010,0cyclictest28-21ksoftirqd/210:38:362
7782991010,0cyclictest28-21ksoftirqd/208:25:172
777199100,0cyclictest0-21swapper/108:25:191
776399109,1cyclictest9-21ksoftirqd/012:25:150
776399109,1cyclictest9-21ksoftirqd/011:55:370
776399109,1cyclictest9-21ksoftirqd/011:10:210
776399109,1cyclictest9-21ksoftirqd/009:05:010
776399109,1cyclictest9-21ksoftirqd/007:30:000
77939998,1cyclictest35-21ksoftirqd/310:40:143
77939998,1cyclictest35-21ksoftirqd/308:55:003
77939997,1cyclictest35-21ksoftirqd/311:55:003
77829999,0cyclictest28-21ksoftirqd/212:05:432
77829998,1cyclictest28-21ksoftirqd/211:45:232
77829998,1cyclictest28-21ksoftirqd/210:27:282
77829998,1cyclictest28-21ksoftirqd/209:05:112
77829998,0cyclictest28-21ksoftirqd/210:40:202
77639998,1cyclictest9-21ksoftirqd/012:24:590
77639998,1cyclictest9-21ksoftirqd/011:40:140
77639998,1cyclictest9-21ksoftirqd/011:25:130
77639998,1cyclictest9-21ksoftirqd/010:35:160
77639997,1cyclictest9-21ksoftirqd/010:45:000
77639997,1cyclictest30006-21ssh10:33:540
77939988,0cyclictest35-21ksoftirqd/310:45:003
77939987,1cyclictest35-21ksoftirqd/311:15:163
77939987,1cyclictest35-21ksoftirqd/310:25:133
77939987,1cyclictest35-21ksoftirqd/307:55:003
77939986,1cyclictest35-21ksoftirqd/309:25:163
77939980,5cyclictest5654-21ntp_states09:15:193
77939980,5cyclictest0-21swapper/312:15:123
77939980,4cyclictest0-21swapper/312:37:173
77829988,0cyclictest28-21ksoftirqd/211:40:162
77829988,0cyclictest28-21ksoftirqd/208:00:202
77829987,1cyclictest28-21ksoftirqd/209:00:012
77829987,1cyclictest28-21ksoftirqd/207:20:162
77829986,1cyclictest28-21ksoftirqd/208:25:002
77829986,1cyclictest28-21ksoftirqd/208:00:002
77829986,1cyclictest28-21ksoftirqd/207:15:152
77829986,1cyclictest28-21ksoftirqd/207:10:182
77829986,1cyclictest1930-21kworker/2:108:45:122
77829985,2cyclictest28-21ksoftirqd/207:35:002
77829980,1cyclictest0-21swapper/207:50:112
77719988,0cyclictest21-21ksoftirqd/112:22:091
77719988,0cyclictest21-21ksoftirqd/112:06:551
77719980,6cyclictest0-21swapper/111:30:471
77639987,1cyclictest9-21ksoftirqd/012:35:150
77639987,1cyclictest9-21ksoftirqd/012:15:140
77639987,1cyclictest9-21ksoftirqd/012:05:190
77639987,1cyclictest9-21ksoftirqd/011:40:010
77639987,1cyclictest9-21ksoftirqd/010:55:130
77639987,1cyclictest9-21ksoftirqd/009:30:140
77639987,1cyclictest9-21ksoftirqd/009:30:140
77639987,1cyclictest9-21ksoftirqd/008:24:590
77639986,1cyclictest9-21ksoftirqd/008:00:000
77639986,1cyclictest20402-21switchtime08:40:190
77639984,2cyclictest254-21systemd-journal07:25:000
77639984,1cyclictest9-21ksoftirqd/011:55:000
77639981,6cyclictest27035-21/usr/sbin/munin11:15:180
77639980,7cyclictest0-21swapper/009:35:180
77939977,0cyclictest35-21ksoftirqd/311:35:163
77939977,0cyclictest35-21ksoftirqd/310:00:173
77939976,1cyclictest35-21ksoftirqd/312:25:163
77939976,1cyclictest10324-21ntpq10:05:193
77939975,1cyclictest8857-21cat07:10:153
77939975,1cyclictest730-21ssh10:37:393
77939971,6cyclictest10319-21munin-node08:22:393
77939971,4cyclictest0-21swapper/309:35:103
77939971,2cyclictest0-21swapper/307:30:193
77939970,2cyclictest0-21swapper/310:33:413
77829975,1cyclictest28-21ksoftirqd/208:55:172
77829975,1cyclictest28-21ksoftirqd/208:20:002
77829971,1cyclictest16059-21tr07:25:142
77719977,0cyclictest21-21ksoftirqd/111:10:131
77719970,7cyclictest0-21swapper/110:55:121
77719970,7cyclictest0-21swapper/110:35:221
77719970,7cyclictest0-21swapper/109:42:141
77719970,6cyclictest0-21swapper/109:31:041
77719970,6cyclictest0-21swapper/109:31:041
77719970,5cyclictest0-21swapper/108:20:141
77719970,1cyclictest0-21swapper/109:18:341
77719970,0cyclictest0-21swapper/111:45:221
77719970,0cyclictest0-21swapper/110:22:361
77639976,1cyclictest9-21ksoftirqd/008:50:000
77639976,1cyclictest9-21ksoftirqd/007:18:440
77639975,1cyclictest9-21ksoftirqd/008:55:000
77639972,4cyclictest654-21diskmemload12:10:170
77639972,4cyclictest0-21swapper/009:45:180
77639972,1cyclictest672-21idleruntime-cro09:10:000
77639971,6cyclictest9199-21telnet10:05:130
77639971,6cyclictest7938-21ssh10:47:120
77639970,6cyclictest9639-21ssh10:50:140
77639970,6cyclictest9639-21ssh10:50:140
77639970,6cyclictest7488-21ssh11:31:340
77639970,6cyclictest6968-21ssh09:17:240
77639970,6cyclictest654-21diskmemload12:30:160
77639970,6cyclictest30567-21ssh11:20:040
77639970,6cyclictest24112-21df09:40:140
77639970,6cyclictest17349-21ssh10:15:160
77639970,6cyclictest12711-21ssh10:10:060
77639970,6cyclictest0-21swapper/008:30:140
77639970,1cyclictest7957-21apt-get09:20:000
77639970,1cyclictest5501-21ssh10:00:010
77639970,1cyclictest21717-21head10:20:200
77639970,1cyclictest12167-21ssh09:25:070
7471270,0sleep10-21swapper/110:00:431
77939965,1cyclictest9644-21cat12:20:163
77939965,1cyclictest35-21ksoftirqd/312:30:153
77939965,1cyclictest35-21ksoftirqd/311:05:013
77939965,1cyclictest35-21ksoftirqd/309:00:143
77939965,1cyclictest35-21ksoftirqd/308:25:133
77939965,1cyclictest35-21ksoftirqd/308:00:163
77939965,1cyclictest29066-21ssh12:01:423
77939964,1cyclictest35-21ksoftirqd/309:40:133
77939963,1cyclictest654-21diskmemload11:40:143
77939962,4cyclictest9204-21kworker/u8:110:10:273
77939960,6cyclictest7753-21cyclictest11:09:253
77939960,3cyclictest30848-21/usr/sbin/munin09:50:153
77939960,2cyclictest0-21swapper/312:14:083
77939960,2cyclictest0-21swapper/312:07:133
77939960,2cyclictest0-21swapper/311:26:403
77939960,2cyclictest0-21swapper/310:20:093
77939960,2cyclictest0-21swapper/310:16:543
77939960,2cyclictest0-21swapper/307:55:123
77939960,1cyclictest0-21swapper/309:33:133
77939960,1cyclictest0-21swapper/309:33:133
77829965,1cyclictest28-21ksoftirqd/207:45:182
77719966,0cyclictest21-21ksoftirqd/111:51:411
77719966,0cyclictest0-21swapper/112:10:201
77719965,1cyclictest21-21ksoftirqd/110:05:471
77719962,1cyclictest111rcu_preempt09:35:201
77719961,2cyclictest0-21swapper/111:35:131
77719960,6cyclictest0-21swapper/111:21:161
77719960,6cyclictest0-21swapper/110:25:271
77719960,6cyclictest0-21swapper/107:55:181
77719960,3cyclictest0-21swapper/111:40:361
77719960,2cyclictest0-21swapper/110:53:271
77719960,2cyclictest0-21swapper/110:53:261
77719960,2cyclictest0-21swapper/108:05:111
77719960,2cyclictest0-21swapper/107:15:001
77719960,1cyclictest0-21swapper/112:30:121
77719960,1cyclictest0-21swapper/110:10:121
77719960,1cyclictest0-21swapper/109:52:401
77639965,1cyclictest9-21ksoftirqd/008:25:130
77639965,1cyclictest9-21ksoftirqd/008:10:140
77639965,1cyclictest9-21ksoftirqd/008:00:010
77639962,1cyclictest254-21systemd-journal07:15:000
77639960,1cyclictest2581-21cstates08:05:130
707260,0sleep30-21swapper/311:22:443
77939955,0cyclictest35-21ksoftirqd/309:10:163
77939955,0cyclictest35-21ksoftirqd/307:20:143
77939954,1cyclictest35-21ksoftirqd/309:05:143
77939954,1cyclictest35-21ksoftirqd/307:35:163
77939954,1cyclictest15751-21apt-get07:25:123
77939952,3cyclictest10321-21kworker/3:107:45:143
77939952,1cyclictest254-21systemd-journal08:45:003
77939952,1cyclictest11512-21df07:15:153
77939951,2cyclictest4576-21apt-get08:10:123
77939950,2cyclictest0-21swapper/308:45:123
77719955,0cyclictest21-21ksoftirqd/112:00:101
77719955,0cyclictest21-21ksoftirqd/107:50:191
77719955,0cyclictest0-21swapper/111:56:491
77719955,0cyclictest0-21swapper/110:40:391
77719952,1cyclictest0-21swapper/108:45:151
77719951,2cyclictest10619-21chrt09:21:291
77719951,1cyclictest0-21swapper/109:10:171
77719950,5cyclictest0-21swapper/110:15:471
77719950,5cyclictest0-21swapper/108:53:261
77719950,4cyclictest0-21swapper/111:25:161
77719950,3cyclictest0-21swapper/112:38:391
77719950,3cyclictest0-21swapper/111:15:351
77719950,3cyclictest0-21swapper/111:06:491
77719950,2cyclictest0-21swapper/112:29:441
77719950,2cyclictest0-21swapper/110:45:011
77719950,2cyclictest0-21swapper/107:40:121
77719950,1cyclictest0-21swapper/112:16:241
77719950,1cyclictest0-21swapper/111:00:141
77719950,1cyclictest0-21swapper/110:30:421
77719950,1cyclictest0-21swapper/109:55:491
77719950,1cyclictest0-21swapper/108:55:121
77719950,0cyclictest0-21swapper/107:32:531
77719950,0cyclictest0-21swapper/107:25:431
77639954,1cyclictest9-21ksoftirqd/007:30:140
77639950,5cyclictest0-21swapper/007:45:310
77639950,4cyclictest22877-21chrt07:40:120
77639950,4cyclictest20465-21/usr/sbin/munin07:35:180
77639950,3cyclictest0-21swapper/008:35:120
77639950,0cyclictest0-21swapper/008:15:160
77639950,0cyclictest0-21swapper/007:50:110
77939944,0cyclictest3622-21sensors08:05:203
77939944,0cyclictest35-21ksoftirqd/308:35:003
77939944,0cyclictest0-21swapper/308:34:463
77939943,1cyclictest35-21ksoftirqd/308:15:153
77939942,1cyclictest26036-21/usr/sbin/munin08:55:143
77719943,1cyclictest0-21swapper/109:45:181
77719942,1cyclictest0-21swapper/108:35:121
77719940,4cyclictest0-21swapper/108:40:191
77719940,4cyclictest0-21swapper/107:20:301
77719940,2cyclictest0-21swapper/109:06:111
77719940,1cyclictest0-21swapper/108:35:001
77719940,0cyclictest0-21swapper/109:00:201
77719940,0cyclictest0-21swapper/108:10:201
77719940,0cyclictest0-21swapper/108:00:121
77719931,1cyclictest0-21swapper/107:35:141
77719930,1cyclictest0-21swapper/108:15:121
77719930,1cyclictest0-21swapper/107:45:141
77719930,0cyclictest0-21swapper/107:15:061
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional