You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-21 - 22:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack1slot1.osadl.org (updated Fri Nov 21, 2025 12:45:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
262412208150,44sleep20-21swapper/207:08:192
260332208160,23sleep30-21swapper/307:05:343
262152205150,21sleep10-21swapper/107:07:581
261672197159,25sleep00-21swapper/007:07:200
2646599178,3cyclictest28-21ksoftirqd/211:29:232
26465991717,0cyclictest28-21ksoftirqd/211:00:272
26455991615,1cyclictest9-21ksoftirqd/011:35:000
52252150,0sleep10-21swapper/108:40:011
26455991515,0cyclictest9-21ksoftirqd/009:40:160
169222150,1sleep016925-21fschecks_time11:20:170
298562140,0sleep20-21swapper/211:37:252
2645699140,14cyclictest0-21swapper/111:30:181
26455991414,0cyclictest9-21ksoftirqd/012:40:010
26455991413,1cyclictest9-21ksoftirqd/011:55:130
26455991413,1cyclictest9-21ksoftirqd/011:50:160
26455991413,1cyclictest9-21ksoftirqd/010:55:210
26455991412,1cyclictest9-21ksoftirqd/009:35:120
26465991311,1cyclictest28-21ksoftirqd/210:35:202
2645699130,12cyclictest0-21swapper/107:45:091
26455991313,0cyclictest9-21ksoftirqd/010:30:160
26455991312,1cyclictest9-21ksoftirqd/012:25:120
26455991312,1cyclictest9-21ksoftirqd/010:10:000
26455991312,1cyclictest9-21ksoftirqd/010:10:000
26455991312,1cyclictest9-21ksoftirqd/010:05:000
26455991311,1cyclictest9-21ksoftirqd/011:45:160
26465991211,1cyclictest28-21ksoftirqd/208:30:012
26465991210,1cyclictest28-21ksoftirqd/212:30:212
2645599129,2cyclictest9-21ksoftirqd/007:20:130
26455991211,1cyclictest9-21ksoftirqd/011:15:210
26455991211,1cyclictest9-21ksoftirqd/011:00:160
26455991211,1cyclictest9-21ksoftirqd/009:25:150
26455991210,1cyclictest9-21ksoftirqd/010:50:160
26455991210,1cyclictest9-21ksoftirqd/009:05:230
26455991210,1cyclictest9-21ksoftirqd/008:55:000
303282110,0sleep019210-21diskmemload12:24:260
2647399119,1cyclictest35-21ksoftirqd/310:45:003
26473991110,1cyclictest35-21ksoftirqd/309:25:013
2646599119,1cyclictest28-21ksoftirqd/212:25:142
2646599119,1cyclictest28-21ksoftirqd/210:05:142
2646599119,1cyclictest28-21ksoftirqd/210:05:132
26465991110,1cyclictest28-21ksoftirqd/212:15:162
26465991110,1cyclictest28-21ksoftirqd/211:50:112
26465991110,1cyclictest28-21ksoftirqd/211:34:542
26465991110,1cyclictest28-21ksoftirqd/211:09:512
26465991110,1cyclictest28-21ksoftirqd/209:51:482
26465991110,1cyclictest28-21ksoftirqd/209:40:362
26465991110,1cyclictest28-21ksoftirqd/209:25:212
26465991110,1cyclictest28-21ksoftirqd/209:00:102
26465991110,0cyclictest28-21ksoftirqd/210:00:142
2646599110,8cyclictest0-21swapper/211:10:182
2645599113,4cyclictest23262-21latency_hist10:45:000
26455991111,0cyclictest9-21ksoftirqd/010:25:210
26455991111,0cyclictest9-21ksoftirqd/008:10:090
26455991111,0cyclictest9-21ksoftirqd/007:25:080
26455991110,1cyclictest9-21ksoftirqd/011:40:010
26455991110,1cyclictest9-21ksoftirqd/011:25:010
26455991110,1cyclictest9-21ksoftirqd/011:05:130
26455991110,1cyclictest9-21ksoftirqd/009:55:010
26455991110,1cyclictest9-21ksoftirqd/008:00:170
26455991110,1cyclictest9-21ksoftirqd/007:45:100
2647399109,1cyclictest35-21ksoftirqd/312:35:003
2647399109,1cyclictest35-21ksoftirqd/310:40:003
2647399109,1cyclictest35-21ksoftirqd/310:10:003
2647399109,1cyclictest35-21ksoftirqd/310:09:593
2646599109,1cyclictest28-21ksoftirqd/212:10:212
2646599109,1cyclictest28-21ksoftirqd/212:00:192
2646599109,1cyclictest28-21ksoftirqd/211:40:152
2646599109,1cyclictest28-21ksoftirqd/211:20:132
2646599109,1cyclictest28-21ksoftirqd/210:30:142
2646599109,1cyclictest28-21ksoftirqd/210:20:112
2646599109,1cyclictest28-21ksoftirqd/210:17:012
2646599109,1cyclictest28-21ksoftirqd/208:20:182
2646599109,1cyclictest0-21swapper/207:20:132
2646599109,0cyclictest28-21ksoftirqd/211:15:152
2646599108,1cyclictest28-21ksoftirqd/212:39:132
2646599108,1cyclictest28-21ksoftirqd/211:45:232
2646599108,1cyclictest28-21ksoftirqd/210:47:562
2646599108,1cyclictest28-21ksoftirqd/210:25:212
26465991010,0cyclictest28-21ksoftirqd/211:55:142
26465991010,0cyclictest28-21ksoftirqd/209:18:032
26465991010,0cyclictest28-21ksoftirqd/209:14:142
26465991010,0cyclictest28-21ksoftirqd/207:40:142
2646599100,0cyclictest0-21swapper/208:35:302
2645599109,1cyclictest9-21ksoftirqd/012:05:190
2645599109,1cyclictest9-21ksoftirqd/010:20:120
2645599109,1cyclictest9-21ksoftirqd/010:15:140
2645599109,1cyclictest9-21ksoftirqd/009:55:140
2645599109,1cyclictest9-21ksoftirqd/009:45:110
2645599109,1cyclictest9-21ksoftirqd/008:40:150
2645599109,1cyclictest9-21ksoftirqd/007:30:190
2645599109,1cyclictest9-21ksoftirqd/007:30:180
2645599109,1cyclictest9-21ksoftirqd/007:15:000
2645599108,1cyclictest9-21ksoftirqd/012:01:030
2645599108,1cyclictest9-21ksoftirqd/010:15:010
2645599105,4cyclictest9-21ksoftirqd/008:25:170
26455991010,0cyclictest9-21ksoftirqd/012:30:160
26455991010,0cyclictest9-21ksoftirqd/012:17:160
26455991010,0cyclictest9-21ksoftirqd/011:10:120
26455991010,0cyclictest9-21ksoftirqd/009:31:530
26455991010,0cyclictest9-21ksoftirqd/009:15:140
264739998,1cyclictest35-21ksoftirqd/311:14:593
264739998,1cyclictest35-21ksoftirqd/310:00:003
264739998,1cyclictest35-21ksoftirqd/309:20:013
264739997,1cyclictest35-21ksoftirqd/311:45:153
264739992,5cyclictest23520-21apt-get08:10:103
264739990,2cyclictest0-21swapper/309:30:113
264659999,0cyclictest28-21ksoftirqd/212:23:222
264659999,0cyclictest28-21ksoftirqd/210:55:132
264659999,0cyclictest28-21ksoftirqd/209:35:322
264659998,1cyclictest28-21ksoftirqd/212:05:222
264659998,1cyclictest28-21ksoftirqd/210:41:202
264659998,1cyclictest28-21ksoftirqd/209:46:462
264659998,0cyclictest28-21ksoftirqd/209:20:162
264659997,1cyclictest28-21ksoftirqd/208:45:162
264659993,6cyclictest28-21ksoftirqd/208:54:592
264659990,0cyclictest0-21swapper/207:50:432
264559999,0cyclictest9-21ksoftirqd/012:10:120
264559999,0cyclictest9-21ksoftirqd/010:45:140
264559999,0cyclictest9-21ksoftirqd/009:20:490
264559999,0cyclictest9-21ksoftirqd/009:10:100
264559999,0cyclictest9-21ksoftirqd/008:05:140
264559998,1cyclictest9-21ksoftirqd/008:55:140
264559998,1cyclictest9-21ksoftirqd/008:20:000
264559990,5cyclictest9036-21kworker/0:007:35:210
264559990,3cyclictest0-21swapper/009:00:110
264739987,1cyclictest35-21ksoftirqd/311:40:013
264739987,1cyclictest35-21ksoftirqd/308:20:003
264739987,1cyclictest35-21ksoftirqd/308:05:003
264739987,1cyclictest35-21ksoftirqd/307:15:003
264739987,0cyclictest35-21ksoftirqd/310:10:513
264739986,1cyclictest13863-21ntpq11:15:183
264739985,2cyclictest15708-21sh10:33:593
264739984,3cyclictest35-21ksoftirqd/310:53:453
264739981,5cyclictest26446-21cyclictest11:35:273
264739981,4cyclictest0-21swapper/307:25:133
264739980,6cyclictest0-21swapper/310:17:493
264659988,0cyclictest13758-21sensors08:55:202
264659987,1cyclictest28-21ksoftirqd/210:53:072
264659987,1cyclictest28-21ksoftirqd/209:55:212
264659986,1cyclictest8901-21sendmail-msp07:40:012
264659986,1cyclictest31781-21cat10:10:152
264659983,5cyclictest28-21ksoftirqd/209:30:232
264569981,6cyclictest8026-21chrt11:07:401
264569980,5cyclictest0-21swapper/110:02:241
264559987,1cyclictest9-21ksoftirqd/008:00:000
264559987,1cyclictest9-21ksoftirqd/007:50:140
264559986,1cyclictest9-21ksoftirqd/011:40:160
264559986,1cyclictest9-21ksoftirqd/008:45:150
264559986,1cyclictest9-21ksoftirqd/008:20:190
264559986,1cyclictest9-21ksoftirqd/007:15:010
264559984,1cyclictest254-21systemd-journal07:45:010
264559980,7cyclictest0-21swapper/008:30:180
264559980,6cyclictest18468-21ssh10:36:330
11692280,1sleep10-21swapper/111:57:151
264739976,1cyclictest35-21ksoftirqd/312:40:003
264739976,1cyclictest35-21ksoftirqd/309:39:593
264739975,1cyclictest5775-21ssh11:50:123
264739975,1cyclictest35-21ksoftirqd/307:40:013
264739975,1cyclictest343-21ssh09:25:453
264739975,1cyclictest19210-21diskmemload10:55:203
264739974,1cyclictest35-21ksoftirqd/308:58:363
264739971,4cyclictest819-21lldpd12:09:223
264739971,4cyclictest0-21swapper/310:20:123
264739971,3cyclictest1852-21apt-get11:00:133
264739971,2cyclictest13076-21apt-get12:00:133
264739970,3cyclictest0-21swapper/312:28:583
264739970,0cyclictest0-21swapper/309:45:103
264659976,1cyclictest60950irq/123-eno108:10:112
264659976,1cyclictest28-21ksoftirqd/209:05:182
264659976,1cyclictest21418-21kworker/2:008:05:092
264659975,1cyclictest28-21ksoftirqd/207:45:112
264569971,5cyclictest0-21swapper/109:20:151
264569970,5cyclictest0-21swapper/110:18:141
264569970,4cyclictest0-21swapper/112:01:011
264569970,4cyclictest0-21swapper/111:28:211
264559977,0cyclictest9-21ksoftirqd/008:35:120
21855270,0sleep10-21swapper/110:40:491
264739966,0cyclictest35-21ksoftirqd/308:25:013
264739966,0cyclictest10742-21sensors11:55:173
264739965,1cyclictest35-21ksoftirqd/309:05:003
264739965,1cyclictest35-21ksoftirqd/308:40:013
264739965,1cyclictest35-21ksoftirqd/307:15:013
264739965,1cyclictest29095-21ssh12:20:293
264739965,1cyclictest25876-21ssh12:16:363
264739965,1cyclictest17824-21ntpq09:50:183
264739965,1cyclictest11480-21ssh09:40:513
264739965,0cyclictest19210-21diskmemload10:25:273
264739964,1cyclictest35-21ksoftirqd/309:09:593
264739964,1cyclictest35-21ksoftirqd/308:25:013
264739964,1cyclictest20953-21if_err_eno111:25:163
264739963,1cyclictest254-21systemd-journal07:44:563
264739962,1cyclictest20144-21/usr/sbin/munin12:10:153
264739961,2cyclictest21115-21apt-get08:05:093
264739961,2cyclictest19210-21diskmemload11:06:253
264739961,1cyclictest16268-21apt-get11:20:123
264739961,1cyclictest0-21swapper/309:10:113
264739960,6cyclictest0-21swapper/310:01:593
264739960,3cyclictest11454-21kworker/3:008:40:153
264739960,3cyclictest0-21swapper/311:30:493
264739960,2cyclictest17448-21proc_pri07:55:183
264739960,1cyclictest25956-21ssh10:47:283
264659966,0cyclictest60950irq/123-eno108:30:112
264659966,0cyclictest23065-21kworker/2:208:15:212
264659966,0cyclictest21418-21kworker/2:007:55:192
264659965,1cyclictest28-21ksoftirqd/208:40:142
264659965,1cyclictest21418-21kworker/2:007:10:122
264659965,1cyclictest19689-21ntpq08:00:182
264659964,1cyclictest28-21ksoftirqd/207:15:012
264659963,1cyclictest254-21systemd-journal07:30:192
264659963,1cyclictest254-21systemd-journal07:30:192
264569961,2cyclictest0-21swapper/112:14:541
264569960,6cyclictest0-21swapper/110:05:221
264569960,6cyclictest0-21swapper/110:05:211
264569960,6cyclictest0-21swapper/107:20:211
264569960,4cyclictest0-21swapper/112:30:141
264569960,4cyclictest0-21swapper/110:53:431
264569960,4cyclictest0-21swapper/109:10:491
264569960,3cyclictest0-21swapper/111:11:061
264739952,2cyclictest4380-21apt-get07:30:103
264739952,2cyclictest4380-21apt-get07:30:103
264739952,1cyclictest35-21ksoftirqd/307:21:043
264739952,1cyclictest254-21systemd-journal08:55:003
264739950,2cyclictest13828-21apt-get07:50:133
264739950,1cyclictest0-21swapper/308:45:173
264739950,1cyclictest0-21swapper/307:45:193
264659954,1cyclictest28-21ksoftirqd/207:25:132
264569955,0cyclictest0-21swapper/112:21:081
264569955,0cyclictest0-21swapper/111:40:241
264569955,0cyclictest0-21swapper/109:35:121
264569954,1cyclictest0-21swapper/108:30:131
264569953,1cyclictest0-21swapper/109:53:441
264569952,3cyclictest0-21swapper/108:40:201
264569952,2cyclictest0-21swapper/108:10:111
264569951,1cyclictest0-21swapper/110:30:151
264569950,4cyclictest0-21swapper/111:35:211
264569950,3cyclictest0-21swapper/112:28:281
264569950,3cyclictest0-21swapper/111:02:011
264569950,3cyclictest0-21swapper/110:55:051
264569950,3cyclictest0-21swapper/110:11:101
264569950,3cyclictest0-21swapper/109:40:531
264569950,2cyclictest0-21swapper/112:35:171
264569950,2cyclictest0-21swapper/112:05:161
264569950,2cyclictest0-21swapper/111:51:091
264569950,2cyclictest0-21swapper/110:35:121
264569950,2cyclictest0-21swapper/110:20:221
264569950,1cyclictest0-21swapper/110:45:161
264569950,1cyclictest0-21swapper/110:28:511
264569950,1cyclictest0-21swapper/109:55:131
264569950,1cyclictest0-21swapper/109:16:171
264569950,1cyclictest0-21swapper/108:45:121
264569950,0cyclictest0-21swapper/112:18:491
264569950,0cyclictest0-21swapper/111:15:111
264569950,0cyclictest0-21swapper/109:45:201
264569950,0cyclictest0-21swapper/107:55:161
264739942,1cyclictest742-21runrttasks08:30:093
264569943,1cyclictest18907-21chrt09:06:201
264569943,1cyclictest0-21swapper/107:30:121
264569943,1cyclictest0-21swapper/107:30:121
264569941,2cyclictest0-21swapper/108:50:151
264569941,1cyclictest0-21swapper/107:10:131
264569940,4cyclictest0-21swapper/109:30:401
264569940,4cyclictest0-21swapper/109:25:191
264569940,4cyclictest0-21swapper/107:25:171
264569940,3cyclictest0-21swapper/111:45:041
264569940,1cyclictest0-21swapper/111:20:161
264569940,0cyclictest0-21swapper/107:15:011
264569933,0cyclictest0-21swapper/108:00:121
264569932,1cyclictest8725-21chrt07:38:281
264569931,1cyclictest0-21swapper/108:20:131
264569931,1cyclictest0-21swapper/108:15:131
264569931,1cyclictest0-21swapper/108:05:081
264569931,1cyclictest0-21swapper/107:50:121
264569930,2cyclictest0-21swapper/107:40:151
264569930,1cyclictest0-21swapper/108:55:171
264569930,1cyclictest0-21swapper/108:25:171
264569930,0cyclictest0-21swapper/109:00:191
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional