You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-30 - 00:15
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rack1slot1.osadl.org (updated Sat Nov 29, 2025 12:45:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
219162212151,47sleep00-21swapper/007:05:510
222322209158,25sleep30-21swapper/307:09:563
219692204150,39sleep10-21swapper/107:06:321
221152202162,26sleep20-21swapper/207:08:272
13062600,0sleep10-21swapper/112:35:151
22347991818,0cyclictest35-21ksoftirqd/310:36:243
22347991717,0cyclictest35-21ksoftirqd/310:14:093
22347991717,0cyclictest35-21ksoftirqd/309:43:443
22347991717,0cyclictest35-21ksoftirqd/309:18:273
22347991616,0cyclictest35-21ksoftirqd/312:12:053
22347991616,0cyclictest35-21ksoftirqd/311:21:293
22347991616,0cyclictest35-21ksoftirqd/310:55:513
22347991616,0cyclictest35-21ksoftirqd/310:43:213
22347991616,0cyclictest35-21ksoftirqd/309:36:243
22347991515,0cyclictest35-21ksoftirqd/311:01:323
22338991513,1cyclictest28-21ksoftirqd/207:25:132
22347991414,0cyclictest35-21ksoftirqd/312:23:263
22347991414,0cyclictest35-21ksoftirqd/309:55:273
22347991414,0cyclictest35-21ksoftirqd/309:47:193
22347991414,0cyclictest35-21ksoftirqd/309:11:453
22347991313,0cyclictest35-21ksoftirqd/312:36:273
22347991313,0cyclictest35-21ksoftirqd/312:15:383
22347991313,0cyclictest35-21ksoftirqd/310:03:013
22347991313,0cyclictest35-21ksoftirqd/309:53:373
22347991313,0cyclictest35-21ksoftirqd/309:30:393
22347991313,0cyclictest35-21ksoftirqd/308:53:173
22347991312,1cyclictest35-21ksoftirqd/312:34:533
22347991312,1cyclictest35-21ksoftirqd/311:35:013
22347991312,1cyclictest35-21ksoftirqd/309:25:013
22338991311,1cyclictest28-21ksoftirqd/211:00:002
22338991311,1cyclictest28-21ksoftirqd/210:15:152
2233599130,12cyclictest0-21swapper/110:10:171
202862130,0sleep30-21swapper/308:10:193
2234799127,2cyclictest35-21ksoftirqd/307:15:123
22347991212,0cyclictest35-21ksoftirqd/311:59:173
22347991212,0cyclictest35-21ksoftirqd/311:54:333
22347991212,0cyclictest35-21ksoftirqd/311:11:143
22347991212,0cyclictest35-21ksoftirqd/310:54:363
22347991212,0cyclictest35-21ksoftirqd/310:19:593
22347991212,0cyclictest35-21ksoftirqd/309:05:233
22347991211,1cyclictest35-21ksoftirqd/308:35:003
22347991211,1cyclictest35-21ksoftirqd/308:00:013
22347991210,1cyclictest35-21ksoftirqd/310:30:213
22338991211,1cyclictest28-21ksoftirqd/212:10:012
22338991211,1cyclictest28-21ksoftirqd/210:00:142
22338991210,1cyclictest28-21ksoftirqd/211:20:142
22338991210,1cyclictest28-21ksoftirqd/210:40:142
22338991210,1cyclictest28-21ksoftirqd/209:45:152
22338991210,1cyclictest28-21ksoftirqd/209:20:212
22338991210,1cyclictest28-21ksoftirqd/208:30:142
2234799118,1cyclictest341rcuc/308:05:123
22347991111,0cyclictest35-21ksoftirqd/312:02:393
22347991111,0cyclictest35-21ksoftirqd/311:45:363
22347991111,0cyclictest35-21ksoftirqd/311:40:173
22347991111,0cyclictest35-21ksoftirqd/311:15:003
22347991111,0cyclictest35-21ksoftirqd/310:09:573
22347991111,0cyclictest35-21ksoftirqd/309:28:073
22347991111,0cyclictest35-21ksoftirqd/308:29:593
22347991111,0cyclictest35-21ksoftirqd/308:20:003
22347991111,0cyclictest35-21ksoftirqd/307:55:003
22347991111,0cyclictest35-21ksoftirqd/307:15:003
22347991110,1cyclictest35-21ksoftirqd/312:05:233
22347991110,1cyclictest35-21ksoftirqd/311:35:013
22347991110,1cyclictest35-21ksoftirqd/311:30:003
22347991110,1cyclictest35-21ksoftirqd/311:05:203
22347991110,1cyclictest35-21ksoftirqd/310:45:013
22347991110,1cyclictest35-21ksoftirqd/310:25:213
22347991110,1cyclictest35-21ksoftirqd/310:20:173
22347991110,1cyclictest35-21ksoftirqd/308:40:003
22347991110,1cyclictest35-21ksoftirqd/307:50:013
22347991110,1cyclictest35-21ksoftirqd/307:45:003
22347991110,1cyclictest35-21ksoftirqd/307:34:593
2233899119,1cyclictest28-21ksoftirqd/212:25:192
2233899119,1cyclictest28-21ksoftirqd/212:05:162
2233899119,1cyclictest28-21ksoftirqd/210:25:182
2233899119,1cyclictest28-21ksoftirqd/209:20:002
22338991110,1cyclictest28-21ksoftirqd/209:10:172
2233399119,1cyclictest9-21ksoftirqd/007:20:000
323942100,0sleep10-21swapper/110:15:301
2234799109,1cyclictest35-21ksoftirqd/312:25:173
2234799109,1cyclictest35-21ksoftirqd/308:45:183
2234799109,1cyclictest35-21ksoftirqd/308:40:173
2234799109,1cyclictest35-21ksoftirqd/308:00:143
2234799109,1cyclictest35-21ksoftirqd/307:35:013
2234799109,1cyclictest35-21ksoftirqd/307:30:003
2234799109,1cyclictest35-21ksoftirqd/307:20:193
2234799108,1cyclictest35-21ksoftirqd/309:00:153
2234799108,1cyclictest35-21ksoftirqd/308:55:143
2234799108,1cyclictest35-21ksoftirqd/308:55:133
2234799108,1cyclictest35-21ksoftirqd/308:20:143
2233899109,1cyclictest28-21ksoftirqd/212:20:162
2233899109,1cyclictest28-21ksoftirqd/210:45:242
2233899109,1cyclictest28-21ksoftirqd/210:10:152
2233899109,1cyclictest28-21ksoftirqd/209:55:172
2233899109,1cyclictest28-21ksoftirqd/209:35:182
2233899108,1cyclictest320241tune2fs08:35:162
2233899108,1cyclictest28-21ksoftirqd/211:50:222
2233899108,1cyclictest28-21ksoftirqd/211:45:142
2233899108,1cyclictest28-21ksoftirqd/210:08:252
2233899108,1cyclictest28-21ksoftirqd/209:05:182
22338991010,0cyclictest28-21ksoftirqd/211:15:152
2233399109,1cyclictest9-21ksoftirqd/012:00:000
2233399109,1cyclictest9-21ksoftirqd/011:55:010
2233399103,2cyclictest254-21systemd-journal12:32:340
2233399102,7cyclictest24396-21taskset07:11:560
2233399101,4cyclictest30055-21apt-get09:30:010
2233399100,6cyclictest24685-21munin-node09:20:090
2233399100,6cyclictest11977-21apt-get12:05:130
2233399100,5cyclictest0-21swapper/009:50:140
223389999,0cyclictest28-21ksoftirqd/211:35:122
223389999,0cyclictest28-21ksoftirqd/211:10:172
223389998,1cyclictest28-21ksoftirqd/211:55:202
223389998,1cyclictest28-21ksoftirqd/211:30:192
223389998,1cyclictest28-21ksoftirqd/211:00:132
223389998,1cyclictest28-21ksoftirqd/209:40:202
223389997,1cyclictest28-21ksoftirqd/212:00:182
223389997,1cyclictest28-21ksoftirqd/211:05:132
223389997,1cyclictest28-21ksoftirqd/210:20:152
223389997,1cyclictest28-21ksoftirqd/209:25:142
223389997,1cyclictest28-21ksoftirqd/208:45:132
223389997,1cyclictest28-21ksoftirqd/208:45:012
223389997,1cyclictest28-21ksoftirqd/208:00:142
223389997,1cyclictest28-21ksoftirqd/207:55:152
223389993,5cyclictest24685-21munin-node10:51:002
223359990,4cyclictest0-21swapper/110:36:051
223389987,1cyclictest28-21ksoftirqd/210:35:152
223389987,1cyclictest28-21ksoftirqd/209:54:292
223389987,1cyclictest28-21ksoftirqd/208:55:162
223389987,1cyclictest28-21ksoftirqd/208:55:162
223389987,1cyclictest28-21ksoftirqd/208:25:172
223389986,1cyclictest28-21ksoftirqd/212:35:142
223389986,1cyclictest24650-21munin-node07:15:012
223389980,2cyclictest254-21systemd-journal07:25:002
223359981,6cyclictest0-21swapper/108:05:171
223339986,2cyclictest13453-21cstates09:05:150
223339986,1cyclictest9-21ksoftirqd/007:30:100
223339980,7cyclictest18499-21chrt11:27:530
223339980,6cyclictest254-21systemd-journal10:12:450
223339980,4cyclictest0-21swapper/012:03:330
223339980,3cyclictest0-21swapper/008:20:110
223339980,1cyclictest25472-21ssh11:37:310
223389977,0cyclictest28-21ksoftirqd/212:30:212
223389977,0cyclictest28-21ksoftirqd/211:40:222
223389976,1cyclictest28-21ksoftirqd/211:25:162
223389976,1cyclictest28-21ksoftirqd/210:30:172
223389976,1cyclictest28-21ksoftirqd/208:10:192
223389976,1cyclictest28-21ksoftirqd/207:35:162
223389975,1cyclictest28-21ksoftirqd/209:30:132
223389975,1cyclictest28-21ksoftirqd/208:50:162
223389975,1cyclictest28-21ksoftirqd/207:40:152
223389975,1cyclictest22025-21cstates08:15:142
223389974,1cyclictest254-21systemd-journal12:17:012
223389970,6cyclictest8286-21expr07:45:142
223359971,2cyclictest0-21swapper/111:40:181
223339976,1cyclictest8881-21telnet11:15:130
223339975,1cyclictest14173-21ssh11:20:240
223339973,3cyclictest15245-21diskmemload10:01:160
223339973,0cyclictest0-21swapper/009:45:200
223339971,5cyclictest26868-21ssh12:25:170
223339971,5cyclictest23243-21/usr/sbin/munin10:50:170
223339971,5cyclictest21145-21ssh10:45:220
223339970,6cyclictest7008-21ssh09:40:210
223339970,6cyclictest32628-21ssh11:01:450
223339970,6cyclictest21966-21ssh11:32:400
223339970,6cyclictest15245-21diskmemload10:15:180
223339970,6cyclictest0-21swapper/012:15:050
223339970,6cyclictest0-21swapper/010:55:170
223339970,6cyclictest0-21swapper/010:35:150
223339970,5cyclictest15245-21diskmemload09:10:220
223339970,4cyclictest742-21runrttasks10:08:120
223339970,1cyclictest7878-21ssh10:28:060
223339970,1cyclictest6734-21ssh11:10:230
223339970,1cyclictest4041-21ssh09:36:330
223339970,1cyclictest32240-21ssh11:46:250
223339970,1cyclictest30517-21ssh09:30:070
223339970,1cyclictest3021-21ssh12:35:410
223339970,1cyclictest28467-21df_inode07:20:150
223339970,1cyclictest254-21systemd-journal08:05:000
223339970,1cyclictest22805-21apt-get12:20:140
223339970,1cyclictest15435-21ssh12:10:020
223339970,1cyclictest15245-21diskmemload10:20:070
223339970,1cyclictest15245-21diskmemload09:55:120
223339970,1cyclictest0-21swapper/011:43:400
223339970,1cyclictest0-21swapper/010:30:150
223389965,1cyclictest28-21ksoftirqd/208:20:132
223389965,1cyclictest28-21ksoftirqd/208:05:152
223389965,1cyclictest28-21ksoftirqd/207:52:322
223389964,1cyclictest28-21ksoftirqd/209:05:002
223389964,1cyclictest28-21ksoftirqd/207:30:132
223359964,1cyclictest0-21swapper/110:00:141
223359963,1cyclictest0-21swapper/109:58:521
223359961,3cyclictest0-21swapper/110:21:461
223359961,3cyclictest0-21swapper/108:25:001
223359960,6cyclictest0-21swapper/109:05:181
223359960,6cyclictest0-21swapper/109:00:221
223359960,4cyclictest0-21swapper/109:20:361
223359960,3cyclictest0-21swapper/112:31:191
223359960,3cyclictest0-21swapper/112:11:211
223359960,3cyclictest0-21swapper/112:08:211
223359960,3cyclictest0-21swapper/109:35:191
223359960,3cyclictest0-21swapper/109:25:111
223359960,2cyclictest0-21swapper/112:00:141
223359960,2cyclictest0-21swapper/111:30:181
223359960,1cyclictest0-21swapper/107:30:151
223339964,1cyclictest1308-21/usr/sbin/munin08:40:190
223339963,1cyclictest254-21systemd-journal07:38:420
223339961,0cyclictest0-21swapper/008:25:150
223339960,6cyclictest0-21swapper/010:40:220
223339960,5cyclictest4431-21grep08:45:150
223339960,5cyclictest0-21swapper/011:05:120
223339960,5cyclictest0-21swapper/008:55:130
223339960,5cyclictest0-21swapper/008:55:120
223339960,1cyclictest31120-21hddtemp_smartct07:25:160
223339960,1cyclictest254-21systemd-journal08:09:560
223339960,1cyclictest0-21swapper/008:35:130
223339960,1cyclictest0-21swapper/008:15:120
223339960,0cyclictest0-21swapper/009:16:010
223339960,0cyclictest0-21swapper/009:04:530
223339960,0cyclictest0-21swapper/008:32:380
223339960,0cyclictest0-21swapper/008:13:550
223339960,0cyclictest0-21swapper/007:57:440
223389954,1cyclictest28-21ksoftirqd/207:15:012
223359955,0cyclictest0-21swapper/108:25:231
223359951,2cyclictest0-21swapper/111:00:201
223359951,2cyclictest0-21swapper/110:06:431
223359951,1cyclictest0-21swapper/110:51:431
223359951,1cyclictest0-21swapper/108:00:161
223359950,5cyclictest0-21swapper/110:55:161
223359950,5cyclictest0-21swapper/109:40:161
223359950,5cyclictest0-21swapper/107:56:081
223359950,4cyclictest0-21swapper/112:27:321
223359950,3cyclictest179582sleep110:41:051
223359950,3cyclictest0-21swapper/111:35:191
223359950,3cyclictest0-21swapper/111:27:101
223359950,3cyclictest0-21swapper/111:11:091
223359950,3cyclictest0-21swapper/110:45:451
223359950,3cyclictest0-21swapper/110:30:551
223359950,3cyclictest0-21swapper/109:30:111
223359950,3cyclictest0-21swapper/109:11:101
223359950,2cyclictest0-21swapper/112:19:231
223359950,2cyclictest0-21swapper/111:16:121
223359950,2cyclictest0-21swapper/109:53:391
223359950,2cyclictest0-21swapper/109:46:481
223359950,1cyclictest0-21swapper/111:05:421
223359950,1cyclictest0-21swapper/110:25:171
223359950,1cyclictest0-21swapper/109:15:001
223359950,1cyclictest0-21swapper/108:55:131
223359950,1cyclictest0-21swapper/108:55:121
223359950,0cyclictest0-21swapper/107:49:491
223339954,1cyclictest5183-21/usr/sbin/munin07:40:200
223339953,1cyclictest7639-21chrt07:45:130
223339950,4cyclictest6063-21telnet08:50:140
223339950,4cyclictest0-21swapper/007:50:120
223359944,0cyclictest0-21swapper/108:46:171
223359944,0cyclictest0-21swapper/107:27:011
223359942,2cyclictest0-21swapper/108:55:001
223359940,2cyclictest0-21swapper/112:20:001
223359940,2cyclictest0-21swapper/111:55:021
223359940,2cyclictest0-21swapper/111:50:171
223359940,2cyclictest0-21swapper/111:46:371
223359940,2cyclictest0-21swapper/111:20:051
223359940,2cyclictest0-21swapper/108:40:161
223359940,2cyclictest0-21swapper/107:40:191
223359932,1cyclictest313562sleep108:35:111
223359931,1cyclictest0-21swapper/108:30:141
223359931,1cyclictest0-21swapper/108:15:111
223359931,1cyclictest0-21swapper/108:10:141
223359931,1cyclictest0-21swapper/107:54:561
223359931,1cyclictest0-21swapper/107:20:141
223359931,1cyclictest0-21swapper/107:10:121
223359930,1cyclictest0-21swapper/107:35:011
223359930,1cyclictest0-21swapper/107:15:181
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional