You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-22 - 19:23
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackeslot2.osadl.org (updated Sat Nov 22, 2025 12:43:58)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
247817621110,2sleep30-21swapper/309:29:013
268870121000,2sleep30-21swapper/311:30:293
23913762820,2sleep30-21swapper/308:25:333
27896842660,2sleep30-21swapper/312:25:393
2295039992522,2cyclictest2382558-21munin-plugin-st08:20:000
27993722230,1sleep00-21swapper/012:32:260
229503999230,17cyclictest0-21swapper/007:15:260
2295039992219,2cyclictest2618199-21apt-key10:50:030
2295039992219,2cyclictest2618199-21apt-key10:50:030
2295041992118,1cyclictest0-21swapper/210:45:012
2295041992118,1cyclictest0-21swapper/208:20:002
2295039992118,2cyclictest2766033-21apt-key12:15:010
2295039992114,6cyclictest2636910-21tr11:00:310
835298200,2rtkit-daemon8351-21rtkit-daemon08:17:481
302487291200,2phc2sys0-21swapper/311:08:023
2295041992017,1cyclictest0-21swapper/210:10:002
2295041992017,1cyclictest0-21swapper/208:35:012
2295040992018,1cyclictest501rcuop/211:24:031
229503999209,6cyclictest0-21swapper/011:45:000
229503999208,7cyclictest0-21swapper/009:35:280
229503999205,5cyclictest2437925-1cat09:05:020
229503999201,17cyclictest2496881-21/usr/sbin/munin09:40:310
229503999200,16cyclictest0-21swapper/011:55:540
2295041991917,1cyclictest0-21swapper/212:15:012
2295041991916,1cyclictest0-21swapper/209:52:572
2295041991916,1cyclictest0-21swapper/209:50:012
2295040991916,2cyclictest2809748-21apt-config12:40:011
2295040991916,2cyclictest2809748-21apt-config12:40:011
2295040991916,2cyclictest2479258-21latency_hist09:30:021
2295040991916,2cyclictest2352136-21gpgconf07:55:001
2295040991916,2cyclictest1700-21systemd-logind09:15:021
2295040991915,3cyclictest2532530-21ssh10:00:321
2295040991915,3cyclictest2532530-21ssh10:00:321
2295039991916,2cyclictest2407139-21turbostat.cron08:40:000
2295039991916,2cyclictest2295035-21cyclictest08:55:320
302487291180,2phc2sys0-21swapper/310:58:243
2295041991815,1cyclictest0-21swapper/212:31:112
2295041991815,1cyclictest0-21swapper/211:58:452
2295041991815,1cyclictest0-21swapper/211:00:322
2295041991815,1cyclictest0-21swapper/210:47:042
2295041991815,1cyclictest0-21swapper/210:47:042
2295041991815,1cyclictest0-21swapper/210:22:102
2295041991815,1cyclictest0-21swapper/210:10:362
2295041991815,1cyclictest0-21swapper/209:32:302
2295041991815,1cyclictest0-21swapper/209:20:032
2295041991815,1cyclictest0-21swapper/207:25:332
2295041991815,1cyclictest0-21swapper/207:20:012
2295041991814,2cyclictest0-21swapper/211:50:342
229504099189,4cyclictest0-21swapper/112:00:021
229504099185,8cyclictest2626745-21dump-pmu-power10:55:001
2295040991815,2cyclictest210-21jbd2/sda2-807:50:011
2295040991810,2cyclictest501rcuop/209:40:261
229503999188,2cyclictest0-21swapper/010:25:240
229503999187,3cyclictest2443757-21diskmemload12:08:580
2295039991815,2cyclictest1-21systemd09:10:010
2295039991812,2cyclictest0-21swapper/011:36:520
229503999180,13cyclictest0-21swapper/007:20:360
835298170,2rtkit-daemon0-21swapper/112:14:281
302471791170,1ptp4l0-21swapper/308:00:353
2295041991715,1cyclictest0-21swapper/210:35:292
2295041991715,1cyclictest0-21swapper/209:20:332
2295041991715,1cyclictest0-21swapper/209:20:332
2295041991714,1cyclictest0-21swapper/212:24:392
2295041991714,1cyclictest0-21swapper/212:05:322
2295041991714,1cyclictest0-21swapper/211:46:152
2295041991714,1cyclictest0-21swapper/211:25:302
2295041991714,1cyclictest0-21swapper/210:35:012
2295041991714,1cyclictest0-21swapper/209:42:302
2295041991714,1cyclictest0-21swapper/209:39:142
2295041991714,1cyclictest0-21swapper/209:00:032
2295041991714,1cyclictest0-21swapper/208:38:102
2295041991714,1cyclictest0-21swapper/208:30:012
2295041991713,2cyclictest0-21swapper/209:55:352
229504099179,3cyclictest2464871-21kthreadcore09:20:361
229504099179,3cyclictest2464871-21kthreadcore09:20:361
229504099178,4cyclictest0-21swapper/108:30:011
229504099177,2cyclictest191rcu_preempt11:47:151
229504099175,3cyclictest2740101-21kworker/u16:3-rpciod12:02:291
229504099174,8cyclictest2479502-21kworker/u16:3+xprtiod11:18:041
229504099174,8cyclictest2479502-21kworker/u16:3+xprtiod11:18:041
2295040991714,2cyclictest2574596-21systemd-run10:25:021
2295040991714,2cyclictest2432199-21cpuspeed_turbos09:00:281
2295040991714,2cyclictest2318563-21kthreadcore07:25:341
2295040991714,2cyclictest1652-1atopacctd10:35:271
2295040991714,2cyclictest0-21swapper/109:20:011
2295040991713,3cyclictest2545001-21latency10:05:361
229504099171,11cyclictest2496353-21latency_hist09:40:011
2295040991710,3cyclictest2787004-21kthreadcore12:25:341
229503999179,7cyclictest0-21swapper/012:35:260
229503999179,7cyclictest0-21swapper/012:35:260
229503999179,4cyclictest2443757-21diskmemload10:20:310
2295039991714,2cyclictest2723948-21grep11:50:300
2295039991714,2cyclictest2689168-21irqcore11:30:320
2295039991714,2cyclictest2670237-21ssh11:20:010
2295039991714,2cyclictest2670237-21ssh11:20:010
2295039991714,2cyclictest2449544-21sendmail_mailtr09:10:360
2295039991714,2cyclictest2321544-21munin-plugin-st07:30:010
2295039991714,2cyclictest1629-21avahi-daemon09:50:010
229503999171,11cyclictest0-21swapper/010:41:230
2295039991710,6cyclictest2647462-21kthreadcore11:05:340
229503999170,13cyclictest2301127-21munin-run07:15:010
302487291160,4phc2sys0-21swapper/312:16:503
302487291160,2phc2sys0-21swapper/312:02:003
2295041991614,1cyclictest0-21swapper/212:15:362
2295041991613,1cyclictest0-21swapper/212:40:012
2295041991613,1cyclictest0-21swapper/212:40:012
2295041991613,1cyclictest0-21swapper/211:36:482
2295041991613,1cyclictest0-21swapper/211:30:412
2295041991613,1cyclictest0-21swapper/211:18:412
2295041991613,1cyclictest0-21swapper/211:18:412
2295041991613,1cyclictest0-21swapper/210:57:192
2295041991613,1cyclictest0-21swapper/209:26:562
2295041991613,1cyclictest0-21swapper/209:05:102
2295041991613,1cyclictest0-21swapper/207:30:282
2295041991613,1cyclictest0-21swapper/207:23:592
2295041991612,2cyclictest0-21swapper/211:40:382
2295041991612,2cyclictest0-21swapper/210:50:112
2295041991612,2cyclictest0-21swapper/208:40:322
229504099169,3cyclictest2723208-21/usr/sbin/munin11:50:321
229504099169,1cyclictest601rcuop/311:30:171
229504099169,1cyclictest601rcuop/309:59:191
2295040991613,2cyclictest351ktimers/110:20:001
2295040991613,2cyclictest2617741-21latency_hist10:50:031
2295040991613,2cyclictest2617741-21latency_hist10:50:031
2295040991613,2cyclictest2332654-21missed_timers07:35:341
2295040991613,2cyclictest1652-1atopacctd10:30:021
2295040991612,3cyclictest2780305-21needreboot12:20:351
2295040991612,3cyclictest2638193-21kthreadcore11:00:321
2295040991612,2cyclictest0-21swapper/107:20:011
2295040991611,4cyclictest2687633-21grep11:30:011
2295040991611,4cyclictest2295035-21cyclictest09:30:271
2295040991610,2cyclictest2557193-21true10:15:011
2295040991610,2cyclictest170550irq/121-eno107:15:021
229503999167,4cyclictest2431720-21kworker/u16:2-events_unbound09:59:450
229503999167,4cyclictest191rcu_preempt10:19:310
229503999167,4cyclictest0-21swapper/010:05:340
229503999167,1cyclictest0-21swapper/010:35:260
2295039991613,2cyclictest8351-21rtkit-daemon08:51:100
2295039991613,2cyclictest2588868-21switchtime10:30:470
2295039991613,2cyclictest2458233-21swap09:15:400
2295039991613,2cyclictest0-21swapper/012:20:010
2295039991610,5cyclictest0-21swapper/009:50:320
835298150,1rtkit-daemon0-21swapper/109:49:351
302487291150,4phc2sys0-21swapper/311:50:263
302487291150,3phc2sys0-21swapper/312:35:313
302487291150,3phc2sys0-21swapper/312:35:313
302487291150,3phc2sys0-21swapper/310:17:533
302487291150,2phc2sys0-21swapper/309:52:273
302487291150,2phc2sys0-21swapper/309:38:353
229504199159,4cyclictest0-21swapper/212:00:242
229504199159,3cyclictest0-21swapper/207:40:012
2295041991513,1cyclictest0-21swapper/212:25:302
2295041991513,1cyclictest0-21swapper/209:10:042
2295041991512,1cyclictest0-21swapper/211:10:272
2295041991512,1cyclictest0-21swapper/211:05:452
2295041991512,1cyclictest0-21swapper/210:25:302
2295041991512,1cyclictest0-21swapper/208:50:362
2295041991512,1cyclictest0-21swapper/208:02:122
2295041991512,1cyclictest0-21swapper/207:50:432
2295041991511,2cyclictest0-21swapper/210:15:262
229504099159,2cyclictest2769957-21kthreadcore12:15:361
229504099159,2cyclictest2603704-21kthreadcore10:40:331
229504099153,8cyclictest2309497-21kworker/u16:0+xprtiod09:53:401
229504099152,2cyclictest191rcu_preempt11:00:011
229504099151,9cyclictest2376457-21latency_hist08:15:001
2295040991513,1cyclictest8351-21rtkit-daemon08:50:561
2295040991513,1cyclictest1635-21dbus-daemon09:00:011
2295040991512,2cyclictest2583821-21aten_repower_fr10:30:301
2295040991512,2cyclictest2314702-21mailstats07:20:401
2295040991512,2cyclictest1652-1atopacctd11:37:471
2295040991512,2cyclictest0-21swapper/108:10:001
2295040991511,3cyclictest2793236-21tr12:30:291
2295040991511,3cyclictest2751614-21kthreadcore12:05:351
2295040991510,1cyclictest170550irq/121-eno111:40:531
229503999159,5cyclictest0-21swapper/012:25:300
229503999159,4cyclictest1803-21gdbus11:50:020
229503999158,6cyclictest2551759-21kthreadcore10:10:370
229503999158,2cyclictest0-21swapper/012:22:250
2295039991512,2cyclictest2680314-21gltestperf11:25:300
2295039991512,2cyclictest2483917-21kthreadcore09:30:340
2295039991512,2cyclictest2385527-21kthreadcore08:20:350
2295039991512,2cyclictest2351966-21pluginstate07:55:000
2295039991512,2cyclictest2337198-21kthreadcore07:40:340
2295039991511,3cyclictest2479502-21kworker/u16:3+nfsiod10:51:150
302487291140,4phc2sys0-21swapper/309:41:443
302487291140,2phc2sys0-21swapper/312:09:293
302487291140,2phc2sys0-21swapper/310:33:183
302487291140,2phc2sys0-21swapper/309:46:363
23393092140,1sleep20-21swapper/207:40:402
2295041991412,1cyclictest0-21swapper/211:25:012
229504199141,1cyclictest0-21swapper/207:45:292
2295041991411,1cyclictest0-21swapper/210:00:262
2295041991411,1cyclictest0-21swapper/210:00:262
2295041991411,1cyclictest0-21swapper/208:55:292
2295041991411,1cyclictest0-21swapper/208:20:352
2295041991411,1cyclictest0-21swapper/208:10:342
2295041991411,1cyclictest0-21swapper/207:55:382
2295041991410,2cyclictest0-21swapper/207:10:342
2295041991410,1cyclictest0-21swapper/208:05:332
229504099149,4cyclictest2407765-21cpuspeed_turbos08:40:281
2295040991411,2cyclictest2645288-21grep11:05:301
2295040991411,2cyclictest2439899-21kthreadcore09:05:461
2295040991411,2cyclictest2334711-21fschecks_time07:40:301
2295040991411,2cyclictest2295035-21cyclictest11:10:301
2295040991411,2cyclictest2295035-21cyclictest08:20:351
2295040991411,2cyclictest1631-21gmain08:45:021
229503999148,3cyclictest2443757-21diskmemload09:23:510
229503999148,3cyclictest2443757-21diskmemload09:23:510
229503999147,3cyclictest2642866-21kworker/u16:2-xprtiod12:00:280
229503999147,3cyclictest2443757-21diskmemload11:11:280
2295039991411,2cyclictest2671247-21cpuspeed_turbos11:20:290
2295039991411,2cyclictest2532847-21kernelversion10:00:320
2295039991411,2cyclictest2532847-21kernelversion10:00:320
2295039991411,2cyclictest2471666-21irqcore09:25:330
2295039991411,2cyclictest2408806-21kthreadcore08:40:320
2295039991411,2cyclictest2391555-21kthreadcore08:25:330
2295039991411,2cyclictest2368453-21kthreadcore08:05:340
2295039991411,2cyclictest2342568-21kthreadcore07:45:390
229503999140,7cyclictest2352470-21/usr/sbin/munin07:55:310
229503999140,6cyclictest2633432-21chrt10:56:510
302487291131,2phc2sys0-21swapper/309:18:323
302487291130,4phc2sys0-21swapper/307:15:303
302487291130,3phc2sys0-21swapper/311:15:273
302487291130,3phc2sys0-21swapper/311:15:273
302487291130,3phc2sys0-21swapper/311:00:253
302487291130,2phc2sys0-21swapper/312:10:313
302487291130,2phc2sys0-21swapper/311:39:403
302487291130,2phc2sys0-21swapper/311:25:343
302487291130,2phc2sys0-21swapper/310:23:543
302487291130,2phc2sys0-21swapper/308:59:533
2295041991310,1cyclictest0-21swapper/208:45:332
229504099133,4cyclictest0-21swapper/108:00:341
2295040991311,1cyclictest8351-21rtkit-daemon08:37:571
2295040991311,1cyclictest2322116-21cpuspeed_turbos07:30:291
2295040991310,2cyclictest2399509-21kthreadcore08:30:341
2295040991310,2cyclictest2354600-21kthreadcore07:55:331
229503999139,3cyclictest2401128-21systemctl08:35:010
229503999134,5cyclictest0-21swapper/008:46:460
229503999134,1cyclictest601rcuop/307:35:320
229503999132,2cyclictest2370906-21aten2.4-expect08:10:270
2295039991310,2cyclictest2358936-21cpuspeed_turbos08:00:280
229503999130,4cyclictest2321907-21aten2.4-expect07:30:280
302487291122,2phc2sys0-21swapper/309:57:163
302487291120,3phc2sys0-21swapper/311:23:253
302487291120,3phc2sys0-21swapper/307:40:273
302487291120,3phc2sys0-21swapper/307:35:263
302487291120,2phc2sys0-21swapper/310:46:403
302487291120,2phc2sys0-21swapper/310:46:403
302487291120,2phc2sys0-21swapper/310:36:363
302487291120,2phc2sys0-21swapper/310:04:333
302487291120,2phc2sys0-21swapper/310:04:333
302487291120,2phc2sys0-21swapper/308:43:303
302487291120,2phc2sys0-21swapper/308:19:563
302487291120,2phc2sys0-21swapper/308:14:293
229504199129,1cyclictest0-21swapper/207:10:012
229503999129,2cyclictest2295207-21true07:10:010
302487291111,3phc2sys0-21swapper/311:42:123
302487291111,3phc2sys0-21swapper/308:05:393
302487291111,2phc2sys0-21swapper/310:26:543
302487291110,7phc2sys2451734-21chrt09:13:543
302487291110,3phc2sys0-21swapper/310:12:023
302487291110,2phc2sys0-21swapper/310:53:073
302487291110,2phc2sys0-21swapper/310:08:323
302487291110,2phc2sys0-21swapper/309:31:493
302487291110,2phc2sys0-21swapper/309:20:493
302487291110,2phc2sys0-21swapper/309:20:493
302487291110,2phc2sys0-21swapper/308:40:013
302487291110,2phc2sys0-21swapper/307:26:563
229504099118,2cyclictest2294879-21latency_hist07:10:011
302487291102,3phc2sys0-21swapper/309:05:533
302487291101,2phc2sys0-21swapper/312:20:323
302487291101,2phc2sys0-21swapper/307:20:353
302487291101,2phc2sys0-21swapper/307:05:403
302487291100,3phc2sys0-21swapper/311:55:353
302487291100,3phc2sys0-21swapper/307:30:333
302487291100,2phc2sys0-21swapper/311:11:033
302487291100,2phc2sys0-21swapper/310:40:213
302487291100,2phc2sys0-21swapper/309:01:403
302487291100,2phc2sys0-21swapper/308:31:363
302487291100,1phc2sys0-21swapper/312:30:093
30248729191,2phc2sys0-21swapper/307:45:323
30248729190,4phc2sys0-21swapper/308:45:253
30248729190,2phc2sys0-21swapper/311:45:093
30248729190,2phc2sys0-21swapper/308:54:403
30248729190,2phc2sys0-21swapper/308:20:263
30248729190,2phc2sys0-21swapper/307:55:333
30248729190,2phc2sys0-21swapper/307:50:293
30248729190,1phc2sys0-21swapper/307:13:223
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional