You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-24 - 17:54
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackeslot2.osadl.org (updated Mon Nov 24, 2025 12:43:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
233772621200,1sleep00-21swapper/010:00:320
233772621200,1sleep00-21swapper/010:00:320
25130692960,2sleep30-21swapper/311:40:343
21528212250,2sleep20-21swapper/207:50:332
2096520992514,7cyclictest2564426-21kthreadcore12:10:320
209652099251,17cyclictest2472714-21cat11:20:010
209652099247,11cyclictest0-21swapper/012:20:210
2096520992419,4cyclictest2245761-21sh09:10:010
2096520992414,6cyclictest2434154-21grep10:55:320
2096520992414,6cyclictest2343640-21kthreadcore10:05:310
209652099240,22cyclictest170550irq/121-eno112:35:230
209652099237,11cyclictest0-21swapper/010:25:220
2096520992313,8cyclictest0-21swapper/011:55:020
209652099229,8cyclictest0-21swapper/011:05:310
2096520992219,2cyclictest2184399-21apt-get08:20:020
2096520992216,5cyclictest2289777-21grep09:35:010
2096520992214,4cyclictest0-21swapper/011:25:000
2096520992210,8cyclictest2272589-21tail09:25:240
22290852210,2sleep20-21swapper/208:55:292
2096528992118,1cyclictest0-21swapper/209:10:012
2096526992117,3cyclictest2359101-21cut10:15:011
2096526992111,3cyclictest2286221-21wc09:30:331
2096520992118,2cyclictest2209252-21latency_hist08:40:000
209652099211,1cyclictest2490582-21apt-get11:30:220
2096520992110,6cyclictest0-21swapper/009:45:240
2096526992013,3cyclictest2371962-21kthreadcore10:20:301
2096526992013,3cyclictest2321174-21/usr/sbin/munin09:50:331
2096520992017,2cyclictest1803-21gdbus10:00:010
2096520992014,5cyclictest8351-21rtkit-daemon10:51:110
2096520992014,5cyclictest1631-21gmain07:50:010
2096520992014,5cyclictest1631-21gmain07:50:010
302487291190,2phc2sys0-21swapper/310:56:153
2096528991916,1cyclictest0-21swapper/209:35:012
2096526991916,2cyclictest2172519-21wc08:10:021
2096526991912,3cyclictest2525515-21/usr/sbin/munin11:50:291
2096526991912,3cyclictest2247725-21irqrtprio09:10:301
209652099198,7cyclictest2399488-21grep10:35:320
2096520991914,4cyclictest8351-21rtkit-daemon09:36:030
2096520991914,4cyclictest0-21swapper/008:25:020
2096520991912,6cyclictest2096514-21cyclictest12:05:460
2096520991912,6cyclictest2096514-21cyclictest12:05:460
2096520991911,7cyclictest2350512-21kworker/u16:2+nfsiod11:13:100
302487291180,3phc2sys0-21swapper/311:21:183
302487291180,3phc2sys0-21swapper/309:37:553
302487291180,3phc2sys0-21swapper/309:25:453
302487291180,2phc2sys0-21swapper/309:55:033
2096526991815,2cyclictest2507444-21latency_hist11:40:001
2096526991814,3cyclictest2149395-21kthreadcore07:50:281
2096526991814,3cyclictest1635-21dbus-daemon07:40:011
2096526991811,3cyclictest2603894-21/usr/sbin/munin12:35:251
2096526991810,3cyclictest0-21swapper/111:10:011
209652099188,6cyclictest2372444-21kthreadcore10:20:300
209652099186,7cyclictest0-21swapper/010:30:240
209652099184,9cyclictest0-21swapper/010:45:230
2096520991815,2cyclictest1635-21dbus-daemon07:15:010
2096520991812,5cyclictest2233571-21grep09:00:000
2096520991812,5cyclictest2200912-21kthreadcore08:30:360
2096520991812,5cyclictest2128514-21mailstats07:30:350
2096520991812,5cyclictest1-21systemd08:55:010
2096520991810,7cyclictest0-21swapper/012:00:280
302487291170,3phc2sys0-21swapper/311:19:083
302487291170,2phc2sys0-21swapper/312:36:223
302487291170,2phc2sys0-21swapper/310:30:303
302487291170,2phc2sys0-21swapper/309:47:383
2096528991714,1cyclictest0-21swapper/208:25:022
209652699177,3cyclictest501rcuop/210:49:041
209652699174,4cyclictest2315769-21kworker/u16:0+xprtiod10:18:341
2096526991714,2cyclictest2209385-21latency_hist08:40:011
2096526991714,2cyclictest2102736-21systemctl07:15:011
2096526991713,3cyclictest2397475-21kthreadcore10:35:311
2096526991711,2cyclictest170550irq/121-eno112:00:281
2096526991711,2cyclictest170550irq/121-eno111:00:011
209652699170,9cyclictest2313145-21sh09:45:451
209652099177,5cyclictest0-21swapper/010:44:440
209652099176,7cyclictest0-21swapper/011:45:370
209652099175,7cyclictest0-21swapper/012:30:320
2096520991714,2cyclictest2359416-21apt-key10:15:010
2096520991714,2cyclictest0-21swapper/011:30:000
2096520991713,3cyclictest2149123-21kthreadcore07:50:280
2096520991713,3cyclictest1652-1atopacctd07:35:300
2096520991710,5cyclictest1542102-1atop12:30:010
302487291160,2phc2sys0-21swapper/309:51:233
302487291160,2phc2sys0-21swapper/309:44:253
302487291160,2phc2sys0-21swapper/309:14:563
2096528991614,1cyclictest0-21swapper/210:10:012
2096528991614,1cyclictest0-21swapper/207:50:012
2096528991614,1cyclictest0-21swapper/207:50:012
2096528991613,1cyclictest0-21swapper/210:51:112
2096528991613,1cyclictest0-21swapper/209:35:272
209652699167,3cyclictest501rcuop/211:26:191
209652699167,2cyclictest501rcuop/211:58:381
209652699166,4cyclictest2439060-21gltestperf11:00:271
209652699165,3cyclictest2568612-21sed12:15:011
209652699164,3cyclictest0-21swapper/109:59:351
2096526991613,2cyclictest2232846-21mailstats08:55:351
2096526991613,2cyclictest2197637-21cpu08:30:301
2096526991613,2cyclictest2190861-21apt-key08:25:011
2096526991613,2cyclictest1635-21dbus-daemon12:30:011
2096526991613,2cyclictest0-21swapper/107:10:011
2096526991612,3cyclictest2078079-21kworker/u16:3+nfsiod09:39:451
209652099169,6cyclictest0-21swapper/009:15:250
209652099163,8cyclictest2111449-21aten2.4-expect07:20:220
209652099162,9cyclictest2512452-21kthreadcore11:40:310
2096520991613,2cyclictest1635-21dbus-daemon11:40:000
2096520991613,2cyclictest0-21swapper/008:10:010
2096520991611,3cyclictest0-21swapper/008:05:000
209652099161,10cyclictest2250915-21kthreadcore09:10:320
2096520991610,5cyclictest8351-21rtkit-daemon11:55:270
2096520991610,5cyclictest241rcuc/009:40:270
2096520991610,5cyclictest2317600-21kthreadcore09:50:290
2096520991610,5cyclictest2153954-21aten2.4-expect07:55:230
2096520991610,5cyclictest1652-1atopacctd09:24:320
302487291153,3phc2sys0-21swapper/310:15:233
302487291150,2phc2sys0-21swapper/311:46:573
302487291150,2phc2sys0-21swapper/311:11:343
302487291150,2phc2sys0-21swapper/311:05:203
2096528991513,1cyclictest0-21swapper/212:15:022
2096528991512,1cyclictest0-21swapper/210:47:242
2096528991512,1cyclictest0-21swapper/208:55:012
209652899150,13cyclictest0-21swapper/212:15:202
209652899150,12cyclictest0-21swapper/211:40:412
209652699159,5cyclictest1635-21dbus-daemon08:50:011
209652699158,1cyclictest601rcuop/310:02:311
209652699158,1cyclictest601rcuop/310:02:311
209652699158,1cyclictest170550irq/121-eno111:31:391
209652699157,3cyclictest2548596-21kworker/u16:0+events_unbound12:20:221
209652699156,6cyclictest501rcuop/209:15:021
209652699156,3cyclictest191rcu_preempt10:08:241
209652699156,1cyclictest491rcuog/211:16:541
209652699155,6cyclictest36-21ksoftirqd/108:05:011
209652699155,3cyclictest501rcuop/210:31:051
209652699154,3cyclictest0-21swapper/111:40:301
2096526991512,2cyclictest2574282-21timerwakeupswit12:15:351
2096526991512,2cyclictest1700-21systemd-logind08:45:001
2096526991512,2cyclictest1631-21gmain08:15:301
2096526991511,3cyclictest2223155-21kthreadcore08:50:261
2096526991511,3cyclictest2192669-21kthreadcore08:25:301
2096526991510,1cyclictest491rcuog/209:20:221
209652699150,5cyclictest2473878-21ls11:20:281
209652699150,11cyclictest0-21swapper/111:47:001
209652099157,2cyclictest0-21swapper/012:15:200
209652099155,6cyclictest0-21swapper/008:45:240
2096520991512,2cyclictest2096514-21cyclictest10:15:250
2096520991511,3cyclictest70-21kcompactd008:10:260
2096520991510,4cyclictest2209760-21tail08:40:260
2096520991510,4cyclictest1-21systemd09:05:020
2096520991510,3cyclictest1652-1atopacctd08:25:300
209652099150,6cyclictest2105768-21diskstats07:15:250
302487291140,2phc2sys0-21swapper/311:53:483
302487291140,2phc2sys0-21swapper/309:24:343
23834372140,2sleep30-21swapper/310:26:403
2096528991412,1cyclictest0-21swapper/211:25:012
2096528991411,1cyclictest0-21swapper/212:21:152
2096528991411,1cyclictest0-21swapper/212:05:462
2096528991411,1cyclictest0-21swapper/212:05:462
2096528991411,1cyclictest0-21swapper/211:46:312
2096528991411,1cyclictest0-21swapper/208:15:312
2096528991411,1cyclictest0-21swapper/207:30:352
209652899140,3cyclictest24361422sleep210:57:462
209652899140,3cyclictest0-21swapper/207:20:212
209652899140,11cyclictest2122822-21chrt07:25:412
209652699147,3cyclictest36-21ksoftirqd/110:50:241
209652699146,3cyclictest501rcuop/209:43:391
2096526991412,1cyclictest2404284-21grep10:40:281
2096526991411,2cyclictest2486703-21kworker/u16:1-rpciod12:07:201
2096526991411,2cyclictest2486703-21kworker/u16:1-rpciod12:07:201
2096526991411,2cyclictest2486703-21kworker/u16:1+nfsiod12:31:571
2096526991411,2cyclictest2379104-21kthreadcore10:25:291
2096526991411,2cyclictest2233980-21aten_repower_en09:00:281
2096526991411,2cyclictest2142733-21irqcore07:45:321
2096526991411,2cyclictest2142733-21irqcore07:45:321
2096526991411,2cyclictest2125887-21kthreadcore07:30:301
2096526991411,2cyclictest2120756-21kthreadcore07:25:311
2096526991411,2cyclictest2114815-21kthreadcore07:20:291
2096526991410,3cyclictest2455795-21aten_repower_en11:10:251
2096526991410,3cyclictest2242464-21kthreadcore09:05:311
2096526991410,3cyclictest2177587-21mailstats08:10:331
2096526991410,3cyclictest2104983-21gltestperf07:15:031
209652099149,4cyclictest2141604-21latency_hist07:45:010
209652099147,6cyclictest0-21swapper/007:25:230
2096520991410,3cyclictest2438629-21cpuspeed_turbos11:00:250
302487291131,6phc2sys0-21swapper/307:50:223
302487291130,4phc2sys0-21swapper/312:33:433
302487291130,4phc2sys0-21swapper/312:10:153
302487291130,3phc2sys0-21swapper/307:40:223
302487291130,2phc2sys0-21swapper/311:32:063
302487291130,2phc2sys0-21swapper/311:04:563
302487291130,2phc2sys0-21swapper/310:40:123
302487291130,2phc2sys0-21swapper/310:39:073
302487291130,2phc2sys0-21swapper/308:10:233
302487291130,2phc2sys0-21swapper/307:31:273
302487291130,2phc2sys0-21swapper/307:18:423
2096528991310,1cyclictest0-21swapper/212:35:362
2096528991310,1cyclictest0-21swapper/212:00:222
2096528991310,1cyclictest0-21swapper/211:55:272
2096528991310,1cyclictest0-21swapper/211:30:272
2096528991310,1cyclictest0-21swapper/211:13:102
2096528991310,1cyclictest0-21swapper/210:40:312
2096528991310,1cyclictest0-21swapper/210:35:272
2096528991310,1cyclictest0-21swapper/209:55:362
2096528991310,1cyclictest0-21swapper/209:50:292
2096528991310,1cyclictest0-21swapper/209:40:272
2096528991310,1cyclictest0-21swapper/209:25:242
2096528991310,1cyclictest0-21swapper/209:24:322
2096528991310,1cyclictest0-21swapper/208:30:292
209652899130,7cyclictest0-21swapper/211:40:012
209652899130,2cyclictest0-21swapper/210:00:242
209652899130,2cyclictest0-21swapper/210:00:242
209652699135,3cyclictest0-21swapper/109:25:301
2096526991310,2cyclictest2158948-21switchtime07:55:341
2096526991310,2cyclictest2137611-21kthreadcore07:40:291
302487291120,3phc2sys0-21swapper/312:28:093
302487291120,3phc2sys0-21swapper/312:02:323
302487291120,2phc2sys0-21swapper/309:17:323
302487291120,2phc2sys0-21swapper/308:41:333
209652899129,1cyclictest0-21swapper/212:30:012
209652899129,1cyclictest0-21swapper/211:50:232
209652899129,1cyclictest0-21swapper/211:17:302
209652899129,1cyclictest0-21swapper/211:03:102
209652899129,1cyclictest0-21swapper/210:30:292
209652899129,1cyclictest0-21swapper/210:15:282
209652899129,1cyclictest0-21swapper/209:45:352
209652899129,1cyclictest0-21swapper/209:15:252
209652899121,6cyclictest2254859-21chrt09:15:012
2096528991210,1cyclictest0-21swapper/211:25:312
2096528991210,1cyclictest0-21swapper/209:05:022
2096528991210,1cyclictest0-21swapper/207:55:232
209652099125,5cyclictest260-21systemd-journal07:10:020
302487291113,2phc2sys0-21swapper/310:48:213
302487291112,2phc2sys0-21swapper/312:20:273
302487291112,2phc2sys0-21swapper/312:05:133
302487291112,2phc2sys0-21swapper/312:05:133
302487291112,2phc2sys0-21swapper/310:24:013
302487291111,3phc2sys0-21swapper/307:05:323
302487291111,2phc2sys0-21swapper/311:35:393
302487291110,3phc2sys0-21swapper/310:00:363
302487291110,3phc2sys0-21swapper/310:00:363
302487291110,3phc2sys0-21swapper/309:30:353
302487291110,3phc2sys0-21swapper/308:25:023
302487291110,3phc2sys0-21swapper/308:15:243
302487291110,3phc2sys0-21swapper/307:25:233
302487291110,3phc2sys0-21swapper/307:15:013
302487291110,2phc2sys0-21swapper/311:55:193
302487291110,2phc2sys0-21swapper/311:28:133
302487291110,2phc2sys0-21swapper/310:50:143
302487291110,2phc2sys0-21swapper/310:07:423
209652899119,1cyclictest0-21swapper/210:23:342
209652899119,1cyclictest0-21swapper/210:10:572
209652899119,1cyclictest0-21swapper/208:45:312
209652899119,1cyclictest0-21swapper/208:40:262
209652899119,1cyclictest0-21swapper/208:25:302
209652899119,1cyclictest0-21swapper/207:40:252
209652899118,1cyclictest0-21swapper/211:05:312
209652899118,1cyclictest0-21swapper/210:28:212
209652899118,1cyclictest0-21swapper/208:36:442
209652899118,1cyclictest0-21swapper/208:11:082
302487291100,3phc2sys0-21swapper/310:10:343
302487291100,3phc2sys0-21swapper/308:05:303
302487291100,2phc2sys0-21swapper/312:15:513
302487291100,2phc2sys0-21swapper/308:52:323
302487291100,2phc2sys0-21swapper/308:25:223
302487291100,2phc2sys0-21swapper/307:57:253
302487291100,2phc2sys0-21swapper/307:40:023
302487291100,1phc2sys0-21swapper/309:02:093
21150062100,2sleep30-21swapper/307:20:303
209652899108,1cyclictest0-21swapper/208:00:222
209652899108,1cyclictest0-21swapper/207:15:022
209652899108,1cyclictest0-21swapper/207:10:432
209652899103,5cyclictest2595039-21chrt12:30:032
209652899101,6cyclictest2096779-21chrt07:10:022
209652899100,5cyclictest0-21swapper/207:35:222
30248729191,3phc2sys0-21swapper/309:05:293
30248729191,3phc2sys0-21swapper/308:00:243
30248729191,2phc2sys0-21swapper/308:45:343
30248729190,2phc2sys0-21swapper/308:55:323
30248729190,2phc2sys0-21swapper/308:35:363
30248729190,2phc2sys0-21swapper/308:30:353
30248729190,2phc2sys0-21swapper/307:45:393
30248729190,2phc2sys0-21swapper/307:45:393
20965289997,1cyclictest0-21swapper/208:05:312
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional