You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-02 - 11:46
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackeslot2.osadl.org (updated Fri May 02, 2025 00:43:59)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
23278582350,3sleep30-21swapper/320:05:263
2257745992821,6cyclictest1-21systemd00:00:011
225774699271,9cyclictest0-21swapper/200:10:012
25010912518,2phc2sys0-21swapper/321:46:053
2257740992516,8cyclictest2240602-1atopacctd21:30:030
25010912418,2phc2sys0-21swapper/323:46:373
25010912418,2phc2sys0-21swapper/322:24:013
25010912418,2phc2sys0-21swapper/321:24:303
25010912418,2phc2sys0-21swapper/319:16:213
25010912417,3phc2sys0-21swapper/323:24:213
25010912417,2phc2sys0-21swapper/323:52:303
25010912417,2phc2sys0-21swapper/323:18:113
25010912417,2phc2sys0-21swapper/322:54:113
25010912417,2phc2sys0-21swapper/321:25:293
25010912417,2phc2sys0-21swapper/300:09:153
25010912417,2phc2sys0-21swapper/300:00:163
25010912317,3phc2sys0-21swapper/323:40:073
25010912317,2phc2sys0-21swapper/323:36:363
25010912317,2phc2sys0-21swapper/323:27:023
25010912317,2phc2sys0-21swapper/323:13:193
25010912317,2phc2sys0-21swapper/323:04:533
25010912317,2phc2sys0-21swapper/322:57:273
25010912317,2phc2sys0-21swapper/322:36:393
25010912317,2phc2sys0-21swapper/322:15:443
25010912317,2phc2sys0-21swapper/322:12:553
25010912317,2phc2sys0-21swapper/322:02:183
25010912317,2phc2sys0-21swapper/322:02:173
25010912317,2phc2sys0-21swapper/321:54:483
25010912317,2phc2sys0-21swapper/321:42:103
25010912317,2phc2sys0-21swapper/321:12:323
25010912317,2phc2sys0-21swapper/321:00:583
25010912317,2phc2sys0-21swapper/320:50:443
25010912317,2phc2sys0-21swapper/320:42:063
25010912317,2phc2sys0-21swapper/320:20:493
25010912317,2phc2sys0-21swapper/320:10:473
25010912317,2phc2sys0-21swapper/319:36:413
25010912317,2phc2sys0-21swapper/319:11:343
25010912317,2phc2sys0-21swapper/300:31:143
25010912317,2phc2sys0-21swapper/300:23:363
25010912317,2phc2sys0-21swapper/300:12:143
2257745992320,2cyclictest2263901-21munin-node19:15:011
2257745992318,1cyclictest178850irq/121-eno123:30:001
251028222218,2sleep30-21swapper/322:07:543
25010912217,3phc2sys0-21swapper/323:58:223
25010912217,3phc2sys0-21swapper/322:31:573
25010912217,3phc2sys0-21swapper/322:28:213
25010912217,3phc2sys0-21swapper/321:37:193
25010912217,3phc2sys0-21swapper/321:19:353
25010912217,3phc2sys0-21swapper/321:08:253
25010912217,3phc2sys0-21swapper/320:34:473
25010912217,3phc2sys0-21swapper/320:01:093
25010912217,3phc2sys0-21swapper/319:40:183
25010912217,3phc2sys0-21swapper/319:30:563
25010912217,3phc2sys0-21swapper/300:37:473
25010912217,3phc2sys0-21swapper/300:26:013
25010912217,3phc2sys0-21swapper/300:15:513
25010912216,2phc2sys0-21swapper/323:31:423
247510122218,2sleep20-21swapper/221:47:522
2257746992219,1cyclictest0-21swapper/222:40:002
2257740992219,2cyclictest2357150-21systemd20:30:010
2257740992219,2cyclictest1-21systemd00:30:010
277547022117,2sleep20-21swapper/200:38:262
276100022117,2sleep20-21swapper/200:30:252
274884622117,2sleep20-21swapper/200:23:232
273868222117,2sleep20-21swapper/200:16:102
270323022117,2sleep20-21swapper/223:55:462
269449622117,2sleep20-21swapper/223:50:492
268618222117,2sleep20-21swapper/223:46:362
264218822117,2sleep20-21swapper/223:22:072
263327122117,2sleep20-21swapper/223:16:582
262598622117,2sleep20-21swapper/223:14:222
260984322117,2sleep30-21swapper/323:05:223
259084522117,2sleep20-21swapper/222:54:262
257119322117,2sleep20-21swapper/222:41:112
255420022117,2sleep20-21swapper/222:32:172
253868422117,2sleep20-21swapper/222:25:202
253607322117,2sleep20-21swapper/222:21:512
251966922117,2sleep20-21swapper/222:13:502
250274822117,2sleep20-21swapper/222:04:562
250274822117,2sleep20-21swapper/222:04:562
25010912117,2phc2sys0-21swapper/322:49:073
25010912117,2phc2sys0-21swapper/322:40:293
25010912117,2phc2sys0-21swapper/321:55:253
25010912117,2phc2sys0-21swapper/321:30:323
25010912117,2phc2sys0-21swapper/320:25:163
249282022117,2sleep20-21swapper/221:58:062
246633022117,2sleep20-21swapper/221:42:592
245854222117,2sleep20-21swapper/221:39:432
244748822117,2sleep20-21swapper/221:31:012
244048022117,2sleep20-21swapper/221:28:572
243061822117,2sleep20-21swapper/221:22:232
241491822117,2sleep20-21swapper/221:15:142
238103522118,2sleep30-21swapper/320:45:533
236969222117,2sleep20-21swapper/220:40:232
235613322117,2sleep20-21swapper/220:25:292
235003322117,2sleep20-21swapper/220:20:322
233227322118,2sleep20-21swapper/220:05:572
230816522118,2sleep20-21swapper/219:48:022
228408022118,2sleep30-21swapper/319:29:153
227238122117,2sleep30-21swapper/319:20:103
2257746992118,1cyclictest0-21swapper/222:20:002
2257745992118,2cyclictest0-21swapper/122:45:011
2257745992114,2cyclictest178850irq/121-eno121:40:251
225774099210,2cyclictest2732759-21/usr/sbin/munin00:15:300
267606422017,2sleep20-21swapper/223:40:272
265450522017,2sleep20-21swapper/223:30:252
250334722017,2sleep20-21swapper/222:05:202
25010912017,2phc2sys0-21swapper/320:57:453
25010912017,2phc2sys0-21swapper/320:36:303
25010912017,2phc2sys0-21swapper/320:36:293
25010912017,2phc2sys0-21swapper/319:45:413
238107622017,2sleep20-21swapper/220:46:242
236916922017,2sleep20-21swapper/220:39:352
236916922017,2sleep20-21swapper/220:39:352
236299422017,2sleep20-21swapper/220:32:542
234446822017,2sleep20-21swapper/220:16:472
233846722017,2sleep20-21swapper/220:12:382
232618722017,2sleep20-21swapper/220:01:002
232025322017,2sleep20-21swapper/219:57:592
231420222017,2sleep30-21swapper/319:52:523
231420222017,2sleep30-21swapper/319:52:513
231404222017,2sleep20-21swapper/219:50:462
231404222017,2sleep20-21swapper/219:50:462
230196222017,2sleep20-21swapper/219:40:442
229597022017,2sleep20-21swapper/219:36:482
228984022017,2sleep20-21swapper/219:30:462
228400022017,2sleep20-21swapper/219:28:142
227798522017,2sleep20-21swapper/219:23:412
227178322017,2sleep20-21swapper/219:16:442
226357822017,2sleep20-21swapper/219:13:072
2257746992017,1cyclictest0-21swapper/200:15:002
2257745992017,2cyclictest2458747-21sh21:40:011
2257740992018,1cyclictest2573635-21/usr/sbin/munin22:45:010
2257740992011,8cyclictest2494192-21latency_hist22:00:020
225774099200,1cyclictest2618597-21expr23:10:190
25010911917,1phc2sys0-21swapper/319:56:563
2257746991916,1cyclictest0-21swapper/223:30:002
2257745991916,2cyclictest2520602-21systemd-run22:15:021
2257745991915,3cyclictest1-21systemd23:25:011
2257745991913,4cyclictest2339019-21apt-get20:15:191
2257745991912,2cyclictest0-21swapper/123:50:011
2257745991911,3cyclictest2539934-21kthreadcore22:25:261
2257745991910,4cyclictest0-21swapper/123:45:031
2257745991910,4cyclictest0-21swapper/121:30:011
225774099198,6cyclictest0-21swapper/023:55:150
2257740991916,2cyclictest2750362-21/usr/sbin/munin00:25:030
2257740991916,2cyclictest2543640-21tail22:25:290
2257740991916,2cyclictest2263981-21switchtime19:15:010
2257740991916,2cyclictest2257734-21cyclictest22:10:000
2257740991912,6cyclictest2563633-21runrttasks22:38:120
2257746991816,1cyclictest0-21swapper/219:10:012
225774599189,3cyclictest0-21swapper/123:35:251
2257745991815,2cyclictest9244-21rtkit-daemon23:10:571
2257745991815,2cyclictest2728896-21needreboot00:10:271
2257745991815,2cyclictest0-21swapper/123:10:011
2257745991815,2cyclictest0-21swapper/122:10:001
2257745991815,2cyclictest0-21swapper/121:15:011
2257740991815,2cyclictest1726-21systemd-logind19:50:020
2257740991812,5cyclictest2657124-21kthreadcore23:30:270
2257740991810,4cyclictest2706390-21/usr/sbin/munin00:00:280
2257746991715,1cyclictest0-21swapper/200:05:012
225774599174,8cyclictest2357104-21latency_hist20:30:011
2257745991715,1cyclictest2776488-21cat00:39:591
2257745991714,2cyclictest2697056-21latency_hist23:55:011
2257745991714,2cyclictest2257734-21cyclictest21:50:021
2257745991714,2cyclictest2257734-21cyclictest21:35:011
2257745991714,2cyclictest0-21swapper/122:25:011
2257745991713,3cyclictest2376952-21kthreadcore20:45:291
2257745991713,3cyclictest2372329-21kthreadcore20:40:291
2257745991713,3cyclictest1761-21gdbus22:40:001
225774099179,6cyclictest0-21swapper/021:50:030
225774099178,4cyclictest0-21swapper/023:50:300
225774099173,2cyclictest0-21swapper/023:45:460
225774099173,13cyclictest2514634-21kthreadcore22:10:230
2257740991714,2cyclictest2670681-21cron23:40:000
2257740991714,2cyclictest2608967-21ssh23:05:020
2257740991714,2cyclictest2529397-21cut22:20:010
2257740991714,2cyclictest2240602-1atopacctd19:35:240
2257740991714,2cyclictest0-21swapper/023:45:010
2257740991712,4cyclictest2534039-21tr22:20:270
225774099171,14cyclictest2636616-21if_err_eno123:20:230
2257740991711,1cyclictest0-21swapper/000:36:250
225774699161,9cyclictest0-21swapper/223:40:002
2257746991613,1cyclictest0-21swapper/221:50:212
2257745991613,2cyclictest2706592-21aten_repower_vo00:00:191
2257745991613,2cyclictest2591498-21latency_hist22:55:021
2257745991613,2cyclictest2420456-21grep21:15:311
2257745991613,2cyclictest2357199-21kworker/u16:2-rpciod21:55:321
2257745991613,2cyclictest2301577-21sendmail_mailtr19:40:351
2257745991613,2cyclictest2257734-21cyclictest23:00:251
2257745991613,2cyclictest2240602-1atopacctd23:18:131
225774599161,10cyclictest2594553-21kthreadcore22:55:241
2257745991610,2cyclictest178850irq/121-eno122:00:261
2257745991610,2cyclictest178850irq/121-eno122:00:251
225774099169,6cyclictest2717173-21kthreadcore00:05:240
225774099166,5cyclictest0-21swapper/000:10:300
225774099161,6cyclictest2759533-21ssh00:30:190
2257740991614,1cyclictest2414770-21munin-run21:15:020
2257740991613,2cyclictest2653078-21apt-key23:30:000
2257740991613,2cyclictest2588307-21grep22:50:320
2257740991613,2cyclictest2429047-21grep21:20:330
2257740991613,2cyclictest2311299-21kthreadcore19:50:260
2257740991613,2cyclictest2311299-21kthreadcore19:50:250
2257740991613,2cyclictest0-21swapper/023:00:010
2257740991612,3cyclictest2357199-21kworker/u16:2+nfsiod22:03:260
2257740991612,3cyclictest2357199-21kworker/u16:2+nfsiod22:03:250
2257740991611,4cyclictest2357199-21kworker/u16:2-rpciod21:36:370
2257740991611,1cyclictest601rcuop/319:40:360
2257740991610,1cyclictest0-21swapper/020:40:210
225774099160,2cyclictest2467824-21munin-run21:45:010
225774099160,15cyclictest2617656-21ls23:10:000
234464221512,2sleep30-21swapper/320:19:013
2257746991512,1cyclictest0-21swapper/221:00:002
225774599159,4cyclictest1695-21dbus-daemon21:55:021
2257745991512,2cyclictest2750330-21apt-config00:25:031
2257745991512,2cyclictest2523779-21kthreadcore22:15:241
2257745991512,2cyclictest2302755-21telnet19:45:221
2257745991512,2cyclictest2257734-21cyclictest00:15:311
2257745991512,2cyclictest1726-21systemd-logind20:05:031
2257745991512,2cyclictest0-21swapper/100:10:001
2257745991511,3cyclictest2386639-21ptp4l-jitter20:50:301
2257745991511,3cyclictest2335716-21kthreadcore20:10:281
225774099158,6cyclictest2465125-21kworker/u16:3+nfsiod23:17:420
225774099158,6cyclictest2323032-21tr20:00:260
225774099157,4cyclictest2442241-21cstates21:30:230
2257740991512,2cyclictest2477212-21cpuspeed_turbos21:50:190
2257740991512,2cyclictest2351055-21gpgconf20:25:020
2257740991512,2cyclictest2332605-21latency_hist20:10:020
2257740991512,2cyclictest2240602-1atopacctd21:05:150
2257740991512,2cyclictest1700-21gmain22:35:020
2257740991511,3cyclictest2296459-21kworker/u16:3+nfsiod21:15:110
2257740991511,2cyclictest0-21swapper/019:30:170
225774099150,14cyclictest2387446-21dump-pmu-power20:55:000
225774099150,13cyclictest2363191-21apt20:35:010
2257746991411,1cyclictest0-21swapper/223:05:212
2257746991411,1cyclictest0-21swapper/223:00:192
2257746991411,1cyclictest0-21swapper/222:55:172
2257746991411,1cyclictest0-21swapper/221:10:262
2257746991411,1cyclictest0-21swapper/221:10:002
2257746991411,1cyclictest0-21swapper/220:55:002
225774599147,6cyclictest770595-21systemd-journal22:32:151
225774599144,5cyclictest2296435-21cat19:40:031
2257745991411,2cyclictest2755754-21mailstats00:25:291
2257745991411,2cyclictest2654698-21irqcore23:30:251
2257745991411,2cyclictest2350791-21cron20:25:011
2257745991411,2cyclictest2327741-21irqcore20:05:251
2257745991411,2cyclictest2282584-21kthreadcore19:25:261
2257745991411,2cyclictest2278200-21sh19:25:011
2257745991411,2cyclictest2270424-21kthreadcore19:15:261
2257745991411,2cyclictest0-21swapper/100:35:011
2257745991410,3cyclictest2426756-21kthreadcore21:20:291
2257745991410,3cyclictest2398341-21kthreadcore21:00:281
2257740991411,2cyclictest2574642-21tune2fs22:45:200
2257740991411,2cyclictest2337902-21mailstats20:10:310
2257740991411,2cyclictest2315902-21irqrtprio19:55:250
2257740991411,2cyclictest2271285-21mailstats19:15:300
2257740991411,2cyclictest1761-21gdbus19:10:020
2257740991411,2cyclictest1726-21systemd-logind19:25:010
2257746991311,1cyclictest0-21swapper/200:25:252
2257746991310,1cyclictest0-21swapper/221:00:332
225774599139,3cyclictest2312977-21kthreadcore19:50:271
225774599139,3cyclictest2312977-21kthreadcore19:50:261
225774599139,3cyclictest2288840-21kthreadcore19:30:251
2257745991311,1cyclictest2314896-21aten2.4-expect19:55:201
225774099135,7cyclictest2281978-21tr19:25:250
225774099134,4cyclictest0-21swapper/020:55:250
2257740991310,2cyclictest2399683-21systemd-run21:05:010
2257740991310,2cyclictest2375772-21aten_repower_po20:45:230
2257740991310,2cyclictest2368413-21ptp4l-jitter20:35:280
2257740991310,2cyclictest2368413-21ptp4l-jitter20:35:270
2257746991210,1cyclictest0-21swapper/222:45:222
225774599129,2cyclictest2574190-21sh22:45:171
225774599129,2cyclictest2402922-21kthreadcore21:05:261
225774599129,2cyclictest2357580-21head20:30:181
225774599128,3cyclictest2389083-21kthreadcore20:55:281
225774099129,2cyclictest2257734-21cyclictest20:15:250
225774599111,5cyclictest2364098-21uniq20:35:201
225774599111,5cyclictest2364098-21uniq20:35:191
225774599111,5cyclictest2257586-21latency_hist19:10:021
250109170,2phc2sys0-21swapper/319:05:243
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional