You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-25 - 08:21
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot2.osadl.org (updated Tue Nov 25, 2025 00:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1485947995853,4cyclictest1954664-21latency_hist07:13:217
148530125747,7sleep50-21swapper/503:19:415
148532225646,7sleep40-21swapper/403:19:564
1485947995348,4cyclictest2055733-21latency_hist08:03:207
148545325319,30sleep70-21swapper/703:21:437
148531525342,8sleep60-21swapper/603:19:506
148594799480,46cyclictest2075888-21latency_hist08:13:217
1485947994544,0cyclictest0-21swapper/706:03:457
1485939994339,3cyclictest1671641-21kworker/u16:0+flush-8:005:08:394
1485943994038,2cyclictest1954432-21kworker/u16:0+flush-8:007:18:505
1485947993831,5cyclictest589235-21systemd-journal06:48:217
1485947993831,5cyclictest589235-21systemd-journal06:48:217
1485946993834,3cyclictest1415718-21kworker/u16:1+events_unbound03:38:216
1485943993836,2cyclictest2005034-21kworker/u16:1+events_unbound07:40:575
1485943993836,2cyclictest1399252-21kworker/u16:0+events_unbound03:41:075
1485943993835,2cyclictest2085126-21kworker/u16:6+flush-8:008:18:225
1485947993736,0cyclictest0-21swapper/707:03:307
1485946993734,2cyclictest2005034-21kworker/u16:1+events_unbound07:48:386
1485943993735,2cyclictest1671868-21kworker/u16:2+events_unbound05:37:425
1485943993634,2cyclictest2065807-21kworker/u16:2+events_unbound08:49:075
1485943993634,2cyclictest1712290-21kworker/u16:1+events_unbound06:10:435
1485943993632,3cyclictest2005034-21kworker/u16:1+events_unbound08:09:425
1485946993533,2cyclictest2015482-21kworker/u16:0+flush-8:008:18:206
1485946993533,2cyclictest2015482-21kworker/u16:0+flush-8:008:18:206
1485946993533,2cyclictest1930062-21kworker/u16:1+events_unbound07:08:386
1485946993532,2cyclictest2055612-21kworker/u16:3+flush-8:008:03:346
1485943993533,2cyclictest2065807-21kworker/u16:2+flush-8:008:43:475
1485943993533,2cyclictest1863627-21kworker/u16:1+events_unbound06:46:235
1485943993533,2cyclictest1863627-21kworker/u16:1+events_unbound06:46:235
1485943993533,2cyclictest1823058-21kworker/u16:0+events_unbound06:14:305
1485943993533,2cyclictest1802190-21kworker/u16:2+events_unbound06:24:345
1485943993533,2cyclictest1783384-21kworker/u16:3+events_unbound05:58:545
1485943993533,2cyclictest1783384-21kworker/u16:3+events_unbound05:58:545
1485943993533,2cyclictest1712290-21kworker/u16:1+events_unbound06:04:325
1485943993532,2cyclictest1954432-21kworker/u16:0+events_unbound07:28:225
1485943993532,2cyclictest1954432-21kworker/u16:0+events_unbound07:28:225
1485943993532,2cyclictest1671868-21kworker/u16:2+flush-8:004:58:215
1485943993432,2cyclictest1851857-21kworker/u16:3+events_unbound06:54:455
1485943993432,2cyclictest1762685-21kworker/u16:0+flush-8:005:45:315
1485943993431,2cyclictest1570528-21kworker/u16:0+events_unbound04:33:225
148594799330,31cyclictest2126598-21latency_hist08:38:217
1485946993331,2cyclictest1671868-21kworker/u16:2+flush-8:005:18:216
1485946993331,2cyclictest1671868-21kworker/u16:2+flush-8:005:18:216
1485943993331,2cyclictest2015482-21kworker/u16:0+events_unbound08:27:315
1485943993331,2cyclictest1954432-21kworker/u16:0+events_unbound07:33:455
1485943993331,2cyclictest1914607-21kworker/u16:5+events_unbound07:04:455
1485943993331,2cyclictest1671868-21kworker/u16:2+events_unbound05:16:235
1485943993331,2cyclictest1671868-21kworker/u16:2+events_unbound05:16:235
1485943993331,2cyclictest1610914-21kworker/u16:1+events_unbound04:28:445
1485943993331,2cyclictest1610914-21kworker/u16:1+events_unbound04:28:445
1485943993331,2cyclictest1415718-21kworker/u16:1+events_unbound03:32:315
1485943993330,2cyclictest1762685-21kworker/u16:0+events_unbound05:51:245
1485943993230,2cyclictest1851857-21kworker/u16:3+events_unbound06:52:035
1485943993230,2cyclictest1610914-21kworker/u16:1+events_unbound04:21:485
1485943993230,2cyclictest1539407-21kworker/u16:5+events_unbound03:55:315
1485939993230,2cyclictest1712290-21kworker/u16:1+flush-8:006:18:214
1485947993130,0cyclictest0-21swapper/705:46:217
1485943993129,2cyclictest1762685-21kworker/u16:0+flush-8:005:41:215
1485943993129,2cyclictest1671641-21kworker/u16:0+events_unbound05:02:195
1485943993129,2cyclictest1399252-21kworker/u16:0+events_unbound03:51:565
1485939993128,2cyclictest2005034-21kworker/u16:1+flush-8:008:08:464
1485939993127,3cyclictest1914607-21kworker/u16:5+flush-8:007:23:204
1485947993029,0cyclictest0-21swapper/707:31:557
1485947993029,0cyclictest0-21swapper/707:31:557
1485947993029,0cyclictest0-21swapper/705:57:267
1485947993029,0cyclictest0-21swapper/705:28:367
1485943993028,2cyclictest2005034-21kworker/u16:1+flush-8:007:43:225
1485943993028,2cyclictest1914607-21kworker/u16:5+events_unbound07:24:555
1485943993028,2cyclictest1641365-21kworker/u16:3+events_unbound04:43:305
1485943993028,2cyclictest1520262-21kworker/u16:3+events_unbound03:44:405
1485943993028,2cyclictest1520262-21kworker/u16:3+events_unbound03:44:405
1485939993027,2cyclictest2015482-21kworker/u16:0+events_unbound08:48:344
1485939993027,2cyclictest1475431-21kworker/u16:2+flush-8:003:23:394
1485939993026,3cyclictest1475431-21kworker/u16:2+flush-8:003:33:194
1485947992928,0cyclictest0-21swapper/706:35:107
1485947992928,0cyclictest0-21swapper/705:20:207
1485947992923,5cyclictest1661751-21latency_hist04:48:227
1485946992927,2cyclictest1399252-21kworker/u16:0+flush-8:003:28:236
1485943992927,2cyclictest2106804-21kworker/u16:1+events_unbound08:31:025
1485943992927,2cyclictest2055612-21kworker/u16:3+flush-8:008:08:115
1485943992927,2cyclictest1989701-21kworker/u16:2+flush-8:007:49:115
1485943992927,2cyclictest1930062-21kworker/u16:1+events_unbound07:08:425
1485943992927,2cyclictest1875531-21kworker/u16:0+events_unbound06:36:215
1485943992927,2cyclictest1671641-21kworker/u16:0+events_unbound05:25:315
1485943992927,2cyclictest1520262-21kworker/u16:3+events_unbound03:59:475
1485943992926,2cyclictest1823755-21kworker/u16:4+flush-8:006:28:315
1485939992927,2cyclictest1671641-21kworker/u16:0+flush-8:005:23:504
1485947992827,0cyclictest0-21swapper/708:42:237
1485947992827,0cyclictest0-21swapper/706:30:597
1485946992826,2cyclictest1851857-21kworker/u16:3+events_unbound06:18:506
1485946992826,2cyclictest1641365-21kworker/u16:3+events_unbound04:38:216
1485946992825,2cyclictest2005034-21kworker/u16:1+flush-8:007:38:376
1485946992825,2cyclictest1539407-21kworker/u16:5+flush-8:004:03:386
1485943992826,2cyclictest2065807-21kworker/u16:2+events_unbound08:41:025
1485943992826,2cyclictest2065807-21kworker/u16:2+events_unbound08:35:265
1485943992826,2cyclictest1802190-21kworker/u16:2+events_unbound05:54:325
1485943992826,2cyclictest1741727-21kworker/u16:4+events_unbound05:32:115
1485943992826,2cyclictest1682337-21kworker/u16:3+events_unbound05:12:395
1485943992826,2cyclictest1682337-21kworker/u16:3+events_unbound05:04:285
1485943992826,2cyclictest1641616-21kworker/u16:4+events_unbound04:42:155
1485943992826,2cyclictest1560393-21kworker/u16:2+events_unbound04:10:125
1485947992726,0cyclictest0-21swapper/706:39:227
1485947992726,0cyclictest0-21swapper/706:13:237
1485947992726,0cyclictest0-21swapper/705:14:407
1485947992726,0cyclictest0-21swapper/705:14:407
1485947992726,0cyclictest0-21swapper/705:05:357
1485947992726,0cyclictest0-21swapper/704:51:077
1485946992725,2cyclictest1802190-21kworker/u16:2+events_unbound05:58:506
1485946992725,2cyclictest1802190-21kworker/u16:2+events_unbound05:58:506
1485943992725,2cyclictest1954432-21kworker/u16:0+flush-8:007:15:435
1485943992725,2cyclictest1641616-21kworker/u16:4+events_unbound04:51:485
1485943992725,2cyclictest1539407-21kworker/u16:5+events_unbound04:24:405
1485939992725,2cyclictest1914607-21kworker/u16:5+events_unbound07:28:504
1485939992725,2cyclictest1914607-21kworker/u16:5+events_unbound07:28:504
1485947992625,0cyclictest0-21swapper/708:04:357
1485947992625,0cyclictest0-21swapper/706:02:277
1485947992625,0cyclictest0-21swapper/706:02:277
1485947992625,0cyclictest0-21swapper/705:27:247
1485947992625,0cyclictest0-21swapper/704:03:207
1485947992625,0cyclictest0-21swapper/703:47:527
1485947992625,0cyclictest0-21swapper/703:47:527
1485947992621,4cyclictest589235-21systemd-journal04:38:437
1485947992621,4cyclictest1550515-21latency_hist03:53:217
1485947992620,5cyclictest589235-21systemd-journal04:23:217
1485946992624,2cyclictest1914607-21kworker/u16:5+flush-8:007:28:456
1485946992624,2cyclictest1914607-21kworker/u16:5+flush-8:007:28:456
1485946992623,2cyclictest1823755-21kworker/u16:4+flush-8:006:25:086
1485943992624,2cyclictest2015482-21kworker/u16:0+events_unbound07:57:315
1485943992624,2cyclictest1930062-21kworker/u16:1+events_unbound07:00:315
1485943992624,2cyclictest1851857-21kworker/u16:3+events_unbound06:21:035
1485943992624,2cyclictest1671868-21kworker/u16:2+events_unbound05:22:235
1485943992624,2cyclictest1415718-21kworker/u16:1+events_unbound03:26:225
1485939992624,2cyclictest1475431-21kworker/u16:2+flush-8:003:43:214
1485939992622,3cyclictest1570528-21kworker/u16:0+flush-8:004:33:404
1485947992524,0cyclictest0-21swapper/707:38:187
1485947992524,0cyclictest0-21swapper/707:22:367
1485947992524,0cyclictest0-21swapper/703:55:197
1485947992524,0cyclictest0-21swapper/703:32:477
1485943992523,2cyclictest1539407-21kworker/u16:5+events_unbound04:06:515
1485947992423,0cyclictest0-21swapper/708:48:457
1485947992423,0cyclictest0-21swapper/708:29:147
1485947992423,0cyclictest0-21swapper/707:49:227
1485947992423,0cyclictest0-21swapper/705:35:507
1485947992423,0cyclictest0-21swapper/704:55:277
1485943992422,2cyclictest1560393-21kworker/u16:2+events_unbound04:14:155
1485943992422,2cyclictest1481469-21kworker/u16:4+events_unbound03:37:155
1485947992322,0cyclictest0-21swapper/706:21:507
1485947992322,0cyclictest0-21swapper/704:24:527
1485947992322,0cyclictest0-21swapper/704:08:147
1485947992322,0cyclictest0-21swapper/703:39:117
1485946992320,2cyclictest1712290-21kworker/u16:1+events_unbound06:13:336
1485943992321,2cyclictest2015482-21kworker/u16:0+events_unbound08:16:585
1485943992321,2cyclictest2015482-21kworker/u16:0+events_unbound08:16:585
1485943992321,2cyclictest1989701-21kworker/u16:2+events_unbound07:58:265
1485939992321,2cyclictest1712290-21kworker/u16:1+events_unbound05:33:514
1485947992220,1cyclictest0-21swapper/708:13:467
1485947992220,1cyclictest0-21swapper/708:13:467
1485939992219,2cyclictest1570528-21kworker/u16:0+flush-8:004:18:464
1485947992120,0cyclictest0-21swapper/706:50:437
1485947992120,0cyclictest0-21swapper/706:11:017
1485947992120,0cyclictest0-21swapper/704:16:187
1485946992119,2cyclictest1570528-21kworker/u16:0+events_unbound04:13:476
1485946992118,2cyclictest1989701-21kworker/u16:2+flush-8:007:36:146
1485943992119,2cyclictest1875531-21kworker/u16:0+events_unbound06:40:105
1485939992118,2cyclictest1914607-21kworker/u16:5+events_unbound07:33:354
1485947992019,0cyclictest0-21swapper/705:02:317
1485939992018,2cyclictest1712290-21kworker/u16:1+flush-8:006:08:474
1485939992016,3cyclictest1671641-21kworker/u16:0+flush-8:004:53:394
1485947991918,0cyclictest0-21swapper/703:35:257
1485939991917,2cyclictest2015482-21kworker/u16:0+flush-8:008:13:464
1485939991917,2cyclictest2015482-21kworker/u16:0+flush-8:008:13:464
1485939991917,2cyclictest1783384-21kworker/u16:3+events_unbound05:53:494
1485939991915,3cyclictest1914607-21kworker/u16:5+flush-8:007:18:194
1485939991915,3cyclictest1762685-21kworker/u16:0+flush-8:005:50:514
1485939991915,3cyclictest1475431-21kworker/u16:2+flush-8:003:33:414
1485947991817,0cyclictest0-21swapper/707:15:527
1485947991817,0cyclictest0-21swapper/704:36:087
1485947991815,2cyclictest4175659-21snmpd06:23:597
1485946991816,2cyclictest1851857-21kworker/u16:3+events_unbound06:58:466
1485946991816,2cyclictest1802190-21kworker/u16:2+flush-8:006:33:366
1485946991814,3cyclictest1539407-21kworker/u16:5+flush-8:004:28:526
1485946991814,3cyclictest1539407-21kworker/u16:5+flush-8:004:28:526
1485939991816,2cyclictest1520262-21kworker/u16:3+flush-8:003:53:384
1485939991815,3cyclictest1989701-21kworker/u16:2+flush-8:007:58:524
1485939991815,2cyclictest2005034-21kworker/u16:1+events_unbound07:38:344
1485939991814,3cyclictest2085126-21kworker/u16:6+flush-8:008:18:464
1485939991814,3cyclictest2020036-21kworker/u16:4+flush-8:007:46:504
1485947991716,0cyclictest0-21swapper/704:08:247
1485947991716,0cyclictest0-21swapper/703:27:177
1485947991714,2cyclictest0-21swapper/707:38:217
1485947991712,4cyclictest1793084-21latency_hist05:53:217
1485946991715,2cyclictest1682337-21kworker/u16:3+flush-8:005:08:486
1485946991714,2cyclictest1802190-21kworker/u16:2+flush-8:006:28:466
1485939991714,3cyclictest1520262-21kworker/u16:3+flush-8:003:48:474
1485939991714,3cyclictest1475431-21kworker/u16:2+flush-8:003:43:384
1485939991714,3cyclictest1475431-21kworker/u16:2+flush-8:003:43:384
1485947991615,0cyclictest0-21swapper/707:45:487
1485947991615,0cyclictest0-21swapper/705:08:467
1485947991615,0cyclictest0-21swapper/704:30:307
1485947991615,0cyclictest0-21swapper/704:30:307
1485947991612,3cyclictest589235-21systemd-journal07:28:157
1485946991614,2cyclictest1741727-21kworker/u16:4+flush-8:005:33:446
1485946991614,2cyclictest1520262-21kworker/u16:3+flush-8:003:53:466
1485939991613,2cyclictest1631114-21kworker/u16:2+flush-8:004:38:394
148593999160,15cyclictest1620121-21memory04:23:444
1485947991514,0cyclictest0-21swapper/706:53:517
1485946991514,1cyclictest1802190-21kworker/u16:2+events_unbound06:43:416
1485946991514,1cyclictest1802190-21kworker/u16:2+events_unbound06:43:416
1485946991513,2cyclictest2085126-21kworker/u16:6+flush-8:008:23:366
148594799140,4cyclictest2143162-21kthreadcore08:43:437
148594799140,13cyclictest0-21swapper/708:23:457
1485946991413,1cyclictest0-21swapper/608:18:446
1485946991413,1cyclictest0-21swapper/603:43:486
1485946991413,1cyclictest0-21swapper/603:43:486
1485946991412,2cyclictest2015482-21kworker/u16:0+flush-8:007:53:476
1485946991412,2cyclictest1954432-21kworker/u16:0+flush-8:007:26:266
1485946991412,2cyclictest1712290-21kworker/u16:1+flush-8:005:58:166
1485946991412,2cyclictest1671868-21kworker/u16:2+flush-8:005:38:486
1485946991412,2cyclictest1570528-21kworker/u16:0+flush-8:004:23:466
1485946991412,2cyclictest1520262-21kworker/u16:3+flush-8:003:53:216
1485946991411,2cyclictest1570528-21kworker/u16:0+events_unbound04:08:356
1485939991413,1cyclictest0-21swapper/404:28:464
1485939991413,1cyclictest0-21swapper/404:28:464
1485939991412,2cyclictest2065807-21kworker/u16:2+events_unbound08:38:364
1485939991412,2cyclictest1802190-21kworker/u16:2+events_unbound05:58:364
1485939991412,2cyclictest1802190-21kworker/u16:2+events_unbound05:58:364
1485939991411,2cyclictest1671868-21kworker/u16:2+events_unbound05:43:394
1485939991411,2cyclictest1610914-21kworker/u16:1+flush-8:004:48:504
1485946991310,2cyclictest2125567-21needreboot08:33:456
148594699130,1cyclictest0-21swapper/608:12:166
1485939991312,1cyclictest0-21swapper/406:21:294
1485939991312,1cyclictest0-21swapper/404:58:534
1485939991311,2cyclictest2005034-21kworker/u16:1+events_unbound07:53:504
1485939991310,2cyclictest1520262-21kworker/u16:3+events_unbound03:58:354
148593999130,13cyclictest0-21swapper/406:52:334
148593999130,13cyclictest0-21swapper/406:41:494
148593999130,13cyclictest0-21swapper/405:40:024
148594799128,3cyclictest984960-21gvfsd-wsdd06:58:407
148594799125,6cyclictest27394-21gmain05:38:387
1485947991212,0cyclictest0-21swapper/707:58:037
148594699129,2cyclictest1641365-21kworker/u16:3+events_unbound04:43:376
148594699128,3cyclictest2137868-21cat08:43:386
1485946991211,1cyclictest0-21swapper/607:44:036
1485946991211,1cyclictest0-21swapper/607:13:476
1485946991211,1cyclictest0-21swapper/607:06:226
1485946991211,1cyclictest0-21swapper/606:03:386
1485946991211,1cyclictest0-21swapper/604:50:576
1485946991211,1cyclictest0-21swapper/603:40:296
1485946991210,2cyclictest1682337-21kworker/u16:3+events_unbound05:03:456
1485946991210,2cyclictest1570528-21kworker/u16:0+flush-8:004:18:456
148594699120,1cyclictest0-21swapper/605:02:376
148594699120,1cyclictest0-21swapper/604:39:176
148594699120,12cyclictest0-21swapper/603:59:246
1485939991211,1cyclictest0-21swapper/407:09:064
1485939991210,2cyclictest2085126-21kworker/u16:6+flush-8:008:28:214
148593999120,12cyclictest0-21swapper/408:29:494
148593999120,12cyclictest0-21swapper/408:03:574
148593999120,12cyclictest0-21swapper/405:33:154
148593999120,12cyclictest0-21swapper/405:03:564
148594799118,2cyclictest2096282-21munin-run08:23:207
148594699116,4cyclictest1723640-21cat05:18:366
1485946991110,1cyclictest0-21swapper/606:54:046
1485946991110,1cyclictest0-21swapper/604:53:286
148594699110,1cyclictest0-21swapper/605:25:106
148594699110,11cyclictest0-21swapper/608:51:506
148594699110,11cyclictest0-21swapper/606:50:466
148593999119,2cyclictest1712290-21kworker/u16:1+flush-8:005:13:364
148593999119,2cyclictest1712290-21kworker/u16:1+flush-8:005:13:364
148593999118,3cyclictest1570528-21kworker/u16:0+flush-8:004:13:364
148593999118,2cyclictest1914607-21kworker/u16:5+flush-8:007:03:364
1485939991110,1cyclictest0-21swapper/407:23:554
1485939991110,1cyclictest0-21swapper/406:36:564
1485939991110,1cyclictest0-21swapper/406:32:034
1485939991110,1cyclictest0-21swapper/405:22:224
1485939991110,1cyclictest0-21swapper/404:10:204
148593999110,11cyclictest0-21swapper/408:35:294
148593999110,11cyclictest0-21swapper/406:27:104
148594699109,1cyclictest0-21swapper/608:32:276
148594699109,1cyclictest0-21swapper/607:22:466
148594699109,1cyclictest0-21swapper/605:49:266
148594699108,2cyclictest1741727-21kworker/u16:4+flush-8:005:28:376
148594699106,3cyclictest2046784-21cat07:58:356
148594699106,3cyclictest1885135-21cat06:38:366
148593999109,1cyclictest0-21swapper/408:46:034
148593999109,1cyclictest0-21swapper/407:51:024
14859469998,1cyclictest0-21swapper/603:28:026
14859399994,4cyclictest1918537-21cut06:53:404
14859399994,4cyclictest1895214-21cat06:43:354
14859399994,4cyclictest1895214-21cat06:43:354
14859469987,1cyclictest0-21swapper/605:43:366
14859469986,1cyclictest0-21swapper/608:38:356
14859469983,4cyclictest1824590-21awk06:08:376
14859399986,2cyclictest1814634-21irqcore06:03:364
14859399984,3cyclictest1658036-21kthreadcore04:43:424
14859399984,3cyclictest1578725-21kthreadcore04:03:444
14859399980,2cyclictest0-21swapper/406:58:344
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional