You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-27 - 18:47
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot2.osadl.org (updated Wed May 27, 2026 12:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
970002996058,2cyclictest1553550-21kworker/u16:3+events_unbound11:57:396
970002996058,2cyclictest1117978-21kworker/u16:2+events_unbound10:42:406
970002995956,2cyclictest1553550-21kworker/u16:3+events_unbound11:32:246
970002995956,2cyclictest1553550-21kworker/u16:3+events_unbound11:32:246
969997995754,2cyclictest1553550-21kworker/u16:3+flush-8:012:22:365
969996995754,2cyclictest1469424-21kworker/u16:0+flush-8:010:57:254
96951525747,7sleep40-21swapper/407:04:264
969996995452,2cyclictest1410795-21kworker/u16:1+flush-8:011:07:394
970007995348,4cyclictest1543672-21latency_hist11:27:097
969996995350,2cyclictest1483141-21kworker/u16:2+flush-8:011:47:234
970002995250,2cyclictest1483141-21kworker/u16:2+flush-8:011:27:356
970002995250,2cyclictest1351540-21kworker/u16:0+events_unbound10:32:406
969996995149,2cyclictest1469424-21kworker/u16:0+events_unbound11:17:394
969996995148,2cyclictest1553550-21kworker/u16:3+flush-8:012:02:244
970002995048,2cyclictest1553550-21kworker/u16:3+events_unbound12:22:406
970002995048,2cyclictest1483141-21kworker/u16:2+events_unbound11:47:416
969996994947,2cyclictest1410795-21kworker/u16:1+events_unbound11:27:234
969996994947,2cyclictest1313453-21kworker/u16:3+events_unbound10:27:394
969996994947,2cyclictest1313453-21kworker/u16:3+events_unbound10:12:114
970002994846,2cyclictest1483141-21kworker/u16:2+flush-8:011:17:416
969996994846,2cyclictest1351540-21kworker/u16:0+events_unbound10:17:394
970002994745,2cyclictest1483141-21kworker/u16:2+flush-8:011:12:396
970002994745,2cyclictest1410795-21kworker/u16:1+events_unbound10:37:396
969996994745,2cyclictest1117978-21kworker/u16:2+flush-8:010:02:364
969996994643,2cyclictest1351540-21kworker/u16:0+flush-8:010:22:254
970002994543,2cyclictest1351540-21kworker/u16:0+flush-8:010:17:376
969996994542,2cyclictest1567376-21kworker/u16:4+events_unbound12:30:074
9675332453,30sleep70-21swapper/707:02:367
970007994441,2cyclictest1277063-21perf09:37:107
970007994441,2cyclictest1277063-21perf09:37:107
970002994442,2cyclictest1553550-21kworker/u16:3+events_unbound12:32:246
970002994442,2cyclictest1313453-21kworker/u16:3+events_unbound10:02:386
969996994442,2cyclictest1553550-21kworker/u16:3+flush-8:011:32:444
969996994442,2cyclictest1553550-21kworker/u16:3+flush-8:011:32:444
969996994442,2cyclictest1553550-21kworker/u16:3+events_unbound11:42:404
970002994341,2cyclictest1483141-21kworker/u16:2+events_unbound11:22:306
970002994341,2cyclictest1447137-21kworker/u16:4+events_unbound10:49:366
969996994341,2cyclictest1567376-21kworker/u16:4+flush-8:012:12:384
969996994341,2cyclictest1567376-21kworker/u16:4+flush-8:012:12:384
969996994341,2cyclictest1553550-21kworker/u16:3+events_unbound12:32:434
969996994341,2cyclictest1553550-21kworker/u16:3+events_unbound11:57:234
969996994341,2cyclictest1483141-21kworker/u16:2+events_unbound11:13:194
969996994341,2cyclictest1410795-21kworker/u16:1+events_unbound10:56:444
969996994341,2cyclictest1410795-21kworker/u16:1+events_unbound10:56:444
970002994239,2cyclictest1483141-21kworker/u16:2+events_unbound12:02:126
970002994139,2cyclictest1553550-21kworker/u16:3+flush-8:011:37:396
970002994139,2cyclictest1238478-21kworker/u16:5+flush-8:009:25:246
969996994138,2cyclictest1410795-21kworker/u16:1+events_unbound11:02:124
970002994038,2cyclictest1567376-21kworker/u16:4+flush-8:012:12:596
970002994038,2cyclictest1567376-21kworker/u16:4+flush-8:012:12:596
970002994038,2cyclictest1325577-21kworker/u16:4+events_unbound10:27:086
969996994038,2cyclictest1240836-21kworker/u16:0+flush-8:009:45:114
970002993937,2cyclictest1667770-21kworker/u16:0+flush-8:012:21:006
970002993937,2cyclictest1325577-21kworker/u16:4+flush-8:010:09:156
970002993937,2cyclictest1240836-21kworker/u16:0+events_unbound09:45:166
969996993937,2cyclictest1483141-21kworker/u16:2+flush-8:011:56:154
969996993937,2cyclictest1447137-21kworker/u16:4+events_unbound10:47:474
969996993937,2cyclictest1117978-21kworker/u16:2+flush-8:009:12:104
970002993836,2cyclictest1483141-21kworker/u16:2+flush-8:011:53:116
969996993836,2cyclictest1553550-21kworker/u16:3+events_unbound12:25:554
969996993836,2cyclictest1483141-21kworker/u16:2+events_unbound11:22:424
969996993836,2cyclictest1240836-21kworker/u16:0+events_unbound09:37:084
969996993836,2cyclictest1240836-21kworker/u16:0+events_unbound09:37:084
969996993836,2cyclictest1240836-21kworker/u16:0+events_unbound09:29:524
969996993836,2cyclictest1117978-21kworker/u16:2+events_unbound09:22:074
969996993835,2cyclictest1567376-21kworker/u16:4+flush-8:012:17:254
970007993732,4cyclictest1422479-21latency_hist10:37:107
970002993735,2cyclictest1313453-21kworker/u16:3+flush-8:010:12:306
970002993734,2cyclictest969774-21kworker/u16:1+events_unbound08:47:126
969996993735,2cyclictest1166111-21kworker/u16:4+flush-8:009:12:564
969996993735,2cyclictest1117978-21kworker/u16:2+events_unbound09:53:004
970007993631,4cyclictest1031-21rs:main7
970002993634,2cyclictest1469424-21kworker/u16:0+flush-8:010:56:116
970002993634,2cyclictest1469424-21kworker/u16:0+flush-8:010:56:116
970002993634,2cyclictest1278774-21kworker/u16:1+events_unbound09:56:356
970002993634,2cyclictest1240836-21kworker/u16:0+flush-8:009:33:356
970002993634,2cyclictest1240836-21kworker/u16:0+flush-8:009:33:356
970002993634,2cyclictest1240836-21kworker/u16:0+events_unbound09:50:516
969996993634,2cyclictest1553550-21kworker/u16:3+events_unbound11:39:164
969996993634,2cyclictest1351540-21kworker/u16:0+flush-8:010:32:264
969996993634,2cyclictest1240836-21kworker/u16:0+flush-8:009:49:274
969996993634,2cyclictest1117978-21kworker/u16:2+events_unbound09:59:154
970002993533,2cyclictest1483141-21kworker/u16:2+events_unbound11:09:076
970002993533,2cyclictest1278774-21kworker/u16:1+events_unbound09:41:006
969996993533,2cyclictest1567376-21kworker/u16:4+events_unbound12:10:444
969996993533,2cyclictest1325577-21kworker/u16:4+flush-8:010:08:444
96940323525,7sleep50-21swapper/507:02:505
970007993433,0cyclictest0-21swapper/710:30:067
970007993431,2cyclictest1346660-21ntpq10:02:347
970002993432,2cyclictest1238478-21kworker/u16:5+events_unbound09:30:086
970002993432,2cyclictest1225630-21kworker/u16:3+events_unbound09:16:436
970002993432,2cyclictest1147034-21kworker/u16:3+flush-8:008:37:376
970002993432,2cyclictest1117978-21kworker/u16:2+flush-8:009:20:166
969996993432,2cyclictest969774-21kworker/u16:1+events_unbound08:02:054
969996993432,2cyclictest1410795-21kworker/u16:1+events_unbound10:44:124
970002993331,2cyclictest983619-21kworker/u16:2+flush-8:007:17:356
970002993331,2cyclictest1483141-21kworker/u16:2+events_unbound12:11:006
969996993331,2cyclictest1166111-21kworker/u16:4+events_unbound09:23:564
969996993331,2cyclictest1117978-21kworker/u16:2+events_unbound10:41:554
969996993331,2cyclictest1117978-21kworker/u16:2+events_unbound08:56:564
970002993230,2cyclictest1553550-21kworker/u16:3+events_unbound11:44:516
970002993230,2cyclictest1469424-21kworker/u16:0+events_unbound10:58:326
969996993230,2cyclictest1117978-21kworker/u16:2+events_unbound09:39:154
970007993130,0cyclictest0-21swapper/710:10:437
970002993128,2cyclictest969774-21kworker/u16:1+flush-8:007:22:206
970002993128,2cyclictest969774-21kworker/u16:1+flush-8:007:22:206
970007993029,0cyclictest0-21swapper/708:52:367
970002993028,2cyclictest906480-21kworker/u16:0+flush-8:007:46:556
970002993028,2cyclictest1553550-21kworker/u16:3+events_unbound12:29:446
970002993028,2cyclictest1483141-21kworker/u16:2+events_unbound11:05:086
969997993028,2cyclictest969774-21kworker/u16:1+events_unbound07:52:355
969997993027,2cyclictest1117978-21kworker/u16:2+events_unbound10:02:245
16653542300,1chrt1665352-21grep12:17:227
970007992928,0cyclictest0-21swapper/711:13:117
970007992928,0cyclictest0-21swapper/708:19:057
970002992927,2cyclictest1278774-21kworker/u16:1+flush-8:009:58:356
970002992926,2cyclictest969774-21kworker/u16:1+flush-8:008:42:106
969997992927,2cyclictest1469424-21kworker/u16:0+flush-8:010:57:355
969996992927,2cyclictest969774-21kworker/u16:1+flush-8:008:22:414
970007992827,0cyclictest0-21swapper/708:09:527
970007992827,0cyclictest0-21swapper/708:09:527
970007992827,0cyclictest0-21swapper/707:14:247
970002992826,2cyclictest969774-21kworker/u16:1+flush-8:008:04:206
970002992826,2cyclictest1313453-21kworker/u16:3+flush-8:010:27:306
970002992826,2cyclictest1050877-21kworker/u16:4+events_unbound08:16:216
969996992826,2cyclictest969774-21kworker/u16:1+events_unbound07:36:554
969996992826,2cyclictest1166111-21kworker/u16:4+flush-8:008:58:154
15028262280,1chrt1502829-21cut11:07:337
970007992726,0cyclictest0-21swapper/710:00:187
970002992725,2cyclictest1117978-21kworker/u16:2+events_unbound08:55:246
970002992724,2cyclictest969774-21kworker/u16:1+events_unbound07:27:206
969996992725,2cyclictest969774-21kworker/u16:1+flush-8:008:33:214
969996992725,2cyclictest1166111-21kworker/u16:4+events_unbound09:03:214
14705292270,1chrt1470527-21ssh10:56:197
14705292270,1chrt1470527-21ssh10:56:197
970007992625,0cyclictest0-21swapper/712:13:367
970007992625,0cyclictest0-21swapper/712:13:367
970007992625,0cyclictest0-21swapper/711:27:587
970007992625,0cyclictest0-21swapper/711:19:227
970007992625,0cyclictest0-21swapper/710:39:537
970007992625,0cyclictest0-21swapper/708:50:457
970007992625,0cyclictest0-21swapper/708:46:477
970007992625,0cyclictest0-21swapper/707:55:017
970007992624,1cyclictest1590128-21ssh11:43:347
970002992624,2cyclictest983619-21kworker/u16:2+flush-8:007:42:066
970002992624,2cyclictest969774-21kworker/u16:1+events_unbound08:00:206
970002992624,2cyclictest1166111-21kworker/u16:4+flush-8:009:10:076
969997992624,2cyclictest1117978-21kworker/u16:2+flush-8:009:38:535
970007992524,0cyclictest0-21swapper/711:06:137
970007992524,0cyclictest0-21swapper/708:59:567
970007992523,1cyclictest1254108-21ssh09:27:247
970002992523,2cyclictest969774-21kworker/u16:1+events_unbound07:13:206
969996992523,2cyclictest906480-21kworker/u16:0+events_unbound07:17:124
970007992423,0cyclictest0-21swapper/712:08:147
970007992423,0cyclictest0-21swapper/710:23:117
970007992423,0cyclictest0-21swapper/710:19:177
970007992423,0cyclictest0-21swapper/709:48:007
970007992423,0cyclictest0-21swapper/709:24:497
970007992423,0cyclictest0-21swapper/708:36:527
970007992423,0cyclictest0-21swapper/708:12:257
970007992423,0cyclictest0-21swapper/708:04:497
970007992423,0cyclictest0-21swapper/707:33:327
970007992423,0cyclictest0-21swapper/707:24:327
970007992423,0cyclictest0-21swapper/707:24:327
970007992423,0cyclictest0-21swapper/707:11:567
970007992422,1cyclictest1322513-21ssh09:52:367
970007992422,1cyclictest1204329-21diskmemload11:50:537
970002992422,2cyclictest1117978-21kworker/u16:2+flush-8:008:29:206
969997992421,3cyclictest969774-21kworker/u16:1+flush-8:007:27:535
969996992422,2cyclictest969774-21kworker/u16:1+events_unbound07:23:204
969996992422,2cyclictest969774-21kworker/u16:1+events_unbound07:23:204
969996992422,2cyclictest906480-21kworker/u16:0+events_unbound07:11:194
96969022414,7sleep60-21swapper/607:06:526
970007992322,0cyclictest0-21swapper/709:02:347
970002992320,2cyclictest969774-21kworker/u16:1+flush-8:008:07:206
970002992320,2cyclictest969774-21kworker/u16:1+flush-8:008:07:206
969997992321,2cyclictest969774-21kworker/u16:1+flush-8:007:32:355
969997992321,2cyclictest1278774-21kworker/u16:1+flush-8:009:47:415
970007992221,0cyclictest0-21swapper/710:45:327
970007992221,0cyclictest0-21swapper/707:49:137
970007992216,5cyclictest1616284-21latency_hist11:57:107
970002992220,2cyclictest1040892-21kworker/u16:3+events_unbound07:55:216
969997992220,2cyclictest1567376-21kworker/u16:4+events_unbound11:37:235
969997992218,3cyclictest969774-21kworker/u16:1+flush-8:007:57:305
969997992217,4cyclictest1176387-21diskstats08:52:245
970007992120,0cyclictest0-21swapper/712:29:177
970007992120,0cyclictest0-21swapper/708:26:167
970007992116,4cyclictest1712962-21latency_hist12:37:107
970002992119,2cyclictest969774-21kworker/u16:1+flush-8:008:22:056
970002992118,2cyclictest1166111-21kworker/u16:4+events_unbound08:57:126
969996992119,2cyclictest983619-21kworker/u16:2+events_unbound07:16:214
969996992119,2cyclictest1117978-21kworker/u16:2+events_unbound08:51:244
969996992119,2cyclictest1050877-21kworker/u16:4+events_unbound08:12:054
969996992119,2cyclictest1050877-21kworker/u16:4+events_unbound08:12:054
969996992119,2cyclictest1040892-21kworker/u16:3+events_unbound07:44:404
970007992019,0cyclictest0-21swapper/712:25:127
970007992019,0cyclictest0-21swapper/708:29:317
970007992019,0cyclictest0-21swapper/708:00:537
969996992018,2cyclictest969774-21kworker/u16:1+events_unbound07:28:524
969996992018,2cyclictest1079412-21kworker/u16:0+events_unbound08:14:204
969996992018,2cyclictest1040892-21kworker/u16:3+events_unbound07:48:194
13014892200,1chrt1301490-21sed09:47:107
970007991918,0cyclictest0-21swapper/708:39:357
970002991917,2cyclictest969774-21kworker/u16:1+events_unbound09:04:206
970002991917,2cyclictest969774-21kworker/u16:1+events_unbound08:34:206
970002991917,2cyclictest969774-21kworker/u16:1+events_unbound07:52:016
969997991917,2cyclictest1553550-21kworker/u16:3+flush-8:011:57:435
969997991917,2cyclictest1410795-21kworker/u16:1+flush-8:010:42:525
969997991917,2cyclictest1278774-21kworker/u16:1+flush-8:009:42:475
969996991917,2cyclictest1079412-21kworker/u16:0+events_unbound08:47:084
970007991817,0cyclictest0-21swapper/707:29:457
970007991716,0cyclictest0-21swapper/707:21:287
970002991715,2cyclictest983619-21kworker/u16:2+flush-8:007:32:256
969997991715,2cyclictest1050877-21kworker/u16:4+events_unbound08:12:275
969997991714,2cyclictest1567376-21kworker/u16:4+flush-8:012:32:265
970007991615,0cyclictest0-21swapper/707:42:157
970007991615,0cyclictest0-21swapper/707:41:347
970007991614,1cyclictest1579393-21ssh11:41:007
970002991614,2cyclictest906480-21kworker/u16:0+events_unbound07:07:146
969997991614,2cyclictest969774-21kworker/u16:1+flush-8:008:47:375
969997991614,2cyclictest1313453-21kworker/u16:3+flush-8:010:32:055
969997991611,4cyclictest983619-21kworker/u16:2+flush-8:007:17:105
970007991514,0cyclictest0-21swapper/710:47:537
970007991511,3cyclictest1234-21snmpd09:38:297
970002991512,2cyclictest969774-21kworker/u16:1+events_unbound08:22:136
969997991513,2cyclictest1278774-21kworker/u16:1+events_unbound09:57:335
969997991513,2cyclictest1166111-21kworker/u16:4+flush-8:008:57:365
969997991512,3cyclictest1079412-21kworker/u16:0+events_unbound08:17:345
96999799150,2cyclictest978539-21ntpq07:07:345
96999799150,15cyclictest0-21swapper/511:03:165
969996991513,2cyclictest969774-21kworker/u16:1+flush-8:008:27:314
969996991513,2cyclictest969774-21kworker/u16:1+events_unbound08:20:374
969997991413,1cyclictest0-21swapper/511:43:375
969997991413,1cyclictest0-21swapper/510:53:105
969997991413,1cyclictest0-21swapper/510:53:105
969997991412,2cyclictest1240836-21kworker/u16:0+flush-8:009:27:365
969997991412,2cyclictest1040892-21kworker/u16:3+events_unbound07:47:325
969997991411,2cyclictest983619-21kworker/u16:2+events_unbound07:37:245
96999799140,1cyclictest0-21swapper/509:16:135
96999799140,14cyclictest0-21swapper/512:16:345
96999799140,14cyclictest0-21swapper/512:16:345
96999799140,14cyclictest0-21swapper/510:13:555
969996991412,2cyclictest969774-21kworker/u16:1+flush-8:007:40:164
969996991410,3cyclictest1050877-21kworker/u16:4+events_unbound08:02:334
97000799139,3cyclictest1234-21snmpd10:17:037
97000799138,4cyclictest1557073-21cat11:32:257
97000799138,4cyclictest1557073-21cat11:32:257
969997991312,1cyclictest0-21swapper/512:05:135
969997991312,1cyclictest0-21swapper/511:30:235
969997991312,1cyclictest0-21swapper/510:22:265
969997991312,1cyclictest0-21swapper/509:24:535
969997991310,2cyclictest1268464-21cut09:32:275
969997991310,2cyclictest1268464-21cut09:32:275
96999799130,13cyclictest0-21swapper/511:21:525
96999799130,13cyclictest0-21swapper/511:13:025
96999799130,12cyclictest1042126-21ps07:42:265
96999799130,0cyclictest0-21swapper/512:27:565
969996991312,1cyclictest0-21swapper/407:52:404
97000799126,5cyclictest6382-21gvfs-afc-volume09:17:487
96999799120,1cyclictest0-21swapper/508:28:365
97000799118,2cyclictest1234-21snmpd09:07:437
97000799118,2cyclictest0-21swapper/709:12:297
97000799115,4cyclictest1618054-21grep11:57:267
970007991111,0cyclictest0-21swapper/710:57:537
96999799119,2cyclictest983619-21kworker/u16:2+flush-8:007:22:255
96999799119,2cyclictest983619-21kworker/u16:2+flush-8:007:22:255
96999799119,2cyclictest969774-21kworker/u16:1+flush-8:008:02:395
96999799119,2cyclictest1117978-21kworker/u16:2+events_unbound08:32:335
969997991110,1cyclictest0-21swapper/512:10:545
96999799110,11cyclictest0-21swapper/508:41:415
96999799109,1cyclictest0-21swapper/512:22:065
96999799109,1cyclictest0-21swapper/511:50:345
96999799109,1cyclictest0-21swapper/509:06:555
96999799109,1cyclictest0-21swapper/507:21:175
96999699108,1cyclictest0-21swapper/408:37:294
9699979994,4cyclictest5951-21gsd-power10:49:425
9699979990,1cyclictest0-21swapper/509:07:395
9699979987,1cyclictest0-21swapper/511:37:005
9699979987,1cyclictest0-21swapper/511:37:005
9699979986,1cyclictest0-21swapper/509:52:265
9699979985,2cyclictest0-21swapper/508:07:325
9699979985,2cyclictest0-21swapper/508:07:325
9699979984,3cyclictest1157435-21cat08:42:245
9699979983,4cyclictest5951-21gsd-power10:17:425
9699979975,1cyclictest0-21swapper/509:17:275
9699979974,2cyclictest1350564-21cstates10:07:205
9699979972,4cyclictest1120211-21grep08:22:295
9699979961,1cyclictest201rcu_preempt11:10:285
9699979960,2cyclictest0-21swapper/510:35:385
9699979960,1cyclictest0-21swapper/511:22:405
9699979950,4cyclictest1604633-21taskset11:52:195
9699979950,3cyclictest0-21swapper/510:37:335
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional