You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-15 - 00:54
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack0slot2.osadl.org (updated Thu May 14, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6509552940,1sleep7650954-21cut07:08:157
650521995149,2cyclictest1019520-21kworker/u16:3+flush-8:011:58:275
65021124736,7sleep50-21swapper/507:07:425
650521994644,2cyclictest1252298-21kworker/u16:0+events_unbound12:28:305
650521994644,2cyclictest1252298-21kworker/u16:0+events_unbound12:28:305
6501462415,31sleep70-21swapper/707:06:477
650521993937,2cyclictest1019520-21kworker/u16:3+events_unbound12:21:085
650521993836,2cyclictest982179-21kworker/u16:2+events_unbound10:00:165
650521993836,2cyclictest1019520-21kworker/u16:3+events_unbound10:56:195
650521993836,2cyclictest1006014-21kworker/u16:0+events_unbound10:31:035
650521993835,2cyclictest827135-21kworker/u16:4+events_unbound09:23:315
65017423828,7sleep40-21swapper/407:07:094
650521993735,2cyclictest865829-21kworker/u16:0+events_unbound09:33:045
650521993735,2cyclictest1252298-21kworker/u16:0+events_unbound12:33:215
650521993735,2cyclictest1201921-21kworker/u16:1+events_unbound11:26:315
650521993735,2cyclictest1019520-21kworker/u16:3+flush-8:012:05:035
650521993735,2cyclictest1019520-21kworker/u16:3+events_unbound12:23:525
650521993735,2cyclictest1019520-21kworker/u16:3+events_unbound12:17:555
650521993735,2cyclictest1019520-21kworker/u16:3+events_unbound10:45:155
650526993632,3cyclictest1387323-21/usr/sbin/munin12:33:177
650521993634,2cyclictest865829-21kworker/u16:0+flush-8:009:29:045
650521993634,2cyclictest1201921-21kworker/u16:1+events_unbound12:09:275
650521993634,2cyclictest1142164-21kworker/u16:4+events_unbound11:05:525
650521993634,2cyclictest1019520-21kworker/u16:3+events_unbound10:42:365
650521993633,2cyclictest1019520-21kworker/u16:3+events_unbound10:08:035
650526993529,5cyclictest1203223-21latency_hist11:18:027
650521993533,2cyclictest982383-21kworker/u16:3+events_unbound09:53:555
650521993533,2cyclictest982179-21kworker/u16:2+flush-8:009:51:355
650521993533,2cyclictest982179-21kworker/u16:2+events_unbound10:05:485
650521993533,2cyclictest865829-21kworker/u16:0+events_unbound09:45:195
650521993533,2cyclictest865829-21kworker/u16:0+events_unbound09:45:195
650521993533,2cyclictest1201921-21kworker/u16:1+events_unbound11:45:075
650521993533,2cyclictest1176750-21kworker/u16:0+events_unbound11:14:475
650521993533,2cyclictest1142164-21kworker/u16:4+flush-8:011:09:555
650521993533,2cyclictest1142164-21kworker/u16:4+events_unbound11:00:005
650521993533,2cyclictest1019520-21kworker/u16:3+flush-8:011:51:035
650521993533,2cyclictest1019520-21kworker/u16:3+events_unbound11:31:085
650521993432,2cyclictest856216-21kworker/u16:1+events_unbound09:10:325
650521993432,2cyclictest1056677-21kworker/u16:1+events_unbound10:24:165
650521993432,2cyclictest1019520-21kworker/u16:3+flush-8:010:19:355
650521993432,2cyclictest1019520-21kworker/u16:3+events_unbound10:33:435
650521993431,2cyclictest578190-21kworker/u16:0+flush-8:007:28:045
13701742340,1chrt1370175-21kthreadcore12:23:247
650521993331,2cyclictest856216-21kworker/u16:1+events_unbound09:20:245
650521993331,2cyclictest1142164-21kworker/u16:4+events_unbound11:21:205
650521993331,2cyclictest1019520-21kworker/u16:3+events_unbound11:57:515
650521993331,2cyclictest1019520-21kworker/u16:3+events_unbound11:42:565
650521993230,2cyclictest1142164-21kworker/u16:4+events_unbound11:34:045
650521993230,2cyclictest1056677-21kworker/u16:1+events_unbound10:50:515
650521993230,2cyclictest1019520-21kworker/u16:3+events_unbound10:15:565
650521993129,2cyclictest856216-21kworker/u16:1+events_unbound09:17:405
650521993129,2cyclictest759584-21kworker/u16:3+events_unbound08:22:125
650521993129,2cyclictest759584-21kworker/u16:3+events_unbound08:22:125
650526993029,0cyclictest0-21swapper/711:38:157
650521993028,2cyclictest856216-21kworker/u16:1+events_unbound09:40:325
650523992925,3cyclictest683874-21diskstats07:23:156
11782662290,1chrt1178267-21ssh11:07:107
650526992827,0cyclictest0-21swapper/707:16:207
650521992826,2cyclictest740977-21kworker/u16:2+events_unbound07:58:315
650521992826,2cyclictest631549-21kworker/u16:1+events_unbound07:49:125
650526992726,0cyclictest0-21swapper/707:37:277
650523992724,2cyclictest578190-21kworker/u16:0+flush-8:007:43:076
650521992725,2cyclictest740977-21kworker/u16:2+events_unbound08:06:125
650521992725,2cyclictest578190-21kworker/u16:0+flush-8:007:26:115
650521992725,2cyclictest578190-21kworker/u16:0+events_unbound08:31:115
650526992625,0cyclictest0-21swapper/710:38:157
650526992625,0cyclictest0-21swapper/708:15:397
6501272264,7sleep60-21swapper/607:06:306
650526992524,0cyclictest0-21swapper/712:19:307
650526992524,0cyclictest0-21swapper/709:06:417
650526992522,2cyclictest1383606-21ntpq12:28:277
650526992522,2cyclictest1383606-21ntpq12:28:277
650526992522,1cyclictest922657-21ssh09:23:177
650521992523,2cyclictest578190-21kworker/u16:0+events_unbound07:36:125
650521992523,2cyclictest567213-21kworker/u16:5+flush-8:007:08:305
650521992522,2cyclictest759584-21kworker/u16:3+events_unbound08:48:055
650521992522,2cyclictest567213-21kworker/u16:5+events_unbound07:43:125
9812232240,1chrt981224-21sh09:45:287
9812232240,1chrt981224-21sh09:45:287
650526992423,0cyclictest0-21swapper/711:02:387
650526992423,0cyclictest0-21swapper/709:20:387
650526992423,0cyclictest0-21swapper/708:53:007
650526992423,0cyclictest0-21swapper/707:26:167
650521992422,2cyclictest578190-21kworker/u16:0+events_unbound08:36:085
650521992421,2cyclictest578190-21kworker/u16:0+flush-8:007:53:135
650526992322,0cyclictest0-21swapper/709:34:307
650526992322,0cyclictest0-21swapper/709:10:347
650526992322,0cyclictest0-21swapper/708:27:167
650526992322,0cyclictest0-21swapper/707:59:417
650526992322,0cyclictest0-21swapper/707:54:407
650526992319,2cyclictest1273482-21sh11:43:257
10915042230,1chrt1091502-21ssh10:30:247
650526992221,0cyclictest0-21swapper/710:02:507
650526992221,0cyclictest0-21swapper/709:39:377
650526992221,0cyclictest0-21swapper/709:02:117
650526992221,0cyclictest0-21swapper/707:45:517
650521992220,2cyclictest759584-21kworker/u16:3+events_unbound08:16:455
650521992220,2cyclictest578190-21kworker/u16:0+events_unbound08:12:125
650526992120,0cyclictest0-21swapper/710:19:137
650526992120,0cyclictest0-21swapper/708:44:287
650526992120,0cyclictest0-21swapper/708:35:317
650526992120,0cyclictest0-21swapper/707:52:237
650526992119,1cyclictest0-21swapper/707:18:267
650526992019,0cyclictest0-21swapper/712:06:427
650526992019,0cyclictest0-21swapper/709:15:507
650526992019,0cyclictest0-21swapper/708:11:237
650526992018,1cyclictest1335452-21sh12:08:387
650521992017,2cyclictest827135-21kworker/u16:4+events_unbound08:58:035
650526991918,0cyclictest0-21swapper/711:49:577
650526991918,0cyclictest0-21swapper/711:32:017
650526991918,0cyclictest0-21swapper/707:41:487
650526991917,1cyclictest0-21swapper/710:08:507
650526991916,2cyclictest944607-21ssh09:30:477
650523991917,2cyclictest827135-21kworker/u16:4+events_unbound09:28:276
650523991915,3cyclictest1201921-21kworker/u16:1+flush-8:011:38:276
650521991917,2cyclictest759584-21kworker/u16:3+events_unbound08:24:565
65051699190,1cyclictest0-21swapper/409:11:584
650526991817,0cyclictest0-21swapper/712:15:537
650526991817,0cyclictest0-21swapper/711:55:307
650526991817,0cyclictest0-21swapper/711:24:067
650526991817,0cyclictest0-21swapper/711:09:507
650526991817,0cyclictest0-21swapper/710:47:147
650526991816,1cyclictest1030734-21ssh10:06:177
650523991816,2cyclictest740977-21kworker/u16:2+flush-8:007:59:076
65052399180,1cyclictest0-21swapper/609:14:106
650516991813,4cyclictest759527-21pool-gnome-soft07:59:064
650526991716,0cyclictest0-21swapper/709:51:057
650526991716,0cyclictest0-21swapper/708:56:377
650526991716,0cyclictest0-21swapper/708:32:147
650526991716,0cyclictest0-21swapper/708:04:157
650526991715,1cyclictest1203666-21ssh11:18:097
650526991714,2cyclictest1234-21snmpd09:53:547
650521991715,2cyclictest631549-21kworker/u16:1+flush-8:007:20:445
650521991715,2cyclictest631549-21kworker/u16:1+flush-8:007:16:075
650526991615,0cyclictest0-21swapper/710:33:457
650526991615,0cyclictest0-21swapper/708:22:157
650526991615,0cyclictest0-21swapper/708:22:157
650526991614,1cyclictest0-21swapper/711:58:257
650521991614,2cyclictest578190-21kworker/u16:0+events_unbound08:43:145
65051699160,13cyclictest0-21swapper/411:19:214
650526991513,1cyclictest0-21swapper/707:29:187
65052399150,8cyclictest0-21swapper/609:58:156
650521991513,2cyclictest827135-21kworker/u16:4+events_unbound09:07:085
65051699150,4cyclictest0-21swapper/410:22:104
650526991411,2cyclictest0-21swapper/708:38:037
650523991413,1cyclictest0-21swapper/612:19:356
650523991413,1cyclictest0-21swapper/610:13:566
650523991412,2cyclictest1201921-21kworker/u16:1+flush-8:012:08:016
65052399140,14cyclictest0-21swapper/611:57:216
65052399140,14cyclictest0-21swapper/611:24:056
65052399140,14cyclictest0-21swapper/610:52:146
650521991412,2cyclictest827135-21kworker/u16:4+events_unbound08:40:085
65051699140,7cyclictest1119212-21irqstats10:43:184
65051699140,4cyclictest11109121cut10:38:204
65051699140,3cyclictest8197541kthreadcore08:33:204
65051699140,3cyclictest12467541kthreadcore11:33:214
65051699140,1cyclictest0-21swapper/408:23:154
65051699140,12cyclictest0-21swapper/410:25:364
650526991311,1cyclictest1053795-21ssh10:13:427
65052399139,3cyclictest1167800-21interrupts11:03:166
650523991312,1cyclictest1252298-21kworker/u16:0+events_unbound11:58:166
650523991312,1cyclictest0-21swapper/610:38:036
650523991312,1cyclictest0-21swapper/609:43:586
650523991312,1cyclictest0-21swapper/609:43:586
650523991312,1cyclictest0-21swapper/608:23:346
650523991311,2cyclictest1142164-21kworker/u16:4+flush-8:010:58:066
650523991311,2cyclictest1019520-21kworker/u16:3+flush-8:012:23:066
650523991311,2cyclictest1019520-21kworker/u16:3+flush-8:012:13:276
650516991312,1cyclictest0-21swapper/410:00:134
650516991312,1cyclictest0-21swapper/408:03:234
65051699130,6cyclictest1313952-21grep12:03:124
65051699130,4cyclictest10474781kthreadcore10:13:194
65051699130,3cyclictest10220791kthreadcore10:03:174
65052699127,3cyclictest1143287-21ssh10:53:187
650526991212,0cyclictest0-21swapper/710:52:527
650526991212,0cyclictest0-21swapper/710:23:507
65052399129,2cyclictest1142164-21kworker/u16:4+flush-8:011:18:236
65052399127,4cyclictest703304-21cat07:33:166
65052399127,4cyclictest701348-21smart_sda07:28:286
650523991211,1cyclictest0-21swapper/610:26:136
65052399120,1cyclictest0-21swapper/607:16:436
650521991210,2cyclictest567213-21kworker/u16:5+events_unbound07:40:075
65051699128,3cyclictest809063-21cat08:28:164
65051699123,8cyclictest778148-21awk08:08:234
65051699123,8cyclictest1284912-21cut11:48:224
650516991211,1cyclictest0-21swapper/409:38:084
65051699120,6cyclictest943488-21chrt09:28:504
65051699120,4cyclictest789920-21if_p4p108:18:164
65051699120,4cyclictest789920-21if_p4p108:18:164
65051699120,4cyclictest740342-21chrt07:49:464
65051699120,4cyclictest1292660-21grep11:53:194
65051699120,3cyclictest12531741cstates11:38:144
65051699120,11cyclictest0-21swapper/411:58:134
65052699118,2cyclictest1234-21snmpd11:35:187
65052399118,2cyclictest674993-21irqstats07:18:186
65052399117,3cyclictest809244-21irqcore08:28:176
65052399117,3cyclictest762448-21kthreadcore08:03:196
650523991110,1cyclictest0-21swapper/607:48:056
65052399110,3cyclictest996230-21tune2fs09:53:166
65052399110,3cyclictest1200513-21/usr/sbin/munin11:13:306
65052199119,2cyclictest827135-21kworker/u16:4+events_unbound08:54:205
65051699113,7cyclictest1156748-21cut10:58:194
65051699113,7cyclictest1146736-21tr10:53:214
65051699112,8cyclictest910280-21cut09:18:154
65051699112,8cyclictest900837-21kthreadcore09:13:204
65051699112,8cyclictest872619-21kthreadcore08:58:234
65051699112,8cyclictest839128-21cut08:43:194
65051699112,8cyclictest742782-21cut07:53:194
65051699112,8cyclictest712863-21sh07:38:164
65051699112,8cyclictest1345685-21grep12:13:214
65051699110,9cyclictest828068-21tune2fs08:38:164
65051699110,5cyclictest878462-21cat09:03:204
65051699110,4cyclictest995997-21expr09:53:144
65051699110,4cyclictest986347-21grep09:48:184
65051699110,4cyclictest979936-21timerwakeupswit09:43:304
65051699110,4cyclictest979936-21timerwakeupswit09:43:304
65051699110,4cyclictest950771-21kthreadcore09:33:204
65051699110,4cyclictest856359-21cpuspeed_turbos08:53:144
65051699110,4cyclictest847388-21sh08:48:164
65051699110,4cyclictest788607-21taskset08:16:144
65051699110,4cyclictest705205-21cut07:33:194
65051699110,4cyclictest697618-21cut07:28:214
65051699110,4cyclictest683686-21expr07:23:144
65051699110,4cyclictest673896-21cat07:18:134
65051699110,4cyclictest664976-21if_p4p107:13:174
65051699110,4cyclictest1385957-21taskset12:31:304
65051699110,4cyclictest1385957-21taskset12:31:304
65051699110,4cyclictest1326744-21sh12:08:144
65051699110,4cyclictest12727991kthreadcore11:43:224
65051699110,4cyclictest1239612-21taskset11:32:244
65051699110,4cyclictest1192307-21if_err_p4p111:13:154
65051699110,4cyclictest1181056-21cat11:08:174
65051699110,4cyclictest1081244-21cpu10:28:144
65051699110,4cyclictest1035249-21cut10:08:194
65051699110,3cyclictest7282941kthreadcore07:43:204
65052399108,2cyclictest86-21ksoftirqd/609:38:186
65052399108,2cyclictest86-21ksoftirqd/608:08:176
65052399106,3cyclictest946628-21cpuspeed_turbos09:33:136
65052399106,3cyclictest1333019-21kthreadcore12:08:226
65052399106,3cyclictest1146887-21kthreadcore10:53:216
65052399106,3cyclictest1056984-21grep10:18:146
65052399105,4cyclictest926199-21cut09:23:226
65052399105,4cyclictest741181-21grep07:53:146
65052399104,5cyclictest0-21swapper/610:28:216
65052399104,5cyclictest0-21swapper/609:48:186
65052399104,5cyclictest0-21swapper/609:08:216
65052399100,9cyclictest884207-21unixbench_multi09:03:306
65052399100,9cyclictest797332-21ntpq08:18:246
65052399100,9cyclictest797332-21ntpq08:18:246
65052399100,9cyclictest782936-21kthreadcore08:13:196
65052399100,3cyclictest1244969-21kthreadcore11:33:206
65052399100,3cyclictest1125380-21kthreadcore10:43:226
65052399100,3cyclictest1025742-21grep10:03:196
65052399100,2cyclictest1265774-21cut11:43:166
65051699101,1cyclictest681rcuog/412:27:244
65051699100,9cyclictest1216078-21cpuspeed_turbos11:23:124
65051699100,8cyclictest922141-21tr09:23:154
65051699100,4cyclictest1397957-21taskset12:36:034
65051699100,4cyclictest1168245-21kthreadcore11:03:194
65051699100,4cyclictest1130963-21sh10:48:154
65051699100,4cyclictest1094921-21cat10:33:194
65051699100,3cyclictest659764-21taskset07:09:404
6505239990,8cyclictest911092-21kthreadcore09:18:186
6505239990,8cyclictest853387-21cut08:48:226
6505239990,8cyclictest826081-21ntpq08:33:266
6505239990,8cyclictest1277337-21cat11:48:136
6505239990,8cyclictest1231170-21kthreadcore11:28:186
6505239990,8cyclictest1183025-21cat11:08:186
6505239990,8cyclictest0-21swapper/610:08:296
6505239990,8cyclictest0-21swapper/608:53:176
6505239990,4cyclictest869455-21grep08:58:216
6505239990,3cyclictest1098220-21cut10:33:216
6505239990,1cyclictest0-21swapper/608:38:306
6505169990,8cyclictest1360516-21chrt12:19:444
6505239986,2cyclictest86-21ksoftirqd/612:34:206
6505239986,2cyclictest86-21ksoftirqd/612:29:256
6505239986,2cyclictest86-21ksoftirqd/612:29:256
6505239983,4cyclictest837414-21cat08:43:146
6505239980,2cyclictest712122-21/usr/sbin/munin07:38:146
660054270,0sleep60-21swapper/607:13:036
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional