You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-14 - 20:32
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Sat Mar 14, 2026 12:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
12885352710,0sleep40-21swapper/408:48:514
1083934996155,5cyclictest650-21systemd-journal09:28:517
108332125747,7sleep40-21swapper/406:59:304
1083922995654,2cyclictest1666034-21kworker/u16:2+events_unbound12:24:245
1083922995654,2cyclictest1399671-21kworker/u16:0+events_unbound10:29:205
1083922995452,2cyclictest1399671-21kworker/u16:0+events_unbound11:14:055
1083922995351,2cyclictest1497834-21kworker/u16:1+flush-8:012:14:205
1083922995149,2cyclictest1497834-21kworker/u16:1+flush-8:011:39:185
1083922995147,2cyclictest1497834-21kworker/u16:1+events_unbound11:12:085
1083934995045,4cyclictest1677991-21latency_hist11:33:507
1083922995049,1cyclictest1497834-21kworker/u16:1+events_unbound10:38:515
1083922995048,2cyclictest1106697-21kworker/u16:3+events_unbound07:54:165
1083921995047,2cyclictest1666034-21kworker/u16:2+events_unbound11:54:074
1083926994947,2cyclictest1317632-21kworker/u16:3+flush-8:009:23:516
1083922994947,2cyclictest1399671-21kworker/u16:0+flush-8:010:34:175
1083922994846,2cyclictest1530445-21kworker/u16:3+events_unbound10:49:205
1083922994846,2cyclictest1497834-21kworker/u16:1+events_unbound10:55:125
1083922994744,2cyclictest1193213-21kworker/u16:0+flush-8:008:43:515
1083922994644,2cyclictest1399671-21kworker/u16:0+events_unbound11:02:085
1083922994644,2cyclictest1399671-21kworker/u16:0+events_unbound11:02:085
1083922994644,2cyclictest1338925-21kworker/u16:2+events_unbound09:19:165
1083922994644,2cyclictest1317632-21kworker/u16:3+events_unbound09:27:425
1083934994539,5cyclictest1240706-21latency_hist08:23:507
1083934994539,5cyclictest1240706-21latency_hist08:23:507
1083922994543,2cyclictest1497834-21kworker/u16:1+events_unbound11:29:185
1083922994543,2cyclictest1338925-21kworker/u16:2+events_unbound09:13:135
1083922994542,2cyclictest1497834-21kworker/u16:1+flush-8:011:04:185
1083921994543,2cyclictest1666034-21kworker/u16:2+events_unbound12:09:184
1083922994442,2cyclictest1338925-21kworker/u16:2+events_unbound09:54:195
1083922994442,2cyclictest1174063-21kworker/u16:0+flush-8:007:49:215
1083922994341,2cyclictest1711625-21kworker/u16:0+flush-8:011:59:055
1083922994341,2cyclictest1641127-21kworker/u16:3+events_unbound11:25:125
1083922994341,2cyclictest1497834-21kworker/u16:1+events_unbound10:27:565
1083922994341,2cyclictest1437663-21kworker/u16:4+events_unbound10:21:375
1083922994341,2cyclictest1437663-21kworker/u16:4+events_unbound10:21:375
1083922994341,2cyclictest1317632-21kworker/u16:3+events_unbound09:38:335
1083922994341,2cyclictest1183449-21kworker/u16:2+flush-8:008:49:195
1083922994240,2cyclictest1784406-21kworker/u16:3+events_unbound12:32:415
1083922994240,2cyclictest1666034-21kworker/u16:2+flush-8:012:09:285
1083922994240,2cyclictest1497834-21kworker/u16:1+events_unbound12:21:485
1083922994240,2cyclictest1338925-21kworker/u16:2+events_unbound10:00:175
1083922994240,2cyclictest1338925-21kworker/u16:2+events_unbound09:52:105
1083922994240,2cyclictest1193213-21kworker/u16:0+flush-8:008:14:205
1083921994240,2cyclictest1530445-21kworker/u16:3+events_unbound10:41:484
1083921994240,2cyclictest1497834-21kworker/u16:1+events_unbound10:56:064
1083921994239,2cyclictest1641127-21kworker/u16:3+events_unbound11:23:084
107451724232,7sleep50-21swapper/506:58:595
12718862410,0sleep71271887-21cat08:39:087
1083922994140,1cyclictest1497834-21kworker/u16:1+events_unbound11:34:115
1083922994139,2cyclictest1437663-21kworker/u16:4+events_unbound10:17:345
1083921994139,2cyclictest1399671-21kworker/u16:0+flush-8:010:44:204
1083921994139,2cyclictest1338925-21kworker/u16:2+events_unbound10:14:294
1083921994139,2cyclictest1134529-21kworker/u16:4+flush-8:008:09:064
1083921994138,2cyclictest1497834-21kworker/u16:1+events_unbound12:28:484
10745192415,30sleep70-21swapper/706:59:017
1083926994038,2cyclictest1497834-21kworker/u16:1+flush-8:010:38:506
1083926994037,2cyclictest1437663-21kworker/u16:4+flush-8:010:08:576
1083922994038,2cyclictest1497834-21kworker/u16:1+events_unbound12:04:565
1083922994038,2cyclictest1399671-21kworker/u16:0+events_unbound10:04:465
1083922994038,2cyclictest1399671-21kworker/u16:0+events_unbound09:48:255
1083922994038,2cyclictest1193213-21kworker/u16:0+events_unbound09:05:575
1083922994038,2cyclictest1183449-21kworker/u16:2+events_unbound08:54:215
1083922994037,2cyclictest1134529-21kworker/u16:4+events_unbound07:34:185
1083922994037,2cyclictest1134529-21kworker/u16:4+events_unbound07:34:185
1083921994038,2cyclictest1497834-21kworker/u16:1+events_unbound12:04:034
1083921994038,2cyclictest1399671-21kworker/u16:0+events_unbound10:29:064
1083922993937,2cyclictest1711625-21kworker/u16:0+events_unbound11:56:165
1083922993937,2cyclictest1399671-21kworker/u16:0+flush-8:009:39:195
1083922993937,2cyclictest1399671-21kworker/u16:0+events_unbound11:23:445
1083922993937,2cyclictest1399671-21kworker/u16:0+events_unbound10:45:165
1083922993937,2cyclictest1338925-21kworker/u16:2+events_unbound10:11:585
1083922993937,2cyclictest1338925-21kworker/u16:2+events_unbound09:31:085
1083921993937,2cyclictest1711625-21kworker/u16:0+events_unbound11:51:294
1083921993937,2cyclictest1338925-21kworker/u16:2+flush-8:009:19:234
1083934993835,2cyclictest1350465-21ssh09:14:237
108393499380,37cyclictest1616269-21ssh11:05:417
108393499380,36cyclictest1446754-21ssh09:54:237
1083922993836,2cyclictest1183449-21kworker/u16:2+events_unbound07:59:225
1083922993836,2cyclictest1134529-21kworker/u16:4+events_unbound08:34:175
1083921993836,2cyclictest1338925-21kworker/u16:2+events_unbound09:14:434
1083926993735,2cyclictest1530445-21kworker/u16:3+flush-8:010:49:016
1083926993735,2cyclictest1317632-21kworker/u16:3+flush-8:009:29:096
1083926993735,2cyclictest1183449-21kworker/u16:2+flush-8:008:38:516
1083922993735,2cyclictest1497834-21kworker/u16:1+events_unbound11:53:015
1083921993735,2cyclictest1317632-21kworker/u16:3+events_unbound09:42:244
1083921993735,2cyclictest1193213-21kworker/u16:0+events_unbound08:24:174
1083921993735,2cyclictest1183449-21kworker/u16:2+flush-8:007:59:194
1083921993735,2cyclictest1106697-21kworker/u16:3+events_unbound07:39:174
1083934993636,0cyclictest0-21swapper/712:23:457
1083921993634,2cyclictest1497834-21kworker/u16:1+events_unbound10:28:174
1083921993634,2cyclictest1174063-21kworker/u16:0+events_unbound07:49:174
1083934993532,2cyclictest1727703-21kthreadcore11:54:097
108393499350,33cyclictest1486177-21ssh10:13:527
1083922993533,2cyclictest1497834-21kworker/u16:1+events_unbound11:46:415
1083921993533,2cyclictest1641127-21kworker/u16:3+events_unbound11:41:404
1083921993533,2cyclictest1497834-21kworker/u16:1+events_unbound11:00:074
1083921993533,2cyclictest1497834-21kworker/u16:1+events_unbound11:00:074
1083921993533,2cyclictest1338925-21kworker/u16:2+flush-8:009:45:044
108274023515,14sleep60-21swapper/606:59:246
1083926993432,2cyclictest1666034-21kworker/u16:2+flush-8:012:08:456
1083921993432,2cyclictest1711625-21kworker/u16:0+events_unbound11:59:474
1083921993432,2cyclictest1399671-21kworker/u16:0+events_unbound10:11:434
1083921993432,2cyclictest1338925-21kworker/u16:2+events_unbound09:53:324
1083921993432,2cyclictest1317632-21kworker/u16:3+events_unbound09:12:084
1083921993432,2cyclictest1122422-21kworker/u16:2+events_unbound07:20:084
1083934993329,3cyclictest1119190-21kthreadcore07:19:097
1083922993331,2cyclictest1193213-21kworker/u16:0+events_unbound09:14:275
1083921993331,2cyclictest1784406-21kworker/u16:3+events_unbound12:29:514
1083921993331,2cyclictest1641127-21kworker/u16:3+events_unbound11:34:324
1083921993331,2cyclictest1497834-21kworker/u16:1+events_unbound11:29:334
1083921993331,2cyclictest1437663-21kworker/u16:4+events_unbound10:20:404
1083921993331,2cyclictest1437663-21kworker/u16:4+events_unbound10:20:404
1083921993331,2cyclictest1399671-21kworker/u16:0+events_unbound11:14:584
1083921993331,2cyclictest1399671-21kworker/u16:0+events_unbound09:38:144
1083921993331,2cyclictest1354657-21kworker/u16:1+events_unbound09:32:044
1083921993331,2cyclictest1193213-21kworker/u16:0+events_unbound08:20:134
1083921993331,2cyclictest1193213-21kworker/u16:0+events_unbound08:20:134
1083921993331,2cyclictest1183449-21kworker/u16:2+events_unbound08:29:154
1083926993229,2cyclictest1641127-21kworker/u16:3+flush-8:011:33:466
1083922993230,2cyclictest1074201-21kworker/u16:1+events_unbound07:16:135
1083921993230,2cyclictest1784406-21kworker/u16:3+events_unbound12:19:004
1083921993230,2cyclictest1497834-21kworker/u16:1+events_unbound10:36:464
1083921993230,2cyclictest1437663-21kworker/u16:4+events_unbound10:06:204
1083921993230,2cyclictest1338925-21kworker/u16:2+events_unbound10:03:154
1083921993230,2cyclictest1134529-21kworker/u16:4+events_unbound07:48:304
13431472310,0chrt0-21swapper/609:14:096
1083926993128,2cyclictest1307848-21kworker/u16:1+flush-8:009:08:506
1083922993129,2cyclictest1183449-21kworker/u16:2+events_unbound08:44:155
1083922993128,2cyclictest1193213-21kworker/u16:0+flush-8:008:29:015
1083921993129,2cyclictest1530445-21kworker/u16:3+events_unbound11:03:594
1083921993129,2cyclictest1134529-21kworker/u16:4+events_unbound09:01:374
1083921993129,2cyclictest1134529-21kworker/u16:4+events_unbound08:34:194
1083934993026,3cyclictest1318438-21ssh09:04:047
1083926993027,2cyclictest1399671-21kworker/u16:0+flush-8:010:14:186
1083921993028,2cyclictest1666034-21kworker/u16:2+events_unbound11:47:584
1083921993028,2cyclictest1497834-21kworker/u16:1+events_unbound12:15:354
1083921993028,2cyclictest1497834-21kworker/u16:1+events_unbound11:24:364
1083921993028,2cyclictest1183449-21kworker/u16:2+flush-8:008:49:174
1083921993028,2cyclictest1134529-21kworker/u16:4+events_unbound08:06:014
11892812290,0sleep40-21swapper/407:54:104
1083922992927,2cyclictest1134529-21kworker/u16:4+flush-8:008:59:185
1083922992927,2cyclictest1134529-21kworker/u16:4+events_unbound07:40:095
1083921992927,2cyclictest1497834-21kworker/u16:1+events_unbound10:53:244
1083921992927,2cyclictest1193213-21kworker/u16:0+events_unbound09:08:184
1083921992927,2cyclictest1183449-21kworker/u16:2+events_unbound08:56:134
1083921992927,2cyclictest1183449-21kworker/u16:2+events_unbound08:42:184
1083921992927,2cyclictest1134529-21kworker/u16:4+events_unbound07:31:324
108393499280,26cyclictest1095785-21cut07:08:557
1083922992826,2cyclictest1074201-21kworker/u16:1+events_unbound07:09:115
1083921992826,2cyclictest1338925-21kworker/u16:2+events_unbound09:57:444
1083921992826,2cyclictest1183449-21kworker/u16:2+events_unbound08:15:144
1083934992727,0cyclictest0-21swapper/711:49:207
1083934992727,0cyclictest0-21swapper/710:46:067
108393499270,26cyclictest5747-21gnome-shell09:48:007
1083926992724,2cyclictest1338925-21kworker/u16:2+flush-8:009:28:466
1083921992725,2cyclictest1074201-21kworker/u16:1+events_unbound07:10:024
1083921992725,2cyclictest1074201-21kworker/u16:1+events_unbound07:06:254
1083921992725,2cyclictest1030726-21kworker/u16:0+events_unbound07:18:384
1083921992724,2cyclictest1497834-21kworker/u16:1+events_unbound11:09:064
1083934992624,1cyclictest1317202-21diskmemload10:54:027
1083934992620,5cyclictest1298090-21latency_hist08:53:507
1083922992624,2cyclictest1183449-21kworker/u16:2+events_unbound08:22:105
1083922992624,2cyclictest1183449-21kworker/u16:2+events_unbound08:22:105
1083922992624,2cyclictest1134529-21kworker/u16:4+events_unbound07:44:205
1083922992623,2cyclictest1134529-21kworker/u16:4+events_unbound08:08:515
1083926992524,1cyclictest1497834-21kworker/u16:1+events_unbound11:27:286
1083926992523,2cyclictest1338925-21kworker/u16:2+flush-8:009:44:326
1083926992523,2cyclictest1193213-21kworker/u16:0+flush-8:008:14:166
1083922992523,2cyclictest1183449-21kworker/u16:2+events_unbound08:06:135
1083921992523,2cyclictest1106697-21kworker/u16:3+events_unbound07:38:454
1083921992523,2cyclictest1106697-21kworker/u16:3+events_unbound07:38:454
1083921992523,2cyclictest1074201-21kworker/u16:1+events_unbound07:25:484
1083934992422,1cyclictest1498205-21ssh10:18:537
1083934992422,1cyclictest1498205-21ssh10:18:537
108393499240,23cyclictest1388075-21sh09:31:217
108393499240,22cyclictest1144070-21sed07:29:177
1083922992422,2cyclictest1063571-21kworker/u16:2+events_unbound07:08:015
12170252220,1chrt1217028-21kthreadcore08:09:117
108393499220,21cyclictest1820933-21ssh12:32:047
108393499220,21cyclictest1657437-21tr11:24:087
1083922992220,2cyclictest1106697-21kworker/u16:3+events_unbound07:31:575
1083922992220,2cyclictest1074201-21kworker/u16:1+events_unbound07:28:145
1083934992116,4cyclictest1211967-21latency_hist08:08:507
1083934992019,1cyclictest0-21swapper/710:50:017
108393499200,19cyclictest1522791-21cat10:29:047
1083926992018,2cyclictest1183449-21kworker/u16:2+flush-8:008:03:516
1083926992018,2cyclictest1106697-21kworker/u16:3+events_unbound07:58:516
1083926992018,2cyclictest1074201-21kworker/u16:1+events_unbound07:09:096
1083926992017,2cyclictest1399671-21kworker/u16:0+flush-8:009:39:066
1083934991913,5cyclictest1135416-21latency_hist07:28:507
1083934991911,7cyclictest0-21swapper/711:09:107
1083926991918,1cyclictest1711625-21kworker/u16:0+events_unbound11:50:266
1083926991917,2cyclictest1497834-21kworker/u16:1+flush-8:011:59:156
1083926991917,2cyclictest1134529-21kworker/u16:4+events_unbound08:59:186
1083926991916,2cyclictest1134529-21kworker/u16:4+flush-8:007:34:226
1083926991916,2cyclictest1134529-21kworker/u16:4+flush-8:007:34:226
1083922991917,2cyclictest1122422-21kworker/u16:2+events_unbound07:21:415
1083934991818,0cyclictest0-21swapper/711:40:597
1083934991818,0cyclictest0-21swapper/710:24:057
108393499180,17cyclictest1641811-21ssh11:18:297
1083926991816,2cyclictest1784406-21kworker/u16:3+events_unbound12:29:256
1083922991816,2cyclictest1183449-21kworker/u16:2+events_unbound08:26:425
1083934991715,1cyclictest1340048-21ssh09:11:337
1083934991715,1cyclictest1280068-21hwlatdetect08:44:047
1083934991714,2cyclictest1390880-21sed09:34:077
1083934991714,2cyclictest1146340-21irqcore07:34:087
1083934991714,2cyclictest1146340-21irqcore07:34:087
1083934991713,3cyclictest1713123-21ssh11:47:227
1083934991711,5cyclictest1689979-21latency_hist11:38:507
108393499170,16cyclictest1472288-21ssh10:06:127
108393499170,16cyclictest1267-21snmpd11:19:167
1083926991714,2cyclictest1641127-21kworker/u16:3+flush-8:011:19:056
1083926991713,3cyclictest1183449-21kworker/u16:2+flush-8:008:49:176
1083921991715,2cyclictest1317632-21kworker/u16:3+flush-8:009:24:094
1083934991616,0cyclictest0-21swapper/712:02:257
1083934991615,1cyclictest1317202-21diskmemload11:00:017
1083934991615,1cyclictest1317202-21diskmemload11:00:017
108393499160,15cyclictest1778956-21kthreadcore12:14:127
108393499160,15cyclictest1545437-21ssh10:37:527
1083926991614,2cyclictest1530445-21kworker/u16:3+flush-8:010:44:256
1083926991614,2cyclictest1193213-21kworker/u16:0+flush-8:008:24:056
1083926991614,2cyclictest1030726-21kworker/u16:0+events_unbound07:04:146
108393499157,7cyclictest0-21swapper/712:12:287
1083934991515,0cyclictest0-21swapper/710:40:017
1083934991515,0cyclictest0-21swapper/710:13:137
1083934991515,0cyclictest0-21swapper/709:39:267
108393499150,14cyclictest1461030-21ssh10:02:417
1083926991513,2cyclictest1497834-21kworker/u16:1+events_unbound11:05:006
108393499149,4cyclictest1116281-21latency_hist07:18:517
108393499145,8cyclictest0-21swapper/709:21:117
1083934991411,2cyclictest1259813-21ls08:33:507
108393499140,12cyclictest1268994-21sed08:34:217
108393499140,12cyclictest1178351-21cut07:49:117
1083926991413,1cyclictest0-21swapper/610:53:586
1083926991411,3cyclictest1497834-21kworker/u16:1+flush-8:010:39:196
108392699140,1cyclictest0-21swapper/611:43:096
108392699140,14cyclictest0-21swapper/612:09:296
108392699140,14cyclictest0-21swapper/611:54:116
108392699140,14cyclictest0-21swapper/611:14:466
108392699140,14cyclictest0-21swapper/609:49:196
108392699140,14cyclictest0-21swapper/609:35:276
108392699140,14cyclictest0-21swapper/609:13:046
108392699140,13cyclictest0-21swapper/612:18:566
108393499139,3cyclictest1298481-21/usr/sbin/munin08:54:187
108393499139,3cyclictest1267-21snmpd07:07:127
108393499139,3cyclictest1193875-21cut07:59:067
108393499138,4cyclictest1184408-21cat07:54:047
108393499136,6cyclictest0-21swapper/712:26:087
108393499136,6cyclictest0-21swapper/709:50:187
108393499135,7cyclictest0-21swapper/712:08:087
108393499130,4cyclictest1316240-21ntpq08:59:167
108393499130,3cyclictest1230218-21ntp_states08:14:177
1083926991312,1cyclictest0-21swapper/611:46:466
108392699130,13cyclictest0-21swapper/612:15:096
108392699130,13cyclictest0-21swapper/611:10:596
108392699130,13cyclictest0-21swapper/610:03:216
108393499128,3cyclictest1155628-21perl07:39:057
108393499120,3cyclictest1164522-21/usr/sbin/munin07:44:167
1083926991211,1cyclictest0-21swapper/611:37:386
108392699120,1cyclictest0-21swapper/608:23:246
108392699120,1cyclictest0-21swapper/608:23:246
108393499110,3cyclictest1248049-21cut08:24:137
1083926991110,1cyclictest0-21swapper/610:29:136
1083926991110,1cyclictest0-21swapper/608:29:526
1083926991110,1cyclictest0-21swapper/607:20:206
108392699110,11cyclictest0-21swapper/608:05:266
108392699109,1cyclictest0-21swapper/610:19:266
108392699109,1cyclictest0-21swapper/610:19:266
108392699109,1cyclictest0-21swapper/607:46:596
108392699107,2cyclictest1074201-21kworker/u16:1+events_unbound07:24:046
10839269998,1cyclictest0-21swapper/612:24:376
10839269998,1cyclictest0-21swapper/610:59:386
10839269998,1cyclictest0-21swapper/610:59:386
10839269998,1cyclictest0-21swapper/610:25:266
10839269998,1cyclictest0-21swapper/607:32:196
10839269998,1cyclictest0-21swapper/607:15:376
10839269997,2cyclictest1399671-21kworker/u16:0+events_unbound10:04:056
10839269997,2cyclictest1338925-21kworker/u16:2+flush-8:009:54:276
10839269987,1cyclictest0-21swapper/607:49:126
10839269976,1cyclictest0-21swapper/608:42:576
10839269976,1cyclictest0-21swapper/607:39:346
10839269975,2cyclictest1134529-21kworker/u16:4+flush-8:008:09:136
10839269950,5cyclictest0-21swapper/608:53:546
10839269950,5cyclictest0-21swapper/608:44:066
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional