You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-19 - 12:00
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack0slot2.osadl.org (updated Sat Sep 19, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
39763426151,7sleep40-21swapper/419:06:344
39769525621,30sleep70-21swapper/719:07:257
39764524838,7sleep50-21swapper/519:06:435
398139994239,2cyclictest719772-21kworker/u16:4+events_unbound21:59:266
398132994138,2cyclictest793020-21kworker/u16:3+events_unbound23:04:264
398146993934,4cyclictest683383-21latency_hist21:29:277
398146993933,4cyclictest1132415-21latency_hist00:34:267
398139993937,2cyclictest398338-21kworker/u16:1+flush-8:019:24:266
398146993832,4cyclictest998700-21latency_hist23:39:267
398132993634,2cyclictest556352-21kworker/u16:3+flush-8:020:44:274
398132993634,2cyclictest1092903-21kworker/u16:2+events_unbound00:25:014
398137993533,2cyclictest624864-21kworker/u16:0+flush-8:021:44:265
398132993533,2cyclictest421628-21kworker/u16:0+flush-8:019:44:264
398139993432,2cyclictest460421-21kworker/u16:1+events_unbound19:54:276
398132993432,2cyclictest815371-21kworker/u16:0+events_unbound23:34:484
398137993331,2cyclictest793020-21kworker/u16:3+flush-8:023:15:045
398137993331,2cyclictest624864-21kworker/u16:0+events_unbound21:25:295
398137993330,2cyclictest815371-21kworker/u16:0+events_unbound22:29:285
398132993330,2cyclictest719772-21kworker/u16:4+flush-8:021:49:264
398146993227,4cyclictest804682-21latency_hist22:19:267
398146993227,4cyclictest557139-21latency_hist20:29:277
398139993230,2cyclictest793020-21kworker/u16:3+events_unbound22:29:416
398139993230,2cyclictest538085-21kworker/u16:1+flush-8:021:19:526
398137993229,2cyclictest624864-21kworker/u16:0+flush-8:021:14:325
398137993229,2cyclictest1035240-21kworker/u16:4+events_unbound00:14:405
398132993230,2cyclictest815371-21kworker/u16:0+events_unbound22:38:054
398132993229,2cyclictest624864-21kworker/u16:0+flush-8:021:54:334
398137993129,2cyclictest901792-21kworker/u16:1+events_unbound23:04:485
398137993129,2cyclictest624864-21kworker/u16:0+events_unbound21:38:045
398137993129,2cyclictest1092903-21kworker/u16:2+flush-8:000:29:205
398137993128,2cyclictest708045-21kworker/u16:2+events_unbound21:49:285
398132993129,2cyclictest350730-21kworker/u16:2+flush-8:019:14:324
398132993128,2cyclictest681080-21kworker/u16:3+events_unbound21:39:364
398132993126,2cyclictest815371-21kworker/u16:0+events_unbound22:22:374
398139993028,2cyclictest538085-21kworker/u16:1+events_unbound21:34:426
398139993028,2cyclictest1035240-21kworker/u16:4+flush-8:000:19:336
398137993028,2cyclictest793020-21kworker/u16:3+events_unbound22:36:365
398137993028,2cyclictest793020-21kworker/u16:3+events_unbound22:28:055
398137993028,2cyclictest793020-21kworker/u16:3+events_unbound22:28:055
398137993028,2cyclictest624864-21kworker/u16:0+events_unbound22:09:265
398137993028,2cyclictest489388-21kworker/u16:2+flush-8:020:14:265
398132993028,2cyclictest624864-21kworker/u16:0+events_unbound21:15:374
398132993028,2cyclictest538085-21kworker/u16:1+events_unbound21:36:364
398139992925,3cyclictest864680-21kworker/u16:1+flush-8:022:44:276
398137992927,2cyclictest793020-21kworker/u16:3+events_unbound22:55:375
398137992927,2cyclictest793020-21kworker/u16:3+events_unbound22:42:375
398137992927,2cyclictest792011-21kworker/u16:1+flush-8:022:24:215
398137992927,2cyclictest719772-21kworker/u16:4+events_unbound21:45:375
398137992927,2cyclictest708045-21kworker/u16:2+events_unbound22:09:375
398137992926,2cyclictest815371-21kworker/u16:0+events_unbound23:34:405
398137992926,2cyclictest1021938-21kworker/u16:1+events_unbound00:04:285
398132992927,2cyclictest986592-21kworker/u16:3+events_unbound23:46:374
398132992927,2cyclictest719772-21kworker/u16:4+events_unbound22:03:364
398139992826,2cyclictest719772-21kworker/u16:4+flush-8:021:59:526
398139992826,2cyclictest517176-21kworker/u16:3+events_unbound20:04:496
398139992825,2cyclictest877825-21kworker/u16:2+flush-8:022:49:366
398137992826,2cyclictest815371-21kworker/u16:0+events_unbound23:51:365
398137992826,2cyclictest1096075-21kworker/u16:3+events_unbound00:29:435
398137992825,2cyclictest489388-21kworker/u16:2+events_unbound20:49:445
398132992826,2cyclictest815371-21kworker/u16:0+events_unbound23:25:004
398132992826,2cyclictest719772-21kworker/u16:4+events_unbound21:54:254
39766422817,7sleep60-21swapper/619:07:006
10947352280,1chrt1094737-21ssh00:17:127
398139992725,2cyclictest1035240-21kworker/u16:4+events_unbound00:09:496
398137992725,2cyclictest719772-21kworker/u16:4+events_unbound21:58:045
398137992725,2cyclictest624864-21kworker/u16:0+flush-8:021:30:135
398137992725,2cyclictest538085-21kworker/u16:1+events_unbound21:19:575
398137992725,2cyclictest421628-21kworker/u16:0+events_unbound20:34:505
398132992725,2cyclictest489388-21kworker/u16:2+events_unbound21:28:044
398132992725,2cyclictest460421-21kworker/u16:1+events_unbound19:59:224
398139992624,2cyclictest624864-21kworker/u16:0+events_unbound21:04:506
398137992624,2cyclictest460421-21kworker/u16:1+events_unbound19:54:415
398132992624,2cyclictest901792-21kworker/u16:1+events_unbound23:07:364
398132992624,2cyclictest877825-21kworker/u16:2+events_unbound22:58:374
398132992624,2cyclictest815371-21kworker/u16:0+flush-8:023:54:214
398132992624,2cyclictest793020-21kworker/u16:3+flush-8:022:29:364
398132992624,2cyclictest719772-21kworker/u16:4+events_unbound22:15:374
398132992624,2cyclictest1035240-21kworker/u16:4+events_unbound00:14:364
398132992623,2cyclictest708045-21kworker/u16:2+events_unbound22:09:324
398132992623,2cyclictest1096075-21kworker/u16:3+events_unbound00:29:294
398146992519,5cyclictest625141-21latency_hist21:04:267
398137992523,2cyclictest962389-21kworker/u16:2+events_unbound23:43:045
398137992523,2cyclictest1092903-21kworker/u16:2+flush-8:000:19:375
398137992522,2cyclictest556352-21kworker/u16:3+events_unbound21:09:365
398137992522,2cyclictest1035240-21kworker/u16:4+events_unbound23:54:285
398132992523,2cyclictest815371-21kworker/u16:0+flush-8:023:39:364
398132992523,2cyclictest1035240-21kworker/u16:4+events_unbound23:59:474
398132992523,2cyclictest1035240-21kworker/u16:4+events_unbound23:54:364
398132992523,2cyclictest1021938-21kworker/u16:1+flush-8:000:04:514
10079982250,1chrt999186-21/usr/sbin/munin23:39:537
398139992422,2cyclictest388239-21kworker/u16:4+flush-8:019:29:266
398139992421,3cyclictest556352-21kworker/u16:3+events_unbound20:59:496
398137992422,2cyclictest815371-21kworker/u16:0+events_unbound23:14:265
398137992422,2cyclictest719772-21kworker/u16:4+events_unbound22:14:525
398137992422,2cyclictest350730-21kworker/u16:2+events_unbound19:14:495
398132992423,1cyclictest793020-21kworker/u16:3+events_unbound22:25:494
398132992423,1cyclictest793020-21kworker/u16:3+events_unbound22:25:494
398132992421,2cyclictest1035240-21kworker/u16:4+events_unbound00:19:434
398139992321,2cyclictest556352-21kworker/u16:3+events_unbound20:34:566
398137992321,2cyclictest815371-21kworker/u16:0+events_unbound23:25:375
398137992321,2cyclictest793020-21kworker/u16:3+events_unbound22:47:365
398137992320,2cyclictest708045-21kworker/u16:2+flush-8:021:59:325
398132992321,2cyclictest901792-21kworker/u16:1+events_unbound23:22:374
398132992321,2cyclictest815371-21kworker/u16:0+events_unbound23:14:524
398132992321,2cyclictest556352-21kworker/u16:3+flush-8:021:09:544
398146992217,4cyclictest768249-21latency_hist22:04:277
398139992220,2cyclictest986592-21kworker/u16:3+events_unbound23:45:216
398139992220,2cyclictest815371-21kworker/u16:0+events_unbound22:35:086
398139992220,2cyclictest1035240-21kworker/u16:4+events_unbound00:24:446
398139992219,3cyclictest421628-21kworker/u16:0+events_unbound20:14:496
398139992219,2cyclictest815371-21kworker/u16:0+flush-8:023:49:326
398137992220,2cyclictest815371-21kworker/u16:0+events_unbound23:32:135
398137992219,3cyclictest421628-21kworker/u16:0+flush-8:020:14:445
398132992220,2cyclictest624864-21kworker/u16:0+events_unbound21:30:244
398146992119,1cyclictest829034-21awk22:29:267
398146992119,1cyclictest829034-21awk22:29:267
398139992118,2cyclictest624864-21kworker/u16:0+flush-8:021:39:276
398137992119,2cyclictest986592-21kworker/u16:3+events_unbound23:48:035
398137992119,2cyclictest421628-21kworker/u16:0+events_unbound20:24:395
398137992119,2cyclictest1096075-21kworker/u16:3+events_unbound00:36:375
398132992119,2cyclictest877825-21kworker/u16:2+events_unbound22:51:254
398132992119,2cyclictest624864-21kworker/u16:0+flush-8:021:19:544
398146992015,4cyclictest645-21systemd-journal20:44:277
398146992014,5cyclictest659116-21latency_hist21:19:277
398139992018,2cyclictest793020-21kworker/u16:3+flush-8:022:59:556
398139992015,4cyclictest1121497-21cat00:29:406
398137992018,2cyclictest815371-21kworker/u16:0+events_unbound22:50:365
398137992018,2cyclictest793020-21kworker/u16:3+events_unbound23:02:495
398137992018,2cyclictest460421-21kworker/u16:1+flush-8:019:59:505
398137992018,2cyclictest388239-21kworker/u16:4+events_unbound19:49:225
398132992018,2cyclictest864680-21kworker/u16:1+events_unbound22:45:374
398132992018,2cyclictest1096075-21kworker/u16:3+flush-8:000:34:464
398139991917,2cyclictest681080-21kworker/u16:3+events_unbound21:29:416
398137991918,1cyclictest1035240-21kworker/u16:4+events_unbound00:00:325
398137991917,2cyclictest556352-21kworker/u16:3+flush-8:020:54:515
398132991917,2cyclictest538085-21kworker/u16:1+events_unbound20:25:374
398146991816,1cyclictest756141-21awk21:59:267
398139991816,2cyclictest815371-21kworker/u16:0+events_unbound23:24:546
398139991816,2cyclictest719772-21kworker/u16:4+events_unbound22:11:376
398139991816,2cyclictest708045-21kworker/u16:2+events_unbound22:08:046
398139991816,2cyclictest681080-21kworker/u16:3+flush-8:021:29:226
398139991816,2cyclictest517176-21kworker/u16:3+flush-8:020:09:416
398139991816,2cyclictest388239-21kworker/u16:4+flush-8:019:39:426
398139991814,3cyclictest421628-21kworker/u16:0+flush-8:019:29:446
398139991814,3cyclictest421628-21kworker/u16:0+flush-8:019:29:446
398137991816,2cyclictest489388-21kworker/u16:2+events_unbound20:05:375
398137991815,2cyclictest421628-21kworker/u16:0+events_unbound19:29:305
398137991815,2cyclictest421628-21kworker/u16:0+events_unbound19:29:305
398132991816,2cyclictest901792-21kworker/u16:1+events_unbound23:12:494
398132991816,2cyclictest815371-21kworker/u16:0+events_unbound23:29:554
398132991816,2cyclictest624864-21kworker/u16:0+events_unbound22:06:284
398132991815,2cyclictest421628-21kworker/u16:0+events_unbound19:29:464
398132991815,2cyclictest421628-21kworker/u16:0+events_unbound19:29:464
398146991716,0cyclictest0-21swapper/719:14:417
398146991712,4cyclictest645-21systemd-journal21:09:267
39814699170,1cyclictest0-21swapper/722:49:497
398137991716,1cyclictest815371-21kworker/u16:0+events_unbound23:22:415
398137991715,2cyclictest350730-21kworker/u16:2+events_unbound19:36:385
398137991714,2cyclictest489388-21kworker/u16:2+events_unbound20:29:365
39813299170,1cyclictest0-21swapper/419:20:484
39814699160,14cyclictest508603-21latency_hist20:04:267
39814699160,14cyclictest0-21swapper/720:19:517
39814699160,14cyclictest0-21swapper/720:19:517
39814699160,14cyclictest0-21swapper/719:19:487
398139991614,2cyclictest815371-21kworker/u16:0+events_unbound22:24:486
398139991614,2cyclictest815371-21kworker/u16:0+events_unbound22:24:486
398139991613,3cyclictest793020-21kworker/u16:3+flush-8:022:54:506
398137991613,2cyclictest624864-21kworker/u16:0+flush-8:021:04:365
398132991614,2cyclictest793020-21kworker/u16:3+flush-8:022:40:124
398132991614,2cyclictest538085-21kworker/u16:1+events_unbound20:55:374
398132991614,2cyclictest421628-21kworker/u16:0+events_unbound19:49:524
398132991613,2cyclictest1021938-21kworker/u16:1+events_unbound00:11:564
39813299160,1cyclictest0-21swapper/419:27:584
39813299160,1cyclictest0-21swapper/419:12:374
39814699157,7cyclictest6337-21gmain19:44:487
39814699150,2cyclictest971443-21ssh23:24:517
39814699150,13cyclictest1274-21snmpd21:34:017
39814699150,13cyclictest0-21swapper/700:09:497
398137991513,2cyclictest815371-21kworker/u16:0+events_unbound00:13:335
398137991513,2cyclictest538085-21kworker/u16:1+flush-8:020:59:425
398137991513,2cyclictest388239-21kworker/u16:4+events_unbound19:39:405
398132991513,2cyclictest489388-21kworker/u16:2+flush-8:020:29:484
398146991412,1cyclictest0-21swapper/723:29:497
398146991412,1cyclictest0-21swapper/720:29:517
39814699140,13cyclictest0-21swapper/720:14:507
39814699140,12cyclictest1045057-21ssh23:55:137
398139991413,1cyclictest0-21swapper/623:31:546
398139991413,1cyclictest0-21swapper/623:19:176
398139991412,2cyclictest986592-21kworker/u16:3+events_unbound23:34:566
398139991412,2cyclictest815371-21kworker/u16:0+flush-8:000:04:316
398139991412,2cyclictest460421-21kworker/u16:1+events_unbound19:44:416
398139991412,2cyclictest350730-21kworker/u16:2+events_unbound19:39:226
398139991411,3cyclictest624864-21kworker/u16:0+events_unbound21:49:496
39813999140,2cyclictest0-21swapper/600:36:046
39813999140,14cyclictest0-21swapper/623:20:526
39813299140,1cyclictest0-21swapper/420:59:474
39814699139,3cyclictest1274-21snmpd20:41:157
39814699139,3cyclictest1274-21snmpd20:37:427
398146991310,2cyclictest950285-21munin-run23:19:267
398146991310,2cyclictest1274-21snmpd22:13:537
398146991310,2cyclictest1234-21tuned-ppd19:09:417
398146991310,2cyclictest0-21swapper/723:09:537
39814699130,3cyclictest518305-21latency_hist20:09:267
39814699130,11cyclictest695992-21ssh21:34:387
39813999139,4cyclictest0-21swapper/623:11:246
39813999139,3cyclictest558304-21cat20:29:416
398139991312,1cyclictest0-21swapper/623:04:386
398139991312,1cyclictest0-21swapper/622:44:556
398139991311,2cyclictest815371-21kworker/u16:0+events_unbound00:00:086
398139991310,2cyclictest624864-21kworker/u16:0+events_unbound21:14:426
39813999130,2cyclictest0-21swapper/620:46:216
39813999130,13cyclictest0-21swapper/620:19:526
39813999130,13cyclictest0-21swapper/620:19:526
398137991311,2cyclictest388239-21kworker/u16:4+events_unbound19:51:375
398132991311,2cyclictest489388-21kworker/u16:2+flush-8:020:44:574
398132991310,2cyclictest388239-21kworker/u16:4+flush-8:019:34:374
39814699129,2cyclictest1274-21snmpd19:55:477
39814699129,2cyclictest1274-21snmpd00:01:537
39814699128,3cyclictest1274-21snmpd23:04:407
39814699128,3cyclictest1274-21snmpd21:45:447
39814699126,5cyclictest6050-21gmain23:44:447
39814699125,6cyclictest6241-21gvfs-afc-volume22:44:497
398146991212,0cyclictest0-21swapper/722:38:577
39814699120,2cyclictest1142581-21ssh00:35:387
39814699120,2cyclictest1070079-21ssh00:06:277
39814699120,1cyclictest0-21swapper/721:49:417
39814699120,1cyclictest0-21swapper/720:54:517
39814699120,10cyclictest890138-21ssh22:54:367
39813999121,11cyclictest86-21ksoftirqd/622:18:126
398139991211,1cyclictest0-21swapper/623:55:246
39813999120,1cyclictest0-21swapper/621:49:256
39813999120,1cyclictest0-21swapper/619:15:426
398137991210,2cyclictest556352-21kworker/u16:3+flush-8:020:39:495
398137991210,2cyclictest388239-21kworker/u16:4+events_unbound19:11:375
398132991210,2cyclictest421628-21kworker/u16:0+flush-8:020:34:474
39814699118,2cyclictest1274-21snmpd19:39:357
39814699117,3cyclictest1274-21snmpd23:02:017
39814699117,3cyclictest1274-21snmpd19:35:237
39814699117,3cyclictest1274-21snmpd19:29:477
39814699117,3cyclictest1274-21snmpd19:29:477
39814699117,3cyclictest1274-21snmpd19:26:357
39814699116,5cyclictest6241-21gvfs-afc-volume21:14:037
39814699116,4cyclictest718872-21sh21:42:487
39814699110,9cyclictest0-21swapper/700:19:507
39814699110,2cyclictest815369-21sh22:21:397
39814699110,1cyclictest960444-21ssh23:20:517
39814699110,1cyclictest861898-21ssh22:39:497
39814699110,1cyclictest1118568-21sh00:26:217
39814699110,1cyclictest0-21swapper/721:19:497
39814699110,10cyclictest837925-21memory22:29:507
39814699110,10cyclictest1034494-21ssh23:53:147
39813999119,2cyclictest538085-21kworker/u16:1+flush-8:021:09:426
39813999118,3cyclictest388239-21kworker/u16:4+flush-8:019:09:506
39813999112,8cyclictest500477-21kernelversion19:59:436
39813799117,3cyclictest489388-21kworker/u16:2+events_unbound20:19:515
39813799117,3cyclictest489388-21kworker/u16:2+events_unbound20:19:515
39813799110,11cyclictest0-21swapper/519:21:145
39813299117,3cyclictest538923-21cat20:19:414
39813299117,3cyclictest538923-21cat20:19:414
398132991110,1cyclictest0-21swapper/420:51:254
398132991110,1cyclictest0-21swapper/419:45:314
39814699106,3cyclictest1274-21snmpd20:09:307
39814699104,4cyclictest480741-21sed19:49:417
39814699100,1cyclictest778230-21ssh22:05:217
39813999100,3cyclictest606218-21cpuspeed_turbos20:54:396
39813999100,3cyclictest1091207-21cut00:14:476
39813299109,1cyclictest0-21swapper/421:08:084
39813299109,1cyclictest0-21swapper/420:03:484
3981469990,8cyclictest1274-21snmpd20:50:037
3981399993,5cyclictest0-21swapper/622:19:446
3981399990,8cyclictest999910-21perl23:39:406
3981399990,8cyclictest604604-21cat20:49:476
3981399990,2cyclictest547990-21tr20:24:376
3981329998,1cyclictest0-21swapper/420:07:074
3981399986,2cyclictest489388-21kworker/u16:2+flush-8:020:39:526
3981399980,2cyclictest489557-21/usr/sbin/munin19:54:386
3981379986,1cyclictest0-21swapper/519:24:475
3981329984,3cyclictest536990-21/usr/sbin/munin20:14:544
3981329983,4cyclictest521450-21grep20:09:454
3981379975,2cyclictest489388-21kworker/u16:2+flush-8:020:49:275
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional