You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-09 - 11:10
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot2.osadl.org (updated Tue Dec 09, 2025 00:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
77854826755,8sleep40-21swapper/403:20:024
779070995452,2cyclictest1281715-21kworker/u16:4+events_unbound08:12:536
77846724838,7sleep50-21swapper/503:18:595
77844824735,8sleep60-21swapper/603:18:446
779075994641,4cyclictest789019-21latency_hist03:27:267
779068994543,2cyclictest793335-21kworker/u16:4+flush-8:003:29:355
779070994442,2cyclictest994855-21kworker/u16:1+flush-8:006:37:546
779070994441,2cyclictest883537-21kworker/u16:0+flush-8:004:22:256
779068994442,2cyclictest1216893-21kworker/u16:3+flush-8:007:09:505
77861924310,29sleep70-21swapper/703:21:027
779070994240,2cyclictest769079-21kworker/u16:0+events_unbound03:32:546
779068994139,2cyclictest994855-21kworker/u16:1+events_unbound05:08:555
779068994139,2cyclictest1351454-21kworker/u16:1+events_unbound08:21:365
779068994139,2cyclictest1266718-21kworker/u16:0+events_unbound07:34:545
779070994038,2cyclictest994855-21kworker/u16:1+events_unbound05:48:596
779070994037,2cyclictest1116068-21kworker/u16:0+flush-8:006:42:556
779068994038,2cyclictest1125872-21kworker/u16:3+events_unbound06:40:545
779075993937,1cyclictest1215552-21ntpq06:52:507
779070993937,2cyclictest994855-21kworker/u16:1+events_unbound06:28:006
779068993937,2cyclictest1266718-21kworker/u16:0+events_unbound07:20:545
779070993836,2cyclictest803445-21kworker/u16:1+flush-8:003:49:446
779068993836,2cyclictest793335-21kworker/u16:4+flush-8:003:38:445
779060993834,3cyclictest823020-21kworker/u16:3+flush-8:004:22:434
779075993732,4cyclictest853459-21latency_hist03:57:257
77907599370,35cyclictest1408086-21latency_hist08:32:257
779068993735,2cyclictest883537-21kworker/u16:0+events_unbound04:13:365
779060993735,2cyclictest1186057-21kworker/u16:4+flush-8:006:47:544
779068993634,2cyclictest883537-21kworker/u16:0+events_unbound04:28:515
779068993634,2cyclictest1351454-21kworker/u16:1+events_unbound08:05:545
77907599350,34cyclictest924084-21latency_hist04:32:267
779068993533,2cyclictest1307371-21kworker/u16:3+events_unbound08:01:485
779068993533,2cyclictest1044839-21kworker/u16:2+events_unbound06:15:535
779068993532,2cyclictest1054974-21kworker/u16:0+events_unbound05:37:195
779070993432,2cyclictest693034-21kworker/u16:2+flush-8:003:47:216
779068993432,2cyclictest994855-21kworker/u16:1+flush-8:006:08:555
779068993432,2cyclictest893859-21kworker/u16:4+flush-8:004:57:515
779068993432,2cyclictest883537-21kworker/u16:0+events_unbound04:10:355
779068993432,2cyclictest1044839-21kworker/u16:2+events_unbound05:56:365
779060993432,2cyclictest1281715-21kworker/u16:4+flush-8:008:22:534
779060993430,3cyclictest1116068-21kworker/u16:0+flush-8:006:37:434
779068993331,2cyclictest994855-21kworker/u16:1+flush-8:006:54:355
779068993331,2cyclictest863951-21kworker/u16:1+events_unbound04:04:355
779068993331,2cyclictest1281715-21kworker/u16:4+flush-8:008:24:355
779068993331,2cyclictest1266718-21kworker/u16:0+flush-8:007:30:075
779068993330,2cyclictest1368101-21kworker/u16:0+flush-8:008:32:345
779068993230,2cyclictest994855-21kworker/u16:1+flush-8:006:00:545
779068993230,2cyclictest953380-21kworker/u16:2+flush-8:004:46:075
779068993230,2cyclictest863226-21kworker/u16:5+events_unbound03:58:005
779068993230,2cyclictest823020-21kworker/u16:3+flush-8:004:35:355
779068993230,2cyclictest1307371-21kworker/u16:3+events_unbound07:50:535
779068993230,2cyclictest1266718-21kworker/u16:0+flush-8:007:53:245
779068993230,2cyclictest1024729-21kworker/u16:3+events_unbound05:20:545
779075993130,0cyclictest0-21swapper/706:37:547
779070993129,2cyclictest769079-21kworker/u16:0+events_unbound03:28:456
779070993129,2cyclictest1200344-21kworker/u16:2+flush-8:007:17:216
779068993129,2cyclictest994855-21kworker/u16:1+events_unbound06:49:555
779068993129,2cyclictest913778-21kworker/u16:1+events_unbound04:53:285
779068993129,2cyclictest769079-21kworker/u16:0+flush-8:003:25:355
779068993129,2cyclictest1125872-21kworker/u16:3+events_unbound06:45:555
779068993129,2cyclictest1064997-21kworker/u16:4+events_unbound05:39:285
779060993128,2cyclictest1266718-21kworker/u16:0+flush-8:007:22:554
779075993025,4cyclictest1055171-21latency_hist05:37:257
779070993028,2cyclictest883537-21kworker/u16:0+flush-8:004:39:406
779068993028,2cyclictest994855-21kworker/u16:1+flush-8:006:28:565
779068993028,2cyclictest893859-21kworker/u16:4+flush-8:004:41:535
779068993028,2cyclictest1307371-21kworker/u16:3+events_unbound08:08:565
779068993028,2cyclictest1200344-21kworker/u16:2+events_unbound07:06:005
779075992928,0cyclictest0-21swapper/707:56:437
779075992924,4cyclictest863558-21latency_hist04:02:257
779070992927,2cyclictest883537-21kworker/u16:0+events_unbound04:29:406
779068992927,2cyclictest893859-21kworker/u16:4+events_unbound05:16:545
779068992927,2cyclictest883537-21kworker/u16:0+events_unbound05:25:535
779068992927,2cyclictest1216893-21kworker/u16:3+events_unbound07:25:515
779068992927,2cyclictest1186057-21kworker/u16:4+flush-8:007:14:275
779068992927,2cyclictest1044839-21kworker/u16:2+events_unbound05:45:555
779068992926,2cyclictest793335-21kworker/u16:4+flush-8:003:42:365
77907599280,26cyclictest1236686-21latency_hist07:07:257
779068992826,2cyclictest769079-21kworker/u16:0+events_unbound03:37:175
779068992826,2cyclictest1407864-21kworker/u16:5+flush-8:008:44:585
779068992826,2cyclictest1116068-21kworker/u16:0+events_unbound06:21:355
779075992726,0cyclictest0-21swapper/708:50:187
779075992726,0cyclictest0-21swapper/704:40:037
779075992726,0cyclictest0-21swapper/703:48:007
779070992725,2cyclictest1064997-21kworker/u16:4+flush-8:005:57:216
779068992725,2cyclictest994855-21kworker/u16:1+flush-8:006:04:185
779068992725,2cyclictest893859-21kworker/u16:4+flush-8:004:52:075
779068992725,2cyclictest1307024-21kworker/u16:1+events_unbound07:41:075
779075992625,0cyclictest0-21swapper/706:58:397
779075992625,0cyclictest0-21swapper/705:25:377
779075992621,4cyclictest1145957-21latency_hist06:22:257
77907599260,24cyclictest1347538-21latency_hist08:02:257
779070992623,2cyclictest883537-21kworker/u16:0+flush-8:005:27:276
779068992624,2cyclictest1116068-21kworker/u16:0+events_unbound06:26:285
779060992623,2cyclictest769079-21kworker/u16:0+flush-8:003:27:284
779075992524,0cyclictest0-21swapper/706:51:037
779075992524,0cyclictest0-21swapper/704:34:477
779075992523,1cyclictest1418509-21cat08:37:257
779070992523,2cyclictest883537-21kworker/u16:0+flush-8:004:57:556
779070992523,2cyclictest883537-21kworker/u16:0+events_unbound04:22:286
779070992523,2cyclictest769079-21kworker/u16:0+events_unbound03:25:446
779070992523,2cyclictest1307371-21kworker/u16:3+flush-8:008:21:256
779070992523,2cyclictest1116068-21kworker/u16:0+events_unbound06:09:286
779068992523,2cyclictest823020-21kworker/u16:3+flush-8:004:19:435
779068992523,2cyclictest1351454-21kworker/u16:1+events_unbound08:12:475
779068992523,2cyclictest1044839-21kworker/u16:2+events_unbound05:51:195
779068992523,2cyclictest1024729-21kworker/u16:3+flush-8:005:30:565
779075992423,0cyclictest0-21swapper/705:37:547
779075992423,0cyclictest0-21swapper/705:10:547
779075992423,0cyclictest0-21swapper/703:40:437
779070992422,2cyclictest1281715-21kworker/u16:4+flush-8:008:03:006
779068992422,2cyclictest984279-21kworker/u16:3+events_unbound05:05:435
779068992422,2cyclictest1368101-21kworker/u16:0+events_unbound08:39:395
779068992422,2cyclictest1266718-21kworker/u16:0+flush-8:007:47:235
779060992422,2cyclictest893859-21kworker/u16:4+flush-8:005:17:534
779060992422,2cyclictest1351454-21kworker/u16:1+flush-8:008:12:414
779075992322,0cyclictest0-21swapper/705:49:207
779075992322,0cyclictest0-21swapper/704:54:397
779075992322,0cyclictest0-21swapper/704:26:267
779075992318,4cyclictest1246729-21latency_hist07:12:257
779070992321,2cyclictest883537-21kworker/u16:0+events_unbound04:57:256
779070992321,2cyclictest1296955-21kworker/u16:2+events_unbound07:37:486
779070992321,2cyclictest1044839-21kworker/u16:2+events_unbound06:34:446
779070992320,3cyclictest1337204-21kworker/u16:2+flush-8:007:58:006
779068992321,2cyclictest793335-21kworker/u16:4+flush-8:003:54:365
779068992321,2cyclictest1428070-21kworker/u16:3+events_unbound08:49:195
779068992321,2cyclictest1125872-21kworker/u16:3+flush-8:006:34:005
779075992217,4cyclictest1367705-21latency_hist08:12:257
779070992220,2cyclictest953380-21kworker/u16:2+flush-8:004:43:156
779070992220,2cyclictest1307024-21kworker/u16:1+flush-8:007:42:406
779070992220,2cyclictest1186057-21kworker/u16:4+events_unbound06:57:446
779070992220,2cyclictest1054974-21kworker/u16:0+events_unbound05:37:276
779070992219,2cyclictest994855-21kworker/u16:1+flush-8:006:56:246
779068992220,2cyclictest1351454-21kworker/u16:1+flush-8:008:30:115
779060992220,2cyclictest1407864-21kworker/u16:5+flush-8:008:37:544
779075992120,0cyclictest0-21swapper/708:26:147
779075992120,0cyclictest0-21swapper/708:06:597
779075992120,0cyclictest0-21swapper/704:07:457
779075992119,1cyclictest96-21ksoftirqd/708:14:187
779075992119,1cyclictest0-21swapper/707:47:507
779070992119,2cyclictest1428070-21kworker/u16:3+events_unbound08:47:446
779070992119,2cyclictest1337204-21kworker/u16:2+events_unbound08:10:556
779070992119,2cyclictest1216893-21kworker/u16:3+events_unbound07:19:516
779068992119,2cyclictest1216175-21kworker/u16:0+events_unbound07:01:075
779060992119,2cyclictest1116068-21kworker/u16:0+events_unbound06:07:404
779075992019,0cyclictest0-21swapper/706:27:267
779075992019,0cyclictest0-21swapper/705:52:287
779075992019,0cyclictest0-21swapper/704:49:597
779070992018,2cyclictest1368101-21kworker/u16:0+flush-8:008:35:536
779070992018,2cyclictest1200344-21kworker/u16:2+flush-8:007:07:236
779060992017,2cyclictest1307371-21kworker/u16:3+events_unbound08:02:434
779075991918,1cyclictest0-21swapper/708:38:297
779075991918,0cyclictest0-21swapper/706:26:357
779075991917,1cyclictest793347-21/usr/sbin/munin03:27:577
779075991916,2cyclictest984007-21timerwakeupswit04:57:567
779075991916,2cyclictest1195352-21/usr/sbin/munin06:42:507
779060991917,2cyclictest984279-21kworker/u16:3+flush-8:005:02:524
779075991817,0cyclictest0-21swapper/704:16:267
779075991815,2cyclictest4175659-21snmpd08:19:297
77907599180,16cyclictest0-21swapper/706:32:507
779070991816,2cyclictest994855-21kworker/u16:1+flush-8:006:12:506
779070991816,2cyclictest883537-21kworker/u16:0+flush-8:004:13:436
779070991816,2cyclictest1064997-21kworker/u16:4+events_unbound06:02:536
779075991716,0cyclictest0-21swapper/707:47:057
779075991716,0cyclictest0-21swapper/707:13:327
779075991716,0cyclictest0-21swapper/706:15:257
779075991716,0cyclictest0-21swapper/705:46:057
779075991716,0cyclictest0-21swapper/705:18:347
779075991715,1cyclictest0-21swapper/707:24:457
779075991715,1cyclictest0-21swapper/704:18:227
779070991715,2cyclictest994855-21kworker/u16:1+events_unbound05:26:546
779070991715,2cyclictest793335-21kworker/u16:4+events_unbound03:57:436
779070991715,2cyclictest793335-21kworker/u16:4+events_unbound03:57:086
779070991715,2cyclictest1368101-21kworker/u16:0+events_unbound08:25:116
779068991715,2cyclictest693034-21kworker/u16:2+events_unbound03:48:325
779060991715,2cyclictest1044839-21kworker/u16:2+events_unbound06:02:514
779060991714,2cyclictest823020-21kworker/u16:3+flush-8:004:37:454
779075991616,0cyclictest0-21swapper/707:29:457
779075991615,0cyclictest0-21swapper/707:18:457
779075991615,0cyclictest0-21swapper/706:10:427
779075991614,1cyclictest0-21swapper/704:42:467
779070991614,2cyclictest883537-21kworker/u16:0+events_unbound04:47:526
779070991614,2cyclictest1428070-21kworker/u16:3+events_unbound08:42:436
779068991614,2cyclictest883537-21kworker/u16:0+events_unbound04:26:195
77906099160,15cyclictest805009-21kthreadcore03:32:434
77907599159,5cyclictest1045119-21latency_hist05:32:257
779075991514,0cyclictest0-21swapper/706:07:047
779075991514,0cyclictest0-21swapper/703:35:197
77907599150,13cyclictest0-21swapper/703:42:517
779070991513,2cyclictest893859-21kworker/u16:4+flush-8:005:03:546
779070991513,2cyclictest863951-21kworker/u16:1+flush-8:004:04:496
779070991513,2cyclictest793335-21kworker/u16:4+events_unbound03:37:566
779070991513,2cyclictest1281715-21kworker/u16:4+events_unbound07:47:446
779070991513,2cyclictest1116068-21kworker/u16:0+flush-8:006:22:506
779070991512,2cyclictest1064997-21kworker/u16:4+flush-8:005:57:396
779060991513,2cyclictest823020-21kworker/u16:3+flush-8:003:57:414
77906099150,14cyclictest0-21swapper/407:42:254
77907599147,6cyclictest27082-21ssh-agent04:02:547
779075991413,0cyclictest0-21swapper/705:59:477
779075991413,0cyclictest0-21swapper/705:13:077
779070991412,2cyclictest984279-21kworker/u16:3+events_unbound05:12:456
779070991412,2cyclictest1276820-21kworker/u16:1+flush-8:007:32:216
779070991412,2cyclictest1200344-21kworker/u16:2+flush-8:007:22:496
779060991412,2cyclictest1216893-21kworker/u16:3+events_unbound07:27:424
779060991410,3cyclictest793335-21kworker/u16:4+flush-8:003:52:524
77906099140,1cyclictest0-21swapper/408:27:534
779075991313,0cyclictest0-21swapper/707:35:067
77907099139,3cyclictest1296003-21missed_timers07:32:486
779070991311,2cyclictest823020-21kworker/u16:3+flush-8:004:07:516
77906099139,3cyclictest994855-21kworker/u16:1+flush-8:005:47:574
77906099139,3cyclictest883537-21kworker/u16:0+flush-8:005:28:294
77906099130,13cyclictest0-21swapper/405:32:504
77907599129,2cyclictest4175659-21snmpd05:03:157
77907599120,1cyclictest0-21swapper/708:45:287
779070991211,1cyclictest0-21swapper/604:32:556
779070991210,2cyclictest994855-21kworker/u16:1+flush-8:005:07:506
779070991210,2cyclictest1368101-21kworker/u16:0+events_unbound08:38:546
779070991210,2cyclictest1368101-21kworker/u16:0+events_unbound08:28:356
779070991210,2cyclictest1307371-21kworker/u16:3+events_unbound07:52:536
779070991210,2cyclictest1186057-21kworker/u16:4+flush-8:007:07:556
779070991210,2cyclictest1064997-21kworker/u16:4+flush-8:005:42:526
77906099129,2cyclictest1116068-21kworker/u16:0+flush-8:006:22:564
779060991211,1cyclictest0-21swapper/403:39:484
77906099120,1cyclictest0-21swapper/406:57:494
77906099120,1cyclictest0-21swapper/405:38:124
77906099120,1cyclictest0-21swapper/404:33:534
77906099120,1cyclictest0-21swapper/403:45:574
77906099120,12cyclictest0-21swapper/404:48:514
77907599110,5cyclictest550053-21sshd07:39:527
77907099119,2cyclictest893859-21kworker/u16:4+events_unbound05:17:506
779070991110,1cyclictest0-21swapper/606:48:026
779070991110,1cyclictest0-21swapper/605:35:216
779060991110,1cyclictest883537-21kworker/u16:0+events_unbound04:57:444
779060991110,1cyclictest0-21swapper/408:34:554
779060991110,1cyclictest0-21swapper/407:05:514
779060991110,1cyclictest0-21swapper/406:18:334
779060991110,1cyclictest0-21swapper/405:44:304
779060991110,1cyclictest0-21swapper/405:26:414
779060991110,1cyclictest0-21swapper/404:07:434
77906099110,11cyclictest0-21swapper/408:49:354
77906099110,11cyclictest0-21swapper/406:37:194
77906099110,11cyclictest0-21swapper/406:29:174
77906099110,11cyclictest0-21swapper/404:43:304
77906099110,11cyclictest0-21swapper/404:28:414
77906099110,11cyclictest0-21swapper/403:23:154
77906099110,0cyclictest0-21swapper/404:55:574
77906099109,1cyclictest0-21swapper/408:07:294
77906099109,1cyclictest0-21swapper/407:48:344
77906099109,1cyclictest0-21swapper/406:46:184
77906099109,1cyclictest0-21swapper/406:01:324
77906099109,1cyclictest0-21swapper/405:13:364
77906099109,1cyclictest0-21swapper/405:07:284
77906099109,1cyclictest0-21swapper/403:48:384
77906099100,10cyclictest0-21swapper/407:11:034
7790709998,1cyclictest0-21swapper/606:19:206
7790609998,1cyclictest0-21swapper/408:19:284
7790609998,1cyclictest0-21swapper/406:57:014
7790609996,2cyclictest1328476-21hddtemp_smartct07:52:404
7790609987,1cyclictest0-21swapper/408:01:304
7790609987,1cyclictest0-21swapper/406:13:124
7790609987,1cyclictest0-21swapper/405:56:104
7790609987,1cyclictest0-21swapper/404:13:524
7790609987,1cyclictest0-21swapper/404:02:314
7790609986,1cyclictest0-21swapper/407:37:434
7790609986,1cyclictest0-21swapper/407:12:384
7790609983,4cyclictest899988-21cut04:17:474
7790609983,4cyclictest1287910-21expr07:32:384
7790609983,4cyclictest1258023-21irqcore07:17:434
7790609980,7cyclictest0-21swapper/408:42:424
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional