You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-11 - 05:24
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Thu Dec 11, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3134249997064,5cyclictest3632171-21latency_hist07:27:177
3134249996358,4cyclictest3501056-21latency_hist06:22:177
313380426150,7sleep40-21swapper/403:20:464
3134249995449,4cyclictest3682551-21latency_hist07:52:177
313365325419,30sleep70-21swapper/703:18:417
3134249995047,2cyclictest3792427-21ntpq08:42:427
3134236994845,2cyclictest3134463-21kworker/u16:3+events_unbound03:42:444
3134243994644,1cyclictest3134463-21kworker/u16:3+events_unbound04:07:335
3134236994643,2cyclictest3623314-21kworker/u16:0+events_unbound08:37:324
313373624636,7sleep50-21swapper/503:19:515
313384424535,7sleep60-21swapper/603:21:206
3134249994439,4cyclictest3410304-21latency_hist05:37:177
3134236994341,2cyclictest3309248-21kworker/u16:1+flush-8:005:07:464
3134236994340,3cyclictest3208487-21kworker/u16:1+flush-8:004:12:494
36643802420,1sleep73664378-21cut07:42:347
3134245994239,2cyclictest3732378-21kworker/u16:5+flush-8:008:37:176
3134236994239,2cyclictest3561740-21kworker/u16:1+flush-8:007:12:434
3134249994039,0cyclictest0-21swapper/704:22:337
3134249994039,0cyclictest0-21swapper/704:20:407
3134236994037,2cyclictest3460463-21kworker/u16:4+flush-8:006:42:334
3134236993937,2cyclictest3623314-21kworker/u16:0+flush-8:007:42:414
3134236993937,2cyclictest3623314-21kworker/u16:0+events_unbound07:52:454
3134236993937,2cyclictest3349474-21kworker/u16:0+flush-8:005:27:494
3134249993833,3cyclictest3389109-21ntpq05:22:437
3134249993833,3cyclictest3389109-21ntpq05:22:437
3134249993832,5cyclictest589235-21systemd-journal05:02:187
3134249993832,5cyclictest3601955-21latency_hist07:12:177
3134249993735,1cyclictest0-21swapper/704:02:447
3134236993735,2cyclictest3732378-21kworker/u16:5+events_unbound08:36:144
3134236993735,2cyclictest3379773-21kworker/u16:1+events_unbound05:35:424
3134249993633,2cyclictest3379051-21ntp_offset05:17:437
3134249993633,2cyclictest3379051-21ntp_offset05:17:437
3134249993630,5cyclictest3309441-21latency_hist04:47:187
3134236993533,2cyclictest3440278-21kworker/u16:3+flush-8:006:02:344
3134236993533,2cyclictest3349474-21kworker/u16:0+events_unbound05:45:454
3134236993533,2cyclictest3208716-21kworker/u16:2+flush-8:004:02:454
3134236993533,2cyclictest3134463-21kworker/u16:3+flush-8:004:00:524
3134236993533,2cyclictest3134463-21kworker/u16:3+events_unbound03:51:284
3134249993433,0cyclictest0-21swapper/705:14:437
3134249993429,4cyclictest3531310-21latency_hist06:37:187
3134236993432,2cyclictest3481284-21kworker/u16:1+events_unbound06:35:514
3134236993432,2cyclictest3349474-21kworker/u16:0+events_unbound06:08:284
3134236993432,2cyclictest3349474-21kworker/u16:0+events_unbound06:08:284
3134249993332,0cyclictest0-21swapper/703:53:257
3134249993332,0cyclictest0-21swapper/703:53:257
3134249993328,4cyclictest3480892-21latency_hist06:12:177
3134249993328,4cyclictest3480892-21latency_hist06:12:177
3134236993331,2cyclictest3623314-21kworker/u16:0+events_unbound07:27:214
3134236993331,2cyclictest3541231-21kworker/u16:0+events_unbound06:49:444
3134236993331,2cyclictest3168170-21kworker/u16:1+events_unbound03:40:534
3134249993231,0cyclictest0-21swapper/704:14:087
3134249993231,0cyclictest0-21swapper/703:50:397
313424999320,30cyclictest3420405-21latency_hist05:42:187
3134236993230,2cyclictest3581803-21kworker/u16:5+flush-8:007:05:574
3134236993230,2cyclictest3208716-21kworker/u16:2+events_unbound04:28:284
3134249993130,0cyclictest0-21swapper/707:19:417
3134249993130,0cyclictest0-21swapper/704:48:367
3134249993129,1cyclictest3632568-21/usr/sbin/munin07:27:327
3134236993129,2cyclictest3623314-21kworker/u16:0+events_unbound08:28:214
3134236993129,2cyclictest3561740-21kworker/u16:1+flush-8:007:57:414
3134236993129,2cyclictest3500379-21kworker/u16:5+events_unbound06:22:364
3134236993129,2cyclictest3349474-21kworker/u16:0+flush-8:006:17:454
3134236993129,2cyclictest3134463-21kworker/u16:3+events_unbound04:18:574
3134236993128,2cyclictest3561740-21kworker/u16:1+flush-8:006:52:334
3134236993128,2cyclictest3561740-21kworker/u16:1+flush-8:006:52:334
3134236993128,2cyclictest3561740-21kworker/u16:1+events_unbound08:22:264
3134236993128,2cyclictest3561740-21kworker/u16:1+events_unbound08:22:264
3134236993128,2cyclictest3077662-21kworker/u16:4+events_unbound03:32:214
3134249993030,0cyclictest0-21swapper/708:14:177
3134243993027,2cyclictest3561740-21kworker/u16:1+flush-8:007:07:485
3134243993027,2cyclictest3561740-21kworker/u16:1+flush-8:007:02:175
3134236993028,2cyclictest3623314-21kworker/u16:0+events_unbound08:48:524
3134236993028,2cyclictest3349474-21kworker/u16:0+events_unbound05:54:004
3134236993028,2cyclictest3349474-21kworker/u16:0+events_unbound05:22:114
3134236993028,2cyclictest3349474-21kworker/u16:0+events_unbound05:22:114
3134236993027,2cyclictest3561740-21kworker/u16:1+flush-8:006:57:354
3134236993027,2cyclictest3349474-21kworker/u16:0+events_unbound06:12:264
33290922290,1chrt3329093-21timerwakeupswit04:52:477
3134249992928,0cyclictest0-21swapper/707:57:447
3134249992928,0cyclictest0-21swapper/706:04:427
3134249992928,0cyclictest0-21swapper/704:34:457
3134245992926,2cyclictest3329333-21kworker/u16:3+flush-8:004:57:456
3134236992927,2cyclictest3732378-21kworker/u16:5+events_unbound08:15:294
3134236992927,2cyclictest3631787-21kworker/u16:4+events_unbound07:26:164
3134236992927,2cyclictest3623314-21kworker/u16:0+flush-8:007:47:334
3134236992927,2cyclictest3561740-21kworker/u16:1+events_unbound07:38:274
3134236992927,2cyclictest3561740-21kworker/u16:1+events_unbound07:38:274
3134236992927,2cyclictest3500379-21kworker/u16:5+events_unbound06:31:534
3134236992927,2cyclictest3338705-21kworker/u16:4+flush-8:005:02:334
3134236992927,2cyclictest3269533-21kworker/u16:4+events_unbound04:43:214
3134236992926,2cyclictest3682363-21kworker/u16:2+flush-8:008:07:284
3134236992926,2cyclictest3600920-21kworker/u16:2+flush-8:007:17:334
3134249992827,0cyclictest0-21swapper/703:46:097
3134236992826,2cyclictest3623314-21kworker/u16:0+events_unbound07:35:494
3134236992826,2cyclictest3600920-21kworker/u16:2+events_unbound07:09:164
3134236992826,2cyclictest3561740-21kworker/u16:1+events_unbound08:18:474
3134236992826,2cyclictest3460463-21kworker/u16:4+flush-8:006:37:554
3134236992826,2cyclictest3360184-21kworker/u16:2+events_unbound05:15:364
3134236992826,2cyclictest3338705-21kworker/u16:4+flush-8:004:57:574
3134236992826,2cyclictest3309248-21kworker/u16:1+events_unbound04:54:334
3134236992826,2cyclictest3309248-21kworker/u16:1+events_unbound04:50:084
3134249992726,0cyclictest0-21swapper/706:23:097
3134249992721,5cyclictest3144259-21latency_hist03:27:187
3134243992724,2cyclictest3208716-21kworker/u16:2+flush-8:004:37:515
3134243992724,2cyclictest3208716-21kworker/u16:2+flush-8:004:37:515
3134236992725,2cyclictest3379773-21kworker/u16:1+events_unbound05:26:054
3134236992725,2cyclictest3379773-21kworker/u16:1+events_unbound05:26:054
3134236992725,2cyclictest3208487-21kworker/u16:1+events_unbound03:55:344
3134236992725,2cyclictest3208487-21kworker/u16:1+events_unbound03:55:344
3134236992725,2cyclictest3134463-21kworker/u16:3+flush-8:004:09:084
3134236992725,2cyclictest1592630-21kworker/u16:0+events_unbound04:39:444
3134236992725,2cyclictest1592630-21kworker/u16:0+events_unbound04:39:444
3134249992625,0cyclictest0-21swapper/704:37:277
3134249992625,0cyclictest0-21swapper/704:37:277
3134249992625,0cyclictest0-21swapper/703:29:247
313424999260,24cyclictest3399232-21ldconfig05:27:437
3134236992624,2cyclictest3349474-21kworker/u16:0+events_unbound05:39:094
3134236992624,2cyclictest1592630-21kworker/u16:0+events_unbound04:26:484
3134236992624,2cyclictest1592630-21kworker/u16:0+events_unbound03:23:124
3134249992524,0cyclictest0-21swapper/708:40:407
3134249992520,4cyclictest3561528-21latency_hist06:52:177
3134245992523,2cyclictest3561740-21kworker/u16:1+flush-8:007:50:176
3134243992522,2cyclictest3732378-21kworker/u16:5+flush-8:008:42:485
3134243992522,2cyclictest3561740-21kworker/u16:1+flush-8:008:02:175
3134236992523,2cyclictest3686431-21kworker/u16:3+events_unbound08:04:294
3134236992523,2cyclictest3269533-21kworker/u16:4+flush-8:004:32:414
3134249992423,0cyclictest0-21swapper/708:35:337
3134249992423,0cyclictest0-21swapper/706:39:327
3134249992419,4cyclictest3178447-21latency_hist03:42:177
3134236992422,2cyclictest3623314-21kworker/u16:0+events_unbound08:43:574
3134236992422,2cyclictest3379773-21kworker/u16:1+flush-8:005:47:394
3134249992322,0cyclictest0-21swapper/707:40:567
3134249992322,0cyclictest0-21swapper/707:40:567
313424999230,21cyclictest3753112-21latency_hist08:27:177
313424999230,21cyclictest3753112-21latency_hist08:27:177
313424999230,21cyclictest27304-21gsd-housekeepin05:51:227
36189932220,0chrt0-21swapper/507:17:405
3134249992221,0cyclictest0-21swapper/708:02:577
3134249992221,0cyclictest0-21swapper/706:01:497
3134245992220,2cyclictest3600920-21kworker/u16:2+flush-8:007:22:486
3134243992219,2cyclictest1592630-21kworker/u16:0+flush-8:003:47:175
3134249992120,0cyclictest0-21swapper/704:07:187
3134249992116,4cyclictest3168335-21latency_hist03:37:187
3134249992019,0cyclictest0-21swapper/707:04:227
3134249992017,2cyclictest4175659-21snmpd08:28:017
3134243992017,2cyclictest3460463-21kworker/u16:4+flush-8:006:46:485
3134243992016,3cyclictest3460463-21kworker/u16:4+flush-8:006:52:485
3134243992016,3cyclictest3460463-21kworker/u16:4+flush-8:006:52:485
3134236992018,2cyclictest1592630-21kworker/u16:0+events_unbound03:28:544
3134236991917,2cyclictest3349474-21kworker/u16:0+events_unbound05:58:304
3134249991818,0cyclictest0-21swapper/707:35:527
3134249991817,0cyclictest0-21swapper/707:00:427
3134249991817,0cyclictest0-21swapper/704:27:467
3134249991815,2cyclictest0-21swapper/705:42:437
3134249991716,0cyclictest0-21swapper/705:09:327
3134245991714,2cyclictest1592630-21kworker/u16:0+flush-8:003:35:116
3134243991714,2cyclictest3581803-21kworker/u16:5+flush-8:007:06:175
3134249991616,0cyclictest0-21swapper/708:08:197
3134249991514,0cyclictest0-21swapper/706:31:297
313424999150,13cyclictest4175659-21snmpd08:19:437
313424599150,14cyclictest0-21swapper/606:37:276
3134243991511,3cyclictest3460463-21kworker/u16:4+flush-8:006:07:495
3134243991511,3cyclictest3460463-21kworker/u16:4+flush-8:006:07:495
313424999149,4cyclictest3683726-21cat07:52:347
3134245991412,2cyclictest3793309-21kworker/u16:3+flush-8:008:47:476
3134243991412,2cyclictest3661412-21kworker/u16:4+flush-8:007:44:385
3134245991312,1cyclictest0-21swapper/607:15:266
3134245991311,2cyclictest3682363-21kworker/u16:2+events_unbound07:57:176
313424399130,0cyclictest0-21swapper/505:57:345
313424999128,3cyclictest3602349-21/usr/sbin/munin07:12:337
313424999128,3cyclictest3561923-21/usr/sbin/munin06:52:447
313424999128,3cyclictest3561923-21/usr/sbin/munin06:52:447
3134245991211,1cyclictest0-21swapper/605:59:186
313424599120,1cyclictest0-21swapper/606:04:306
313424599120,11cyclictest0-21swapper/608:02:536
313424599120,11cyclictest0-21swapper/607:32:186
313424599120,11cyclictest0-21swapper/605:21:566
313424599120,11cyclictest0-21swapper/605:21:566
313424599120,0cyclictest0-21swapper/608:31:166
3134243991211,1cyclictest0-21swapper/508:11:235
3134243991211,1cyclictest0-21swapper/505:09:285
3134243991210,2cyclictest3600920-21kworker/u16:2+flush-8:007:14:345
313424399120,1cyclictest0-21swapper/505:48:435
313424399120,1cyclictest0-21swapper/505:43:315
313424399120,1cyclictest0-21swapper/505:25:145
313424399120,1cyclictest0-21swapper/505:25:145
313424399120,1cyclictest0-21swapper/504:07:025
313424999117,3cyclictest4175659-21snmpd06:42:357
313424999117,3cyclictest3440907-21/usr/sbin/munin05:52:347
313424999117,3cyclictest3209074-21/usr/sbin/munin03:57:357
313424999116,4cyclictest3482068-21cat06:12:347
313424999110,10cyclictest3793808-21/usr/sbin/munin08:47:457
313424999110,10cyclictest3341019-21sed05:02:357
313424599119,2cyclictest3329333-21kworker/u16:3+flush-8:004:57:186
3134245991110,1cyclictest0-21swapper/608:23:336
3134245991110,1cyclictest0-21swapper/608:23:336
3134245991110,1cyclictest0-21swapper/607:43:496
3134245991110,1cyclictest0-21swapper/607:27:546
3134245991110,1cyclictest0-21swapper/606:16:386
3134245991110,1cyclictest0-21swapper/605:10:356
3134245991110,1cyclictest0-21swapper/604:01:236
3134245991110,1cyclictest0-21swapper/603:47:496
313424599110,1cyclictest0-21swapper/605:28:056
313424599110,11cyclictest0-21swapper/608:38:126
313424599110,11cyclictest0-21swapper/608:16:366
313424599110,11cyclictest0-21swapper/607:59:256
313424599110,11cyclictest0-21swapper/607:18:076
313424599110,11cyclictest0-21swapper/606:20:066
313424599110,11cyclictest0-21swapper/604:29:456
313424599110,11cyclictest0-21swapper/604:14:186
313424599110,0cyclictest0-21swapper/606:23:346
313424599110,0cyclictest0-21swapper/604:47:536
313424399119,2cyclictest3561740-21kworker/u16:1+flush-8:007:27:435
313424399119,2cyclictest3077662-21kworker/u16:4+events_unbound03:27:205
3134243991110,1cyclictest0-21swapper/506:38:135
3134243991110,1cyclictest0-21swapper/506:30:205
3134243991110,1cyclictest0-21swapper/506:21:405
3134243991110,1cyclictest0-21swapper/505:55:395
3134243991110,1cyclictest0-21swapper/505:15:375
3134243991110,1cyclictest0-21swapper/504:58:075
3134243991110,1cyclictest0-21swapper/504:32:535
3134243991110,1cyclictest0-21swapper/503:38:595
3134243991110,1cyclictest0-21swapper/503:32:595
313424399110,1cyclictest0-21swapper/506:51:285
313424399110,1cyclictest0-21swapper/506:25:085
313424399110,11cyclictest0-21swapper/508:03:405
313424399110,11cyclictest0-21swapper/507:40:105
313424399110,11cyclictest0-21swapper/507:40:105
313424399110,11cyclictest0-21swapper/506:06:045
313424399110,11cyclictest0-21swapper/505:38:195
313424399110,11cyclictest0-21swapper/504:21:425
313424399110,11cyclictest0-21swapper/504:13:585
313424399110,11cyclictest0-21swapper/503:48:175
313424399110,11cyclictest0-21swapper/503:23:325
313424399110,10cyclictest0-21swapper/505:28:055
313424399110,0cyclictest0-21swapper/503:55:515
313424399110,0cyclictest0-21swapper/503:55:515
313424599109,1cyclictest0-21swapper/604:17:466
313424599109,1cyclictest0-21swapper/603:55:236
313424599109,1cyclictest0-21swapper/603:55:236
313424599109,1cyclictest0-21swapper/603:38:316
313424599109,1cyclictest0-21swapper/603:22:386
313424599108,2cyclictest3338705-21kworker/u16:4+flush-8:005:07:186
313424599100,10cyclictest0-21swapper/605:47:096
313424599100,0cyclictest0-21swapper/605:41:576
313424399109,1cyclictest0-21swapper/508:32:595
313424399109,1cyclictest0-21swapper/508:29:315
313424399109,1cyclictest0-21swapper/507:56:445
31342459998,1cyclictest0-21swapper/608:10:376
31342459998,1cyclictest0-21swapper/607:39:246
31342459998,1cyclictest0-21swapper/607:39:246
31342459998,1cyclictest0-21swapper/604:46:096
31342459998,1cyclictest0-21swapper/604:33:136
31342459998,1cyclictest0-21swapper/604:08:196
31342459998,1cyclictest0-21swapper/604:04:516
31342459998,1cyclictest0-21swapper/603:30:486
31342439998,1cyclictest0-21swapper/508:14:515
31342439998,1cyclictest0-21swapper/503:57:355
3471367280,0sleep60-21swapper/606:07:306
3471367280,0sleep60-21swapper/606:07:306
31342459987,1cyclictest0-21swapper/606:42:486
31342459987,1cyclictest0-21swapper/606:28:476
31342439988,0cyclictest0-21swapper/505:33:075
31342439987,1cyclictest0-21swapper/508:18:195
31342439987,1cyclictest0-21swapper/507:35:465
31342439987,1cyclictest0-21swapper/504:43:185
31342459976,1cyclictest0-21swapper/603:42:476
31342459972,1cyclictest0-21swapper/607:02:046
31342439976,1cyclictest0-21swapper/508:51:075
31342439976,1cyclictest0-21swapper/506:35:325
31342439976,1cyclictest0-21swapper/504:25:105
31342439970,4cyclictest0-21swapper/505:02:355
31342459965,1cyclictest0-21swapper/608:43:246
31342459965,1cyclictest0-21swapper/604:38:256
31342459965,1cyclictest0-21swapper/604:38:256
31342459965,1cyclictest0-21swapper/604:25:306
31342459963,2cyclictest35713182sleep606:53:306
31342459963,2cyclictest35713182sleep606:53:306
31342459963,2cyclictest35274492sleep606:32:396
31342459963,2cyclictest34505292sleep605:56:176
31342459960,3cyclictest0-21swapper/605:32:396
31342459960,3cyclictest0-21swapper/605:12:376
31342459960,2cyclictest0-21swapper/608:18:486
31342439965,1cyclictest0-21swapper/507:24:155
31342439965,1cyclictest0-21swapper/504:31:095
31342439964,1cyclictest3753114-21turbostat08:27:165
31342439964,1cyclictest3753114-21turbostat08:27:165
31342439960,3cyclictest0-21swapper/507:47:385
31342439960,3cyclictest0-21swapper/505:20:595
31342439960,3cyclictest0-21swapper/505:20:595
31342439960,3cyclictest0-21swapper/504:47:405
31342459951,1cyclictest681rcuog/407:07:216
31342459950,4cyclictest3591515-21chrt07:03:076
31342459950,4cyclictest3551845-21chrt06:47:286
31342459950,4cyclictest3430838-21taskset05:47:196
31342459950,1cyclictest991rcuop/705:22:316
31342459950,1cyclictest991rcuop/705:22:316
31342439950,4cyclictest3773634-21chrt08:37:215
31342439950,4cyclictest3481282-21chrt06:12:265
31342439950,4cyclictest3324695-21chrt04:52:375
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional