You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-22 - 18:12
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Mon Dec 22, 2025 12:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
20360525241,8sleep40-21swapper/407:09:044
20358125218,30sleep70-21swapper/707:08:437
203920995044,5cyclictest721171-21latency_hist11:34:197
20352324433,8sleep50-21swapper/507:07:535
20348524434,7sleep60-21swapper/607:07:216
203908994341,2cyclictest401696-21kworker/u16:1+flush-8:009:04:204
203920993934,4cyclictest537007-21latency_hist09:59:197
203920993933,5cyclictest314131-21latency_hist08:04:207
203920993529,5cyclictest401312-21latency_hist08:49:207
203916993432,2cyclictest614571-21kworker/u16:3+flush-8:010:49:196
203908993329,3cyclictest459123-21kworker/u16:1+events_unbound10:09:424
203908993329,3cyclictest459123-21kworker/u16:1+events_unbound10:09:424
203920993226,5cyclictest650-21systemd-journal10:09:197
203916993230,2cyclictest779691-21kworker/u16:3+flush-8:012:19:186
203916993229,2cyclictest401696-21kworker/u16:1+events_unbound08:54:376
203915993230,2cyclictest429477-21kworker/u16:5+events_unbound11:29:345
203920993126,4cyclictest352840-21latency_hist08:24:197
203915993129,2cyclictest459123-21kworker/u16:1+events_unbound09:54:495
203915993028,2cyclictest411394-21kworker/u16:0+flush-8:009:14:145
203908993027,3cyclictest711236-21kworker/u16:2+flush-8:011:54:194
203916992927,2cyclictest740625-21kworker/u16:1+flush-8:011:44:416
203915992927,2cyclictest740625-21kworker/u16:1+flush-8:011:59:345
203915992826,2cyclictest429477-21kworker/u16:5+flush-8:010:24:145
203908992826,2cyclictest779691-21kworker/u16:3+flush-8:012:19:134
203908992826,2cyclictest411394-21kworker/u16:0+flush-8:009:09:434
203920992726,0cyclictest0-21swapper/707:18:117
203920992625,0cyclictest0-21swapper/711:04:397
203916992624,2cyclictest594680-21kworker/u16:1+flush-8:011:00:216
203915992622,3cyclictest769948-21kworker/u16:0+flush-8:012:14:375
203920992524,0cyclictest0-21swapper/712:38:417
203920992524,0cyclictest0-21swapper/710:03:467
203920992524,0cyclictest0-21swapper/707:12:037
203916992523,2cyclictest459123-21kworker/u16:1+events_unbound09:19:426
203915992522,2cyclictest324233-21kworker/u16:3+events_unbound08:14:345
203920992423,0cyclictest0-21swapper/711:36:387
203920992423,0cyclictest0-21swapper/710:56:467
203920992423,0cyclictest0-21swapper/709:13:037
203920992423,0cyclictest0-21swapper/708:11:477
203920992423,0cyclictest0-21swapper/707:35:467
203916992421,2cyclictest459123-21kworker/u16:1+flush-8:009:48:226
203908992421,2cyclictest721404-21kworker/u16:0+events_unbound11:34:454
203908992421,2cyclictest246356-21kworker/u16:2+events_unbound08:34:394
203908992421,2cyclictest246356-21kworker/u16:2+events_unbound08:34:394
203920992322,0cyclictest0-21swapper/709:48:437
203920992322,0cyclictest0-21swapper/709:33:467
203916992321,2cyclictest305551-21kworker/u16:1+events_unbound08:29:466
203916992320,2cyclictest390615-21kworker/u16:4+events_unbound08:49:386
203915992320,2cyclictest411394-21kworker/u16:0+flush-8:009:14:375
203920992222,0cyclictest0-21swapper/710:26:347
203920992221,0cyclictest0-21swapper/712:31:377
203920992221,0cyclictest0-21swapper/712:31:377
203920992221,0cyclictest0-21swapper/710:49:227
203920992221,0cyclictest0-21swapper/710:45:267
203920992221,0cyclictest0-21swapper/710:41:277
203920992221,0cyclictest0-21swapper/710:21:067
203920992221,0cyclictest0-21swapper/710:13:537
203920992221,0cyclictest0-21swapper/710:13:537
203920992221,0cyclictest0-21swapper/709:34:497
203920992221,0cyclictest0-21swapper/707:51:017
203915992220,2cyclictest779691-21kworker/u16:3+flush-8:012:19:445
203908992220,2cyclictest411394-21kworker/u16:0+flush-8:009:14:424
203908992219,2cyclictest429477-21kworker/u16:5+events_unbound11:09:364
203920992120,0cyclictest0-21swapper/710:37:067
203920992120,0cyclictest0-21swapper/709:25:107
203920992120,0cyclictest0-21swapper/709:05:347
203920992120,0cyclictest0-21swapper/708:41:477
203920992120,0cyclictest0-21swapper/708:28:347
203920992120,0cyclictest0-21swapper/707:55:347
203920992120,0cyclictest0-21swapper/707:48:507
20392099210,19cyclictest572307-21cut10:14:397
203908992119,2cyclictest769948-21kworker/u16:0+flush-8:012:24:464
203908992119,2cyclictest594680-21kworker/u16:1+flush-8:010:49:364
203920992020,0cyclictest0-21swapper/708:16:587
203920992019,0cyclictest0-21swapper/712:21:497
203920992019,0cyclictest0-21swapper/711:51:337
203920992019,0cyclictest0-21swapper/708:38:597
203920992019,0cyclictest0-21swapper/708:38:597
203920992019,0cyclictest0-21swapper/707:29:217
203915992018,2cyclictest275794-21kworker/u16:0+flush-8:008:04:345
203915992016,3cyclictest605879-21kworker/u16:2+flush-8:010:59:125
203920991919,0cyclictest0-21swapper/712:13:547
203920991919,0cyclictest0-21swapper/707:21:467
203920991918,0cyclictest0-21swapper/711:15:497
203920991918,0cyclictest0-21swapper/709:23:117
203920991918,0cyclictest0-21swapper/708:52:037
203920991918,0cyclictest0-21swapper/708:07:467
203920991918,0cyclictest0-21swapper/707:40:027
203920991918,0cyclictest0-21swapper/707:27:027
203916991917,2cyclictest305551-21kworker/u16:1+flush-8:007:59:456
203916991917,2cyclictest246356-21kworker/u16:2+flush-8:008:09:396
203916991916,2cyclictest711236-21kworker/u16:2+flush-8:011:54:296
203916991916,2cyclictest324233-21kworker/u16:3+flush-8:008:14:356
203915991917,2cyclictest343415-21kworker/u16:0+events_unbound08:24:325
203915991917,2cyclictest203651-21kworker/u16:1+flush-8:007:24:205
203915991915,3cyclictest184760-21kworker/u16:0+flush-8:007:09:355
203908991917,2cyclictest594680-21kworker/u16:1+flush-8:010:29:424
203920991817,0cyclictest0-21swapper/711:00:547
203920991817,0cyclictest0-21swapper/709:54:067
203916991816,2cyclictest779691-21kworker/u16:3+flush-8:012:39:146
203916991816,2cyclictest438834-21kworker/u16:3+flush-8:009:49:396
203916991816,2cyclictest429477-21kworker/u16:5+flush-8:009:29:396
203916991816,2cyclictest246356-21kworker/u16:2+events_unbound07:49:446
203915991816,2cyclictest594680-21kworker/u16:1+flush-8:011:09:195
203908991814,3cyclictest429477-21kworker/u16:5+flush-8:009:29:494
203920991717,0cyclictest0-21swapper/708:33:067
203920991716,0cyclictest0-21swapper/712:00:217
203920991716,0cyclictest0-21swapper/711:27:117
203920991716,0cyclictest0-21swapper/710:33:037
203920991716,0cyclictest0-21swapper/709:40:187
203916991715,2cyclictest429477-21kworker/u16:5+events_unbound10:19:446
203916991715,2cyclictest411394-21kworker/u16:0+flush-8:009:04:416
203916991715,2cyclictest411394-21kworker/u16:0+events_unbound08:59:446
203908991715,2cyclictest401696-21kworker/u16:1+events_unbound09:04:334
203908991714,3cyclictest401696-21kworker/u16:1+flush-8:008:54:354
203908991714,3cyclictest246356-21kworker/u16:2+flush-8:008:04:444
203920991615,0cyclictest0-21swapper/711:10:467
203920991612,3cyclictest1267-21snmpd08:55:427
203916991614,2cyclictest594680-21kworker/u16:1+events_unbound11:14:336
203916991614,2cyclictest459123-21kworker/u16:1+flush-8:009:28:306
203916991613,2cyclictest438834-21kworker/u16:3+flush-8:009:34:306
203908991614,2cyclictest721404-21kworker/u16:0+flush-8:011:39:464
203908991614,2cyclictest721404-21kworker/u16:0+flush-8:011:39:464
203920991514,0cyclictest0-21swapper/712:15:597
203920991514,0cyclictest0-21swapper/712:06:147
203920991514,0cyclictest0-21swapper/711:55:597
203920991514,0cyclictest0-21swapper/711:46:017
203920991513,1cyclictest0-21swapper/711:39:457
203920991513,1cyclictest0-21swapper/711:39:457
203916991513,2cyclictest711236-21kworker/u16:2+events_unbound11:26:306
203916991513,2cyclictest429477-21kworker/u16:5+flush-8:009:42:296
203916991513,2cyclictest429477-21kworker/u16:5+events_unbound11:42:306
203916991513,2cyclictest429477-21kworker/u16:5+events_unbound11:42:306
203916991513,2cyclictest429477-21kworker/u16:5+events_unbound10:08:306
203916991513,2cyclictest343415-21kworker/u16:0+events_unbound08:19:486
203916991511,3cyclictest594680-21kworker/u16:1+flush-8:010:34:386
20391699150,15cyclictest0-21swapper/611:36:316
203915991513,2cyclictest390615-21kworker/u16:4+events_unbound08:44:435
203915991512,3cyclictest769948-21kworker/u16:0+flush-8:012:34:505
203915991511,3cyclictest203651-21kworker/u16:1+flush-8:007:14:425
203908991513,2cyclictest203651-21kworker/u16:1+events_unbound07:14:224
203908991513,2cyclictest184760-21kworker/u16:0+events_unbound07:09:374
203908991511,3cyclictest246356-21kworker/u16:2+flush-8:008:39:454
20392099140,13cyclictest0-21swapper/708:59:447
203916991413,1cyclictest0-21swapper/608:27:306
203916991412,2cyclictest779691-21kworker/u16:3+flush-8:012:29:136
203916991412,2cyclictest594680-21kworker/u16:1+events_unbound10:39:366
203916991412,2cyclictest246356-21kworker/u16:2+flush-8:008:34:346
203916991412,2cyclictest246356-21kworker/u16:2+flush-8:008:34:346
203916991412,2cyclictest184760-21kworker/u16:0+flush-8:007:19:486
20391699140,14cyclictest0-21swapper/607:59:166
203915991412,2cyclictest429477-21kworker/u16:5+flush-8:009:29:355
203915991412,2cyclictest429477-21kworker/u16:5+flush-8:009:24:345
203915991412,2cyclictest203651-21kworker/u16:1+flush-8:007:29:255
20391599140,14cyclictest0-21swapper/512:29:345
20391599140,14cyclictest0-21swapper/512:29:345
203908991413,1cyclictest0-21swapper/407:57:294
203908991412,2cyclictest614571-21kworker/u16:3+flush-8:010:54:344
203908991412,2cyclictest594680-21kworker/u16:1+flush-8:011:09:164
203908991412,2cyclictest594680-21kworker/u16:1+events_unbound11:19:324
203908991411,2cyclictest788795-21ntpq12:09:444
203908991411,2cyclictest461989-21grep09:19:374
203920991312,0cyclictest0-21swapper/711:23:197
203916991312,1cyclictest0-21swapper/609:59:436
203916991311,2cyclictest246356-21kworker/u16:2+flush-8:008:39:506
203916991311,2cyclictest203651-21kworker/u16:1+flush-8:007:39:346
203916991311,2cyclictest203651-21kworker/u16:1+events_unbound07:34:436
203916991310,2cyclictest769948-21kworker/u16:0+flush-8:012:04:446
203916991310,2cyclictest740625-21kworker/u16:1+flush-8:011:59:376
203916991310,2cyclictest429477-21kworker/u16:5+flush-8:011:49:446
203915991312,1cyclictest0-21swapper/511:49:325
203915991312,1cyclictest0-21swapper/508:49:395
20391599130,13cyclictest0-21swapper/510:30:145
20390899139,3cyclictest594680-21kworker/u16:1+flush-8:011:14:454
20390899139,3cyclictest266894-21cat07:39:354
20390899138,4cyclictest761016-21cat11:54:354
203908991311,2cyclictest429477-21kworker/u16:5+flush-8:010:19:454
203908991311,2cyclictest305551-21kworker/u16:1+flush-8:008:14:544
203908991311,2cyclictest246356-21kworker/u16:2+flush-8:008:44:504
20390899130,5cyclictest0-21swapper/407:29:364
20392099128,3cyclictest1267-21snmpd09:16:187
203920991210,1cyclictest818785-21awk12:29:187
203916991211,1cyclictest0-21swapper/611:23:176
203916991211,1cyclictest0-21swapper/608:47:316
203916991211,1cyclictest0-21swapper/607:25:236
203916991210,2cyclictest204125-21kworker/u16:2+events_unbound07:10:316
20391699120,1cyclictest0-21swapper/611:05:376
20391699120,1cyclictest0-21swapper/609:18:446
203915991211,1cyclictest0-21swapper/511:54:445
203915991211,1cyclictest0-21swapper/511:44:205
203915991211,1cyclictest0-21swapper/509:53:305
203915991211,1cyclictest0-21swapper/509:44:125
203915991211,1cyclictest0-21swapper/507:44:425
20391599120,12cyclictest0-21swapper/507:56:125
20391599120,11cyclictest0-21swapper/512:07:595
20390899129,2cyclictest830054-21kthreadcore12:34:394
203908991211,1cyclictest0-21swapper/410:42:334
203908991211,1cyclictest0-21swapper/409:42:194
203908991210,2cyclictest401696-21kworker/u16:1+flush-8:008:49:484
20390899120,12cyclictest0-21swapper/407:36:594
20391699119,2cyclictest818517-21kworker/u16:2+flush-8:012:29:246
20391699119,2cyclictest818517-21kworker/u16:2+flush-8:012:29:246
20391699119,2cyclictest565771-21kworker/u16:0+events_unbound10:26:306
20391699117,3cyclictest551861-21kworker/u16:2+events_unbound10:14:336
20391699116,4cyclictest673890-21cat11:09:366
203916991110,1cyclictest0-21swapper/612:23:216
203916991110,1cyclictest0-21swapper/611:31:106
203916991110,1cyclictest0-21swapper/610:58:136
203916991110,1cyclictest0-21swapper/609:09:456
203916991110,1cyclictest0-21swapper/608:06:136
20391699110,0cyclictest0-21swapper/610:50:396
20391699110,0cyclictest0-21swapper/610:33:376
203915991110,1cyclictest0-21swapper/510:49:565
203915991110,1cyclictest0-21swapper/509:21:115
203915991110,1cyclictest0-21swapper/508:42:525
20391599110,11cyclictest0-21swapper/511:17:515
20391599110,11cyclictest0-21swapper/511:12:485
20391599110,11cyclictest0-21swapper/511:02:425
20391599110,11cyclictest0-21swapper/510:44:545
20391599110,11cyclictest0-21swapper/510:25:215
20391599110,11cyclictest0-21swapper/510:15:345
20391599110,11cyclictest0-21swapper/510:10:415
20391599110,11cyclictest0-21swapper/510:10:415
20391599110,11cyclictest0-21swapper/509:01:095
20391599110,0cyclictest0-21swapper/510:42:325
20391599110,0cyclictest0-21swapper/508:03:185
20390899119,2cyclictest769948-21kworker/u16:0+flush-8:011:59:504
20390899119,2cyclictest594680-21kworker/u16:1+flush-8:010:59:414
20390899119,2cyclictest305551-21kworker/u16:1+events_unbound07:59:444
20390899119,1cyclictest0-21swapper/408:19:394
20390899117,3cyclictest246356-21kworker/u16:2+flush-8:007:49:454
203908991110,1cyclictest0-21swapper/412:20:274
203908991110,1cyclictest0-21swapper/410:15:454
203908991110,1cyclictest0-21swapper/409:44:324
203908991110,1cyclictest0-21swapper/409:26:244
20390899110,11cyclictest0-21swapper/412:31:204
20390899110,11cyclictest0-21swapper/412:31:204
20390899110,11cyclictest0-21swapper/411:33:284
20390899110,11cyclictest0-21swapper/411:28:074
20391699109,1cyclictest0-21swapper/607:29:486
20391699108,2cyclictest203651-21kworker/u16:1+events_unbound07:17:306
20391599109,1cyclictest0-21swapper/508:33:535
20391599109,1cyclictest0-21swapper/507:35:335
20391599108,2cyclictest0-21swapper/511:36:275
20391599100,9cyclictest0-21swapper/509:59:385
20390899109,1cyclictest0-21swapper/412:07:124
20390899109,1cyclictest0-21swapper/410:37:404
20390899109,1cyclictest0-21swapper/408:28:144
20390899108,2cyclictest429477-21kworker/u16:5+flush-8:009:54:444
20390899100,0cyclictest0-21swapper/411:46:334
2039169998,1cyclictest0-21swapper/610:11:526
2039169998,1cyclictest0-21swapper/610:11:526
2039169995,3cyclictest536024-21ntp_kernel_err09:54:436
2039169990,8cyclictest280187-21cut07:44:406
2039159998,1cyclictest0-21swapper/508:56:355
2039159998,1cyclictest0-21swapper/508:12:455
2039159997,2cyclictest246356-21kworker/u16:2+flush-8:008:34:495
2039159997,2cyclictest246356-21kworker/u16:2+flush-8:008:34:495
2039159997,2cyclictest246356-21kworker/u16:2+flush-8:008:19:375
2039159995,3cyclictest237916-21iostat_ios07:24:365
2039159995,3cyclictest0-21swapper/507:39:485
2039159993,1cyclictest2880932cut07:49:385
2039089995,3cyclictest438834-21kworker/u16:3+flush-8:009:49:454
2039089994,4cyclictest327322-21kthreadcore08:09:394
2039089990,8cyclictest238124-21irqcore07:24:374
2039169980,7cyclictest787514-21grep12:09:406
2039159987,1cyclictest0-21swapper/509:07:475
2039159986,2cyclictest594680-21kworker/u16:1+flush-8:010:34:325
2039159986,1cyclictest0-21swapper/512:09:315
2039159985,2cyclictest429477-21kworker/u16:5+flush-8:010:04:455
2039159984,3cyclictest810219-21cat12:24:345
2039159984,3cyclictest493335-21cut09:34:365
2039159983,4cyclictest693814-21cut11:19:365
2039089987,1cyclictest0-21swapper/409:37:454
2039089986,2cyclictest429477-21kworker/u16:5+flush-8:010:24:454
2039089986,1cyclictest0-21swapper/407:19:474
2039089983,4cyclictest630707-21cut10:44:404
2039089983,4cyclictest547809-21sh10:04:354
2039089983,4cyclictest538170-21if_err_p4p109:59:354
2039089983,4cyclictest364406-21cut08:29:374
2039089983,4cyclictest276648-21tr07:44:374
2039159973,3cyclictest732078-21cut11:39:365
2039159973,3cyclictest732078-21cut11:39:365
2039159973,3cyclictest508380-21cat09:44:315
2039159970,6cyclictest703275-21cut11:24:355
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional