You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-06 - 22:27
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Mon Apr 06, 2026 12:58:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2188199861140,718cyclictest481ktimersoftd/409:38:494
218819978621,761cyclictest25598-21nscd09:13:134
2188199719124,338cyclictest0-21swapper/411:32:284
218819971031,676cyclictest0-21swapper/412:11:394
218819970525,677cyclictest0-21swapper/412:49:064
218819970424,677cyclictest0-21swapper/409:16:404
218819970424,677cyclictest0-21swapper/409:16:404
2187799679211,295cyclictest26682-21kworker/u16:009:19:120
2187799679211,295cyclictest26682-21kworker/u16:009:19:110
218819967638,549cyclictest0-21swapper/411:35:374
218819967638,423cyclictest0-21swapper/410:41:164
218819967075,592cyclictest0-21swapper/410:52:544
2187799670117,127cyclictest704-21nscd11:36:330
218819966874,591cyclictest0-21swapper/412:31:374
218819966628,127cyclictest0-21swapper/411:23:134
218819965561,592cyclictest64450irq/122-eth010:46:534
218819965316,634cyclictest0-21swapper/412:37:014
218819964810,42cyclictest0-21swapper/410:40:024
21881996469,634cyclictest0-21swapper/412:03:464
21881996445,592cyclictest0-21swapper/411:48:004
218809963686,381cyclictest0-21swapper/312:35:023
218849962874,381cyclictest0-21swapper/712:03:207
218809962673,380cyclictest0-21swapper/310:42:303
218829962530,380cyclictest21874-21cyclictest12:07:095
218819962534,304cyclictest0-21swapper/411:13:084
218819962534,304cyclictest0-21swapper/411:13:084
2188199625285,338cyclictest64450irq/122-eth010:23:074
2188399623116,85cyclictest121rcu_preempt12:04:516
218829962226,339cyclictest0-21swapper/512:10:395
218789962171,126cyclictest0-21swapper/109:15:151
218789962171,126cyclictest0-21swapper/109:15:151
2187899618196,84cyclictest0-21swapper/110:51:261
218819961323,554cyclictest0-21swapper/412:17:274
2188199611270,211cyclictest0-21swapper/411:25:144
2187799611189,169cyclictest0-21swapper/012:36:300
218789960714,169cyclictest0-21swapper/112:35:401
218789960653,380cyclictest0-21swapper/111:42:041
218849960452,126cyclictest0-21swapper/712:21:167
218839960411,84cyclictest0-21swapper/612:37:266
218819960412,126cyclictest17574-21diskmemload11:41:174
2187899602305,125cyclictest0-21swapper/110:22:261
2187899594508,84cyclictest231rcuc/110:42:311
21884995930,84cyclictest0-21swapper/711:45:497
2187899592124,253cyclictest0-21swapper/111:26:111
218809959180,297cyclictest26850-21rm10:52:003
218819959038,549cyclictest0-21swapper/409:24:044
2187799590169,47cyclictest0-21swapper/010:55:130
2188299588119,126cyclictest0-21swapper/511:33:315
218819958835,550cyclictest64450irq/122-eth012:44:214
2187899588289,126cyclictest29701-21diskmemload12:22:161
2188399587118,338cyclictest0-21swapper/610:52:396
218819958432,549cyclictest0-21swapper/412:06:404
218809958429,338cyclictest0-21swapper/312:21:553
218799958372,126cyclictest0-21swapper/209:22:372
2188499582113,296cyclictest121rcu_preempt11:56:337
218839958273,126cyclictest0-21swapper/612:46:536
2187999582282,126cyclictest0-21swapper/209:16:472
2187999582282,126cyclictest0-21swapper/209:16:462
2188099580535,42cyclictest391rcuc/312:03:593
218849957971,126cyclictest0-21swapper/711:33:067
218779957968,338cyclictest0-21swapper/011:15:010
218779957968,338cyclictest0-21swapper/011:15:000
218779957929,211cyclictest0-21swapper/009:24:370
218789957871,213cyclictest0-21swapper/111:52:331
218819957725,549cyclictest0-21swapper/411:52:334
2187999576107,296cyclictest0-21swapper/211:52:082
2188399575109,211cyclictest0-21swapper/609:14:396
218819957322,301cyclictest0-21swapper/412:22:584
218799957362,341cyclictest121rcu_preempt10:23:272
2187899573528,42cyclictest231rcuc/111:56:501
2188099571101,297cyclictest21470-21ssh12:49:363
2188299569100,296cyclictest0-21swapper/512:42:375
218829956655,338cyclictest0-21swapper/512:47:295
218839956495,296cyclictest0-21swapper/611:31:146
21880995639,338cyclictest0-21swapper/309:24:573
218779956212,84cyclictest0-21swapper/012:42:580
218849956149,296cyclictest15140-21ssh09:20:307
218829956197,253cyclictest27197-21chrt11:28:015
218789956111,84cyclictest0-21swapper/109:20:401
218809956011,125cyclictest0-21swapper/312:44:313
218849955989,296cyclictest3676-21ssh11:53:167
218809955447,338cyclictest0-21swapper/311:15:063
218809955283,465cyclictest0-21swapper/309:39:343
2188499551124,254cyclictest693-21cron10:40:027
218789955141,295cyclictest0-21swapper/111:36:111
218849955081,338cyclictest0-21swapper/710:24:537
218809955039,254cyclictest0-21swapper/311:55:303
2187799550129,209cyclictest121rcu_preempt10:40:570
218809954778,296cyclictest0-21swapper/310:38:533
218799954739,125cyclictest121rcu_preempt10:51:532
218849954676,381cyclictest0-21swapper/712:12:107
2188299546120,126cyclictest0-21swapper/511:54:505
218779954580,126cyclictest0-21swapper/009:39:270
218779954579,127cyclictest0-21swapper/010:47:010
218829954378,253cyclictest0-21swapper/509:17:295
218829954378,253cyclictest0-21swapper/509:17:285
218789954334,127cyclictest0-21swapper/112:15:341
2187799543457,84cyclictest111rcuc/012:45:440
218819954275,337cyclictest0-21swapper/410:25:204
218819954232,507cyclictest0-21swapper/408:13:564
2187899542498,42cyclictest231rcuc/109:39:141
2188299541497,42cyclictest551rcuc/512:35:025
2187799541243,126cyclictest0-21swapper/010:21:450
218849954031,84cyclictest121rcu_preempt12:46:127
218829954076,126cyclictest121rcu_preempt12:04:075
2187899540115,253cyclictest0-21swapper/111:47:121
218799953826,339cyclictest0-21swapper/212:12:022
218779953830,126cyclictest0-21swapper/012:11:140
218839953767,296cyclictest0-21swapper/610:46:416
2188099537238,253cyclictest16722-21kworker/u16:110:21:573
218799953627,127cyclictest0-21swapper/211:47:062
218789953629,84cyclictest0-21swapper/112:04:301
2187899533319,126cyclictest0-21swapper/110:55:121
2187899533104,295cyclictest0-21swapper/112:34:441
218789953221,211cyclictest25-21ksoftirqd/109:14:221
218779953223,84cyclictest121rcu_preempt12:17:030
218789953161,296cyclictest0-21swapper/111:22:561
218799952922,127cyclictest0-21swapper/212:32:172
218779952918,380cyclictest0-21swapper/011:31:380
218789952858,169cyclictest25-21ksoftirqd/112:07:161
2188299527105,84cyclictest0-21swapper/512:15:405
2187799527101,253cyclictest0-21swapper/011:22:530
2188099526226,126cyclictest0-21swapper/309:19:393
2188099526226,126cyclictest0-21swapper/309:19:383
218809952514,380cyclictest29701-21diskmemload11:35:413
2187999525442,4cyclictest311rcuc/212:23:052
218809952415,169cyclictest0-21swapper/312:08:593
218809952415,126cyclictest0-21swapper/311:54:173
218839952356,127cyclictest1551-21snmpd12:33:246
2188299523182,338cyclictest204132sleep511:23:075
218779952358,210cyclictest0-21swapper/011:47:530
218789952114,84cyclictest0-21swapper/111:32:481
218849952015,296cyclictest121rcu_preempt09:25:237
218829952098,84cyclictest0-21swapper/509:38:305
218779952013,298cyclictest25990-21diskmemload11:26:290
218849951992,296cyclictest0-21swapper/711:41:337
21883995186,42cyclictest0-21swapper/611:46:106
218789951892,296cyclictest15009-21sh12:44:301
218789951791,211cyclictest0-21swapper/112:46:501
21881995169,126cyclictest121rcu_preempt11:56:514
218809951588,296cyclictest0-21swapper/312:35:413
21879995158,2cyclictest0-21swapper/211:25:142
2187999514257,126cyclictest0-21swapper/211:37:062
21883995114,2cyclictest0-21swapper/611:25:146
21878995114,338cyclictest0-21swapper/112:10:401
218849950982,211cyclictest73-21ksoftirqd/710:45:397
21883995090,84cyclictest0-21swapper/609:19:386
21883995090,84cyclictest0-21swapper/609:19:376
218809950881,296cyclictest0-21swapper/311:32:453
2188499507123,253cyclictest0-21swapper/709:40:137
218779950579,211cyclictest0-21swapper/011:52:180
218799950481,127cyclictest0-21swapper/212:07:342
218789950233,211cyclictest0-21swapper/108:14:311
218779950278,169cyclictest0-21swapper/011:56:130
2188099501160,338cyclictest21874-21cyclictest11:27:183
218829950074,211cyclictest0-21swapper/512:23:245
218809949934,341cyclictest0-21swapper/309:13:483
2188499497414,2cyclictest711rcuc/712:16:377
218849949731,126cyclictest0-21swapper/712:37:107
2188399497202,126cyclictest121rcu_preempt09:21:536
218839949668,425cyclictest0-21swapper/612:09:246
218839949630,211cyclictest0-21swapper/612:40:556
218829949676,82cyclictest0-21swapper/512:25:055
218779949672,211cyclictest0-21swapper/009:14:260
218849949569,423cyclictest0-21swapper/709:16:217
218849949569,423cyclictest0-21swapper/709:16:217
218829949529,211cyclictest0-21swapper/510:45:395
218799949571,381cyclictest0-21swapper/212:46:532
218849949470,211cyclictest0-21swapper/711:23:067
2188499493237,253cyclictest1615-21kworker/u16:112:08:597
218839949368,126cyclictest0-21swapper/611:14:596
218839949368,126cyclictest0-21swapper/611:14:586
218779949329,84cyclictest0-21swapper/012:23:300
218849949224,126cyclictest121rcu_preempt11:27:257
218809949265,296cyclictest0-21swapper/311:25:003
218829949127,42cyclictest0-21swapper/511:47:365
218779949127,126cyclictest0-21swapper/010:25:380
218849949025,7cyclictest0-21swapper/711:36:397
2188099490106,381cyclictest0-21swapper/311:46:553
218849948958,211cyclictest16288-21ssh09:39:537
218809948924,297cyclictest0-21swapper/310:46:273
218779948962,253cyclictest0-21swapper/012:34:040
2188399488148,338cyclictest21874-21cyclictest12:22:006
218799948823,295cyclictest0-21swapper/212:01:092
218819948719,168cyclictest0-21swapper/410:55:104
218799948718,127cyclictest15568-21ssh09:38:492
218829948661,84cyclictest57-21ksoftirqd/511:41:335
218809948621,84cyclictest0-21swapper/312:14:543
218799948617,84cyclictest0-21swapper/211:32:072
218779948620,84cyclictest0-21swapper/012:04:200
2188399485405,77cyclictest631rcuc/612:17:286
218789948419,84cyclictest0-21swapper/110:25:241
218829948199,84cyclictest121rcu_preempt09:13:515
218779947956,126cyclictest121rcu_preempt11:42:410
218779947913,84cyclictest723-21nscd10:38:110
218779947911,338cyclictest0-21swapper/010:54:570
218779947813,127cyclictest0-21swapper/012:09:380
218849947611,84cyclictest29701-21diskmemload12:44:507
218829947612,218cyclictest0-21swapper/511:13:295
218829947612,218cyclictest0-21swapper/511:13:295
218809947610,84cyclictest121rcu_preempt11:40:563
218839947596,295cyclictest15742-21ssh09:39:016
2187999475308,43cyclictest0-21swapper/212:17:232
218829947449,210cyclictest0-21swapper/510:42:095
21879994748,84cyclictest0-21swapper/208:13:272
218829946946,81cyclictest0-21swapper/511:36:575
218809946883,253cyclictest0-21swapper/309:25:113
21880994681,84cyclictest0-21swapper/312:15:423
21882994678,36cyclictest0-21swapper/509:20:185
21884994660,41cyclictest0-21swapper/710:51:577
21879994661,169cyclictest0-21swapper/212:35:532
21883994651,2cyclictest0-21swapper/608:13:276
2187999465124,338cyclictest0-21swapper/212:41:572
2187999465124,338cyclictest0-21swapper/210:42:032
2188399464249,85cyclictest0-21swapper/610:21:326
218809946441,256cyclictest0-21swapper/310:25:423
218799946480,255cyclictest0-21swapper/210:39:022
218839946379,338cyclictest0-21swapper/611:56:126
218819946378,211cyclictest49-21ksoftirqd/409:25:104
218799946379,211cyclictest33-21ksoftirqd/211:41:232
2188399462206,126cyclictest121rcu_preempt10:25:196
218799946239,257cyclictest0-21swapper/210:46:432
218839946178,210cyclictest29701-21diskmemload09:25:116
2188399461289,84cyclictest0-21swapper/610:40:496
2188399461124,335cyclictest0-21swapper/612:11:426
218829946138,42cyclictest121rcu_preempt10:23:485
218839946035,89cyclictest0-21swapper/611:35:576
218829946036,43cyclictest121rcu_preempt12:35:465
218799946076,211cyclictest0-21swapper/209:13:522
218789946038,253cyclictest0-21swapper/110:39:131
218849945933,42cyclictest0-21swapper/712:34:337
218839945936,256cyclictest0-21swapper/611:23:116
218789945975,126cyclictest20952-21smartctl09:25:171
218779945938,126cyclictest0-21swapper/011:15:060
218839945836,2cyclictest0-21swapper/610:39:106
2188399458117,338cyclictest0-21swapper/611:52:096
2188399457116,338cyclictest0-21swapper/611:43:036
218799945634,84cyclictest0-21swapper/210:25:432
218819945328,126cyclictest0-21swapper/408:15:034
218819945328,126cyclictest0-21swapper/408:15:024
2188499452112,338cyclictest0-21swapper/709:13:047
218829945230,7cyclictest0-21swapper/510:55:115
2188199452112,337cyclictest0-21swapper/409:40:114
218819945126,422cyclictest0-21swapper/411:15:074
218829944826,3cyclictest4785-21latency_hist10:40:055
218849944724,210cyclictest0-21swapper/711:14:227
218849944724,210cyclictest0-21swapper/711:14:217
218799944720,338cyclictest0-21swapper/211:23:432
218849944666,296cyclictest0-21swapper/712:25:047
218829944665,87cyclictest0-21swapper/510:51:575
218799944523,339cyclictest0-21swapper/209:25:172
218789944367,203cyclictest0-21swapper/108:15:121
218789944367,203cyclictest0-21swapper/108:15:111
218849944218,127cyclictest9739-21hwlatdetect10:25:207
218809944220,2cyclictest0-21swapper/308:13:263
218849943999,338cyclictest0-21swapper/710:40:447
2187999439143,48cyclictest29631-21seq10:55:122
218829943855,168cyclictest11133-21ssh10:25:405
218829943816,3cyclictest0-21swapper/509:25:185
218799943854,84cyclictest0-21swapper/211:56:122
2187899436268,84cyclictest6503-21kworker/u16:211:13:261
2187899436268,84cyclictest6503-21kworker/u16:211:13:261
2188299434264,168cyclictest561ktimersoftd/508:12:405
2188299431132,126cyclictest8817-21rm11:56:345
218799942646,126cyclictest17954-21cut09:40:162
218779942239,168cyclictest19774-21rm09:25:110
2188099420164,126cyclictest25598-21nscd09:40:133
2188399419292,42cyclictest641ktimersoftd/609:40:116
218799941677,126cyclictest33-21ksoftirqd/211:14:212
218799941677,126cyclictest33-21ksoftirqd/211:14:202
218809941574,338cyclictest0-21swapper/311:14:483
218809941574,338cyclictest0-21swapper/311:14:473
218779941475,84cyclictest0-21swapper/008:14:180
218789941126,177cyclictest17296-21ssh10:46:421
218779940869,84cyclictest0-21swapper/009:40:120
218849940767,338cyclictest0-21swapper/710:55:137
218849940525,256cyclictest0-21swapper/708:13:267
218839940420,84cyclictest0-21swapper/610:55:126
218829940222,211cyclictest0-21swapper/508:15:125
218829940222,211cyclictest0-21swapper/508:15:115
218809939756,338cyclictest0-21swapper/310:55:133
218849939514,297cyclictest0-21swapper/711:15:127
218849938812,36cyclictest0-21swapper/708:15:127
218849938812,36cyclictest0-21swapper/708:15:117
2187999384126,169cyclictest0-21swapper/211:15:122
2187999380124,254cyclictest0-21swapper/212:25:022
2187799376120,253cyclictest16074-21sh12:25:020
2187999373117,126cyclictest29581-21apt08:15:122
2187999373117,126cyclictest29581-21apt08:15:112
218789936627,84cyclictest0-21swapper/109:40:151
218779936569,83cyclictest0-21swapper/008:15:110
218779936569,83cyclictest0-21swapper/008:15:110
2188399363107,253cyclictest0-21swapper/612:25:026
218809936365,296cyclictest0-21swapper/312:25:023
218839936225,3cyclictest0-21swapper/608:15:026
218839936225,3cyclictest0-21swapper/608:15:026
218829935718,84cyclictest0-21swapper/509:40:135
218819935211,338cyclictest0-21swapper/412:25:054
218809935114,2cyclictest0-21swapper/308:15:043
218809935114,2cyclictest0-21swapper/308:15:043
218789934751,84cyclictest0-21swapper/111:15:071
218789933174,168cyclictest0-21swapper/112:25:031
2188399330116,84cyclictest121rcu_preempt11:15:066
218829932975,84cyclictest0-21swapper/511:15:075
2037021190,5sleep00-21swapper/007:05:180
2135628643,5sleep40-21swapper/407:08:444
2130128547,34sleep50-21swapper/507:07:575
2134828454,27sleep70-21swapper/707:08:397
93942830,0sleep40-21swapper/407:40:154
2134228250,28sleep10-21swapper/107:08:331
2131628250,28sleep20-21swapper/207:08:112
1885128252,27sleep30-21swapper/307:05:063
2114127949,27sleep60-21swapper/607:05:416
261132770,0sleep7711rcuc/711:09:287
127252750,1sleep1241ktimersoftd/111:02:181
232382340,0sleep70-21swapper/707:10:157
21882992928,1cyclictest57-21ksoftirqd/509:08:375
21879992910,19cyclictest0-21swapper/208:44:472
21877992927,1cyclictest0-21swapper/007:19:360
21884992810,18cyclictest0-21swapper/710:08:037
21884992810,18cyclictest0-21swapper/709:56:217
21883992828,0cyclictest0-21swapper/609:56:286
21883992810,0cyclictest0-21swapper/607:14:376
21881992810,18cyclictest0-21swapper/407:14:124
21881992810,0cyclictest0-21swapper/410:19:384
21880992828,0cyclictest0-21swapper/308:36:163
21880992810,18cyclictest0-21swapper/310:19:273
21880992810,18cyclictest0-21swapper/309:00:463
21880992810,18cyclictest0-21swapper/308:44:223
21880992810,18cyclictest0-21swapper/307:51:383
21880992810,18cyclictest0-21swapper/307:42:323
21880992810,0cyclictest0-21swapper/310:07:593
21880992810,0cyclictest0-21swapper/309:55:573
21880992810,0cyclictest0-21swapper/307:33:593
21880992810,0cyclictest0-21swapper/307:33:583
21879992827,1cyclictest18504-21ssh09:56:032
21879992827,1cyclictest0-21swapper/209:01:072
21879992827,1cyclictest0-21swapper/208:27:522
21879992827,1cyclictest0-21swapper/207:26:232
21879992810,18cyclictest0-21swapper/208:01:352
21879992810,17cyclictest0-21swapper/210:19:232
21879992810,0cyclictest0-21swapper/208:53:022
21879992810,0cyclictest0-21swapper/208:36:222
21878992810,18cyclictest0-21swapper/110:19:331
21878992810,18cyclictest0-21swapper/109:08:391
21878992810,18cyclictest0-21swapper/107:14:361
21878992810,0cyclictest0-21swapper/108:53:011
21877992810,18cyclictest0-21swapper/010:19:500
21884992727,0cyclictest0-21swapper/708:27:327
21884992727,0cyclictest0-21swapper/707:26:597
21884992710,17cyclictest0-21swapper/710:19:237
21884992710,17cyclictest0-21swapper/709:08:417
21884992710,17cyclictest0-21swapper/708:52:447
21884992710,17cyclictest0-21swapper/707:51:547
21884992710,17cyclictest0-21swapper/707:42:557
21884992710,17cyclictest0-21swapper/707:34:197
21884992710,17cyclictest0-21swapper/707:34:197
21884992710,0cyclictest0-21swapper/709:00:507
21884992710,0cyclictest0-21swapper/708:36:297
21884992710,0cyclictest0-21swapper/707:19:247
21883992727,0cyclictest0-21swapper/607:19:276
21883992710,17cyclictest0-21swapper/610:19:486
21883992710,17cyclictest0-21swapper/609:08:076
21883992710,17cyclictest0-21swapper/608:53:026
21883992710,17cyclictest0-21swapper/608:44:386
21883992710,17cyclictest0-21swapper/608:36:096
21883992710,17cyclictest0-21swapper/608:01:186
21883992710,17cyclictest0-21swapper/607:51:546
21883992710,17cyclictest0-21swapper/607:42:316
21883992710,17cyclictest0-21swapper/607:34:136
21883992710,17cyclictest0-21swapper/607:34:126
21883992710,0cyclictest0-21swapper/610:07:536
21883992710,0cyclictest0-21swapper/609:00:456
21883992710,0cyclictest0-21swapper/608:27:206
21883992710,0cyclictest0-21swapper/607:26:446
21882992727,0cyclictest0-21swapper/509:00:455
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional