You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-10 - 18:18
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Fri Apr 10, 2026 12:55:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
164199982619,677cyclictest11617-21runrttasks12:44:496
164199974464,677cyclictest0-21swapper/610:14:406
164199973151,677cyclictest0-21swapper/611:54:446
1641399713203,296cyclictest0-21swapper/010:35:100
1641399713203,296cyclictest0-21swapper/010:35:090
1642099692351,126cyclictest0-21swapper/712:04:037
1641699688643,43cyclictest391rcuc/311:38:333
164179967075,592cyclictest0-21swapper/409:53:404
164139966222,381cyclictest0-21swapper/010:22:240
1641399655189,126cyclictest3283-21ssh11:19:150
1642099652138,296cyclictest0-21swapper/711:39:177
16419996467,423cyclictest0-21swapper/610:30:136
164199963783,551cyclictest0-21swapper/609:54:566
164179963583,549cyclictest0-21swapper/412:24:334
164199963132,510cyclictest0-21swapper/612:24:486
164189962534,84cyclictest0-21swapper/512:32:335
164199962227,592cyclictest0-21swapper/610:28:066
164199962068,549cyclictest0-21swapper/612:13:186
164199962068,549cyclictest0-21swapper/612:13:186
164199962068,549cyclictest0-21swapper/612:13:176
164199962068,549cyclictest0-21swapper/612:13:176
164199961966,550cyclictest0-21swapper/609:38:486
164199961865,550cyclictest0-21swapper/611:25:336
164199961217,592cyclictest0-21swapper/611:21:516
164199961058,549cyclictest0-21swapper/612:37:576
164139961015,380cyclictest0-21swapper/010:44:220
164179960914,380cyclictest0-21swapper/412:11:194
164179960914,380cyclictest0-21swapper/412:11:194
164179960914,380cyclictest0-21swapper/412:11:194
164179960914,380cyclictest0-21swapper/412:11:184
164199960856,550cyclictest0-21swapper/611:37:036
164199960396,127cyclictest30657-21hwlatdetect11:55:186
16413995970,84cyclictest0-21swapper/010:14:410
16417995961,422cyclictest0-21swapper/411:21:014
16414995960,84cyclictest0-21swapper/110:14:401
1642099594125,296cyclictest0-21swapper/710:22:337
16420995940,84cyclictest0-21swapper/712:44:417
1642099593507,84cyclictest711rcuc/712:39:047
1641599593549,42cyclictest311rcuc/211:39:322
164149959382,380cyclictest0-21swapper/107:23:211
164189958940,126cyclictest0-21swapper/511:22:395
1641399587288,126cyclictest0-21swapper/010:33:250
1641699586118,126cyclictest0-21swapper/310:33:553
164149958530,338cyclictest0-21swapper/112:01:271
164199958431,126cyclictest0-21swapper/610:54:086
1641799582156,423cyclictest24606-21diskmemload12:44:534
1641499582114,211cyclictest25-21ksoftirqd/111:38:061
164139958271,380cyclictest0-21swapper/012:14:360
164139958271,380cyclictest0-21swapper/012:14:360
164139958271,380cyclictest0-21swapper/012:14:360
164139958271,380cyclictest0-21swapper/012:14:360
164209958072,126cyclictest121rcu_preempt11:52:187
1641799578237,338cyclictest64450irq/122-eth011:36:004
1641499578239,168cyclictest3772-21kworker/u16:011:23:441
164199957767,84cyclictest0-21swapper/612:03:006
1641599577236,84cyclictest121rcu_preempt12:35:062
164199957526,429cyclictest0-21swapper/609:55:346
164149957522,126cyclictest0-21swapper/110:15:201
1642099574488,84cyclictest711rcuc/710:41:507
164189957365,84cyclictest0-21swapper/510:22:345
164199957118,550cyclictest0-21swapper/607:29:236
164139957118,465cyclictest1553-21runrttasks11:23:560
164199956916,550cyclictest0-21swapper/607:57:306
164159956917,127cyclictest121rcu_preempt10:30:242
164189956554,380cyclictest0-21swapper/511:39:565
164199956411,550cyclictest0-21swapper/612:15:306
1641399563137,253cyclictest24606-21diskmemload12:24:460
164189956010,84cyclictest0-21swapper/512:43:205
164169956094,126cyclictest0-21swapper/310:26:073
164159956010,126cyclictest0-21swapper/210:51:032
164189955910,298cyclictest0-21swapper/509:54:475
164179955715,373cyclictest0-21swapper/410:15:174
16418995551,339cyclictest0-21swapper/510:25:255
164139955446,126cyclictest0-21swapper/011:39:420
164209955346,254cyclictest0-21swapper/712:32:547
1641899552508,42cyclictest561ktimersoftd/512:38:545
16413995510,84cyclictest1551-21snmpd09:29:290
16413995510,84cyclictest1551-21snmpd09:29:290
16413995510,84cyclictest0-21swapper/012:02:490
164199954980,211cyclictest65-21ksoftirqd/612:32:326
1641499549124,422cyclictest0-21swapper/107:59:381
1642099548122,211cyclictest2130-21ssh11:40:207
164159954879,466cyclictest0-21swapper/212:02:282
1641799546205,338cyclictest64450irq/122-eth009:55:394
164199954574,296cyclictest15849-21basename08:00:236
164189954576,211cyclictest0-21swapper/510:34:145
164199954476,465cyclictest0-21swapper/607:23:056
164169954474,211cyclictest0-21swapper/310:41:313
164159954476,465cyclictest0-21swapper/209:53:082
164159954475,211cyclictest0-21swapper/212:24:282
1641499544120,126cyclictest1551-21snmpd12:21:071
16413995442,373cyclictest0-21swapper/011:27:590
164209954333,507cyclictest15081-21sh12:24:547
1641799541200,338cyclictest64450irq/122-eth011:54:144
164189953973,211cyclictest0-21swapper/512:05:005
1641899538282,126cyclictest24606-21diskmemload10:44:065
164179953872,126cyclictest0-21swapper/410:13:124
164159953870,465cyclictest0-21swapper/212:12:362
164159953870,465cyclictest0-21swapper/212:12:362
164159953870,465cyclictest0-21swapper/212:12:362
164159953870,465cyclictest0-21swapper/212:12:352
164149953872,335cyclictest0-21swapper/110:42:381
1641799537112,422cyclictest0-21swapper/410:53:544
1641799535108,424cyclictest0-21swapper/410:30:154
164189953369,338cyclictest0-21swapper/512:23:335
1641599533146,342cyclictest121rcu_preempt12:45:032
164149953327,41cyclictest0-21swapper/110:32:121
164199953221,508cyclictest0-21swapper/610:24:176
164149953224,126cyclictest0-21swapper/110:24:281
164189953123,84cyclictest0-21swapper/509:37:195
164169953119,296cyclictest0-21swapper/312:22:123
1641599531146,126cyclictest121rcu_preempt11:29:582
164179953023,83cyclictest0-21swapper/411:40:214
164169953066,209cyclictest0-21swapper/312:40:423
1641699530188,339cyclictest15319-21kworker/u16:111:54:163
1641799528233,83cyclictest64450irq/122-eth012:39:544
1641799528105,212cyclictest11554-21rm12:02:034
1642099527270,126cyclictest0-21swapper/707:58:327
164169952757,296cyclictest14213-21chrt07:58:173
164139952719,130cyclictest0-21swapper/009:54:010
164169952598,211cyclictest41-21ksoftirqd/307:26:443
164159952455,211cyclictest11003-21ssh10:30:032
164209952354,211cyclictest721ktimersoftd/711:24:507
164159952112,126cyclictest0-21swapper/208:00:222
1641499521181,338cyclictest16411-21cyclictest12:12:461
1641499521181,338cyclictest16411-21cyclictest12:12:461
1641499521181,338cyclictest16411-21cyclictest12:12:451
1641499521181,338cyclictest16411-21cyclictest12:12:451
164139951911,126cyclictest0-21swapper/010:51:520
164169951810,211cyclictest0-21swapper/310:52:283
164179951747,253cyclictest0-21swapper/407:25:114
16413995179,84cyclictest0-21swapper/009:38:540
164139951412,291cyclictest0-21swapper/012:40:070
16417995135,126cyclictest0-21swapper/412:15:114
164139951387,295cyclictest1651-21ntpd12:35:360
16416995123,126cyclictest121rcu_preempt12:14:363
16416995123,126cyclictest121rcu_preempt12:14:363
16416995123,126cyclictest121rcu_preempt12:14:363
16416995123,126cyclictest121rcu_preempt12:14:353
16415995123,84cyclictest0-21swapper/211:21:182
16414995126,339cyclictest0-21swapper/109:30:211
16416995100,84cyclictest0-21swapper/312:37:293
16415995102,126cyclictest0-21swapper/207:59:242
16415995100,85cyclictest0-21swapper/211:19:322
164209950943,84cyclictest16411-21cyclictest10:31:107
164149950940,211cyclictest25-21ksoftirqd/109:37:181
1641699508125,127cyclictest41-21ksoftirqd/312:15:123
164189950678,211cyclictest57-21ksoftirqd/511:26:145
164209950582,84cyclictest0-21swapper/712:13:437
164209950582,84cyclictest0-21swapper/712:13:437
164209950582,84cyclictest0-21swapper/712:13:437
164209950582,84cyclictest0-21swapper/712:13:437
164179950582,83cyclictest121rcu_preempt11:25:244
164179950580,422cyclictest0-21swapper/407:57:334
164179950579,211cyclictest8251-21ssh10:26:244
164199950434,466cyclictest0-21swapper/610:44:306
1641499504418,84cyclictest231rcuc/111:55:231
164139950439,126cyclictest0-21swapper/011:53:590
164209950280,85cyclictest1553-21runrttasks09:55:447
164149950276,211cyclictest241ktimersoftd/110:28:101
164149950233,126cyclictest12708-21ssh11:25:331
164139950280,83cyclictest0-21swapper/007:59:300
164209950179,84cyclictest0-21swapper/710:52:457
1642099501120,126cyclictest73-21ksoftirqd/712:15:117
164189950134,211cyclictest0-21swapper/510:13:245
16417995001,288cyclictest0-21swapper/410:41:334
1641799500123,246cyclictest1845-21rm09:30:204
164139950032,126cyclictest9-21ksoftirqd/007:24:320
164179949932,84cyclictest121rcu_preempt10:55:134
164139949933,126cyclictest0-21swapper/010:25:060
164209949876,84cyclictest0-21swapper/711:25:477
164199949830,465cyclictest0-21swapper/609:28:166
164199949830,465cyclictest0-21swapper/609:28:156
1641699498114,126cyclictest16411-21cyclictest11:23:173
164179949774,84cyclictest0-21swapper/409:39:424
164169949773,85cyclictest121rcu_preempt11:27:433
1642099496117,295cyclictest0-21swapper/709:36:567
164159949670,211cyclictest0-21swapper/209:37:072
164199949567,169cyclictest0-21swapper/610:35:176
164199949567,169cyclictest0-21swapper/610:35:166
1641699495451,42cyclictest391rcuc/309:30:283
164149949529,42cyclictest0-21swapper/110:35:101
164149949529,42cyclictest0-21swapper/110:35:101
1641799494114,297cyclictest0-21swapper/412:31:594
164199949366,296cyclictest0-21swapper/611:30:256
164199949366,296cyclictest0-21swapper/611:30:256
164189949169,2cyclictest440-21ssh09:30:095
164149949029,81cyclictest121rcu_preempt10:51:041
1641399489109,295cyclictest0-21swapper/012:31:590
164189948825,297cyclictest0-21swapper/509:28:395
164189948825,297cyclictest0-21swapper/509:28:395
1641699487361,42cyclictest391rcuc/311:30:303
1641699487361,42cyclictest391rcuc/311:30:303
1641699487107,296cyclictest15708-21ssh09:37:533
164159948558,211cyclictest0-21swapper/212:31:292
164149948514,296cyclictest0-21swapper/111:54:531
1641899484143,339cyclictest16411-21cyclictest11:30:265
1641899484143,339cyclictest16411-21cyclictest11:30:265
1641599484100,126cyclictest33-21ksoftirqd/211:54:362
164199948315,465cyclictest0-21swapper/609:30:116
164159948356,211cyclictest0-21swapper/211:30:192
164159948356,211cyclictest0-21swapper/211:30:192
164169948217,296cyclictest0-21swapper/312:01:503
164139948255,211cyclictest0-21swapper/012:15:130
164149948113,210cyclictest25-21ksoftirqd/112:31:121
164149948111,211cyclictest774-21awk12:15:301
164199947810,211cyclictest16411-21cyclictest07:30:026
164189947711,84cyclictest121rcu_preempt07:25:125
164179947753,83cyclictest0-21swapper/411:55:164
164159947751,211cyclictest0-21swapper/207:23:372
164149947753,84cyclictest0-21swapper/112:41:271
16413994768,338cyclictest9-21ksoftirqd/011:55:250
1641499472218,84cyclictest241ktimersoftd/109:55:131
16419994712,169cyclictest0-21swapper/610:15:196
16416994712,126cyclictest121rcu_preempt11:55:173
164189946783,211cyclictest0-21swapper/510:52:475
1641699467125,169cyclictest41-21ksoftirqd/312:32:583
1641699466167,126cyclictest0-21swapper/309:55:463
1641699466124,339cyclictest0-21swapper/311:40:023
164149946640,211cyclictest25-21ksoftirqd/110:55:141
1642099465123,339cyclictest24606-21diskmemload09:30:297
1642099465123,211cyclictest30014-21kworker/u16:309:53:477
1641899465124,338cyclictest0-21swapper/512:15:055
1641699465124,338cyclictest3428-21ssh11:19:243
1641699465124,338cyclictest0-21swapper/309:29:473
1641699465124,338cyclictest0-21swapper/309:29:463
164159946581,211cyclictest33-21ksoftirqd/210:14:552
1641599465208,254cyclictest2234-21fschecks_time11:40:252
1641599465124,338cyclictest0-21swapper/209:55:172
164139946539,211cyclictest0-21swapper/010:55:060
1642099464122,339cyclictest698-21ptp4l10:25:037
1641799464123,211cyclictest121rcu_preempt09:29:564
1641799464123,211cyclictest121rcu_preempt09:29:564
1641699464123,338cyclictest0-21swapper/310:24:003
1641599464124,338cyclictest0-21swapper/209:30:102
1641499464207,126cyclictest121rcu_preempt12:38:391
1641699463123,337cyclictest0-21swapper/310:13:053
1641699463123,337cyclictest0-21swapper/309:54:233
1641999462124,126cyclictest65-21ksoftirqd/610:55:096
164179946278,211cyclictest121rcu_preempt08:00:134
164159946276,169cyclictest33-21ksoftirqd/210:24:162
1641499461121,338cyclictest0-21swapper/109:54:271
1641399461120,338cyclictest0-21swapper/012:25:120
1642099460118,339cyclictest0-21swapper/710:55:177
1641399460118,339cyclictest0-21swapper/011:40:060
164199945973,211cyclictest16411-21cyclictest09:40:146
164189945938,255cyclictest0-21swapper/507:23:225
1641699459415,42cyclictest401ktimersoftd/310:35:053
1641699459415,42cyclictest401ktimersoftd/310:35:043
164149945976,126cyclictest27926-21/usr/sbin/munin07:25:281
1641899458119,85cyclictest0-21swapper/511:54:595
1641799458118,338cyclictest0-21swapper/410:23:314
1641699458121,301cyclictest16411-21cyclictest07:23:053
1641799457116,338cyclictest0-21swapper/409:40:184
1641699456115,338cyclictest17851-21rm09:40:113
1641399456115,338cyclictest0-21swapper/009:55:450
1641799455116,337cyclictest0-21swapper/410:35:094
1641799455116,337cyclictest0-21swapper/410:35:084
164209945474,85cyclictest0-21swapper/707:24:537
1642099454113,338cyclictest0-21swapper/707:28:087
164199945431,125cyclictest0-21swapper/611:40:216
1641399454113,339cyclictest0-21swapper/007:28:180
164149945368,210cyclictest0-21swapper/111:30:061
164149945368,210cyclictest0-21swapper/111:30:051
1641499452111,126cyclictest0-21swapper/111:40:251
1641399452206,37cyclictest18758-21fschecks_time09:40:200
1641399452111,338cyclictest0-21swapper/009:30:300
164189945071,376cyclictest0-21swapper/509:40:165
164189945069,126cyclictest57-21ksoftirqd/512:15:125
164159945024,211cyclictest0-21swapper/210:43:412
164189944926,297cyclictest0-21swapper/510:35:115
164189944926,297cyclictest0-21swapper/510:35:105
1641799449111,336cyclictest0-21swapper/411:30:224
1641799449111,336cyclictest0-21swapper/411:30:224
1641599449109,338cyclictest32134-21diskmemload12:15:162
164189944867,84cyclictest0-21swapper/511:55:165
164189944864,168cyclictest0-21swapper/512:14:415
164189944864,168cyclictest0-21swapper/512:14:415
164189944864,168cyclictest0-21swapper/512:14:405
164159944826,84cyclictest0-21swapper/209:28:582
164159944826,84cyclictest0-21swapper/209:28:582
1641499448192,210cyclictest121rcu_preempt11:19:421
164189944768,376cyclictest0-21swapper/511:19:005
164189944766,378cyclictest0-21swapper/509:55:205
164159944766,169cyclictest121rcu_preempt07:25:272
164159944720,212cyclictest0-21swapper/210:35:082
164159944720,212cyclictest0-21swapper/210:35:082
164149944725,47cyclictest0-21swapper/109:40:181
1641899445187,255cyclictest14303-21seq07:59:375
164189943816,256cyclictest0-21swapper/508:00:165
164149943855,126cyclictest24606-21diskmemload12:05:071
1641399436137,126cyclictest121rcu_preempt12:05:050
16420994271,126cyclictest0-21swapper/710:13:377
164209942585,84cyclictest0-21swapper/711:30:167
164209942585,84cyclictest0-21swapper/711:30:167
16419994253,256cyclictest0-21swapper/611:19:486
16418994252,209cyclictest20782-21ssh10:55:205
16413994241,48cyclictest0-21swapper/011:30:340
16413994241,48cyclictest0-21swapper/011:30:330
164159942279,126cyclictest33-21ksoftirqd/211:55:092
164209942182,84cyclictest0-21swapper/709:28:407
164209942182,84cyclictest0-21swapper/709:28:397
164169942182,84cyclictest0-21swapper/308:00:223
164209942081,84cyclictest0-21swapper/709:40:097
164209942079,126cyclictest0-21swapper/711:19:297
164169942081,84cyclictest0-21swapper/310:55:183
164209941981,84cyclictest0-21swapper/712:25:127
164209941980,84cyclictest0-21swapper/711:55:077
164209941980,84cyclictest0-21swapper/710:35:057
164209941980,84cyclictest0-21swapper/710:35:057
164139941980,84cyclictest0-21swapper/008:00:170
164209941877,85cyclictest0-21swapper/708:00:237
164199941878,338cyclictest0-21swapper/612:05:056
1641899418122,84cyclictest2105-21sh11:40:205
1641799418162,253cyclictest481ktimersoftd/407:30:034
164159941877,338cyclictest0-21swapper/210:55:222
164159941876,339cyclictest0-21swapper/210:15:232
164149941880,84cyclictest0-21swapper/107:30:051
164199941777,338cyclictest0-21swapper/612:25:176
1641899417122,211cyclictest0-21swapper/510:15:225
164179941778,84cyclictest0-21swapper/407:24:184
164149941778,84cyclictest0-21swapper/109:29:331
164149941778,84cyclictest0-21swapper/109:29:321
164189941675,338cyclictest0-21swapper/512:05:055
164179941678,84cyclictest0-21swapper/411:19:484
164139941677,84cyclictest0-21swapper/010:15:070
164179941537,84cyclictest0-21swapper/412:05:094
164159941574,338cyclictest0-21swapper/212:25:162
164209941374,84cyclictest0-21swapper/710:15:187
164159941371,339cyclictest0-21swapper/209:40:132
164139941374,84cyclictest0-21swapper/007:30:030
164169941273,84cyclictest0-21swapper/310:15:073
164149940970,84cyclictest0-21swapper/108:00:231
164189940060,337cyclictest0-21swapper/512:25:165
164159939915,254cyclictest0-21swapper/212:05:102
1642099397140,254cyclictest0-21swapper/712:05:027
164189939757,337cyclictest0-21swapper/507:30:065
164169939657,84cyclictest0-21swapper/307:30:103
164179939212,218cyclictest0-21swapper/412:25:174
164149939253,84cyclictest0-21swapper/112:25:121
164169939152,84cyclictest0-21swapper/312:25:113
164169939151,84cyclictest0-21swapper/312:05:093
164159937782,211cyclictest0-21swapper/207:30:052
1642099368110,255cyclictest0-21swapper/707:30:037
1180621110,1sleep00-21swapper/008:45:220
1566228858,27sleep10-21swapper/107:08:191
1569928574,8sleep20-21swapper/207:08:532
1555128545,36sleep50-21swapper/507:06:475
1546128453,28sleep70-21swapper/707:05:297
1317828352,27sleep60-21swapper/607:05:046
32602820,2sleep11641499cyclictest09:48:561
1570628150,28sleep00-21swapper/007:08:590
1550228050,27sleep30-21swapper/307:06:053
1549428049,28sleep40-21swapper/407:05:574
82502740,0sleep10-21swapper/110:47:201
57062680,0sleep40-21swapper/410:45:404
224432670,0sleep40-21swapper/408:10:174
16420992810,18cyclictest0-21swapper/708:41:157
16420992810,18cyclictest0-21swapper/708:29:137
16420992810,18cyclictest0-21swapper/708:17:037
16419992828,0cyclictest0-21swapper/607:13:556
16417992810,18cyclictest0-21swapper/407:13:554
16416992828,0cyclictest0-21swapper/309:16:393
16416992810,18cyclictest0-21swapper/308:52:233
16416992810,18cyclictest0-21swapper/308:29:033
16416992810,18cyclictest0-21swapper/308:16:433
16416992810,0cyclictest0-21swapper/307:13:573
16415992828,0cyclictest0-21swapper/208:41:422
16414992810,18cyclictest0-21swapper/107:13:541
16413992810,18cyclictest0-21swapper/007:13:540
16413992810,17cyclictest0-21swapper/008:16:380
16420992727,0cyclictest0-21swapper/707:13:487
16420992710,17cyclictest0-21swapper/709:16:427
16420992710,17cyclictest0-21swapper/708:51:537
16420992710,17cyclictest0-21swapper/707:45:017
16420992710,17cyclictest0-21swapper/707:44:227
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional