You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-22 - 22:00
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Fri May 22, 2026 12:55:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
30461998070,804cyclictest0-21swapper/712:12:097
3045699780736,42cyclictest311rcuc/211:37:282
304559975334,127cyclictest0-21swapper/111:38:141
304619970062,635cyclictest0-21swapper/711:49:517
304609966531,339cyclictest25976-21ssh10:27:136
304619965964,592cyclictest0-21swapper/711:36:517
3046199659106,549cyclictest0-21swapper/711:57:027
3045899627117,338cyclictest121rcu_preempt10:27:374
304549961823,464cyclictest0-21swapper/012:01:340
304579960699,338cyclictest0-21swapper/311:57:243
304559960393,507cyclictest0-21swapper/112:14:451
30461995983,592cyclictest0-21swapper/712:20:507
304579959041,380cyclictest121rcu_preempt10:26:153
304559958637,338cyclictest0-21swapper/110:12:321
304619958472,296cyclictest0-21swapper/711:14:187
304579958227,381cyclictest0-21swapper/311:15:133
304579958227,381cyclictest0-21swapper/311:15:133
3046099581202,295cyclictest19932-1kworker/u17:111:39:366
3046199577108,381cyclictest0-21swapper/712:36:317
304619957623,550cyclictest0-21swapper/712:05:107
304549957627,84cyclictest0-21swapper/011:04:280
304609957528,335cyclictest0-21swapper/610:13:346
304619957218,551cyclictest0-21swapper/711:05:257
304619957218,551cyclictest0-21swapper/711:05:257
3045799570104,126cyclictest0-21swapper/311:20:113
304619956412,42cyclictest25952-21ssh10:27:057
30457995639,381cyclictest0-21swapper/311:46:023
304549955039,295cyclictest0-21swapper/012:36:050
304579954937,296cyclictest121rcu_preempt11:13:293
304609954834,466cyclictest17222-21kworker/6:011:57:496
304579954739,168cyclictest121rcu_preempt12:12:353
304599954681,126cyclictest0-21swapper/510:28:095
3046199544118,423cyclictest0-21swapper/710:11:317
3045699544255,161cyclictest0-21swapper/210:28:352
304619954333,507cyclictest0-21swapper/711:15:027
304619954333,507cyclictest0-21swapper/711:15:027
304599954376,126cyclictest30667-21ssh12:37:135
304579954379,253cyclictest121rcu_preempt11:05:163
304579954379,253cyclictest121rcu_preempt11:05:163
304559954276,126cyclictest121rcu_preempt11:55:561
304559954133,127cyclictest0-21swapper/110:10:031
304559954069,211cyclictest25-21ksoftirqd/111:05:221
304559954069,211cyclictest25-21ksoftirqd/111:05:221
304619953928,170cyclictest0-21swapper/712:00:427
304599953975,84cyclictest0-21swapper/511:40:095
304599953933,83cyclictest13529-21sh11:45:475
304589953827,42cyclictest0-21swapper/411:20:304
304549953830,84cyclictest121rcu_preempt10:11:170
304599953771,211cyclictest0-21swapper/512:11:045
304569953771,84cyclictest0-21swapper/212:10:482
304589953567,338cyclictest4356-21rm12:01:144
304549953424,296cyclictest0-21swapper/011:12:070
304559953263,295cyclictest0-21swapper/112:15:031
3045799530273,126cyclictest0-21swapper/312:23:333
304609952821,256cyclictest0-21swapper/610:18:046
3045899528144,126cyclictest121rcu_preempt12:11:074
3045899526100,211cyclictest0-21swapper/411:56:384
304559952661,211cyclictest0-21swapper/112:04:231
3045899525310,84cyclictest0-21swapper/411:03:564
304579952599,295cyclictest0-21swapper/311:38:133
304549952426,380cyclictest6286-21diskmemload12:10:570
304619952214,84cyclictest0-21swapper/712:15:107
304619952110,41cyclictest0-21swapper/710:15:297
30456995188,43cyclictest3722-21ssh12:20:412
304549951811,297cyclictest0-21swapper/010:18:020
30454995159,261cyclictest0-21swapper/012:22:040
3045499515431,3cyclictest101ktimersoftd/011:48:220
304559951448,84cyclictest121rcu_preempt10:29:441
304559951347,84cyclictest121rcu_preempt11:20:231
304559951345,296cyclictest0-21swapper/112:36:461
3046099510170,338cyclictest30452-21cyclictest12:10:506
30460995090,84cyclictest0-21swapper/612:20:326
30459995092,7cyclictest121rcu_preempt10:17:385
304559950940,338cyclictest0-21swapper/111:47:471
304589950883,422cyclictest0-21swapper/411:05:064
304589950883,422cyclictest0-21swapper/411:05:064
304589950882,211cyclictest0-21swapper/412:36:374
304559950839,338cyclictest0-21swapper/112:24:361
304589950680,423cyclictest0-21swapper/411:37:464
304619950477,338cyclictest0-21swapper/707:24:157
30461995041,76cyclictest0-21swapper/711:20:227
3045799504122,85cyclictest0-21swapper/310:10:053
304549950436,337cyclictest0-21swapper/010:27:090
304589950379,338cyclictest0-21swapper/410:09:054
3045899503202,84cyclictest0-21swapper/411:12:424
3045799503121,85cyclictest0-21swapper/307:25:163
304569950381,211cyclictest0-21swapper/210:17:042
304549950238,384cyclictest0-21swapper/007:23:240
304589950178,168cyclictest0-21swapper/412:23:034
3045899499284,85cyclictest0-21swapper/410:14:304
304559949931,341cyclictest0-21swapper/110:16:391
304549949931,338cyclictest0-21swapper/011:58:010
304609949829,466cyclictest0-21swapper/611:48:096
3045999498415,4cyclictest561ktimersoftd/512:23:295
304549949834,253cyclictest0-21swapper/011:15:220
304549949834,253cyclictest0-21swapper/011:15:220
3045799497117,84cyclictest0-21swapper/310:12:323
3045799496115,84cyclictest0-21swapper/312:03:543
304569949671,211cyclictest0-21swapper/212:03:322
3045799495115,84cyclictest0-21swapper/310:15:153
3045699495280,84cyclictest0-21swapper/211:45:582
304599949470,84cyclictest0-21swapper/511:55:365
3046099493235,126cyclictest6706-21kworker/u16:011:15:096
3046099493235,126cyclictest6706-21kworker/u16:011:15:096
304589949370,211cyclictest0-21swapper/412:25:164
304559949371,253cyclictest0-21swapper/111:13:001
304549949367,253cyclictest0-21swapper/012:05:070
304599949267,84cyclictest0-21swapper/512:01:465
304559949228,295cyclictest0-21swapper/111:04:141
304549949266,211cyclictest101ktimersoftd/011:39:300
304609949177,248cyclictest13153-21ntp_kernel_err10:20:206
304569948865,84cyclictest0-21swapper/211:11:502
304609948723,253cyclictest0-21swapper/612:04:196
304619948616,467cyclictest0-21swapper/711:03:527
3045899486231,253cyclictest64450irq/122-eth010:17:394
304549948563,380cyclictest0-21swapper/012:15:110
304559948318,296cyclictest0-21swapper/110:30:041
304599948257,295cyclictest0-21swapper/511:03:385
304579948199,84cyclictest30452-21cyclictest12:35:373
304569948114,127cyclictest0-21swapper/207:25:242
304549948012,295cyclictest0-21swapper/011:50:060
304599947952,210cyclictest57-21ksoftirqd/511:13:045
30454994757,338cyclictest0-21swapper/011:05:060
30454994757,338cyclictest0-21swapper/011:05:060
30456994749,254cyclictest0-21swapper/210:11:032
304569947385,127cyclictest0-21swapper/211:04:482
30461994713,41cyclictest0-21swapper/712:25:047
304599947190,83cyclictest0-21swapper/511:39:585
3045999468167,126cyclictest121rcu_preempt11:20:155
304609946783,338cyclictest0-21swapper/611:11:246
304559946680,126cyclictest8883-21tune2fs07:25:121
30457994651,2cyclictest0-21swapper/311:04:293
3046199464124,50cyclictest0-21swapper/710:09:267
304579946441,2cyclictest0-21swapper/310:30:143
3045699464123,338cyclictest0-21swapper/211:05:072
3045699464123,338cyclictest0-21swapper/211:05:062
304609946341,338cyclictest0-21swapper/610:30:046
304609946240,256cyclictest0-21swapper/612:36:366
304589946278,169cyclictest49-21ksoftirqd/411:49:424
3045899462121,338cyclictest0-21swapper/411:40:164
3045499462122,338cyclictest1898-21idleruntime11:40:200
3045799461122,84cyclictest0-21swapper/312:05:073
304559946140,210cyclictest0-21swapper/112:25:071
3045799460119,338cyclictest0-21swapper/308:18:443
304559946038,255cyclictest0-21swapper/112:05:101
304559946037,210cyclictest0-21swapper/107:23:071
304549946038,338cyclictest0-21swapper/009:47:440
304599945837,255cyclictest0-21swapper/511:19:545
304599945837,255cyclictest0-21swapper/511:19:545
304609945772,211cyclictest0-21swapper/611:20:146
304609945734,257cyclictest0-21swapper/611:50:036
3045999457116,126cyclictest0-21swapper/510:13:085
304569945734,3cyclictest0-21swapper/211:57:462
3046099456116,338cyclictest0-21swapper/610:10:006
3045699456115,338cyclictest0-21swapper/212:35:332
304549945634,338cyclictest0-21swapper/010:30:040
304549945634,219cyclictest0-21swapper/010:09:400
304559945533,3cyclictest0-21swapper/108:18:311
3045799454115,84cyclictest0-21swapper/307:24:263
3046199453113,126cyclictest1932-21if_enp3s011:40:217
3045699453111,169cyclictest33-21ksoftirqd/210:09:482
304609945123,127cyclictest23323-21ssh12:15:116
3045899451111,338cyclictest0-21swapper/412:15:174
304569945166,211cyclictest0-21swapper/207:24:282
304609945028,3cyclictest0-21swapper/611:05:466
304609945028,3cyclictest0-21swapper/611:05:466
304589945027,169cyclictest0-21swapper/411:50:054
304569945070,169cyclictest0-21swapper/211:19:402
304569945070,169cyclictest0-21swapper/211:19:402
3045699450108,339cyclictest0-21swapper/211:50:082
304559945024,168cyclictest0-21swapper/111:15:191
304559945024,168cyclictest0-21swapper/111:15:191
304619944927,3cyclictest0-21swapper/708:18:307
3046199449106,340cyclictest16594-21runrttasks11:50:077
304589944826,219cyclictest0-21swapper/410:30:124
3045799448109,84cyclictest0-21swapper/312:15:043
304609944522,256cyclictest0-21swapper/607:25:216
3045999444102,126cyclictest121rcu_preempt11:05:375
3045999444102,126cyclictest121rcu_preempt11:05:365
304609944321,256cyclictest0-21swapper/611:04:466
304569944220,84cyclictest0-21swapper/210:30:112
304619944114,42cyclictest0-21swapper/712:30:247
304589944017,3cyclictest0-21swapper/412:05:104
304599943913,253cyclictest121rcu_preempt10:10:035
304579943998,338cyclictest0-21swapper/312:25:143
304549943917,2cyclictest0-21swapper/008:18:300
304599943816,2cyclictest0-21swapper/512:15:135
304579943897,338cyclictest0-21swapper/311:50:073
304619943756,84cyclictest0-21swapper/710:30:037
304559943716,255cyclictest0-21swapper/111:50:041
304549943796,338cyclictest0-21swapper/010:20:200
304549943711,253cyclictest0-21swapper/012:30:250
30458994297,256cyclictest0-21swapper/407:25:214
30459994286,295cyclictest0-21swapper/512:25:065
304599942788,84cyclictest9022-21fschecks_time07:25:185
3045699427253,84cyclictest0-21swapper/211:40:052
304569942610,248cyclictest0-21swapper/211:20:352
30461994241,256cyclictest0-21swapper/707:25:217
30459994241,256cyclictest0-21swapper/508:18:305
30455994231,338cyclictest0-21swapper/111:40:151
304549942382,338cyclictest0-21swapper/012:25:240
304609942282,338cyclictest0-21swapper/607:24:396
304589942281,338cyclictest0-21swapper/411:15:094
304589942281,338cyclictest0-21swapper/411:15:084
304599942183,84cyclictest0-21swapper/507:24:045
304589942179,338cyclictest0-21swapper/407:24:054
304559942180,338cyclictest0-21swapper/110:20:201
304549942181,337cyclictest0-21swapper/007:25:150
304549942041,295cyclictest0-21swapper/011:20:120
304569941978,338cyclictest0-21swapper/212:25:142
304559941939,296cyclictest0-21swapper/109:47:401
304599941876,84cyclictest0-21swapper/512:30:215
304619941777,338cyclictest0-21swapper/710:20:207
304609941736,250cyclictest0-21swapper/612:25:216
304609941535,296cyclictest0-21swapper/609:47:446
304599941576,84cyclictest0-21swapper/512:05:065
304579941534,296cyclictest0-21swapper/311:40:193
304619941130,296cyclictest0-21swapper/709:47:567
304599941026,84cyclictest0-21swapper/510:30:135
304579940969,338cyclictest0-21swapper/309:47:393
304579940967,339cyclictest0-21swapper/310:20:193
304589940868,338cyclictest0-21swapper/409:47:404
304569940868,84cyclictest0-21swapper/212:05:042
304569940767,84cyclictest0-21swapper/209:47:212
304599940365,84cyclictest0-21swapper/511:50:095
304569940162,84cyclictest0-21swapper/208:19:072
304569940115,126cyclictest33-21ksoftirqd/210:20:252
304609939960,84cyclictest0-21swapper/612:05:066
304609939553,339cyclictest0-21swapper/611:40:056
304599939556,84cyclictest0-21swapper/510:20:245
304599939413,126cyclictest20207-21sh09:47:405
30457993888,295cyclictest0-21swapper/312:40:233
30456993871,211cyclictest0-21swapper/212:40:232
304559938649,253cyclictest0-21swapper/112:40:231
304569937334,84cyclictest0-21swapper/212:15:112
304609937130,339cyclictest0-21swapper/612:30:206
304589936426,171cyclictest0-21swapper/408:18:314
304579936427,253cyclictest0-21swapper/312:30:243
304609936322,338cyclictest0-21swapper/608:18:566
304589935818,84cyclictest0-21swapper/410:20:244
304559935513,211cyclictest18860-21ls12:30:221
304609934912,253cyclictest0-21swapper/612:40:236
30454993392,253cyclictest0-21swapper/012:40:240
304569932126,84cyclictest33-21ksoftirqd/212:30:202
304589932064,253cyclictest0-21swapper/412:30:254
3046199293123,84cyclictest5411-21ssh12:40:247
304589927922,126cyclictest0-21swapper/412:40:244
304599926816,169cyclictest0-21swapper/512:40:235
2910029893,2sleep20-21swapper/207:05:212
41412950,1sleep00-21swapper/008:10:190
2970829062,5sleep40-21swapper/407:05:314
2794529086,1sleep30-21swapper/307:05:143
2980428755,28sleep70-21swapper/707:06:557
53942850,0sleep50-21swapper/509:05:205
2998528351,28sleep60-21swapper/607:09:276
2985128353,27sleep50-21swapper/507:07:335
3000628251,27sleep00-21swapper/007:09:450
2994028149,28sleep10-21swapper/107:08:501
206442800,0sleep40-21swapper/410:41:174
103732700,2sleep50-21swapper/508:20:265
28322690,0sleep00-21swapper/009:39:430
30455994921,25cyclictest24517-21cut09:50:181
3045599438,30cyclictest10441-21switchtime08:20:281
3046099351,30cyclictest0-21swapper/609:50:226
30461993428,3cyclictest0-21swapper/708:20:037
30455993410,23cyclictest0-21swapper/109:31:181
3046099331,29cyclictest0-21swapper/608:20:096
3045899331,3cyclictest64450irq/122-eth009:50:104
3045799331,3cyclictest0-21swapper/308:20:063
3045499331,29cyclictest0-21swapper/009:50:220
30461993224,5cyclictest23648-21cut09:50:137
30454993210,0cyclictest0-21swapper/009:31:160
30460993126,4cyclictest0-21swapper/607:51:356
30460993110,0cyclictest0-21swapper/609:30:386
3045999316,17cyclictest57-21ksoftirqd/509:50:185
3045899311,2cyclictest0-21swapper/408:20:014
30457993125,3cyclictest25833-21ssh09:50:303
3045699319,11cyclictest33-21ksoftirqd/209:50:312
30455993110,20cyclictest0-21swapper/108:51:441
30455993110,20cyclictest0-21swapper/107:51:401
30454993126,5cyclictest0-21swapper/009:08:230
30454993126,4cyclictest0-21swapper/007:19:570
3045499311,2cyclictest0-21swapper/008:20:090
3045699306,11cyclictest121rcu_preempt08:20:132
30455993026,3cyclictest0-21swapper/109:43:271
30455993010,19cyclictest0-21swapper/107:59:151
30461992910,18cyclictest0-21swapper/709:17:307
30455992910,19cyclictest0-21swapper/107:19:571
30461992810,18cyclictest0-21swapper/709:43:217
30461992810,18cyclictest0-21swapper/708:28:207
30460992826,2cyclictest0-21swapper/607:59:486
30460992810,18cyclictest0-21swapper/608:51:246
30458992810,18cyclictest0-21swapper/407:14:084
30457992828,0cyclictest0-21swapper/308:35:513
30457992810,18cyclictest0-21swapper/309:30:473
30457992810,0cyclictest0-21swapper/309:17:493
30457992810,0cyclictest0-21swapper/309:01:153
30457992810,0cyclictest0-21swapper/308:07:393
30456992810,0cyclictest0-21swapper/207:51:362
30455992810,0cyclictest0-21swapper/107:14:071
30454992810,0cyclictest0-21swapper/007:14:000
30461992727,0cyclictest0-21swapper/708:42:587
30461992727,0cyclictest0-21swapper/707:44:237
30461992710,17cyclictest0-21swapper/709:30:497
30461992710,17cyclictest0-21swapper/708:51:337
30461992710,17cyclictest0-21swapper/708:35:537
30461992710,17cyclictest0-21swapper/708:07:447
30461992710,17cyclictest0-21swapper/707:36:487
30461992710,0cyclictest0-21swapper/709:08:187
30460992727,0cyclictest0-21swapper/609:17:286
30460992727,0cyclictest0-21swapper/607:36:406
30460992710,17cyclictest0-21swapper/608:28:056
30460992710,17cyclictest0-21swapper/607:44:126
30460992710,0cyclictest0-21swapper/609:43:076
30460992710,0cyclictest0-21swapper/609:08:216
30460992710,0cyclictest0-21swapper/609:01:276
30460992710,0cyclictest0-21swapper/608:43:226
30460992710,0cyclictest0-21swapper/608:35:226
30460992710,0cyclictest0-21swapper/607:13:546
30459992710,17cyclictest0-21swapper/509:43:035
30459992710,17cyclictest0-21swapper/509:17:175
30459992710,17cyclictest0-21swapper/509:01:075
30459992710,17cyclictest0-21swapper/508:42:575
30459992710,17cyclictest0-21swapper/508:27:525
30459992710,17cyclictest0-21swapper/507:59:455
30459992710,17cyclictest0-21swapper/507:51:205
30459992710,17cyclictest0-21swapper/507:44:315
30459992710,17cyclictest0-21swapper/507:36:495
30459992710,0cyclictest0-21swapper/509:30:445
30458992727,0cyclictest0-21swapper/409:43:114
30458992726,1cyclictest0-21swapper/409:30:344
30458992710,17cyclictest0-21swapper/408:35:424
30458992710,17cyclictest0-21swapper/408:28:064
30458992710,17cyclictest0-21swapper/408:07:344
30458992710,17cyclictest0-21swapper/407:59:224
30458992710,17cyclictest0-21swapper/407:44:154
30458992710,0cyclictest0-21swapper/409:17:354
30458992710,0cyclictest0-21swapper/409:08:384
30458992710,0cyclictest0-21swapper/409:01:034
30458992710,0cyclictest0-21swapper/408:51:274
30458992710,0cyclictest0-21swapper/407:51:084
30458992710,0cyclictest0-21swapper/407:36:434
30457992710,17cyclictest0-21swapper/309:08:233
30457992710,0cyclictest0-21swapper/309:43:193
30457992710,0cyclictest0-21swapper/308:15:003
30457992710,0cyclictest0-21swapper/307:59:253
30457992710,0cyclictest0-21swapper/307:51:213
30457992710,0cyclictest0-21swapper/307:44:243
30457992710,0cyclictest0-21swapper/307:36:543
30456992727,0cyclictest0-21swapper/207:44:182
30456992710,17cyclictest0-21swapper/208:51:312
30456992710,17cyclictest0-21swapper/208:42:492
30456992710,17cyclictest0-21swapper/208:36:012
30456992710,17cyclictest0-21swapper/208:27:562
30456992710,17cyclictest0-21swapper/207:36:392
30456992710,0cyclictest0-21swapper/209:42:582
30456992710,0cyclictest0-21swapper/209:30:412
30456992710,0cyclictest0-21swapper/209:17:312
30456992710,0cyclictest0-21swapper/209:01:162
30456992710,0cyclictest0-21swapper/208:07:272
30456992710,0cyclictest0-21swapper/207:59:162
30456992710,0cyclictest0-21swapper/207:19:542
30456992710,0cyclictest0-21swapper/207:13:582
30455992727,0cyclictest0-21swapper/109:08:161
30455992727,0cyclictest0-21swapper/107:36:451
30455992710,17cyclictest0-21swapper/108:42:591
30455992710,17cyclictest0-21swapper/108:35:431
30455992710,17cyclictest0-21swapper/108:28:001
30455992710,17cyclictest0-21swapper/108:07:341
30455992710,17cyclictest0-21swapper/107:44:181
30455992710,0cyclictest0-21swapper/109:17:281
30455992710,0cyclictest0-21swapper/108:14:591
30454992727,0cyclictest0-21swapper/007:44:240
30454992710,17cyclictest0-21swapper/009:42:560
30454992710,17cyclictest0-21swapper/008:51:230
30454992710,17cyclictest0-21swapper/008:36:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional