You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-27 - 06:46
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Mon Jul 27, 2026 00:54:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
222449978769,634cyclictest0-21swapper/122:44:401
2224499761124,634cyclictest0-21swapper/123:27:311
222479974061,84cyclictest0-21swapper/421:39:054
2224999719208,296cyclictest0-21swapper/622:02:366
222449971434,550cyclictest29840-21diskmemload22:00:521
222489970933,50cyclictest0-21swapper/500:18:345
222449970727,677cyclictest0-21swapper/121:45:341
222439969115,211cyclictest0-21swapper/023:27:020
222479968188,126cyclictest0-21swapper/420:13:424
222479968188,126cyclictest0-21swapper/420:13:424
22244996780,42cyclictest0-21swapper/123:19:131
2224899662576,84cyclictest551rcuc/522:29:215
22244996351,471cyclictest0-21swapper/121:35:281
2224599634548,84cyclictest311rcuc/223:13:172
2224999630119,295cyclictest0-21swapper/600:05:266
222449962732,380cyclictest0-21swapper/100:31:271
2224799621198,211cyclictest15759-21kworker/u16:121:25:134
222509961825,126cyclictest0-21swapper/723:12:427
2224499612102,295cyclictest0-21swapper/123:05:231
222509960511,126cyclictest0-21swapper/723:05:127
222469960411,341cyclictest0-21swapper/321:39:223
222459960046,381cyclictest24874-21turbostat.cron19:15:012
222459959685,297cyclictest0-21swapper/223:04:372
22245995950,84cyclictest0-21swapper/221:39:202
2224399588119,253cyclictest1553-21runrttasks00:17:170
2224799586246,85cyclictest17340-21kworker/4:223:12:104
2224699583113,467cyclictest0-21swapper/321:30:183
2224899582112,296cyclictest0-21swapper/520:11:425
2224899582112,296cyclictest0-21swapper/520:11:415
2224399582242,338cyclictest23941-1kworker/u17:222:04:500
2224599581113,465cyclictest0-21swapper/221:30:172
222449958128,465cyclictest0-21swapper/122:00:031
2224399581113,211cyclictest1551-21snmpd23:53:430
222449957871,296cyclictest0-21swapper/123:03:371
2224699576107,296cyclictest0-21swapper/300:32:413
222449957626,44cyclictest0-21swapper/122:54:411
222489957567,84cyclictest0-21swapper/522:01:315
222489957524,126cyclictest0-21swapper/500:04:565
222489957524,126cyclictest0-21swapper/500:04:565
222439957424,42cyclictest0-21swapper/020:26:400
222439957261,338cyclictest0-21swapper/021:57:290
222469957019,92cyclictest0-21swapper/321:55:513
2224599567309,127cyclictest0-21swapper/222:45:202
222489956512,127cyclictest14653-21ssh23:39:495
222449956512,126cyclictest0-21swapper/121:20:031
222439956414,338cyclictest0-21swapper/021:30:280
222479956294,295cyclictest0-21swapper/422:53:034
2224799562135,296cyclictest28610-21ls00:05:014
2224799562135,296cyclictest28610-21ls00:05:014
222469956212,127cyclictest22241-21cyclictest22:42:293
222479956052,378cyclictest0-21swapper/423:29:534
22246995609,126cyclictest0-21swapper/322:53:033
222479955910,126cyclictest0-21swapper/400:05:074
2224499553124,381cyclictest0-21swapper/120:13:421
2224499553124,381cyclictest0-21swapper/120:13:421
2224899550340,84cyclictest29840-21diskmemload00:38:395
2224799549208,338cyclictest64450irq/122-eth023:05:124
222459954981,465cyclictest0-21swapper/221:56:532
222459954880,465cyclictest0-21swapper/222:00:422
22244995480,3cyclictest0-21swapper/100:04:251
22244995480,3cyclictest0-21swapper/100:04:251
222499954739,172cyclictest0-21swapper/621:39:226
222459954680,211cyclictest0-21swapper/200:12:252
222449954476,465cyclictest0-21swapper/100:18:031
222449954333,507cyclictest0-21swapper/123:54:001
222439954337,254cyclictest0-21swapper/020:14:430
222439954337,254cyclictest0-21swapper/020:14:430
2224899542115,338cyclictest0-21swapper/522:17:035
222509954031,127cyclictest0-21swapper/700:32:387
222479954071,295cyclictest0-21swapper/422:01:454
222449954072,465cyclictest16049-21ssh23:40:151
222449954072,465cyclictest16049-21ssh23:40:151
222509953971,465cyclictest0-21swapper/700:38:327
2224999539163,296cyclictest29840-21diskmemload23:18:596
222439953827,338cyclictest0-21swapper/023:02:450
222469953670,84cyclictest22241-21cyclictest21:20:143
222449953666,338cyclictest0-21swapper/100:05:261
222509953567,465cyclictest0-21swapper/721:57:227
2224899535194,338cyclictest25623-21latency_hist22:00:025
222489953423,338cyclictest0-21swapper/521:37:415
2224399534111,90cyclictest121rcu_preempt00:05:580
222449953264,342cyclictest0-21swapper/100:21:431
2224499530104,296cyclictest422-21ssh23:12:421
2224599529145,211cyclictest0-21swapper/220:13:072
2224599529145,211cyclictest0-21swapper/220:13:072
2224399528144,253cyclictest0-21swapper/023:05:120
222449952619,304cyclictest0-21swapper/120:29:591
2224999524143,84cyclictest121rcu_preempt21:57:166
2224599524225,168cyclictest0-21swapper/223:26:462
222469952315,211cyclictest0-21swapper/323:30:083
222469952214,126cyclictest0-21swapper/322:01:193
222449952111,387cyclictest0-21swapper/119:14:591
222509952013,84cyclictest0-21swapper/723:34:587
222489952010,507cyclictest0-21swapper/500:32:385
222449952052,465cyclictest0-21swapper/100:38:451
22243995168,126cyclictest0-21swapper/000:32:380
222479951043,83cyclictest0-21swapper/421:57:054
22245995081,125cyclictest0-21swapper/220:25:422
222439950882,211cyclictest9-21ksoftirqd/021:45:550
222489950786,126cyclictest29840-21diskmemload23:30:185
22248995071,46cyclictest0-21swapper/523:18:055
222459950781,211cyclictest0-21swapper/222:43:552
222449950580,422cyclictest0-21swapper/100:42:191
2224499505124,338cyclictest0-21swapper/123:35:251
222439950539,84cyclictest15675-21kworker/0:023:47:210
222509950478,423cyclictest0-21swapper/722:43:077
222479950480,83cyclictest0-21swapper/421:30:174
222459950482,338cyclictest0-21swapper/223:47:322
2224599504123,84cyclictest121rcu_preempt00:04:552
2224599504123,84cyclictest121rcu_preempt00:04:552
2225099503119,381cyclictest5035-21cpuspeed_turbos21:30:187
222499950335,211cyclictest0-21swapper/600:21:086
222439950276,126cyclictest0-21swapper/021:19:270
2224899501121,84cyclictest0-21swapper/523:58:475
222459950179,338cyclictest0-21swapper/220:15:092
222509949977,338cyclictest0-21swapper/720:15:097
222479949974,422cyclictest0-21swapper/423:39:214
222479949935,84cyclictest0-21swapper/421:40:094
2224599499114,339cyclictest0-21swapper/221:14:122
222489949832,211cyclictest0-21swapper/522:55:015
222459949774,126cyclictest121rcu_preempt00:05:252
2224499497242,253cyclictest241ktimersoftd/123:30:081
222509949670,210cyclictest17278-21ssh23:04:457
222499949631,84cyclictest0-21swapper/623:58:546
222499949568,211cyclictest65-21ksoftirqd/622:10:176
222489949526,296cyclictest0-21swapper/523:53:385
222489949523,380cyclictest0-21swapper/521:45:305
222509949429,345cyclictest23941-1kworker/u17:222:04:467
2224399494110,84cyclictest121rcu_preempt22:53:440
2224399494110,211cyclictest698-21ptp4l20:15:180
222479949328,126cyclictest30729-21ssh23:47:464
222509949265,211cyclictest0-21swapper/721:38:177
2224899492107,127cyclictest29840-21diskmemload23:04:445
2224499490107,380cyclictest0-21swapper/121:30:181
222499948962,211cyclictest65-21ksoftirqd/623:03:306
222489948968,337cyclictest0-21swapper/520:15:095
222489948920,465cyclictest0-21swapper/523:12:215
222449948823,301cyclictest18358-21sh23:59:061
222499948765,84cyclictest0-21swapper/623:14:116
2224999487147,338cyclictest22241-21cyclictest00:42:036
222439948723,41cyclictest0-21swapper/021:36:050
222439948659,211cyclictest9-21ksoftirqd/023:18:280
2224399486145,338cyclictest22241-21cyclictest23:12:180
222509948560,211cyclictest0-21swapper/722:53:137
222499948520,84cyclictest121rcu_preempt21:30:116
2224899485106,295cyclictest0-21swapper/522:10:175
222489948415,338cyclictest0-21swapper/500:05:415
222479948416,379cyclictest0-21swapper/400:12:034
222499948399,211cyclictest0-21swapper/600:18:046
222509948259,85cyclictest0-21swapper/723:39:517
222459948299,380cyclictest0-21swapper/200:32:382
222459948218,42cyclictest0-21swapper/221:20:172
222449948215,423cyclictest0-21swapper/120:04:251
222469948053,211cyclictest41-21ksoftirqd/323:26:383
222469947996,211cyclictest29752-21ssh00:05:193
222459947954,423cyclictest16894-1kworker/u17:023:19:502
222459947920,37cyclictest0-21swapper/200:38:392
222509947851,211cyclictest73-21ksoftirqd/723:18:327
222509947812,211cyclictest704-21nscd00:18:047
2224599476265,8cyclictest0-21swapper/223:05:272
22243994755,254cyclictest0-21swapper/023:34:580
222489947494,83cyclictest22241-21cyclictest00:12:275
2224499474219,253cyclictest241ktimersoftd/122:05:121
222479947150,85cyclictest0-21swapper/400:38:384
222489947043,254cyclictest0-21swapper/520:25:465
222499946988,85cyclictest22241-21cyclictest00:27:216
222499946988,85cyclictest22241-21cyclictest00:27:216
222489946947,84cyclictest0-21swapper/500:21:455
222499946847,85cyclictest0-21swapper/600:38:386
22248994684,301cyclictest0-21swapper/500:41:345
222479946843,422cyclictest0-21swapper/400:18:064
222459946845,84cyclictest0-21swapper/221:40:212
22243994680,42cyclictest0-21swapper/000:21:250
222509946783,211cyclictest73-21ksoftirqd/721:14:067
222509946782,296cyclictest0-21swapper/720:25:427
222479946783,253cyclictest49-21ksoftirqd/423:59:114
2224399467168,126cyclictest121rcu_preempt21:53:110
2224399467168,126cyclictest121rcu_preempt21:53:110
2225099466336,84cyclictest0-21swapper/719:15:017
222499946645,83cyclictest0-21swapper/622:44:476
222469946580,211cyclictest0-21swapper/300:18:323
222499946480,211cyclictest65-21ksoftirqd/623:27:126
2224899464125,84cyclictest0-21swapper/522:44:585
2224499464124,338cyclictest0-21swapper/121:40:071
222499946341,339cyclictest28480-21ssh00:04:526
222499946341,339cyclictest28480-21ssh00:04:516
222489946376,126cyclictest121rcu_preempt19:15:025
2224899463125,84cyclictest0-21swapper/520:30:075
2224899463125,84cyclictest0-21swapper/520:30:065
2224899463124,84cyclictest0-21swapper/523:29:465
2224899463122,338cyclictest0-21swapper/521:30:135
2224699463122,127cyclictest29840-21diskmemload23:18:233
2224399463122,338cyclictest28365-21taskset00:04:410
2224399463122,338cyclictest28365-21taskset00:04:410
222499946282,84cyclictest0-21swapper/622:54:376
2224699462163,126cyclictest41-21ksoftirqd/320:15:013
2224499462122,338cyclictest31663-21ssh22:55:071
2224499462121,338cyclictest13024-21sh22:10:271
2224899461121,338cyclictest0-21swapper/523:40:295
2224899461121,338cyclictest0-21swapper/523:40:295
222459946176,211cyclictest1731-21sed21:45:302
2224499461124,84cyclictest0-21swapper/119:15:161
2224499461124,84cyclictest0-21swapper/119:15:161
2224499461123,84cyclictest0-21swapper/122:45:111
222439946142,84cyclictest121rcu_preempt22:44:140
222439946134,211cyclictest0-21swapper/021:40:060
222489946080,296cyclictest0-21swapper/520:44:395
2224899460120,338cyclictest0-21swapper/521:20:105
2224899460120,338cyclictest0-21swapper/519:15:185
2224899460120,338cyclictest0-21swapper/519:15:185
2224399460161,126cyclictest121rcu_preempt21:25:120
222489945979,296cyclictest0-21swapper/521:25:135
222449945979,259cyclictest0-21swapper/121:19:251
2225099458242,86cyclictest0-21swapper/700:42:207
222489945878,256cyclictest704-21nscd21:53:045
222489945878,256cyclictest704-21nscd21:53:045
2224799458117,338cyclictest0-21swapper/423:53:584
2224599458116,339cyclictest0-21swapper/223:40:282
2224599458116,339cyclictest0-21swapper/223:40:282
222499945776,84cyclictest0-21swapper/620:29:266
222479945777,83cyclictest0-21swapper/422:29:274
222459945735,169cyclictest1551-21snmpd21:25:192
222449945730,85cyclictest0-21swapper/121:53:021
222449945730,85cyclictest0-21swapper/121:53:021
222489945629,253cyclictest0-21swapper/522:55:135
222459945676,296cyclictest0-21swapper/222:54:312
222439945672,211cyclictest0-21swapper/000:41:360
222509945576,295cyclictest0-21swapper/719:15:157
222509945576,295cyclictest0-21swapper/719:15:147
222509945574,297cyclictest0-21swapper/720:44:397
2225099455158,84cyclictest121rcu_preempt20:10:417
2225099455158,84cyclictest121rcu_preempt20:10:417
222449945533,343cyclictest0-21swapper/123:47:471
222509945473,297cyclictest0-21swapper/723:53:447
2224599454114,167cyclictest33-21ksoftirqd/223:52:262
222439945470,211cyclictest0-21swapper/023:40:140
222439945470,211cyclictest0-21swapper/023:40:140
2225099453111,339cyclictest0-21swapper/721:40:207
222499945373,84cyclictest0-21swapper/623:47:326
222499945331,211cyclictest28879-21sed20:10:396
222499945331,211cyclictest28879-21sed20:10:396
222489945331,255cyclictest0-21swapper/523:05:195
222439945370,253cyclictest121rcu_preempt23:39:490
222499945273,83cyclictest0-21swapper/621:20:046
222479945274,84cyclictest0-21swapper/422:44:164
222479945272,168cyclictest0-21swapper/420:29:304
2224999451195,254cyclictest0-21swapper/622:05:126
222459945168,211cyclictest0-21swapper/222:55:132
222499945069,84cyclictest13900-21ssh00:31:146
222499945026,169cyclictest0-21swapper/623:35:036
222439945075,372cyclictest0-21swapper/000:38:280
222469944971,82cyclictest0-21swapper/323:14:113
222469944922,211cyclictest0-21swapper/323:05:123
222449944927,255cyclictest0-21swapper/100:27:131
222449944927,255cyclictest0-21swapper/100:27:131
222449944923,423cyclictest0-21swapper/122:17:031
2224399449110,84cyclictest121rcu_preempt22:30:170
222509944826,84cyclictest0-21swapper/723:28:217
222509944821,211cyclictest0-21swapper/721:20:097
222509944723,84cyclictest0-21swapper/723:47:487
2225099447105,339cyclictest23831-1kworker/u17:121:25:137
222479944726,84cyclictest0-21swapper/420:44:394
222469944762,84cyclictest0-21swapper/322:29:263
2224499447105,339cyclictest0-21swapper/122:29:271
2224599446274,84cyclictest27516-21rm00:21:132
2224399446109,211cyclictest0-21swapper/023:59:220
222489944565,296cyclictest0-21swapper/523:47:325
2224999444103,338cyclictest0-21swapper/623:05:386
222479944416,296cyclictest0-21swapper/400:21:064
222439944460,211cyclictest0-21swapper/000:12:390
222439944421,256cyclictest0-21swapper/022:55:120
222499944362,84cyclictest0-21swapper/622:29:276
222469944317,296cyclictest31974-21wc21:45:133
222459944319,92cyclictest121rcu_preempt00:18:042
222469944258,169cyclictest0-21swapper/320:10:303
2224799441142,126cyclictest10894-21cpuspeed_turbos22:10:174
2224799441104,172cyclictest0-21swapper/419:15:014
2224699441102,84cyclictest0-21swapper/322:23:373
2224399440103,253cyclictest10902-21grep22:10:170
222459943917,2cyclictest0-21swapper/223:59:252
222449943916,296cyclictest0-21swapper/120:20:131
222439943955,126cyclictest6078-21ssh21:14:120
222469943899,84cyclictest0-21swapper/321:25:193
222469943899,84cyclictest0-21swapper/321:19:323
222469943812,211cyclictest41-21ksoftirqd/321:40:213
222459943857,84cyclictest0-21swapper/223:30:072
222439943859,84cyclictest121rcu_preempt00:27:140
222439943859,84cyclictest121rcu_preempt00:27:140
222499943715,84cyclictest0-21swapper/623:53:446
222449943715,176cyclictest1553-21runrttasks21:25:181
222469943561,84cyclictest0-21swapper/323:59:273
222469943511,126cyclictest0-21swapper/320:29:233
222509943412,84cyclictest0-21swapper/700:04:217
222509943412,84cyclictest0-21swapper/700:04:217
222469943455,84cyclictest1651-21ntpd00:04:263
222469943455,84cyclictest1651-21ntpd00:04:263
222509943349,126cyclictest18017-21ssh23:40:347
222509943349,126cyclictest18017-21ssh23:40:347
22247994339,211cyclictest0-21swapper/423:30:084
222469943394,84cyclictest0-21swapper/322:05:113
22245994336,86cyclictest0-21swapper/222:10:112
222479943211,2cyclictest0-21swapper/400:41:564
222479943150,84cyclictest0-21swapper/421:45:554
22250994307,256cyclictest0-21swapper/700:05:077
222499942949,85cyclictest0-21swapper/600:12:276
22249994291,169cyclictest0-21swapper/621:14:116
222469942990,84cyclictest1651-21ntpd00:21:133
22246994292,211cyclictest41-21ksoftirqd/323:40:043
22246994292,211cyclictest41-21ksoftirqd/323:40:043
22246994292,211cyclictest41-21ksoftirqd/300:42:233
222509942887,338cyclictest0-21swapper/721:45:337
22245994252,262cyclictest0-21swapper/200:42:102
222509942483,338cyclictest0-21swapper/722:10:287
222479942482,84cyclictest0-21swapper/421:20:084
2224799424172,168cyclictest481ktimersoftd/423:05:004
222459942483,338cyclictest0-21swapper/219:15:182
222459942483,338cyclictest0-21swapper/219:15:182
222449942482,339cyclictest0-21swapper/121:14:061
222499942384,84cyclictest13136-21ssh22:45:036
222439942383,337cyclictest0-21swapper/020:56:510
222439942382,338cyclictest0-21swapper/021:20:120
222509942281,126cyclictest0-21swapper/723:58:477
222499942283,84cyclictest698-21ptp4l21:40:206
222499942283,84cyclictest0-21swapper/623:40:026
222499942283,84cyclictest0-21swapper/623:40:016
222499942282,84cyclictest0-21swapper/621:19:326
222489942282,338cyclictest0-21swapper/522:23:385
222469942283,84cyclictest0-21swapper/323:53:443
222469942283,84cyclictest0-21swapper/323:39:353
222469942283,84cyclictest0-21swapper/319:15:053
222469942283,84cyclictest0-21swapper/319:15:053
222469942283,84cyclictest0-21swapper/300:12:033
222509942180,338cyclictest0-21swapper/720:30:087
222509942180,338cyclictest0-21swapper/720:30:087
222499942141,168cyclictest0-21swapper/621:53:126
222499942141,168cyclictest0-21swapper/621:53:116
222479942185,256cyclictest0-21swapper/422:55:124
222479942183,83cyclictest0-21swapper/423:18:444
22247994210,218cyclictest0-21swapper/422:16:564
222469942182,84cyclictest0-21swapper/323:03:303
2224699421121,127cyclictest13022-21ls22:10:283
222459942180,338cyclictest0-21swapper/223:35:262
222489942040,296cyclictest0-21swapper/500:27:335
222489942040,296cyclictest0-21swapper/500:27:335
222459942079,338cyclictest0-21swapper/222:29:262
222439942080,338cyclictest0-21swapper/020:30:150
222439942080,338cyclictest0-21swapper/020:30:150
222439941978,338cyclictest0-21swapper/022:45:030
222489941877,338cyclictest0-21swapper/521:40:215
222489941838,297cyclictest0-21swapper/522:30:175
222479941879,84cyclictest0-21swapper/422:05:094
222459941879,337cyclictest0-21swapper/220:30:082
222459941879,337cyclictest0-21swapper/220:30:082
22244994181,78cyclictest10924-21ssh00:12:271
2225099417161,84cyclictest0-21swapper/700:27:217
2225099417161,84cyclictest0-21swapper/700:27:207
222489941776,338cyclictest0-21swapper/521:14:055
222479941779,84cyclictest0-21swapper/423:40:204
222479941779,84cyclictest0-21swapper/423:40:204
222479941779,84cyclictest0-21swapper/423:20:154
222479941779,83cyclictest0-21swapper/400:27:374
222479941779,83cyclictest0-21swapper/400:27:374
222459941776,338cyclictest0-21swapper/200:27:372
222459941776,338cyclictest0-21swapper/200:27:372
222439941777,338cyclictest0-21swapper/022:29:260
222439941776,338cyclictest0-21swapper/022:23:380
222509941676,338cyclictest0-21swapper/722:55:077
222509941675,338cyclictest0-21swapper/722:45:037
222489941676,84cyclictest0-21swapper/520:20:195
222489941674,84cyclictest0-21swapper/522:05:125
222479941678,84cyclictest0-21swapper/420:30:054
222479941678,84cyclictest0-21swapper/420:30:054
222469941677,84cyclictest0-21swapper/323:47:223
222469941676,84cyclictest0-21swapper/300:38:383
222459941635,83cyclictest1553-21runrttasks21:19:252
222449941535,296cyclictest0-21swapper/120:44:391
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional