You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-29 - 00:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Fri Aug 28, 2026 12:54:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
253279970224,41cyclictest0-21swapper/312:42:003
2532499657107,126cyclictest0-21swapper/011:25:590
2532499657107,126cyclictest0-21swapper/011:25:590
2532699633124,126cyclictest17211-21sh11:03:432
253319962271,126cyclictest0-21swapper/712:17:047
253249962273,84cyclictest0-21swapper/010:03:370
253309960859,92cyclictest25322-21cyclictest11:45:346
253279960712,592cyclictest0-21swapper/311:42:033
25327996059,380cyclictest0-21swapper/310:06:543
253259960050,84cyclictest25322-21cyclictest10:18:591
25325995930,84cyclictest0-21swapper/110:04:361
2533199590507,3cyclictest711rcuc/710:53:437
253279958535,427cyclictest0-21swapper/311:27:003
253279958535,427cyclictest0-21swapper/311:27:003
253279958067,381cyclictest0-21swapper/310:52:333
2532999578279,126cyclictest0-21swapper/510:19:375
253319957425,84cyclictest0-21swapper/711:28:337
253319957425,84cyclictest0-21swapper/711:28:337
253269957020,84cyclictest0-21swapper/210:01:122
2532799569486,3cyclictest391rcuc/311:46:003
253289956826,373cyclictest0-21swapper/410:31:564
253299956756,338cyclictest121rcu_preempt11:04:295
253289956251,338cyclictest0-21swapper/410:19:004
2532699559476,3cyclictest311rcuc/210:18:532
25329995577,126cyclictest16100-21diskmemload10:10:025
25327995552,550cyclictest0-21swapper/310:19:193
2533199554127,126cyclictest73-21ksoftirqd/712:02:187
253249955486,253cyclictest17169-21rm11:03:370
253309955244,126cyclictest0-21swapper/610:52:326
25330995520,85cyclictest0-21swapper/610:34:576
25329995510,84cyclictest0-21swapper/510:34:575
2532499551124,296cyclictest0-21swapper/010:06:180
253259955081,296cyclictest0-21swapper/110:33:381
2532999548335,126cyclictest0-21swapper/512:02:235
2532499548161,126cyclictest121rcu_preempt12:21:360
2532899547164,212cyclictest15368-21rm11:38:004
2532599547294,41cyclictest0-21swapper/108:48:291
253269954578,127cyclictest0-21swapper/211:23:342
253259954540,340cyclictest0-21swapper/108:13:281
2533199544461,3cyclictest721ktimersoftd/711:51:157
253299954437,340cyclictest0-21swapper/511:23:535
2532799543162,296cyclictest19151-21kworker/u16:211:23:333
2532899541285,126cyclictest4165-21kworker/u16:310:53:274
253279954028,423cyclictest0-21swapper/311:03:133
253269953927,339cyclictest0-21swapper/210:31:532
253259953928,84cyclictest27628-21diskmemload12:02:101
2532499539155,295cyclictest0-21swapper/008:14:210
253279953832,425cyclictest0-21swapper/312:26:163
253289953730,338cyclictest0-21swapper/410:20:174
253319953567,169cyclictest0-21swapper/708:15:137
2532699535325,48cyclictest29349-21sh11:45:282
253269953529,294cyclictest0-21swapper/210:09:022
253279953423,508cyclictest12665-21ssh09:48:583
253259953468,126cyclictest0-21swapper/111:02:041
2532799533106,90cyclictest121rcu_preempt10:01:383
253249953368,126cyclictest0-21swapper/011:52:020
253269953261,211cyclictest0-21swapper/211:41:562
253319953161,296cyclictest0-21swapper/710:07:207
253299953018,84cyclictest0-21swapper/508:48:505
253279953019,508cyclictest0-21swapper/308:12:313
253289952921,126cyclictest0-21swapper/411:42:174
253279952922,253cyclictest0-21swapper/312:07:393
2532599529107,338cyclictest0-21swapper/110:35:121
253279952820,423cyclictest0-21swapper/310:35:163
253259952817,126cyclictest0-21swapper/111:38:021
2532699524440,3cyclictest311rcuc/208:12:442
253259951891,211cyclictest15929-21dump-pmu-power10:10:001
25327995154,508cyclictest0-21swapper/311:52:123
25329995148,41cyclictest0-21swapper/511:44:115
253309951391,255cyclictest0-21swapper/611:23:546
25327995121,508cyclictest0-21swapper/310:32:163
25329995100,84cyclictest0-21swapper/511:46:415
253279950780,211cyclictest41-21ksoftirqd/310:55:193
2533199506423,3cyclictest721ktimersoftd/708:11:197
253289950579,253cyclictest0-21swapper/409:49:504
2532899505121,126cyclictest0-21swapper/410:00:494
253259950578,211cyclictest13743-21cron09:50:011
253249950577,253cyclictest16170-21ssh11:55:490
253319950381,338cyclictest0-21swapper/710:35:127
253279950234,465cyclictest0-21swapper/312:16:293
253269950137,2cyclictest0-21swapper/209:48:492
253289950033,464cyclictest0-21swapper/411:01:534
253279949930,84cyclictest15050-21ssh11:37:363
2533099495411,3cyclictest631rcuc/608:47:256
253259949528,2cyclictest0-21swapper/110:53:381
253249949568,338cyclictest0-21swapper/010:33:200
253259949424,42cyclictest0-21swapper/111:45:571
253299949329,382cyclictest0-21swapper/509:48:495
253309949269,338cyclictest0-21swapper/610:35:126
253279949226,84cyclictest0-21swapper/308:45:483
253259949266,168cyclictest1703-21sendmail-mta11:12:441
253319949164,424cyclictest0-21swapper/712:07:067
253319949062,211cyclictest73-21ksoftirqd/710:03:277
253269948964,211cyclictest0-21swapper/212:15:182
253249948921,210cyclictest9-21ksoftirqd/011:44:230
253279948819,254cyclictest0-21swapper/310:20:183
253249948866,84cyclictest0-21swapper/012:41:560
253289948763,84cyclictest0-21swapper/412:41:404
2532899487105,84cyclictest0-21swapper/412:25:514
253259948723,2cyclictest0-21swapper/109:50:061
253249948723,47cyclictest0-21swapper/011:23:540
253289948620,84cyclictest0-21swapper/411:24:204
2532699486401,4cyclictest311rcuc/208:48:412
25326994851,481cyclictest0-21swapper/212:27:082
2533199484142,126cyclictest121rcu_preempt08:48:437
253289948457,211cyclictest28317-21ssh11:26:464
253289948457,211cyclictest28317-21ssh11:26:464
2532599484104,84cyclictest0-21swapper/111:41:261
253319948355,212cyclictest73-21ksoftirqd/710:18:387
253289948361,256cyclictest31912-21ssh12:21:384
2532499482187,88cyclictest12666-21sshd09:48:580
2532499482141,126cyclictest121rcu_preempt10:18:010
253279948011,127cyclictest0-21swapper/311:12:473
253249947911,216cyclictest0-21swapper/012:15:190
253289947811,126cyclictest0-21swapper/408:49:164
253319947795,128cyclictest0-21swapper/710:33:147
25327994779,465cyclictest0-21swapper/311:56:083
2532699477437,37cyclictest311rcuc/212:31:272
253269947553,84cyclictest0-21swapper/211:28:332
253269947553,84cyclictest0-21swapper/211:28:332
2532599474174,126cyclictest121rcu_preempt12:41:061
25331994734,211cyclictest73-21ksoftirqd/711:03:047
25326994727,126cyclictest1608-21fw_packets08:15:162
25326994726,211cyclictest0-21swapper/210:53:432
2533099466125,338cyclictest0-21swapper/611:43:576
2533199465124,126cyclictest73-21ksoftirqd/711:12:387
253319946480,338cyclictest0-21swapper/709:49:597
25328994640,8cyclictest121rcu_preempt09:50:194
253259946480,211cyclictest25-21ksoftirqd/111:51:421
253309946380,211cyclictest0-21swapper/610:07:066
2532999463124,337cyclictest0-21swapper/511:27:065
2532999463124,337cyclictest0-21swapper/511:27:065
2533199462123,84cyclictest0-21swapper/711:56:117
253249946277,169cyclictest0-21swapper/010:35:130
253249946238,253cyclictest0-21swapper/011:38:080
2532999461120,338cyclictest0-21swapper/510:53:275
2532899461121,84cyclictest121rcu_preempt10:35:194
2532599461121,126cyclictest698-21ptp4l10:55:361
2533199460120,338cyclictest0-21swapper/711:44:157
253299946038,4cyclictest9187-21grep10:05:005
253289946038,338cyclictest7788-21ssh11:51:434
253249945937,84cyclictest121rcu_preempt12:06:210
253259945874,211cyclictest0-21swapper/111:25:411
253259945874,211cyclictest0-21swapper/111:25:411
253309945735,41cyclictest0-21swapper/609:49:336
2532599457120,334cyclictest0-21swapper/112:36:241
253249945740,80cyclictest0-21swapper/012:02:120
253319945634,255cyclictest0-21swapper/711:23:197
253249945632,84cyclictest0-21swapper/010:53:000
253259945533,84cyclictest0-21swapper/111:24:401
253259945533,2cyclictest0-21swapper/112:21:361
253249945475,84cyclictest0-21swapper/012:25:510
253319945331,256cyclictest0-21swapper/712:21:367
2533199453114,84cyclictest17148-21df_inode10:10:167
253299945331,3cyclictest4987-21ssh12:41:595
2532599453115,335cyclictest0-21swapper/108:15:081
2533199452110,126cyclictest121rcu_preempt11:46:287
253269945270,84cyclictest121rcu_preempt10:35:182
253289945129,212cyclictest121rcu_preempt12:16:464
253279945124,423cyclictest17561-21hddtemp_smartct10:10:213
253309945066,295cyclictest0-21swapper/611:37:316
253249945071,126cyclictest121rcu_preempt10:20:180
2532999449112,126cyclictest17562-21ssh10:10:205
2532899449325,77cyclictest13778-21runrttasks10:07:114
2532499449108,338cyclictest0-21swapper/008:48:070
253299944826,338cyclictest0-21swapper/512:31:275
253289944824,168cyclictest0-21swapper/412:02:284
2532999447360,84cyclictest551rcuc/511:55:495
253269944724,169cyclictest0-21swapper/212:07:282
253259944624,256cyclictest0-21swapper/110:10:181
2532599446104,254cyclictest0-21swapper/111:55:501
2533099445104,338cyclictest0-21swapper/611:27:196
2533099445104,338cyclictest0-21swapper/611:27:196
2532899445106,84cyclictest3981-21/usr/sbin/munin10:55:324
2532699445107,84cyclictest0-21swapper/211:51:532
253309944422,256cyclictest0-21swapper/612:21:386
2533099444101,172cyclictest121rcu_preempt10:55:326
253279944316,126cyclictest0-21swapper/312:21:273
2532599443103,338cyclictest0-21swapper/110:20:141
2533099442143,295cyclictest0-21swapper/611:03:436
253309944119,256cyclictest0-21swapper/612:17:116
253309943917,3cyclictest0-21swapper/612:41:506
253289943960,126cyclictest0-21swapper/408:13:324
253309943815,126cyclictest0-21swapper/612:07:396
253309943715,3cyclictest0-21swapper/610:01:006
253279943711,211cyclictest0-21swapper/309:50:043
2532699436396,37cyclictest311rcuc/211:37:582
253299943310,84cyclictest0-21swapper/510:20:145
253319943290,339cyclictest30558-21nscd12:41:297
253289943115,247cyclictest0-21swapper/412:31:224
253299942786,338cyclictest0-21swapper/511:37:445
25325994275,256cyclictest0-21swapper/112:17:121
2533099426169,84cyclictest121rcu_preempt12:02:196
253299942541,211cyclictest57-21ksoftirqd/512:27:205
25329994253,3cyclictest0-21swapper/507:35:145
25329994250,3cyclictest4666-21ssh12:07:175
253249942540,295cyclictest0-21swapper/012:31:250
253309942482,339cyclictest0-21swapper/612:31:016
25330994242,256cyclictest0-21swapper/610:18:536
253279942485,84cyclictest0-21swapper/308:15:083
253309942382,338cyclictest0-21swapper/608:12:266
253299942382,338cyclictest0-21swapper/512:21:395
253299942382,338cyclictest0-21swapper/512:16:525
253319942180,338cyclictest0-21swapper/711:38:147
253289942139,251cyclictest121rcu_preempt11:45:424
253269942178,84cyclictest0-21swapper/210:20:182
2532599421254,85cyclictest0-21swapper/112:06:361
253319942039,296cyclictest0-21swapper/710:20:157
253309942079,338cyclictest0-21swapper/612:36:236
2532899420163,126cyclictest121rcu_preempt11:56:114
253319941939,296cyclictest0-21swapper/710:55:117
253299941978,338cyclictest0-21swapper/510:55:325
253259941978,338cyclictest0-21swapper/107:35:091
253249941879,84cyclictest0-21swapper/012:36:240
2532499418120,125cyclictest9-21ksoftirqd/011:46:160
253309941776,338cyclictest0-21swapper/610:20:146
253269941778,84cyclictest31300-21diskmemload12:21:062
2532599417373,42cyclictest231rcuc/112:27:121
253319941676,338cyclictest0-21swapper/712:26:157
253309941675,338cyclictest0-21swapper/608:15:086
253309941575,338cyclictest0-21swapper/611:56:106
253299941536,2cyclictest0-21swapper/510:35:185
253279941575,338cyclictest0-21swapper/312:31:083
253269941575,84cyclictest673-21diskmemload12:41:462
253269941574,127cyclictest33-21ksoftirqd/210:10:112
253249941539,84cyclictest121rcu_preempt10:55:200
253309941473,338cyclictest0-21swapper/608:50:126
253299941473,338cyclictest0-21swapper/511:51:425
253319941332,297cyclictest0-21swapper/709:50:147
253309941333,296cyclictest0-21swapper/609:50:196
253309941331,254cyclictest0-21swapper/611:12:256
253289941374,84cyclictest0-21swapper/412:06:474
253279941372,338cyclictest0-21swapper/307:35:093
253279941333,298cyclictest0-21swapper/308:50:123
253269941374,84cyclictest0-21swapper/211:55:582
253249941375,84cyclictest0-21swapper/008:15:080
253319941271,338cyclictest0-21swapper/708:50:047
253269941171,84cyclictest0-21swapper/210:55:262
253299941070,337cyclictest0-21swapper/508:10:385
253249941071,84cyclictest0-21swapper/010:10:160
253249940828,211cyclictest1634-21ssh11:12:060
253289940667,84cyclictest0-21swapper/412:36:244
253269940667,84cyclictest0-21swapper/209:50:122
253309940464,337cyclictest0-21swapper/610:10:166
253309940423,84cyclictest0-21swapper/607:35:136
253259940463,338cyclictest0-21swapper/108:50:131
253279940222,296cyclictest0-21swapper/312:02:283
253289940162,84cyclictest0-21swapper/408:15:074
253259940120,127cyclictest25322-21cyclictest12:31:101
253299939859,84cyclictest0-21swapper/508:15:085
253319939553,339cyclictest0-21swapper/707:35:097
253289939415,134cyclictest0-21swapper/408:50:134
253289939411,211cyclictest0-21swapper/411:12:434
253299939213,84cyclictest15030-21ssh09:50:145
253319939110,212cyclictest0-21swapper/712:31:077
253299938647,84cyclictest0-21swapper/508:50:045
253269938654,248cyclictest0-21swapper/212:02:202
253309938544,338cyclictest0-21swapper/611:51:376
25324993811,168cyclictest0-21swapper/009:50:040
253319937740,134cyclictest0-21swapper/712:36:237
253289937434,251cyclictest0-21swapper/410:10:194
253249937072,126cyclictest121rcu_preempt07:35:150
2532999367153,83cyclictest0-21swapper/511:12:095
253309936672,211cyclictest0-21swapper/612:25:506
253269936426,171cyclictest0-21swapper/211:12:102
253269936322,126cyclictest0-21swapper/207:35:152
253289935720,171cyclictest0-21swapper/407:35:094
253249935718,84cyclictest0-21swapper/008:50:130
253269932727,296cyclictest0-21swapper/208:50:142
253279932631,170cyclictest0-21swapper/312:36:233
253299929441,3cyclictest0-21swapper/512:36:235
253269929339,84cyclictest33-21ksoftirqd/212:36:232
23790210095,2sleep20-21swapper/207:05:172
2364729085,2sleep10-21swapper/107:05:171
2461128351,28sleep30-21swapper/307:05:593
2485028150,27sleep50-21swapper/507:09:225
2484328151,27sleep70-21swapper/707:09:167
2470828150,27sleep60-21swapper/607:07:226
2489428052,24sleep00-21swapper/007:09:570
56112790,0sleep20-21swapper/209:11:362
2487827948,27sleep40-21swapper/407:09:454
145722780,0sleep70-21swapper/711:19:347
59602720,1sleep20-21swapper/209:28:502
25327993110,20cyclictest0-21swapper/309:38:343
25331992910,18cyclictest0-21swapper/709:38:437
25329992927,1cyclictest0-21swapper/509:29:525
25327992927,2cyclictest0-21swapper/309:21:373
25327992926,3cyclictest0-21swapper/307:46:273
25331992810,18cyclictest0-21swapper/710:44:207
25331992810,18cyclictest0-21swapper/709:29:217
25331992810,18cyclictest0-21swapper/709:21:447
25331992810,18cyclictest0-21swapper/708:03:277
25331992810,18cyclictest0-21swapper/707:58:007
25331992810,18cyclictest0-21swapper/707:14:297
25331992810,0cyclictest0-21swapper/712:14:597
25330992828,0cyclictest0-21swapper/609:38:386
25330992810,18cyclictest0-21swapper/609:13:326
25329992827,1cyclictest0-21swapper/510:44:235
25329992810,17cyclictest0-21swapper/509:21:305
25329992810,0cyclictest0-21swapper/512:14:535
25327992828,0cyclictest0-21swapper/309:06:093
25327992828,0cyclictest0-21swapper/307:58:293
25327992824,3cyclictest0-21swapper/308:22:233
25327992810,18cyclictest0-21swapper/312:14:513
25327992810,18cyclictest0-21swapper/309:13:563
25326992810,18cyclictest0-21swapper/210:44:342
25326992810,18cyclictest0-21swapper/209:21:332
25326992810,18cyclictest0-21swapper/208:34:202
25325992810,18cyclictest0-21swapper/109:30:041
25325992810,18cyclictest0-21swapper/107:34:521
25331992727,0cyclictest0-21swapper/709:13:257
25331992727,0cyclictest0-21swapper/708:33:517
25331992710,17cyclictest0-21swapper/708:38:357
25331992710,17cyclictest0-21swapper/708:28:067
25331992710,17cyclictest0-21swapper/708:21:597
25331992710,17cyclictest0-21swapper/707:53:067
25331992710,17cyclictest0-21swapper/707:46:177
25331992710,17cyclictest0-21swapper/707:40:447
25331992710,17cyclictest0-21swapper/707:22:407
25331992710,0cyclictest0-21swapper/709:05:447
25331992710,0cyclictest0-21swapper/708:58:117
25331992710,0cyclictest0-21swapper/707:34:297
25331992710,0cyclictest0-21swapper/707:29:007
25331992710,0cyclictest0-21swapper/707:17:597
25330992727,0cyclictest0-21swapper/607:34:386
25330992727,0cyclictest0-21swapper/607:22:416
25330992710,17cyclictest0-21swapper/612:14:546
25330992710,17cyclictest0-21swapper/610:43:576
25330992710,17cyclictest0-21swapper/609:30:036
25330992710,17cyclictest0-21swapper/609:05:346
25330992710,17cyclictest0-21swapper/608:27:226
25330992710,17cyclictest0-21swapper/608:22:356
25330992710,17cyclictest0-21swapper/608:03:336
25330992710,17cyclictest0-21swapper/607:18:356
25330992710,17cyclictest0-21swapper/607:14:176
25330992710,0cyclictest0-21swapper/609:29:476
25330992710,0cyclictest0-21swapper/609:21:316
25330992710,0cyclictest0-21swapper/608:58:136
25330992710,0cyclictest0-21swapper/608:33:556
25330992710,0cyclictest0-21swapper/607:58:306
25330992710,0cyclictest0-21swapper/607:53:186
25330992710,0cyclictest0-21swapper/607:46:176
25329992727,0cyclictest0-21swapper/508:33:445
25329992727,0cyclictest0-21swapper/507:28:245
25329992710,17cyclictest0-21swapper/509:37:545
25329992710,17cyclictest0-21swapper/509:13:185
25329992710,17cyclictest0-21swapper/508:58:435
25329992710,17cyclictest0-21swapper/508:22:115
25329992710,17cyclictest0-21swapper/508:03:275
25329992710,17cyclictest0-21swapper/507:46:215
25329992710,17cyclictest0-21swapper/507:34:305
25329992710,17cyclictest0-21swapper/507:22:355
25329992710,17cyclictest0-21swapper/507:14:175
25329992710,0cyclictest0-21swapper/509:05:365
25329992710,0cyclictest0-21swapper/508:38:345
25329992710,0cyclictest0-21swapper/507:58:045
25329992710,0cyclictest0-21swapper/507:53:235
25329992710,0cyclictest0-21swapper/507:41:135
25329992710,0cyclictest0-21swapper/507:18:025
25328992727,0cyclictest0-21swapper/409:29:184
25328992727,0cyclictest0-21swapper/409:13:304
25328992727,0cyclictest0-21swapper/407:23:104
25328992727,0cyclictest0-21swapper/407:18:114
25328992710,17cyclictest0-21swapper/410:43:444
25328992710,17cyclictest0-21swapper/409:37:554
25328992710,17cyclictest0-21swapper/409:21:364
25328992710,17cyclictest0-21swapper/409:05:384
25328992710,17cyclictest0-21swapper/408:39:044
25328992710,17cyclictest0-21swapper/408:34:154
25328992710,17cyclictest0-21swapper/407:58:004
25328992710,17cyclictest0-21swapper/407:53:154
25328992710,17cyclictest0-21swapper/407:46:204
25328992710,0cyclictest0-21swapper/412:14:514
25328992710,0cyclictest0-21swapper/409:30:014
25328992710,0cyclictest0-21swapper/408:27:284
25328992710,0cyclictest0-21swapper/408:22:254
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional