You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-29 - 17:13
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Fri May 29, 2026 12:56:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
104719983427,804cyclictest0-21swapper/111:42:351
10474997298,718cyclictest0-21swapper/410:18:304
104719970871,634cyclictest0-21swapper/109:42:271
104719969962,634cyclictest0-21swapper/111:11:021
10471996848,592cyclictest0-21swapper/110:02:381
10471996848,592cyclictest0-21swapper/110:02:381
10471996848,592cyclictest0-21swapper/110:02:371
104779967178,126cyclictest121rcu_preempt10:17:367
104719967032,635cyclictest0-21swapper/110:24:151
104769964750,295cyclictest0-21swapper/609:42:046
10471996381,634cyclictest0-21swapper/109:32:471
10471996381,634cyclictest0-21swapper/109:32:471
10471996381,634cyclictest0-21swapper/109:32:471
10471996381,634cyclictest0-21swapper/109:32:461
10471996381,634cyclictest0-21swapper/109:32:461
104719963281,82cyclictest0-21swapper/109:55:061
104749963178,380cyclictest0-21swapper/409:44:564
104719962227,507cyclictest0-21swapper/110:52:081
104719962168,380cyclictest0-21swapper/111:36:121
104779962065,296cyclictest0-21swapper/708:11:277
1047799615104,296cyclictest21098-21rm09:42:117
104769961160,126cyclictest0-21swapper/609:33:476
104769961160,126cyclictest0-21swapper/609:33:476
104769961160,126cyclictest0-21swapper/609:33:476
104769961160,126cyclictest0-21swapper/609:33:476
104769961160,126cyclictest0-21swapper/609:33:466
10473996059,381cyclictest0-21swapper/309:41:383
10471995970,42cyclictest0-21swapper/109:37:411
1047399587118,338cyclictest0-21swapper/309:55:053
104709958734,211cyclictest0-21swapper/009:22:400
104719958434,126cyclictest0-21swapper/109:25:161
104779958375,126cyclictest0-21swapper/709:23:077
104729958068,126cyclictest121rcu_preempt09:33:022
104729958068,126cyclictest121rcu_preempt09:33:022
104729958068,126cyclictest121rcu_preempt09:33:022
104729958068,126cyclictest121rcu_preempt09:33:012
104729958068,126cyclictest121rcu_preempt09:33:012
1047399579110,338cyclictest0-21swapper/310:17:093
1047399577193,211cyclictest0-21swapper/309:36:533
1047299575110,126cyclictest0-21swapper/209:43:182
1047199573107,126cyclictest0-21swapper/109:24:231
104719957119,168cyclictest0-21swapper/110:25:031
104719957119,168cyclictest0-21swapper/110:25:031
1047199571188,211cyclictest303-21systemd-journal10:18:311
104719956656,295cyclictest0-21swapper/108:09:391
104729956212,126cyclictest0-21swapper/209:51:032
1047299556133,84cyclictest704-21nscd10:02:062
1047299556133,84cyclictest704-21nscd10:02:062
1047299556133,84cyclictest704-21nscd10:02:062
1047099556131,126cyclictest121rcu_preempt11:42:030
104719955140,338cyclictest0-21swapper/112:32:001
1047799550165,211cyclictest0-21swapper/710:55:097
10472995504,122cyclictest0-21swapper/210:21:132
10472995501,126cyclictest0-21swapper/212:24:442
1047499549209,338cyclictest21231-21kworker/u16:209:53:314
104739954980,126cyclictest0-21swapper/311:36:483
104729954882,211cyclictest0-21swapper/209:23:092
104739954739,84cyclictest0-21swapper/310:53:523
104729954538,126cyclictest0-21swapper/210:16:292
104709954332,127cyclictest21533-21runrttasks09:43:040
104739954271,296cyclictest31199-21kworker/u16:110:20:293
104719954274,465cyclictest0-21swapper/112:21:021
104719954235,3cyclictest0-21swapper/111:52:241
1047099542244,296cyclictest30258-21kworker/u16:212:15:200
104719954128,509cyclictest0-21swapper/112:08:221
104749954076,380cyclictest0-21swapper/410:55:284
104749953972,295cyclictest0-21swapper/409:23:224
104779953830,7cyclictest0-21swapper/709:37:087
104769953874,84cyclictest0-21swapper/609:53:076
1047499538198,338cyclictest30774-21diskmemload10:51:434
104749953729,126cyclictest0-21swapper/409:36:494
104749953726,508cyclictest0-21swapper/412:32:404
1047799536108,297cyclictest121rcu_preempt11:42:487
1047399536109,126cyclictest0-21swapper/307:17:543
104759953465,255cyclictest121rcu_preempt09:41:215
104749953367,127cyclictest0-21swapper/408:09:464
104769953266,211cyclictest0-21swapper/609:36:546
1047499532278,84cyclictest31199-21kworker/u16:110:02:154
1047499532278,84cyclictest31199-21kworker/u16:110:02:154
1047499532278,84cyclictest31199-21kworker/u16:110:02:154
1047299532446,84cyclictest311rcuc/210:51:452
1047599530147,380cyclictest0-21swapper/509:36:485
104739952762,210cyclictest0-21swapper/311:43:113
104709952719,84cyclictest0-21swapper/011:45:190
104749952619,126cyclictest0-21swapper/411:53:104
1047499526101,84cyclictest0-21swapper/411:43:154
104769952518,248cyclictest0-21swapper/610:04:446
104769952518,248cyclictest0-21swapper/610:04:446
104769952518,248cyclictest0-21swapper/610:04:446
104779952419,289cyclictest0-21swapper/707:17:447
1047199524143,84cyclictest28890-21/usr/sbin/munin12:10:341
104709952421,253cyclictest0-21swapper/007:18:280
104779952055,256cyclictest8540-21sh09:31:047
104779952055,256cyclictest8540-21sh09:31:047
104779952055,256cyclictest8540-21sh09:31:047
104779952055,256cyclictest8540-21sh09:31:047
104779952055,256cyclictest8540-21sh09:31:037
104709952014,44cyclictest0-21swapper/010:24:180
104729951911,126cyclictest0-21swapper/209:36:492
10475995121,211cyclictest0-21swapper/509:22:545
1047799511125,126cyclictest73-21ksoftirqd/712:21:017
10471995111,42cyclictest0-21swapper/108:11:181
10476995090,84cyclictest0-21swapper/610:22:256
10472995090,84cyclictest0-21swapper/212:08:002
10475995080,84cyclictest0-21swapper/509:33:495
10475995080,84cyclictest0-21swapper/509:33:495
10475995080,84cyclictest0-21swapper/509:33:495
10475995080,84cyclictest0-21swapper/509:33:495
10475995080,84cyclictest0-21swapper/509:33:485
104749950885,84cyclictest0-21swapper/409:33:454
104749950885,84cyclictest0-21swapper/409:33:454
104749950885,84cyclictest0-21swapper/409:33:454
104749950885,84cyclictest0-21swapper/409:33:454
104749950885,84cyclictest0-21swapper/409:33:444
104749950837,382cyclictest0-21swapper/412:15:214
10474995071,427cyclictest0-21swapper/412:20:504
104709950680,253cyclictest121rcu_preempt11:37:060
104759950481,211cyclictest0-21swapper/510:54:395
1047699503119,253cyclictest121rcu_preempt11:41:376
104739950234,126cyclictest24417-21chrt09:22:103
104739950232,85cyclictest0-21swapper/311:52:363
104709950275,211cyclictest6727-21ssh09:54:470
104769950134,211cyclictest0-21swapper/610:54:556
104729950178,126cyclictest121rcu_preempt09:45:222
104719950135,84cyclictest0-21swapper/110:55:341
104709950135,42cyclictest121rcu_preempt12:42:160
104709950135,42cyclictest121rcu_preempt12:42:160
104749950075,422cyclictest0-21swapper/409:25:114
104749950075,295cyclictest0-21swapper/412:10:264
104779949930,84cyclictest0-21swapper/709:55:037
104749949934,296cyclictest0-21swapper/410:24:174
1047099499116,168cyclictest8051-21ssh09:30:330
1047099499116,168cyclictest8051-21ssh09:30:330
1047099499116,168cyclictest8051-21ssh09:30:330
1047099499116,168cyclictest8051-21ssh09:30:320
1047099499116,168cyclictest8051-21ssh09:30:320
1047799498112,169cyclictest73-21ksoftirqd/710:23:367
1047599498118,126cyclictest57-21ksoftirqd/510:22:385
104749949868,84cyclictest0-21swapper/411:37:084
104709949876,338cyclictest0-21swapper/010:03:450
104709949876,338cyclictest0-21swapper/010:03:440
104709949876,338cyclictest0-21swapper/010:03:440
104709949871,211cyclictest0-21swapper/009:37:000
104709949774,126cyclictest0-21swapper/010:17:360
104779949666,211cyclictest0-21swapper/711:36:487
104759949467,253cyclictest121rcu_preempt07:49:495
104729949469,211cyclictest0-21swapper/207:17:542
104779949371,126cyclictest0-21swapper/710:01:557
104779949371,126cyclictest0-21swapper/710:01:547
104779949371,126cyclictest0-21swapper/710:01:547
104779949326,127cyclictest0-21swapper/711:11:047
1047499493110,380cyclictest0-21swapper/412:07:474
104779949164,295cyclictest10468-21cyclictest08:15:167
104759949164,295cyclictest19476-21ssh11:45:205
104719949127,338cyclictest0-21swapper/108:15:101
104759949064,253cyclictest121rcu_preempt10:02:305
104759949064,253cyclictest121rcu_preempt10:02:305
104759949064,253cyclictest121rcu_preempt10:02:295
104739949066,84cyclictest0-21swapper/309:34:223
104739949066,84cyclictest0-21swapper/309:34:223
104739949066,84cyclictest0-21swapper/309:34:223
104739949066,84cyclictest0-21swapper/309:34:213
104739949066,84cyclictest0-21swapper/309:34:213
104769948866,84cyclictest0-21swapper/611:52:116
104749948559,210cyclictest0-21swapper/408:14:284
104759948462,337cyclictest0-21swapper/510:55:285
104759948357,296cyclictest121rcu_preempt08:12:275
1047599483103,253cyclictest23194-21ssh12:42:225
1047599483103,253cyclictest23194-21ssh12:42:225
104729948322,337cyclictest0-21swapper/211:11:132
104729948314,126cyclictest0-21swapper/209:25:062
104759948217,254cyclictest0-21swapper/509:52:035
104729948213,211cyclictest0-21swapper/210:05:062
104739948052,84cyclictest41-21ksoftirqd/310:02:463
104739948052,84cyclictest41-21ksoftirqd/310:02:463
104739948052,84cyclictest41-21ksoftirqd/310:02:463
104709948011,254cyclictest0-21swapper/010:55:010
104729947914,42cyclictest0-21swapper/212:31:502
104749947810,169cyclictest0-21swapper/411:55:514
104759947711,85cyclictest0-21swapper/512:32:175
104739947755,126cyclictest121rcu_preempt12:08:073
10471994779,465cyclictest0-21swapper/112:15:201
104749947213,3cyclictest0-21swapper/407:49:564
10476994680,84cyclictest25804-21ssh12:08:016
1047399466383,3cyclictest391rcuc/312:20:503
1047399466124,339cyclictest0-21swapper/309:25:133
1047099466252,84cyclictest0-21swapper/009:25:150
104769946580,211cyclictest65-21ksoftirqd/611:55:546
1047599465208,85cyclictest57-21ksoftirqd/511:37:045
104739946580,254cyclictest0-21swapper/308:14:063
1047299465122,340cyclictest0-21swapper/208:08:372
1047699464420,42cyclictest631rcuc/607:20:196
1047099464124,338cyclictest0-21swapper/008:07:510
1047099464123,338cyclictest0-21swapper/011:55:230
104779946341,84cyclictest0-21swapper/710:51:457
1047799463122,125cyclictest30774-21diskmemload11:52:307
1047699463208,124cyclictest121rcu_preempt09:45:236
104759946336,337cyclictest0-21swapper/512:07:445
104709946341,254cyclictest0-21swapper/008:11:360
104769946240,2cyclictest0-21swapper/611:37:526
1047399462120,126cyclictest121rcu_preempt12:41:543
1047399462120,126cyclictest121rcu_preempt12:41:543
104729946236,169cyclictest0-21swapper/207:49:552
104719946237,380cyclictest0-21swapper/112:42:091
104719946237,380cyclictest0-21swapper/112:42:091
1047099462123,337cyclictest0-21swapper/012:31:570
1047499460203,126cyclictest121rcu_preempt11:45:224
1047499460122,84cyclictest0-21swapper/407:20:244
104719946078,380cyclictest10468-21cyclictest07:18:001
104709946077,168cyclictest9-21ksoftirqd/009:45:250
1047699459119,338cyclictest0-21swapper/610:17:366
104779945876,84cyclictest0-21swapper/712:33:147
104729945832,295cyclictest33-21ksoftirqd/210:25:122
104729945832,295cyclictest33-21ksoftirqd/210:25:112
104769945735,253cyclictest0-21swapper/612:00:206
1047299457117,337cyclictest0-21swapper/211:52:372
104769945671,169cyclictest65-21ksoftirqd/609:23:156
1047699456157,126cyclictest121rcu_preempt12:21:156
104749945628,211cyclictest0-21swapper/410:25:154
104749945628,211cyclictest0-21swapper/410:25:154
1047299456117,337cyclictest0-21swapper/211:35:582
104709945630,253cyclictest0-21swapper/012:21:140
104759945571,169cyclictest0-21swapper/511:52:295
1047599455198,84cyclictest704-21nscd10:17:295
104729945432,260cyclictest0-21swapper/209:55:072
1047299453114,84cyclictest0-21swapper/208:12:022
104779945230,84cyclictest0-21swapper/709:45:127
1047299452110,84cyclictest0-21swapper/211:41:512
1047299452110,169cyclictest33-21ksoftirqd/212:10:212
104719945227,126cyclictest0-21swapper/111:55:351
1047099452109,339cyclictest21770-21ssh10:55:320
104759945166,169cyclictest19265-21ssh12:20:505
104749945172,295cyclictest0-21swapper/411:10:414
104749945124,211cyclictest49-21ksoftirqd/407:19:254
104739945123,126cyclictest0-21swapper/312:33:173
1047099451196,125cyclictest704-21nscd09:55:090
1047699450108,339cyclictest1551-21snmpd08:08:476
104759944928,255cyclictest0-21swapper/509:25:235
104779944868,84cyclictest0-21swapper/709:25:277
104769944861,87cyclictest0-21swapper/611:45:216
104749944826,255cyclictest0-21swapper/409:55:094
1047399448153,126cyclictest121rcu_preempt12:10:173
104729944829,331cyclictest0-21swapper/212:41:292
104729944829,331cyclictest0-21swapper/212:41:292
104709944826,255cyclictest0-21swapper/011:52:090
1047599447106,127cyclictest9659-21ssh11:59:175
10476994450,236cyclictest0-21swapper/612:42:156
10476994450,236cyclictest0-21swapper/612:42:156
104759944562,210cyclictest57-21ksoftirqd/507:18:385
104719944422,298cyclictest5783-1kworker/u17:209:55:121
1047399443187,253cyclictest0-21swapper/308:07:063
1047799442227,92cyclictest27868-21grep10:25:177
1047799442227,92cyclictest27868-21grep10:25:167
104709944259,126cyclictest0-21swapper/012:10:160
104709944257,127cyclictest5575-21cut08:15:160
104709944220,213cyclictest0-21swapper/012:07:530
104769944160,85cyclictest0-21swapper/608:10:056
104749943899,84cyclictest0-21swapper/410:05:024
104719943720,3cyclictest0-21swapper/107:49:571
104709943454,86cyclictest121rcu_preempt11:11:070
104769943082,84cyclictest0-21swapper/611:05:246
104759942945,211cyclictest561ktimersoftd/511:10:455
10472994251,126cyclictest0-21swapper/212:00:192
104759942483,338cyclictest0-21swapper/512:10:175
104749942483,338cyclictest0-21swapper/409:45:174
104749942481,126cyclictest0-21swapper/412:42:114
104749942481,126cyclictest0-21swapper/412:42:114
10473994241,127cyclictest0-21swapper/311:05:343
104719942440,296cyclictest0-21swapper/109:45:151
104769942385,83cyclictest21777-21ssh10:55:346
104759942383,338cyclictest0-21swapper/511:43:065
104759942382,338cyclictest0-21swapper/509:45:095
104769942283,84cyclictest0-21swapper/611:11:026
104739942237,126cyclictest121rcu_preempt11:55:493
104769942182,84cyclictest0-21swapper/612:10:146
104759942181,337cyclictest0-21swapper/511:05:335
104759942180,338cyclictest0-21swapper/508:07:595
104739942182,84cyclictest0-21swapper/307:20:123
104719942141,296cyclictest0-21swapper/110:05:131
104769942082,3cyclictest0-21swapper/607:19:036
104759942080,338cyclictest0-21swapper/510:25:115
104759942080,338cyclictest0-21swapper/510:25:115
104759942040,296cyclictest0-21swapper/509:55:135
104739942081,84cyclictest0-21swapper/309:45:233
104719942040,296cyclictest0-21swapper/107:20:171
104709942080,337cyclictest0-21swapper/011:05:240
104769941980,84cyclictest0-21swapper/610:05:036
104709941979,126cyclictest30774-21diskmemload10:05:030
1047699418119,126cyclictest0-21swapper/612:31:496
104759941880,336cyclictest0-21swapper/508:15:115
104749941839,295cyclictest0-21swapper/408:15:044
104739941879,84cyclictest0-21swapper/311:10:463
104739941879,84cyclictest0-21swapper/308:15:093
1047799416378,2cyclictest711rcuc/711:05:327
1047799416121,211cyclictest0-21swapper/708:09:087
104769941678,84cyclictest0-21swapper/612:15:216
104769941634,84cyclictest0-21swapper/607:50:076
104779941576,84cyclictest0-21swapper/711:45:197
1047399415114,127cyclictest10468-21cyclictest10:55:363
104769941475,85cyclictest0-21swapper/608:15:166
1047699414116,209cyclictest0-21swapper/609:25:166
104729941434,84cyclictest121rcu_preempt12:15:202
104779941332,84cyclictest0-21swapper/712:10:347
104749941334,295cyclictest0-21swapper/411:05:244
104729941273,84cyclictest0-21swapper/211:55:252
104769941173,84cyclictest0-21swapper/609:55:096
104769941172,84cyclictest0-21swapper/610:25:176
104769941172,84cyclictest0-21swapper/610:25:176
104739941170,85cyclictest10468-21cyclictest11:45:203
104729941127,168cyclictest0-21swapper/210:55:362
104709941170,338cyclictest0-21swapper/010:25:160
104709941170,338cyclictest0-21swapper/010:25:150
104779941034,43cyclictest25777-21ssh12:07:547
104729941024,211cyclictest1551-21snmpd08:15:102
104749940968,338cyclictest23895-21ssh12:25:074
1047599408152,83cyclictest121rcu_preempt12:15:215
104749940868,338cyclictest0-21swapper/407:50:074
104739940869,84cyclictest0-21swapper/310:25:163
104739940869,84cyclictest0-21swapper/310:25:163
104749940728,295cyclictest0-21swapper/412:00:194
104729940727,169cyclictest0-21swapper/207:20:122
104779940667,84cyclictest0-21swapper/711:55:397
104759940564,338cyclictest0-21swapper/507:20:175
104719940425,295cyclictest0-21swapper/111:05:231
104709940218,295cyclictest0-21swapper/007:20:240
104709940060,337cyclictest0-21swapper/007:50:070
104739939968,204cyclictest0-21swapper/309:55:093
104719939756,338cyclictest0-21swapper/107:50:071
104779939615,257cyclictest0-21swapper/712:42:097
104779939615,257cyclictest0-21swapper/712:42:097
104779939556,84cyclictest0-21swapper/709:55:097
104729939556,84cyclictest0-21swapper/211:45:202
104779939293,126cyclictest0-21swapper/707:20:047
104729938950,84cyclictest0-21swapper/211:05:242
1047099389133,126cyclictest121rcu_preempt12:25:060
104779938445,84cyclictest0-21swapper/710:05:057
104739938142,84cyclictest0-21swapper/312:15:213
1047399381121,254cyclictest0-21swapper/307:49:483
104719937437,41cyclictest0-21swapper/112:00:201
104759937374,296cyclictest0-21swapper/507:50:075
104719937235,253cyclictest0-21swapper/111:45:251
1047799371288,3cyclictest721ktimersoftd/712:25:057
1047799371115,253cyclictest0-21swapper/707:50:077
1047399371114,254cyclictest23521-21ssh10:05:033
1047799370113,254cyclictest8136-21ssh12:15:207
104709936931,42cyclictest0-21swapper/007:49:560
1047399368110,255cyclictest0-21swapper/307:50:063
104769935920,84cyclictest0-21swapper/612:25:066
1047699357104,86cyclictest0-21swapper/607:49:576
104709935619,253cyclictest0-21swapper/012:00:200
104729935312,126cyclictest0-21swapper/212:25:072
104759933540,211cyclictest0-21swapper/510:05:025
104729933478,85cyclictest0-21swapper/207:50:062
104779933035,253cyclictest0-21swapper/707:49:567
104719932771,253cyclictest0-21swapper/112:25:071
104759932567,254cyclictest0-21swapper/512:25:075
104739931932,75cyclictest0-21swapper/312:25:063
104739931863,253cyclictest0-21swapper/312:00:193
1047799288205,3cyclictest721ktimersoftd/712:00:207
104759924630,84cyclictest12460-21ls12:00:205
3081921260,2sleep31047399cyclictest10:42:253
967229058,29sleep70-21swapper/707:07:417
976128858,27sleep30-21swapper/307:08:573
962228761,4sleep50-21swapper/507:06:575
970728655,28sleep60-21swapper/607:08:116
982628252,27sleep10-21swapper/107:09:511
978928251,28sleep20-21swapper/207:09:202
978728151,27sleep00-21swapper/007:09:180
960328149,28sleep40-21swapper/407:06:414
1047299592,42cyclictest0-21swapper/211:15:302
10802550,0sleep20-21swapper/208:05:012
1047299481,33cyclictest0-21swapper/212:35:382
10477994313,27cyclictest721ktimersoftd/712:35:027
1047499421,31cyclictest0-21swapper/412:35:114
10470994131,7cyclictest9796-21sort12:35:150
10477994013,19cyclictest0-21swapper/711:16:327
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional