You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-27 - 09:28
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Thu Aug 27, 2026 00:54:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
165049977553,719cyclictest0-21swapper/523:36:055
165039969759,465cyclictest11901-21kworker/u16:021:37:404
16500996780,168cyclictest0-21swapper/121:40:051
16500996780,168cyclictest0-21swapper/121:40:051
165049965156,84cyclictest0-21swapper/521:56:165
165039964152,84cyclictest121rcu_preempt21:55:244
16499996360,84cyclictest0-21swapper/023:36:050
165049963140,507cyclictest0-21swapper/522:48:485
1650299625114,295cyclictest0-21swapper/321:28:003
164999962331,126cyclictest0-21swapper/022:30:010
165059962167,381cyclictest0-21swapper/623:23:426
165049961726,467cyclictest27571-21ssh21:28:025
1649999617110,126cyclictest121rcu_preempt21:27:120
165069960958,126cyclictest0-21swapper/722:38:367
1650399602554,42cyclictest471rcuc/420:45:154
164999960148,380cyclictest0-21swapper/022:28:150
165009959988,296cyclictest0-21swapper/123:54:341
16499995961,380cyclictest0-21swapper/022:21:000
16504995930,84cyclictest0-21swapper/500:02:295
16502995930,84cyclictest4862-21latency20:35:173
16500995920,83cyclictest0-21swapper/123:36:051
165049959041,338cyclictest0-21swapper/523:22:565
1650699587161,338cyclictest16497-21cyclictest21:40:227
1650699587161,338cyclictest16497-21cyclictest21:40:227
165049958532,126cyclictest0-21swapper/520:41:485
1650099585288,127cyclictest6165-21ssh21:52:551
165049958334,465cyclictest0-21swapper/500:36:365
165049957928,84cyclictest0-21swapper/521:53:115
165059957265,84cyclictest0-21swapper/621:27:306
1650099570313,84cyclictest0-21swapper/122:22:581
165069956760,211cyclictest0-21swapper/721:59:147
165059956554,296cyclictest121rcu_preempt23:45:026
165029956553,126cyclictest0-21swapper/322:27:583
165029956553,126cyclictest0-21swapper/322:27:583
165019956453,85cyclictest0-21swapper/221:37:402
16504995618,550cyclictest0-21swapper/521:38:055
165019956110,84cyclictest0-21swapper/221:28:512
1650299560477,3cyclictest391rcuc/322:22:273
16506995589,127cyclictest0-21swapper/700:36:497
1650399551251,127cyclictest0-21swapper/423:44:504
16499995501,382cyclictest0-21swapper/021:44:310
16499995501,382cyclictest0-21swapper/021:44:310
165049954881,83cyclictest0-21swapper/519:42:475
164999954841,262cyclictest0-21swapper/021:38:130
1649999547121,127cyclictest9007-21sh23:06:220
164999954682,84cyclictest0-21swapper/021:57:570
164999954635,338cyclictest0-21swapper/022:40:020
165059954433,338cyclictest0-21swapper/621:57:166
164999954478,84cyclictest0-21swapper/022:08:590
165059954335,256cyclictest0-21swapper/621:43:446
165059954335,256cyclictest0-21swapper/621:43:446
1650399541243,253cyclictest3089-21kworker/u16:123:06:434
165049954029,296cyclictest0-21swapper/521:40:485
165049954029,296cyclictest0-21swapper/521:40:485
165029954072,127cyclictest0-21swapper/323:00:053
165049953826,381cyclictest0-21swapper/523:25:535
164999953625,380cyclictest0-21swapper/000:03:090
165039953363,338cyclictest0-21swapper/423:24:134
165069953064,126cyclictest121rcu_preempt23:33:227
165069952963,211cyclictest0-21swapper/723:06:027
1650299529100,254cyclictest0-21swapper/321:39:273
1650299528407,37cyclictest401ktimersoftd/323:22:563
1650199528271,125cyclictest0-21swapper/222:38:162
1650199528101,254cyclictest0-21swapper/221:55:272
165009952821,261cyclictest0-21swapper/121:15:211
165049952723,415cyclictest0-21swapper/523:34:095
165049952716,508cyclictest0-21swapper/523:05:495
165039952761,126cyclictest0-21swapper/423:34:384
165039952721,295cyclictest0-21swapper/422:23:074
165029952720,2cyclictest0-21swapper/321:44:313
165029952720,2cyclictest0-21swapper/321:44:313
165059952412,126cyclictest0-21swapper/623:52:236
165049952414,507cyclictest0-21swapper/522:28:155
165049952414,507cyclictest0-21swapper/522:28:155
165009951911,126cyclictest0-21swapper/100:10:451
16504995169,423cyclictest11211-21munin-plugin-st23:45:015
16501995135,126cyclictest0-21swapper/222:49:592
16502995113,126cyclictest121rcu_preempt19:53:113
164999951147,126cyclictest0-21swapper/000:36:480
165069951041,126cyclictest121rcu_preempt21:39:167
1650299510125,169cyclictest41-21ksoftirqd/323:26:553
16506995090,84cyclictest0-21swapper/723:54:257
165049950940,295cyclictest0-21swapper/521:45:045
1650599508123,126cyclictest0-21swapper/622:28:216
1650599508123,126cyclictest0-21swapper/622:28:216
1650099508166,338cyclictest698-21ptp4l00:01:431
1649999508425,3cyclictest101ktimersoftd/019:40:380
165009950780,211cyclictest25-21ksoftirqd/100:18:281
165059950583,84cyclictest0-21swapper/623:36:266
165059950440,252cyclictest24083-21diskmemload21:37:236
165039950478,84cyclictest0-21swapper/422:25:024
165039950478,84cyclictest0-21swapper/422:25:024
165019950481,84cyclictest121rcu_preempt23:05:442
165049950339,461cyclictest0-21swapper/522:20:425
1650299503163,84cyclictest121rcu_preempt22:00:013
164999950381,338cyclictest0-21swapper/020:05:190
165069950280,84cyclictest0-21swapper/722:58:487
165039950280,84cyclictest0-21swapper/423:25:124
1650599501120,262cyclictest1144-21ssh22:09:036
165049950137,212cyclictest0-21swapper/522:08:545
1650599500118,379cyclictest0-21swapper/622:22:426
165039950078,84cyclictest0-21swapper/423:36:264
165009950073,211cyclictest0-21swapper/123:35:031
165059949933,126cyclictest0-21swapper/620:41:086
1650599499158,338cyclictest7471-21kworker/u16:222:39:366
165029949971,212cyclictest0-21swapper/322:49:583
165029949869,380cyclictest0-21swapper/322:00:043
165019949832,255cyclictest0-21swapper/221:40:112
165019949832,255cyclictest0-21swapper/221:40:112
1650199498159,85cyclictest24083-21diskmemload22:21:052
164999949838,375cyclictest0-21swapper/023:54:350
165019949730,84cyclictest0-21swapper/223:23:422
164999949630,126cyclictest0-21swapper/021:54:450
1650399494109,168cyclictest0-21swapper/420:04:104
165019949428,126cyclictest0-21swapper/222:29:182
165019949428,126cyclictest0-21swapper/222:29:182
1650199494110,296cyclictest0-21swapper/200:28:282
1649999494113,84cyclictest0-21swapper/023:44:420
165059949327,295cyclictest0-21swapper/600:35:256
165009949226,89cyclictest0-21swapper/123:25:261
165009949024,210cyclictest0-21swapper/123:42:271
165069948967,84cyclictest0-21swapper/723:36:267
165039948966,84cyclictest0-21swapper/422:09:034
165009948963,211cyclictest0-21swapper/121:45:201
1650099489445,42cyclictest231rcuc/122:38:501
1650699488148,338cyclictest16497-21cyclictest23:55:167
165039948866,84cyclictest0-21swapper/422:58:484
165049948719,465cyclictest0-21swapper/520:02:505
165019948659,169cyclictest33-21ksoftirqd/222:20:002
165009948620,83cyclictest19497-21munin-node22:28:201
165009948620,83cyclictest19497-21munin-node22:28:201
1650599485142,126cyclictest121rcu_preempt00:01:376
165049948522,253cyclictest0-21swapper/500:18:385
1650399485106,295cyclictest0-21swapper/419:54:204
1650299485143,126cyclictest2094-21munin-run22:10:023
165039948463,84cyclictest0-21swapper/421:43:444
165039948463,84cyclictest0-21swapper/421:43:444
164999948462,211cyclictest0-21swapper/022:10:120
164999948416,338cyclictest0-21swapper/023:55:170
165029948320,295cyclictest0-21swapper/320:00:533
165009948357,211cyclictest694-21irqbalance21:29:491
165029948258,211cyclictest0-21swapper/321:30:073
165019948255,211cyclictest33-21ksoftirqd/222:00:282
164999948255,338cyclictest0-21swapper/022:50:050
165029948112,84cyclictest0-21swapper/300:18:153
165029948015,126cyclictest0-21swapper/323:32:333
165009948014,211cyclictest0-21swapper/121:55:101
165019947999,255cyclictest7471-21kworker/u16:200:36:492
165019947956,339cyclictest0-21swapper/222:09:032
165059947755,338cyclictest0-21swapper/619:54:206
16504994779,465cyclictest0-21swapper/520:05:185
164999947713,295cyclictest9-21ksoftirqd/023:25:530
164999947696,83cyclictest0-21swapper/000:09:370
165009947410,295cyclictest0-21swapper/120:02:391
16500994737,84cyclictest0-21swapper/121:35:361
16499994713,465cyclictest0-21swapper/023:24:390
16501994693,84cyclictest121rcu_preempt23:36:222
16499994695,2cyclictest0-21swapper/022:58:380
16499994691,176cyclictest0-21swapper/023:33:490
165019946887,208cyclictest0-21swapper/222:10:122
16499994680,301cyclictest121rcu_preempt21:30:110
165019946783,381cyclictest0-21swapper/221:53:212
16499994672,90cyclictest16497-21cyclictest00:19:390
1650699466170,84cyclictest121rcu_preempt21:53:107
165029946682,211cyclictest41-21ksoftirqd/322:38:203
165069946585,299cyclictest0-21swapper/720:40:507
165049946539,423cyclictest0-21swapper/523:53:335
165069946441,3cyclictest0-21swapper/723:24:027
1650299464121,169cyclictest0-21swapper/323:15:033
165009946479,253cyclictest0-21swapper/119:45:011
1649999464123,338cyclictest0-21swapper/020:41:070
165069946389,119cyclictest0-21swapper/700:01:287
165039946341,298cyclictest29643-21ssh21:30:014
165049946238,258cyclictest0-21swapper/523:55:075
1650399462120,168cyclictest1551-21snmpd22:39:384
165019946278,211cyclictest33-21ksoftirqd/219:53:072
165019946238,339cyclictest0-21swapper/222:59:542
1649999462122,126cyclictest9-21ksoftirqd/022:39:190
165059946182,295cyclictest0-21swapper/623:34:076
165019946139,256cyclictest0-21swapper/223:55:072
1649999461122,337cyclictest0-21swapper/023:45:370
165059946077,84cyclictest16497-21cyclictest00:11:056
1650599460117,127cyclictest0-21swapper/623:07:396
165039946081,83cyclictest9561-21ssh22:50:074
165009946080,338cyclictest0-21swapper/123:05:411
165009946033,296cyclictest16497-21cyclictest22:09:211
1649999460377,4cyclictest111rcuc/019:50:580
164999946034,253cyclictest0-21swapper/023:00:050
165069945975,211cyclictest0-21swapper/719:43:177
165049945937,340cyclictest0-21swapper/500:09:505
165029945931,211cyclictest0-21swapper/323:06:133
165009945937,3cyclictest0-21swapper/120:40:501
165069945834,84cyclictest0-21swapper/722:28:157
165069945834,84cyclictest0-21swapper/722:28:157
165059945875,380cyclictest0-21swapper/623:25:186
165059945836,2cyclictest0-21swapper/600:19:156
165049945832,126cyclictest0-21swapper/522:39:555
1650099458115,211cyclictest25-21ksoftirqd/100:09:371
165039945778,83cyclictest0-21swapper/419:55:084
165019945773,211cyclictest0-21swapper/200:18:302
165019945735,176cyclictest0-21swapper/223:44:212
165069945675,84cyclictest0-21swapper/722:10:017
165059945677,126cyclictest24083-21diskmemload22:59:086
165059945675,84cyclictest0-21swapper/600:09:376
1650199456116,338cyclictest16497-21cyclictest23:54:402
1650399455114,338cyclictest64450irq/122-eth023:53:094
165019945533,259cyclictest0-21swapper/200:01:222
165019945529,211cyclictest33-21ksoftirqd/220:03:522
1650199455115,338cyclictest0-21swapper/221:45:042
1649999455116,337cyclictest0-21swapper/000:28:150
165069945470,84cyclictest0-21swapper/722:22:457
165059945432,177cyclictest0-21swapper/622:10:096
165039945475,84cyclictest0-21swapper/421:52:584
1650599453112,338cyclictest16497-21cyclictest21:54:216
165029945373,295cyclictest0-21swapper/300:09:313
165019945331,338cyclictest0-21swapper/223:27:172
165039945234,292cyclictest0-21swapper/400:01:414
1650099452370,79cyclictest241ktimersoftd/121:30:121
1650699451110,338cyclictest0-21swapper/700:19:167
165039945130,2cyclictest0-21swapper/420:44:204
1650099451199,126cyclictest0-21swapper/123:00:031
164999945125,296cyclictest0-21swapper/020:03:430
165029945027,256cyclictest0-21swapper/321:54:583
165069944925,85cyclictest0-21swapper/722:48:487
165059944970,84cyclictest0-21swapper/623:15:046
165059944927,256cyclictest0-21swapper/619:44:296
165009944923,168cyclictest0-21swapper/119:50:341
165029944826,2cyclictest0-21swapper/323:36:333
165019944864,211cyclictest0-21swapper/223:33:292
165049944764,168cyclictest3204-21ssh21:15:155
1650299447105,211cyclictest0-21swapper/320:05:203
1650199447108,84cyclictest0-21swapper/219:45:002
1649999447108,84cyclictest0-21swapper/000:11:150
1650499446107,337cyclictest0-21swapper/522:40:185
165029944624,84cyclictest0-21swapper/319:40:333
165029944624,2cyclictest0-21swapper/320:40:503
165009944668,375cyclictest0-21swapper/122:40:261
1650499445106,84cyclictest0-21swapper/522:00:045
165039944521,8cyclictest0-21swapper/422:49:484
165009944561,253cyclictest0-21swapper/120:45:151
1650699444102,339cyclictest0-21swapper/722:00:257
1650399444106,335cyclictest0-21swapper/400:19:064
1650199444100,127cyclictest33-21ksoftirqd/221:15:152
1650699443105,127cyclictest73-21ksoftirqd/721:30:027
1650599443111,248cyclictest641ktimersoftd/620:45:156
1650399443105,171cyclictest0-21swapper/419:45:104
164999944362,84cyclictest0-21swapper/020:45:150
165049944220,177cyclictest0-21swapper/523:00:085
1650299442146,82cyclictest0-21swapper/322:59:293
165019944262,296cyclictest0-21swapper/200:09:312
165059944119,126cyclictest0-21swapper/622:49:586
165059944118,3cyclictest0-21swapper/622:50:086
1650499441315,43cyclictest561ktimersoftd/522:10:085
165029944118,3cyclictest0-21swapper/323:55:073
165029944117,84cyclictest0-21swapper/323:53:413
165039944056,253cyclictest16497-21cyclictest22:40:174
165029943955,211cyclictest41-21ksoftirqd/320:45:153
164999943914,299cyclictest121rcu_preempt21:45:200
164999943854,84cyclictest0-21swapper/019:55:080
165039943716,3cyclictest0-21swapper/400:36:494
165009943715,84cyclictest0-21swapper/122:49:321
1650099436350,84cyclictest231rcuc/123:22:571
1649999436138,126cyclictest16497-21cyclictest22:48:390
164999943610,211cyclictest9-21ksoftirqd/023:14:520
165059943353,296cyclictest0-21swapper/621:15:196
1650399433178,253cyclictest64450irq/122-eth021:45:254
164999943353,84cyclictest0-21swapper/000:43:110
165009943211,2cyclictest0-21swapper/100:36:491
165029943188,126cyclictest121rcu_preempt21:45:283
16503994304,210cyclictest49-21ksoftirqd/422:10:104
165059942988,338cyclictest24083-21diskmemload23:00:046
1650099429215,84cyclictest0-21swapper/123:55:181
16506994285,3cyclictest0-21swapper/723:42:277
16504994282,423cyclictest0-21swapper/521:30:115
165069942786,338cyclictest0-21swapper/721:45:207
165029942786,338cyclictest0-21swapper/322:40:233
165009942748,171cyclictest0-21swapper/123:15:031
165059942682,338cyclictest0-21swapper/620:35:176
16504994261,422cyclictest0-21swapper/522:59:525
16500994264,2cyclictest0-21swapper/122:50:081
165069942582,126cyclictest121rcu_preempt22:30:017
16501994251,42cyclictest0-21swapper/222:40:042
165069942439,211cyclictest0-21swapper/700:20:047
165059942483,338cyclictest0-21swapper/622:40:046
165059942482,339cyclictest0-21swapper/622:00:046
165039942440,211cyclictest121rcu_preempt22:00:034
1650299424167,126cyclictest121rcu_preempt23:43:573
165069942383,84cyclictest0-21swapper/721:30:067
165069942382,127cyclictest0-21swapper/719:50:367
165069942340,211cyclictest121rcu_preempt00:11:267
16503994231,2cyclictest0-21swapper/400:11:234
165029942382,338cyclictest0-21swapper/300:01:333
165019942383,338cyclictest0-21swapper/223:45:372
165019942383,338cyclictest0-21swapper/200:11:202
165009942382,338cyclictest0-21swapper/122:59:301
165009942382,338cyclictest0-21swapper/100:20:031
16500994230,296cyclictest0-21swapper/122:10:081
16499994231,2cyclictest0-21swapper/019:14:240
165059942281,339cyclictest0-21swapper/600:28:146
165049942282,338cyclictest0-21swapper/519:53:105
165069942181,84cyclictest0-21swapper/723:26:197
165059942182,84cyclictest0-21swapper/621:45:116
165059942180,338cyclictest0-21swapper/620:05:076
165059942140,297cyclictest0-21swapper/623:14:536
1650199421124,126cyclictest121rcu_preempt20:45:062
164999942181,338cyclictest0-21swapper/022:00:270
165069942081,84cyclictest0-21swapper/723:45:377
165059942081,84cyclictest16497-21cyclictest22:19:406
165059942079,338cyclictest0-21swapper/619:14:236
165059942078,170cyclictest65-21ksoftirqd/623:45:156
165049942080,338cyclictest21391-1kworker/u17:122:50:155
165039942082,84cyclictest0-21swapper/422:19:404
165039942082,84cyclictest0-21swapper/421:30:114
165039942040,216cyclictest0-21swapper/419:43:384
165019942079,338cyclictest0-21swapper/223:14:572
165039941977,211cyclictest49-21ksoftirqd/423:14:574
165029941937,42cyclictest121rcu_preempt23:45:333
165069941879,85cyclictest0-21swapper/700:09:447
165069941877,127cyclictest0-21swapper/723:15:107
165049941881,169cyclictest57-21ksoftirqd/522:30:025
165039941879,83cyclictest0-21swapper/400:09:374
165029941877,338cyclictest0-21swapper/300:11:153
1650699417247,84cyclictest10300-21fschecks_count20:45:157
165049941778,84cyclictest0-21swapper/522:19:405
165039941778,84cyclictest0-21swapper/423:55:164
164999941776,339cyclictest0-21swapper/022:19:400
165059941677,84cyclictest0-21swapper/621:30:116
165049941676,338cyclictest0-21swapper/523:45:165
165049941675,338cyclictest0-21swapper/500:43:115
165039941634,124cyclictest121rcu_preempt23:16:214
165029941634,127cyclictest0-21swapper/300:35:253
165069941576,84cyclictest0-21swapper/720:05:187
165069941574,338cyclictest0-21swapper/722:40:267
165049941576,84cyclictest0-21swapper/523:15:085
165019941575,338cyclictest0-21swapper/220:05:192
165049941434,126cyclictest0-21swapper/519:55:045
165029941432,84cyclictest0-21swapper/300:20:023
165009941374,84cyclictest0-21swapper/100:28:151
164999941329,126cyclictest4360-21ssh22:30:020
165049941271,338cyclictest0-21swapper/520:45:155
165029941232,84cyclictest0-21swapper/321:15:143
165019941168,169cyclictest33-21ksoftirqd/220:44:532
165009941074,83cyclictest0-21swapper/120:05:071
165039940928,126cyclictest19109-21hddtemp_smartct20:05:204
164999940929,256cyclictest0-21swapper/023:15:070
165059940866,338cyclictest0-21swapper/600:43:116
165059940828,49cyclictest0-21swapper/620:03:556
165069940727,84cyclictest0-21swapper/722:19:397
165029940625,257cyclictest0-21swapper/322:50:083
165049940564,338cyclictest0-21swapper/500:11:205
165069940462,211cyclictest0-21swapper/721:15:287
165069940423,84cyclictest0-21swapper/720:01:527
165019940421,253cyclictest0-21swapper/223:00:042
165009940419,126cyclictest0-21swapper/123:45:381
165019940319,381cyclictest0-21swapper/221:30:062
165049940223,300cyclictest0-21swapper/500:20:025
164999940261,338cyclictest0-21swapper/000:20:020
165069940162,84cyclictest0-21swapper/700:28:237
165069940061,84cyclictest0-21swapper/722:10:077
165049940023,163cyclictest0-21swapper/523:14:525
165009939718,84cyclictest0-21swapper/123:14:571
165009939658,84cyclictest0-21swapper/122:19:401
165039939557,84cyclictest0-21swapper/423:45:094
165029939495,126cyclictest131rcu_sched23:14:583
164999939457,168cyclictest0-21swapper/021:15:280
165049939215,173cyclictest0-21swapper/500:28:285
16503993929,211cyclictest0-21swapper/421:15:144
165009939297,126cyclictest0-21swapper/119:45:041
165019938847,338cyclictest0-21swapper/222:50:142
165029938645,338cyclictest0-21swapper/322:20:013
165059938384,85cyclictest121rcu_preempt22:30:116
16506993821,3cyclictest0-21swapper/722:50:087
16502993811,84cyclictest0-21swapper/319:55:083
16501993811,127cyclictest16497-21cyclictest20:35:172
1650399380124,253cyclictest0-21swapper/422:30:094
165059937940,254cyclictest0-21swapper/619:45:126
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional