You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-19 - 09:49
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Sun Jul 19, 2026 00:56:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
251759975634,676cyclictest704-21nscd23:03:304
251759975235,638cyclictest0-21swapper/422:50:304
2517399730218,296cyclictest0-21swapper/222:05:452
251759969717,677cyclictest0-21swapper/419:57:194
251759969217,384cyclictest0-21swapper/400:21:114
251759967538,634cyclictest0-21swapper/422:09:264
2517199667118,338cyclictest1-21systemd23:25:350
251759966024,633cyclictest0-21swapper/400:35:464
251779965016,381cyclictest0-21swapper/600:21:126
25178996428,382cyclictest0-21swapper/700:21:117
25172996362,382cyclictest0-21swapper/122:47:131
25172996362,381cyclictest0-21swapper/100:21:111
25177996351,383cyclictest0-21swapper/622:47:146
25171996351,381cyclictest0-21swapper/000:21:110
251759962975,126cyclictest0-21swapper/423:23:384
251759962975,126cyclictest0-21swapper/423:23:384
251759962531,591cyclictest0-21swapper/423:25:154
251759962135,160cyclictest0-21swapper/423:42:564
251729962029,422cyclictest6396-21rm22:02:271
251729962029,422cyclictest6396-21rm22:02:271
251729962029,422cyclictest6396-21rm22:02:271
251729962029,422cyclictest6396-21rm22:02:271
2517199614104,295cyclictest16357-21ssh22:44:070
251719961120,422cyclictest0-21swapper/021:31:350
251749960513,383cyclictest0-21swapper/322:47:133
25174995986,382cyclictest0-21swapper/300:21:113
25175995972,42cyclictest0-21swapper/422:48:524
251759959180,84cyclictest121rcu_preempt22:41:124
2517599589249,338cyclictest64450irq/122-eth022:29:364
251749958838,339cyclictest0-21swapper/323:24:563
251749958838,339cyclictest0-21swapper/323:24:563
251759958474,507cyclictest0-21swapper/420:34:344
2517599581199,126cyclictest121rcu_preempt00:18:584
251739957867,211cyclictest321ktimersoftd/200:38:242
251759957523,549cyclictest16901-21grep22:10:124
251779956916,550cyclictest0-21swapper/621:50:176
251739956860,472cyclictest0-21swapper/223:57:012
251759956757,507cyclictest0-21swapper/423:59:014
251759956756,508cyclictest0-21swapper/421:49:234
2517199561138,126cyclictest517-21diskmemload22:46:310
251719956010,135cyclictest0-21swapper/022:30:150
2517899558471,85cyclictest711rcuc/700:38:157
2517899557477,77cyclictest711rcuc/722:09:087
25175995561,551cyclictest0-21swapper/421:32:344
25171995568,381cyclictest0-21swapper/023:35:210
251789955543,508cyclictest0-21swapper/723:59:537
25172995510,84cyclictest14221-21ssh00:10:451
251719955140,379cyclictest0-21swapper/022:04:110
251719955140,379cyclictest0-21swapper/022:04:110
251719955140,379cyclictest0-21swapper/022:04:110
251719955140,379cyclictest0-21swapper/022:04:110
25174995501,382cyclictest0-21swapper/323:54:573
25176995490,84cyclictest1553-21runrttasks21:32:455
251769954476,211cyclictest0-21swapper/500:35:505
2517399543125,203cyclictest0-21swapper/223:13:362
251719954072,465cyclictest0-21swapper/021:50:030
251779953932,126cyclictest0-21swapper/623:57:016
251749953969,296cyclictest0-21swapper/323:00:523
251759953831,3cyclictest0-21swapper/423:13:294
251749953825,510cyclictest0-21swapper/323:59:533
251719953730,338cyclictest0-21swapper/022:05:190
251749953569,126cyclictest12904-21taskset22:06:213
251789953465,466cyclictest0-21swapper/700:12:057
251769953266,126cyclictest0-21swapper/522:05:455
251729953222,337cyclictest0-21swapper/121:50:321
251729953125,126cyclictest0-21swapper/122:06:271
251779952921,256cyclictest0-21swapper/623:14:186
2517799528144,126cyclictest121rcu_preempt22:59:316
251719952615,380cyclictest0-21swapper/023:33:340
251729952515,507cyclictest0-21swapper/123:59:531
251749952315,296cyclictest0-21swapper/320:31:043
2517499523143,296cyclictest31636-21kworker/u16:022:01:263
2517499523143,296cyclictest31636-21kworker/u16:022:01:263
2517499523143,296cyclictest31636-21kworker/u16:022:01:263
2517499523143,296cyclictest31636-21kworker/u16:022:01:263
251769952157,295cyclictest0-21swapper/522:03:205
251769952157,295cyclictest0-21swapper/522:03:205
251769952157,295cyclictest0-21swapper/522:03:205
251769952157,295cyclictest0-21swapper/522:03:205
251729952113,87cyclictest0-21swapper/122:41:001
251759952052,465cyclictest0-21swapper/422:59:274
251739952051,296cyclictest0-21swapper/219:56:312
251739951710,43cyclictest0-21swapper/222:43:102
25171995177,507cyclictest0-21swapper/023:59:530
25178995169,255cyclictest0-21swapper/723:14:187
25172995169,211cyclictest0-21swapper/121:32:431
25174995139,501cyclictest0-21swapper/321:50:043
25173995131,127cyclictest0-21swapper/222:49:072
25171995121,338cyclictest1553-21runrttasks00:19:490
25172995103,256cyclictest0-21swapper/123:14:191
25178995081,256cyclictest0-21swapper/723:54:577
25178995081,256cyclictest0-21swapper/722:47:137
25171995071,255cyclictest694-21irqbalance23:14:180
251729950633,127cyclictest0-21swapper/123:23:131
251729950633,127cyclictest0-21swapper/123:23:121
25172995063,252cyclictest0-21swapper/123:54:581
2517199506166,337cyclictest24590-21kworker/u16:222:30:000
251779950540,295cyclictest0-21swapper/623:04:376
251749950233,346cyclictest0-21swapper/300:00:113
251739950275,211cyclictest33-21ksoftirqd/223:15:082
2517599501119,85cyclictest0-21swapper/421:50:294
251789950078,168cyclictest121rcu_preempt22:50:467
2517899500117,129cyclictest0-21swapper/722:03:357
2517899500117,129cyclictest0-21swapper/722:03:347
2517899500117,129cyclictest0-21swapper/722:03:347
2517899500117,129cyclictest0-21swapper/722:03:347
251759950035,384cyclictest0-21swapper/400:40:054
251759950033,465cyclictest0-21swapper/400:13:334
251749950033,211cyclictest0-21swapper/322:28:123
251739950074,211cyclictest33-21ksoftirqd/223:24:222
251739950074,211cyclictest33-21ksoftirqd/223:24:222
251789949976,256cyclictest11787-21diskmemload21:48:257
251779949929,169cyclictest65-21ksoftirqd/620:31:036
251779949829,338cyclictest21993-21sh22:30:016
251719949834,84cyclictest0-21swapper/023:43:270
2517199498201,210cyclictest2176-21kworker/0:019:59:560
2517499497116,84cyclictest0-21swapper/321:48:343
251729949729,338cyclictest0-21swapper/121:48:391
2517499496112,210cyclictest8521-21ssh22:58:023
251729949632,295cyclictest0-21swapper/100:15:021
251729949631,253cyclictest0-21swapper/100:39:221
251729949627,380cyclictest0-21swapper/121:35:281
251779949530,43cyclictest0-21swapper/600:26:096
251759949527,296cyclictest187-21md0_raid122:03:114
251759949527,296cyclictest187-21md0_raid122:03:114
251759949527,296cyclictest187-21md0_raid122:03:114
251759949527,296cyclictest187-21md0_raid122:03:114
251789949426,465cyclictest0-21swapper/721:50:047
251729949325,465cyclictest6043-1kworker/u17:123:01:261
251789949121,338cyclictest0-21swapper/721:35:247
2517899491150,339cyclictest24590-21kworker/u16:222:26:007
2517499490109,84cyclictest0-21swapper/300:16:083
251719949025,295cyclictest0-21swapper/020:34:150
2517199490110,85cyclictest0-21swapper/022:10:120
251779948920,465cyclictest517-21diskmemload21:49:586
251729948964,167cyclictest25-21ksoftirqd/122:27:271
2517899488192,211cyclictest721ktimersoftd/721:32:447
251729948622,41cyclictest0-21swapper/122:58:091
251749948520,296cyclictest0-21swapper/323:14:283
251719948559,211cyclictest9-21ksoftirqd/000:11:360
251789948415,211cyclictest25169-21cyclictest23:02:247
251739948462,211cyclictest0-21swapper/200:19:472
251739948419,254cyclictest0-21swapper/222:30:302
2517799482141,126cyclictest121rcu_preempt22:07:096
251719948213,380cyclictest0-21swapper/022:58:270
2517599481182,296cyclictest64450irq/122-eth023:35:314
2517899480100,296cyclictest25691-21rm00:19:507
2517699480441,37cyclictest551rcuc/522:41:125
251789947914,343cyclictest0-21swapper/719:55:467
251769947954,210cyclictest0-21swapper/522:59:425
251769947812,84cyclictest0-21swapper/523:24:415
251769947812,84cyclictest0-21swapper/523:24:415
251749947850,425cyclictest0-21swapper/300:12:053
251719947813,213cyclictest18954-21ntp_states21:35:260
25175994768,42cyclictest0-21swapper/423:33:394
251719947612,211cyclictest0-21swapper/023:03:480
2517499474390,3cyclictest391rcuc/322:43:103
251739947456,80cyclictest0-21swapper/222:04:542
251739947456,80cyclictest0-21swapper/222:04:542
251739947456,80cyclictest0-21swapper/222:04:542
251739947456,80cyclictest0-21swapper/222:04:542
251719947410,211cyclictest9-21ksoftirqd/023:45:240
251769947250,256cyclictest25113-21ssh00:19:165
251739947149,84cyclictest0-21swapper/223:44:532
25171994717,261cyclictest0-21swapper/000:38:570
25177994701,42cyclictest0-21swapper/600:16:566
25175994702,42cyclictest0-21swapper/423:15:204
25171994701,296cyclictest0-21swapper/023:24:370
25171994701,296cyclictest0-21swapper/023:24:370
2517799467124,340cyclictest0-21swapper/621:31:366
2517399466123,126cyclictest33-21ksoftirqd/221:34:462
2517899465124,339cyclictest0-21swapper/722:59:557
2517899465124,338cyclictest0-21swapper/723:24:307
2517899465124,338cyclictest0-21swapper/723:24:307
251779946585,296cyclictest0-21swapper/622:04:546
251779946585,296cyclictest0-21swapper/622:04:546
251779946585,296cyclictest0-21swapper/622:04:546
251779946585,296cyclictest0-21swapper/622:04:546
25176994651,212cyclictest0-21swapper/500:21:115
2517499465124,338cyclictest0-21swapper/322:50:243
2517499465123,339cyclictest0-21swapper/300:26:063
2517899464124,338cyclictest0-21swapper/723:25:127
2517799464124,338cyclictest517-21diskmemload21:35:256
2517799464124,338cyclictest0-21swapper/623:24:376
2517799464124,338cyclictest0-21swapper/623:24:376
2517199464124,338cyclictest25169-21cyclictest23:53:580
251789946379,381cyclictest0-21swapper/722:30:137
2517899463123,338cyclictest0-21swapper/700:00:097
251769946382,84cyclictest0-21swapper/523:42:585
2517699463122,338cyclictest0-21swapper/522:30:285
2517499462120,339cyclictest0-21swapper/319:57:193
251739946276,169cyclictest33-21ksoftirqd/222:58:432
251719946239,259cyclictest0-21swapper/023:15:240
251789946139,295cyclictest0-21swapper/723:15:147
251779946134,380cyclictest0-21swapper/623:25:156
2517399461378,2cyclictest311rcuc/200:23:492
2517899460122,83cyclictest0-21swapper/700:40:277
2517699460119,338cyclictest121rcu_preempt00:09:295
251749946038,302cyclictest0-21swapper/321:34:043
251719946038,2cyclictest0-21swapper/000:26:080
251779945937,256cyclictest0-21swapper/623:44:296
251779945935,41cyclictest0-21swapper/622:44:326
251729945937,177cyclictest0-21swapper/123:15:151
251729945937,177cyclictest0-21swapper/100:26:151
251789945834,258cyclictest0-21swapper/722:41:387
251779945874,381cyclictest0-21swapper/600:11:436
251749945830,338cyclictest0-21swapper/322:30:293
251779945735,255cyclictest0-21swapper/619:56:426
251759945732,422cyclictest0-21swapper/423:53:514
2517499457117,338cyclictest0-21swapper/323:33:563
251789945672,126cyclictest25169-21cyclictest23:42:277
251719945634,259cyclictest0-21swapper/021:48:250
251759945533,343cyclictest0-21swapper/423:45:154
2517499455115,84cyclictest0-21swapper/322:10:223
251719945576,295cyclictest0-21swapper/022:50:430
251769945424,211cyclictest57-21ksoftirqd/523:14:335
251729945432,210cyclictest0-21swapper/122:30:291
251729945430,84cyclictest0-21swapper/123:25:361
251749945373,218cyclictest27770-21runrttasks00:39:183
251719945331,256cyclictest0-21swapper/000:40:110
251789945230,257cyclictest0-21swapper/723:35:317
2517499452111,338cyclictest0-21swapper/321:35:263
251759945129,343cyclictest25169-21cyclictest22:30:084
251749945128,256cyclictest0-21swapper/323:43:483
251779945066,169cyclictest65-21ksoftirqd/623:15:046
251769945028,85cyclictest0-21swapper/523:03:395
251769944926,126cyclictest121rcu_preempt23:34:515
251769944922,3cyclictest0-21swapper/523:59:395
2517699449150,126cyclictest121rcu_preempt22:50:235
2517699449107,339cyclictest0-21swapper/522:27:245
251779944864,381cyclictest25169-21cyclictest23:45:236
251739944825,3cyclictest0-21swapper/223:03:292
251729944725,256cyclictest0-21swapper/100:40:111
251759944623,343cyclictest0-21swapper/400:26:084
251739944624,259cyclictest0-21swapper/223:33:342
2517599445104,338cyclictest18405-21ssh21:35:204
251749944523,338cyclictest0-21swapper/323:15:033
251739944421,256cyclictest0-21swapper/222:27:472
251739944420,85cyclictest0-21swapper/220:30:422
251729944321,338cyclictest1578-21lldpd22:50:301
251729944119,2cyclictest0-21swapper/120:32:061
2517899440225,84cyclictest121rcu_preempt20:33:287
251769944017,253cyclictest0-21swapper/500:13:485
251739944017,85cyclictest0-21swapper/223:25:162
251729944017,257cyclictest0-21swapper/123:43:481
251729944017,253cyclictest0-21swapper/123:45:211
251739943917,126cyclictest0-21swapper/222:51:022
251729943917,177cyclictest0-21swapper/123:35:031
251779943811,296cyclictest0-21swapper/622:30:146
2517299438180,126cyclictest10247-21sh00:09:441
251779943715,257cyclictest0-21swapper/600:39:516
251759943712,211cyclictest0-21swapper/423:05:054
251759943712,211cyclictest0-21swapper/423:05:054
251749943714,256cyclictest0-21swapper/323:35:313
251729943757,126cyclictest0-21swapper/119:58:541
251739943614,256cyclictest0-21swapper/200:26:092
251779943412,171cyclictest0-21swapper/623:54:576
251769943455,84cyclictest0-21swapper/521:35:035
251769943194,84cyclictest0-21swapper/523:25:105
25176994308,2cyclictest0-21swapper/520:30:305
25176994291,255cyclictest0-21swapper/523:54:585
251739942483,338cyclictest0-21swapper/221:48:252
25177994231,255cyclictest0-21swapper/600:40:056
251769942283,84cyclictest0-21swapper/521:50:295
251769942281,126cyclictest12080-21ssh21:48:515
251769942280,126cyclictest0-21swapper/522:48:015
251739942238,126cyclictest0-21swapper/223:05:102
251739942238,126cyclictest0-21swapper/223:05:102
251779942180,338cyclictest0-21swapper/622:10:236
251749942182,84cyclictest0-21swapper/320:25:063
251749942180,338cyclictest0-21swapper/323:25:073
251729942180,338cyclictest0-21swapper/120:25:111
251729942141,296cyclictest0-21swapper/123:05:051
251729942141,296cyclictest0-21swapper/123:05:051
251789942080,338cyclictest0-21swapper/722:10:127
251779942079,339cyclictest27676-21ssh22:50:316
251749942079,338cyclictest0-21swapper/300:40:303
251759941940,253cyclictest353-21systemd-udevd00:09:354
251749941939,296cyclictest0-21swapper/320:35:143
251739941935,381cyclictest0-21swapper/221:50:032
251729941939,296cyclictest0-21swapper/123:33:411
251719941979,338cyclictest0-21swapper/000:09:290
251719941940,295cyclictest0-21swapper/000:00:110
251789941877,338cyclictest0-21swapper/723:34:187
251779941877,338cyclictest0-21swapper/623:33:346
251779941776,338cyclictest0-21swapper/620:00:116
251779941776,338cyclictest0-21swapper/620:00:116
251769941780,82cyclictest0-21swapper/523:05:125
251769941780,82cyclictest0-21swapper/523:05:125
251739941776,338cyclictest0-21swapper/200:40:302
251789941674,339cyclictest0-21swapper/720:00:117
251789941674,339cyclictest0-21swapper/720:00:117
251779941636,296cyclictest0-21swapper/620:35:136
251769941678,84cyclictest0-21swapper/500:00:105
251759941636,296cyclictest0-21swapper/420:35:134
251739941675,338cyclictest0-21swapper/220:00:122
251739941675,338cyclictest0-21swapper/220:00:112
251769941577,84cyclictest0-21swapper/519:58:095
251779941473,338cyclictest12106-21ntp_offset23:35:236
251749941433,296cyclictest0-21swapper/323:05:043
251749941433,296cyclictest0-21swapper/323:05:043
251789941372,339cyclictest0-21swapper/700:26:127
251719941329,260cyclictest0-21swapper/020:00:040
251719941329,260cyclictest0-21swapper/020:00:040
251769941274,83cyclictest25169-21cyclictest23:15:085
251729941271,338cyclictest0-21swapper/122:10:221
251779941030,296cyclictest187-21md0_raid100:00:116
251769941072,84cyclictest0-21swapper/500:40:295
251769941071,84cyclictest0-21swapper/520:00:055
251769941071,84cyclictest0-21swapper/520:00:045
251759940929,296cyclictest0-21swapper/400:00:114
251739940968,338cyclictest0-21swapper/200:14:072
251789940867,338cyclictest0-21swapper/720:25:117
251789940829,295cyclictest0-21swapper/700:09:417
251769940870,83cyclictest0-21swapper/500:25:505
251769940768,84cyclictest0-21swapper/522:10:135
251789940666,338cyclictest0-21swapper/723:45:157
251779940627,295cyclictest0-21swapper/623:05:056
251779940627,295cyclictest0-21swapper/623:05:056
251779940463,338cyclictest0-21swapper/620:25:126
251719940222,217cyclictest0-21swapper/020:35:100
251749940116,211cyclictest121rcu_preempt23:45:203
251729940162,84cyclictest0-21swapper/120:00:041
251729940162,84cyclictest0-21swapper/120:00:041
251729940122,295cyclictest0-21swapper/120:35:131
251769939918,84cyclictest0-21swapper/520:35:125
251789939716,296cyclictest0-21swapper/723:05:057
251789939716,296cyclictest0-21swapper/723:05:057
251759939756,338cyclictest0-21swapper/420:00:114
251759939756,338cyclictest0-21swapper/420:00:114
251749939598,84cyclictest0-21swapper/320:00:043
251749939598,84cyclictest0-21swapper/320:00:043
251769938850,84cyclictest21716-21nscd23:35:235
2517399382125,126cyclictest33-21ksoftirqd/221:35:272
251789937740,253cyclictest0-21swapper/720:35:057
251749937633,340cyclictest0-21swapper/300:09:363
251739937132,84cyclictest0-21swapper/223:45:232
251759936926,87cyclictest0-21swapper/420:25:064
251739936931,85cyclictest0-21swapper/220:25:072
251769935657,84cyclictest0-21swapper/523:45:145
2517399355276,3cyclictest321ktimersoftd/200:00:102
251739935513,211cyclictest0-21swapper/200:09:352
251739935417,85cyclictest0-21swapper/222:10:142
251719935214,127cyclictest0-21swapper/020:25:110
251739935153,92cyclictest121rcu_preempt20:35:122
251739933838,211cyclictest0-21swapper/223:54:032
251729933882,253cyclictest517-21diskmemload00:00:091
251779933378,253cyclictest0-21swapper/600:09:356
251739933378,253cyclictest0-21swapper/223:35:292
251719932830,126cyclictest517-21diskmemload23:05:060
251719932830,126cyclictest517-21diskmemload23:05:060
251769928978,83cyclictest0-21swapper/520:25:115
423621140,2sleep32517499cyclictest22:20:133
2394829247,40sleep50-21swapper/519:05:215
2394829247,40sleep50-21swapper/519:05:215
2442128961,24sleep40-21swapper/419:05:284
2442128961,24sleep40-21swapper/419:05:284
2467928755,28sleep70-21swapper/719:09:087
2467928755,28sleep70-21swapper/719:09:087
288622830,0sleep40-21swapper/421:23:364
2459028352,27sleep20-21swapper/219:07:512
2459028352,27sleep20-21swapper/219:07:512
2443428351,28sleep60-21swapper/619:05:386
2443428351,28sleep60-21swapper/619:05:386
2445528249,29sleep00-21swapper/019:05:570
2445528249,29sleep00-21swapper/019:05:570
2442028151,27sleep30-21swapper/319:05:283
2442028151,27sleep30-21swapper/319:05:283
2465528052,5sleep10-21swapper/119:08:461
2465528052,5sleep10-21swapper/119:08:461
165332800,0sleep10-21swapper/119:45:221
15672760,0sleep30-21swapper/321:10:133
72872670,0sleep00-21swapper/021:29:010
25178993410,23cyclictest0-21swapper/719:31:597
25178993410,23cyclictest0-21swapper/719:31:587
25171993427,6cyclictest0-21swapper/021:42:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional