You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-30 - 09:20
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Thu Jul 30, 2026 00:44:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9790991383,88cyclictest4191-21apt-get23:16:162
97909911656,14cyclictest544-21cron19:50:592
97909910747,14cyclictest23770-21cut19:36:232
97909910359,11cyclictest181rcu_preempt00:21:142
97909910359,11cyclictest181rcu_preempt00:21:142
915729123,34sleep00-21swapper/018:51:470
9790999056,13cyclictest22562-21kworker/u18:1-rpciod22:16:322
979099903,41cyclictest21396-21apt-get22:51:182
978299897,33cyclictest31-21ksoftirqd/100:10:091
9782998970,13cyclictest21903-21sh23:45:581
9770998866,9cyclictest181rcu_preempt22:17:420
85052888,54sleep18548-21fschecks_time18:51:271
9770998758,20cyclictest20493-21latency_hist21:56:020
9770998751,7cyclictest181rcu_preempt21:22:480
9770998751,7cyclictest181rcu_preempt21:22:480
9770998749,9cyclictest181rcu_preempt22:37:390
9770998668,11cyclictest16881-21diskmemload23:01:220
9782998544,9cyclictest181rcu_preempt20:59:511
9770998564,15cyclictest15158-21/usr/sbin/munin22:41:350
9770998559,19cyclictest3915-21latency_hist20:16:030
9782998451,10cyclictest181rcu_preempt20:47:171
9790998334,19cyclictest15358-21ssh22:41:212
9770998356,8cyclictest181rcu_preempt22:06:010
9790998253,20cyclictest7423-21fschecks_count20:26:232
9770998267,9cyclictest2592-21ssh23:13:000
9770998248,8cyclictest181rcu_preempt19:21:210
979099811,38cyclictest12621-21grep20:41:302
9770998151,22cyclictest15462-21latency_hist20:51:020
9770998145,7cyclictest181rcu_preempt21:30:270
9782997959,14cyclictest2593-21sshd23:13:001
9782997958,14cyclictest10635-21grep20:36:211
9782997945,8cyclictest181rcu_preempt20:06:141
9782997939,8cyclictest181rcu_preempt22:31:011
9782997937,11cyclictest181rcu_preempt21:01:501
9782997937,11cyclictest181rcu_preempt21:01:501
9770997949,22cyclictest16643-21latency_hist19:16:010
9782997861,9cyclictest0-21swapper/121:16:331
9782997861,11cyclictest13314-21sh23:31:081
9782997856,16cyclictest544-21cron19:20:591
9782997838,8cyclictest181rcu_preempt23:51:391
978299782,39cyclictest31-21ksoftirqd/100:19:431
978299782,29cyclictest13300-21ssh22:36:391
9770997851,10cyclictest181rcu_preempt23:26:280
9770997849,21cyclictest0-21swapper/021:51:010
979099776,11cyclictest381ktimers/221:11:092
979099776,11cyclictest381ktimers/221:11:092
9790997732,22cyclictest29952-21ssh21:16:332
9782997764,9cyclictest9759-21cyclictest22:21:461
9782997764,9cyclictest9759-21cyclictest20:32:531
9782997758,14cyclictest19777-21latency_hist19:26:021
9782997757,14cyclictest4249-21sh23:16:181
9782997748,8cyclictest181rcu_preempt22:08:541
9782997748,8cyclictest181rcu_preempt22:08:541
9782997739,18cyclictest25917-21kworker/u19:0-rpciod22:13:281
9770997757,14cyclictest25171-21kworker/u19:0-rpciod23:36:350
9790997643,14cyclictest32495-21latency_hist22:16:012
9790997634,10cyclictest181rcu_preempt21:46:142
9790997611,30cyclictest18958-21kworker/2:0-events22:31:232
9782997659,11cyclictest14699-21apt-get21:46:141
9782997639,8cyclictest181rcu_preempt23:25:481
9782997639,8cyclictest181rcu_preempt23:25:481
9770997655,8cyclictest181rcu_preempt23:52:150
900227615,33sleep20-21swapper/218:51:452
9790997555,14cyclictest8901-21sh22:31:002
9790997553,12cyclictest7273-21munin-plugin-st00:15:582
9790997553,12cyclictest7273-21munin-plugin-st00:15:582
9790997528,13cyclictest181rcu_preempt21:27:002
9782997557,11cyclictest30804-21ssh00:00:591
9782997555,14cyclictest7256-21sh00:15:591
9782997555,14cyclictest7256-21sh00:15:591
9782997553,14cyclictest2374-21systemd-journal21:10:341
9782997545,9cyclictest181rcu_preempt22:43:001
9770997551,8cyclictest181rcu_preempt21:05:460
9770997551,8cyclictest181rcu_preempt21:05:460
977099754,37cyclictest15-21ksoftirqd/019:19:440
9790997459,10cyclictest8270-21processes00:16:332
9790997457,13cyclictest9759-21cyclictest23:41:022
9790997450,14cyclictest16870-21apt20:55:592
979099744,28cyclictest11388-21awk21:40:582
9790997435,14cyclictest0-21swapper/220:21:362
9790997435,14cyclictest0-21swapper/220:21:362
9782997437,10cyclictest25917-21kworker/u19:0-rpciod21:30:061
978299743,29cyclictest31-21ksoftirqd/100:21:351
978299743,29cyclictest31-21ksoftirqd/100:21:351
9770997456,11cyclictest6389-21ssh21:31:320
9770997455,14cyclictest20842-21latency_hist22:51:020
9770997452,8cyclictest181rcu_preempt00:13:280
9770997452,8cyclictest181rcu_preempt00:13:280
9770997443,14cyclictest544-21cron23:46:030
224622740,8sleep10-21swapper/119:32:291
9790997353,13cyclictest9862-21kworker/u17:2+flush-179:021:06:372
979099733,53cyclictest30658-21ssh23:06:182
9790997332,8cyclictest181rcu_preempt22:36:392
9790997331,14cyclictest181rcu_preempt20:39:312
9782997357,11cyclictest9759-21cyclictest22:48:281
9782997345,8cyclictest181rcu_preempt23:28:071
9782997336,14cyclictest181rcu_preempt23:48:491
9770997358,9cyclictest29163-21ssh21:16:090
9770997354,13cyclictest32072-21timerwakeupswit00:01:360
9770997354,13cyclictest32072-21timerwakeupswit00:01:360
9770997345,8cyclictest181rcu_preempt22:31:350
9770997340,11cyclictest181rcu_preempt20:21:240
9770997340,11cyclictest181rcu_preempt20:21:240
9770997337,16cyclictest0-21swapper/019:36:340
9770997326,10cyclictest24303-21users21:06:380
977099732,35cyclictest15-21ksoftirqd/020:39:480
979099728,37cyclictest13913-21apt-get20:46:262
9790997255,11cyclictest300-21rs:main2
9790997252,13cyclictest21524-21apt-key19:31:022
9790997223,13cyclictest181rcu_preempt23:43:092
979099721,40cyclictest39-21ksoftirqd/200:00:482
9782997257,10cyclictest9759-21cyclictest23:04:471
978299724,35cyclictest31-21ksoftirqd/119:56:171
978299724,35cyclictest31-21ksoftirqd/119:56:171
9782997243,11cyclictest181rcu_preempt21:33:441
9782997241,8cyclictest181rcu_preempt19:06:091
9782997233,8cyclictest181rcu_preempt20:46:021
978299723,32cyclictest24105-21munin-run22:56:001
9782997232,9cyclictest0-21swapper/122:06:011
9782997230,8cyclictest0-21swapper/119:01:331
9782997227,18cyclictest16449-21cstates23:36:161
9770997254,12cyclictest6880-21ssh22:26:330
9770997253,9cyclictest0-21swapper/019:01:020
9770997249,8cyclictest181rcu_preempt19:01:340
9770997245,8cyclictest181rcu_preempt21:13:390
9770997245,8cyclictest181rcu_preempt21:13:390
9770997245,11cyclictest181rcu_preempt19:57:260
9770997245,11cyclictest181rcu_preempt19:57:260
9770997243,8cyclictest181rcu_preempt19:47:460
9770997237,11cyclictest181rcu_preempt22:51:130
9801997153,13cyclictest451rcuc/321:39:463
9790997147,11cyclictest181rcu_preempt20:10:342
9790997141,16cyclictest181rcu_preempt19:13:172
9790997135,13cyclictest181rcu_preempt20:01:272
979099713,36cyclictest39-21ksoftirqd/223:25:102
979099713,36cyclictest39-21ksoftirqd/223:25:102
9790997116,41cyclictest20003-21wc19:26:032
9782997156,9cyclictest9997-21cpuspeed18:56:151
9782997155,10cyclictest31737-21ntp_offset00:01:291
9782997155,10cyclictest31737-21ntp_offset00:01:291
9782997151,14cyclictest26386-21sh21:11:191
9782997151,14cyclictest26386-21sh21:11:191
9782997139,22cyclictest26508-21lockfile-remove19:45:591
9782997138,10cyclictest181rcu_preempt22:20:111
9782997133,10cyclictest181rcu_preempt21:42:331
9782997132,8cyclictest181rcu_preempt22:56:241
9782997126,9cyclictest181rcu_preempt20:21:001
9770997152,7cyclictest181rcu_preempt22:09:140
9770997152,7cyclictest181rcu_preempt22:09:140
9770997152,7cyclictest181rcu_preempt21:37:050
9770997148,14cyclictest21534-21systemd19:31:020
9770997146,8cyclictest181rcu_preempt23:24:190
9770997146,8cyclictest181rcu_preempt23:24:190
9770997142,9cyclictest181rcu_preempt22:58:080
9770997142,8cyclictest181rcu_preempt00:07:280
9770997137,16cyclictest181rcu_preempt20:02:040
977099713,49cyclictest30603-21apt-get23:06:160
9790997050,16cyclictest22200-21kworker/u18:3-rpciod21:45:582
979099703,49cyclictest21887-21/usr/sbin/munin19:32:172
9790997021,12cyclictest181rcu_preempt19:41:272
9782997033,8cyclictest181rcu_preempt20:26:021
9782997033,8cyclictest181rcu_preempt20:26:021
9782997033,8cyclictest181rcu_preempt19:56:021
9782997033,8cyclictest181rcu_preempt19:56:021
9782997025,7cyclictest181rcu_preempt21:56:161
9782997025,7cyclictest181rcu_preempt21:56:161
9782997017,29cyclictest31-21ksoftirqd/121:55:291
9782997013,33cyclictest31-21ksoftirqd/119:26:271
9770997053,10cyclictest3612-21ssh22:21:250
9770997052,12cyclictest23506-21latency_hist22:01:020
9770997052,12cyclictest23506-21latency_hist22:01:020
9770997050,14cyclictest17118-21latency_hist20:56:030
9770997049,8cyclictest181rcu_preempt21:41:020
9770997043,8cyclictest181rcu_preempt23:41:270
9790996948,15cyclictest16881-21diskmemload23:31:492
9790996936,15cyclictest181rcu_preempt21:00:182
9790996935,12cyclictest181rcu_preempt22:25:202
9790996934,14cyclictest181rcu_preempt23:28:592
9790996932,16cyclictest181rcu_preempt21:05:122
9790996932,16cyclictest181rcu_preempt21:05:122
9782996955,8cyclictest0-21swapper/119:50:591
9782996952,11cyclictest2374-21systemd-journal21:37:351
977099698,29cyclictest15-21ksoftirqd/020:30:000
9770996949,12cyclictest2374-21systemd-journal19:44:350
9770996947,16cyclictest13276-21sh00:26:010
9770996947,16cyclictest13276-21sh00:26:010
9770996946,10cyclictest181rcu_preempt20:06:180
9770996933,13cyclictest181rcu_preempt19:06:160
9801996846,17cyclictest451rcuc/320:52:073
9790996853,10cyclictest39-21ksoftirqd/220:31:152
9790996850,12cyclictest11301-21systemd-run19:01:002
9790996843,8cyclictest181rcu_preempt23:55:132
9790996843,12cyclictest181rcu_preempt19:06:242
979099683,27cyclictest28519-21/usr/sbin/munin19:51:192
979099683,27cyclictest28519-21/usr/sbin/munin19:51:192
9790996826,7cyclictest181rcu_preempt19:06:022
9782996840,8cyclictest181rcu_preempt23:06:481
9782996840,8cyclictest181rcu_preempt22:33:221
9782996836,8cyclictest181rcu_preempt20:56:011
9782996832,16cyclictest181rcu_preempt20:11:071
9770996854,8cyclictest18115-21ssh20:56:370
9770996846,8cyclictest181rcu_preempt20:31:160
9770996844,11cyclictest181rcu_preempt19:52:300
9770996844,11cyclictest181rcu_preempt19:52:300
9770996817,32cyclictest29080-21cat23:56:350
9790996747,12cyclictest0-21swapper/219:21:012
9790996736,11cyclictest181rcu_preempt21:54:522
979099673,29cyclictest5825-21sh21:31:162
9790996727,10cyclictest181rcu_preempt00:11:022
9790996715,26cyclictest26800-21cat22:06:172
9790996715,26cyclictest26800-21cat22:06:172
9782996734,9cyclictest181rcu_preempt21:25:511
9782996734,9cyclictest181rcu_preempt21:25:511
9782996734,7cyclictest181rcu_preempt20:26:271
9782996733,7cyclictest181rcu_preempt20:01:251
9770996750,8cyclictest0-21swapper/019:36:020
9770996724,8cyclictest181rcu_preempt20:16:100
9790996642,15cyclictest7441-21kworker/u17:0-rpciod22:01:212
9790996635,8cyclictest0-21swapper/223:46:342
9790996631,7cyclictest181rcu_preempt21:21:192
9790996631,7cyclictest181rcu_preempt21:21:192
9770996624,28cyclictest0-21swapper/023:31:140
9790996523,7cyclictest181rcu_preempt21:56:232
9790996523,7cyclictest181rcu_preempt21:56:232
979099652,33cyclictest352-21runrttasks19:59:132
979099652,33cyclictest352-21runrttasks19:59:132
9770996545,8cyclictest181rcu_preempt23:16:520
9770996536,22cyclictest20635-21kworker/u17:1+nfsiod22:15:410
9770996532,9cyclictest181rcu_preempt20:44:090
9790996448,10cyclictest21634-21kworker/u17:5-rpciod22:56:172
979099643,35cyclictest18183-21apt-get22:46:172
9782996435,8cyclictest181rcu_preempt19:36:181
978299643,23cyclictest31-21ksoftirqd/119:11:161
9770996443,7cyclictest181rcu_preempt00:20:100
9801996348,10cyclictest451rcuc/321:15:263
9801996348,10cyclictest451rcuc/321:15:263
9790996341,9cyclictest181rcu_preempt23:02:012
979099623,40cyclictest3637-21cron23:15:582
979099623,38cyclictest4557-21proc_pri20:16:312
979099613,38cyclictest32218-21head00:01:372
979099613,38cyclictest32218-21head00:01:372
9801995945,10cyclictest451rcuc/320:13:273
980199594,42cyclictest25893-21taskset21:10:593
980199594,39cyclictest12020-21chrt22:36:023
980199593,44cyclictest8828-21taskset23:23:133
980199593,44cyclictest8828-21taskset23:23:133
980199593,43cyclictest28406-21chrt22:08:183
980199593,43cyclictest28406-21chrt22:08:183
980199584,38cyclictest10374-21chrt23:26:183
9801995841,10cyclictest451rcuc/320:58:183
9801995817,29cyclictest0-21swapper/323:32:123
980199574,40cyclictest7796-21taskset00:16:203
9801995743,9cyclictest451rcuc/300:12:043
9801995743,9cyclictest451rcuc/300:12:043
980199573,43cyclictest32526-21taskset00:02:263
980199573,43cyclictest32526-21taskset00:02:263
9801995643,8cyclictest451rcuc/322:55:123
980199564,35cyclictest4995-21chrt23:16:533
9801995543,8cyclictest451rcuc/300:07:173
9801995541,9cyclictest451rcuc/319:14:253
980199553,39cyclictest3627-21chrt21:26:363
980199553,34cyclictest29717-21taskset21:16:263
980199552,41cyclictest7627-21chrt22:27:313
859125512,26sleep30-21swapper/318:51:293
980199544,40cyclictest20580-21taskset19:26:273
980199544,37cyclictest13333-21chrt00:26:013
980199544,37cyclictest13333-21chrt00:26:013
9801995440,9cyclictest451rcuc/321:34:513
9801995440,9cyclictest451rcuc/321:24:383
9801995440,9cyclictest451rcuc/321:24:383
9801995440,8cyclictest451rcuc/323:01:023
9801995438,10cyclictest451rcuc/323:53:393
980199543,41cyclictest4051-21taskset22:21:353
980199543,41cyclictest2875-21chrt22:20:583
9801995421,28cyclictest0-21swapper/323:46:013
980199534,35cyclictest30187-21taskset19:56:213
980199534,35cyclictest30187-21taskset19:56:213
980199534,34cyclictest14398-21chrt19:06:343
9801995339,9cyclictest451rcuc/323:58:253
9801995339,9cyclictest451rcuc/323:06:013
980199533,38cyclictest11265-21chrt19:00:593
980199533,37cyclictest12248-21chrt19:01:243
980199533,36cyclictest3094-21chrt23:14:253
980199533,35cyclictest19961-21chrt19:26:033
980199533,32cyclictest25090-21chrt23:51:023
9801995311,33cyclictest18699-21taskset22:46:283
980199525,35cyclictest21336-21taskset21:56:313
980199525,35cyclictest21336-21taskset21:56:313
9801995237,9cyclictest451rcuc/320:07:513
980199523,31cyclictest10359-21chrt20:36:023
980199522,37cyclictest5332-21taskset20:20:593
9801995138,9cyclictest451rcuc/319:53:423
9801995138,9cyclictest451rcuc/319:53:423
9801995137,9cyclictest451rcuc/322:39:523
9801995137,10cyclictest451rcuc/321:03:143
9801995137,10cyclictest451rcuc/321:03:143
9801995136,10cyclictest451rcuc/320:41:013
9801995135,8cyclictest451rcuc/319:47:103
980199513,35cyclictest26082-21chrt22:05:143
980199513,35cyclictest23968-21chrt19:36:283
980199513,33cyclictest16916-21chrt23:36:313
980199512,34cyclictest32059-21taskset20:01:273
980199512,34cyclictest31735-21chrt23:07:363
9801995037,9cyclictest451rcuc/320:23:153
9801995037,9cyclictest451rcuc/320:23:153
9801995036,9cyclictest451rcuc/319:33:093
980199503,37cyclictest20137-21chrt21:55:213
980199503,30cyclictest11635-21chrt21:41:023
9801994935,10cyclictest451rcuc/321:46:393
9801994926,16cyclictest451rcuc/320:50:173
9801994835,8cyclictest451rcuc/322:44:223
980199463,32cyclictest7850-21taskset20:26:343
9801994624,15cyclictest451rcuc/319:19:443
980199454,31cyclictest26512-21taskset19:46:003
980199444,28cyclictest30576-21taskset22:11:343
9801994221,15cyclictest451rcuc/320:43:203
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional