You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-31 - 18:03
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Fri Jul 31, 2026 12:44:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2488210911,66sleep02516-21/usr/sbin/munin06:51:250
370299963,24cyclictest4090-21fschecks_count06:56:161
3697999563,22cyclictest25998-21latency_hist12:00:560
3702999438,48cyclictest0-21swapper/108:56:051
3702999352,34cyclictest11083-21diskmemload12:01:191
370299933,36cyclictest5466-21munin-node07:01:061
370299924,37cyclictest12699-21/usr/sbin/munin09:51:141
370299924,37cyclictest12699-21/usr/sbin/munin09:51:141
370299923,74cyclictest9713-21/usr/sbin/munin08:52:101
370299923,36cyclictest12600-21fschecks_time07:21:161
370299923,32cyclictest20436-21fschecks_time11:51:151
3702999227,12cyclictest0-21swapper/111:16:271
3702999215,34cyclictest9146-21grep11:31:281
3702999213,34cyclictest18906-21latency_hist07:40:551
3702999213,34cyclictest18906-21latency_hist07:40:551
3702999171,14cyclictest13279-21apt-key10:45:561
370299914,34cyclictest16451-21awk07:32:421
370299914,34cyclictest16451-21awk07:32:421
370299913,32cyclictest24497-21taskset11:57:121
370299913,32cyclictest20428-21apt07:45:531
3702999132,51cyclictest0-21swapper/109:06:271
3702999132,51cyclictest0-21swapper/109:06:271
370299905,34cyclictest416-21/usr/sbin/munin09:32:001
370299904,37cyclictest25965-21if_eth011:06:171
3702999034,8cyclictest0-21swapper/109:21:311
370299903,40cyclictest30348-21modprobe08:15:521
370299903,37cyclictest20929-21fschecks_time07:46:151
370299903,32cyclictest9168-21taskset07:11:081
370299903,32cyclictest9168-21taskset07:11:081
3702999026,7cyclictest0-21swapper/111:11:051
3697999018,35cyclictest0-21swapper/010:11:190
3702998937,44cyclictest0-21swapper/108:40:541
370299893,45cyclictest8256-21wc07:06:281
370299893,45cyclictest8256-21wc07:06:281
370299893,38cyclictest803-21sendmail-mta09:46:061
370299893,38cyclictest2845-21latency_hist08:30:551
370299893,36cyclictest27771-21kernelversion08:06:191
370299893,36cyclictest27771-21kernelversion08:06:191
3702998931,52cyclictest0-21swapper/109:30:541
3702998929,10cyclictest0-21swapper/108:17:421
3702998921,11cyclictest0-21swapper/110:11:261
3702998915,31cyclictest6615-21sh10:34:541
3707998866,12cyclictest0-21swapper/207:26:202
3707998866,12cyclictest0-21swapper/207:26:202
370299883,40cyclictest7669-21latency_hist08:45:551
370299883,40cyclictest7669-21latency_hist08:45:551
370299883,36cyclictest7896-21grep09:42:361
370299883,35cyclictest29796-21ssh12:06:221
370299883,33cyclictest3585-21ssh12:16:281
370299883,30cyclictest13538-21/usr/sbin/munin10:47:311
3702998830,9cyclictest0-21swapper/111:46:231
3702998830,9cyclictest0-21swapper/111:46:231
3702998824,12cyclictest0-21swapper/110:56:251
370299882,33cyclictest3421-21/usr/sbin/munin09:36:171
370299882,32cyclictest15179-21unixbench_singl11:41:281
370299882,29cyclictest19292-21latency_hist10:55:541
3707998771,7cyclictest0-21swapper/210:06:182
370799874,48cyclictest39-21ksoftirqd/211:59:422
3707998724,14cyclictest0-21swapper/208:41:052
3707998724,14cyclictest0-21swapper/208:41:052
370299874,36cyclictest24097-21latency_hist07:55:561
370299874,35cyclictest30720-21/usr/sbin/munin10:21:221
370299873,37cyclictest24422-21apt10:10:521
370299873,37cyclictest21605-21latency_hist10:05:561
370299873,37cyclictest21605-21latency_hist10:05:561
370299873,31cyclictest28447-21ps10:16:261
370299873,28cyclictest1644-21ssh10:26:161
3702998730,8cyclictest0-21swapper/109:56:091
3702998730,49cyclictest0-21swapper/111:30:361
3702998729,49cyclictest0-21swapper/108:50:561
3702998721,13cyclictest0-21swapper/108:01:191
3697998761,17cyclictest11083-21diskmemload11:11:280
3697998714,59cyclictest435-21apt-get09:31:080
370299863,36cyclictest5694-21/usr/sbin/munin12:21:191
370299863,35cyclictest14267-21fschecks_time07:26:171
370299863,35cyclictest14267-21fschecks_time07:26:171
3702998627,12cyclictest0-21swapper/109:11:161
370299862,35cyclictest22841-21fschecks_time11:01:171
370299862,31cyclictest2843-21sendmail_mailst11:21:261
370299862,31cyclictest2843-21sendmail_mailst11:21:261
370299862,28cyclictest11008-21fschecks_time07:16:171
370299853,37cyclictest7895-21ntp_kernel_pll_10:36:221
370299852,33cyclictest24264-21cstates07:56:111
370299852,32cyclictest11396-21/usr/sbin/munin11:36:141
370299852,32cyclictest11396-21/usr/sbin/munin11:36:141
370299852,29cyclictest32295-21cpuspeed08:21:101
370799842,52cyclictest39-21ksoftirqd/209:41:352
370299843,31cyclictest23638-21/usr/sbin/munin09:16:171
370299843,31cyclictest23638-21/usr/sbin/munin09:16:171
370299843,30cyclictest15066-21kernelversion09:01:181
370299842,37cyclictest3563-21latency_hist06:55:581
370299842,34cyclictest360-21sh12:11:251
370299842,34cyclictest360-21sh12:11:251
370299842,32cyclictest3034-21cpu08:31:101
370799833,40cyclictest9230-21apt-get08:51:062
3697998316,45cyclictest5742-21ntp_kernel_pll_11:26:250
3697998316,29cyclictest20157-21ssh11:51:060
371499823,39cyclictest0-21swapper/310:46:223
371499822,67cyclictest11695-21chrt08:56:133
3707998246,27cyclictest9174-21sshd08:50:242
370799822,51cyclictest39-21ksoftirqd/210:15:582
3697998250,28cyclictest3684-21cyclictest12:13:060
3697998250,28cyclictest3684-21cyclictest12:13:060
3707998158,14cyclictest58-21kcompactd009:46:282
3707998053,18cyclictest4427-21latency_hist08:35:552
3707998052,14cyclictest0-21swapper/207:25:572
3697998061,13cyclictest18452-21ssh09:06:290
3697998061,13cyclictest18452-21ssh09:06:290
3697998035,31cyclictest6722-21ssh09:41:100
3707997958,10cyclictest0-21swapper/209:40:562
3707997954,13cyclictest0-21swapper/210:35:562
370799792,43cyclictest39-21ksoftirqd/208:12:072
3707997924,13cyclictest0-21swapper/207:11:192
3707997924,13cyclictest0-21swapper/207:11:192
3697997954,17cyclictest32354-21latency_hist09:30:560
3697997913,27cyclictest21332-21mailstats07:46:260
3707997860,13cyclictest3684-21cyclictest11:16:282
3707997858,9cyclictest0-21swapper/208:06:152
3707997858,9cyclictest0-21swapper/208:06:152
3707997855,15cyclictest2374-21systemd-journal11:42:232
3697997856,13cyclictest28326-21sh09:23:080
3697997812,25cyclictest29788-21sh10:19:090
3714997714,50cyclictest0-21swapper/309:31:233
3707997759,13cyclictest5335-21switchtime08:36:272
3707997758,12cyclictest7813-21latency_hist11:30:552
3707997756,9cyclictest0-21swapper/207:55:562
3707997756,14cyclictest3684-21cyclictest11:40:562
3707997756,14cyclictest3684-21cyclictest11:40:562
3707997755,13cyclictest0-21swapper/210:50:552
3707997754,13cyclictest0-21swapper/208:26:152
3697997748,18cyclictest11083-21diskmemload10:25:560
3707997657,13cyclictest300-21rs:main2
3707997655,11cyclictest0-21swapper/207:16:162
3707997653,15cyclictest8048-21mailstats10:36:272
3697997657,12cyclictest13797-21cron11:40:520
3697997657,12cyclictest13797-21cron11:40:520
370799757,46cyclictest32356-21apt-get09:31:082
3707997554,11cyclictest0-21swapper/211:51:272
3707997552,15cyclictest2374-21systemd-journal09:51:232
3707997552,15cyclictest2374-21systemd-journal09:51:232
3707997552,10cyclictest0-21swapper/207:05:572
3707997545,21cyclictest2964-21grep12:16:142
3697997559,9cyclictest3684-21cyclictest09:19:300
3697997559,9cyclictest3684-21cyclictest09:19:300
3697997537,12cyclictest181rcu_preempt10:10:090
369799753,58cyclictest6153-21fschecks_time07:01:180
369799753,36cyclictest10016-21wc07:11:290
369799753,36cyclictest10016-21wc07:11:290
3697997513,29cyclictest8233-21/usr/sbin/munin11:31:090
3707997453,15cyclictest29372-21sh09:25:532
3707997445,21cyclictest14943-21fschecks_time09:01:152
369799744,37cyclictest2988-21fschecks_time12:16:140
3697997412,25cyclictest4693-21rm11:25:360
3697997412,25cyclictest4693-21rm11:25:360
3697997411,27cyclictest2922-21rm10:27:570
3697997410,29cyclictest21936-21rm09:11:590
3707997350,13cyclictest0-21swapper/210:21:342
3697997334,28cyclictest29278-21grep08:11:150
3697997332,15cyclictest13768-21kworker/u18:1-nfsiod10:53:330
203082730,9sleep20-21swapper/210:02:522
203082730,9sleep20-21swapper/210:02:522
371499723,32cyclictest917-21kworker/3:1+events07:51:093
370799725,33cyclictest39-21ksoftirqd/212:25:432
3707997253,11cyclictest20629-21unixbench_singl10:56:312
369799729,26cyclictest352-21runrttasks11:16:030
3697997254,12cyclictest1-21systemd08:50:540
3697997231,27cyclictest18323-21kworker/u17:0+xprtiod12:05:050
3697997216,18cyclictest13383-21/usr/sbin/munin09:51:260
3697997216,18cyclictest13383-21/usr/sbin/munin09:51:260
3697997214,28cyclictest24549-21ssh11:03:590
3697997156,11cyclictest3684-21cyclictest07:00:540
3697997142,21cyclictest10746-21grep08:52:270
3697997113,23cyclictest29674-21/usr/sbin/munin12:06:170
3697997113,21cyclictest15931-21rm10:50:020
3697997112,19cyclictest8139-21proc_pri07:06:260
3697997112,19cyclictest8139-21proc_pri07:06:260
371499708,37cyclictest0-21swapper/307:32:353
371499708,37cyclictest0-21swapper/307:32:353
3707997056,8cyclictest32019-21sh12:10:552
3707997050,9cyclictest0-21swapper/207:32:412
3707997050,9cyclictest0-21swapper/207:32:412
3707997047,7cyclictest181rcu_preempt11:32:472
3707997047,11cyclictest0-21swapper/209:15:562
3707997046,17cyclictest27103-21ssh12:01:292
370799702,40cyclictest39-21ksoftirqd/207:58:592
3697997042,19cyclictest12572-21cut07:21:150
3697997034,9cyclictest181rcu_preempt08:10:520
3697997034,9cyclictest181rcu_preempt08:10:520
3697997013,25cyclictest27718-21seq11:09:250
3697997011,24cyclictest11947-21ssh10:43:030
3707996949,10cyclictest0-21swapper/207:40:552
3707996949,10cyclictest0-21swapper/207:40:552
3707996947,12cyclictest0-21swapper/207:41:152
3707996943,18cyclictest0-21swapper/208:57:282
3707996942,20cyclictest22337-21apt-key07:50:572
3707996941,18cyclictest31963-21latency_hist08:20:562
369799697,33cyclictest11637-21apt-get08:56:060
3697996947,17cyclictest0-21swapper/009:50:520
369799693,32cyclictest5369-21unixbench_singl10:31:300
3697996914,24cyclictest15963-21sh09:02:090
3697996913,23cyclictest5437-21sh09:38:580
247052690,9sleep30-21swapper/311:04:253
238726917,29sleep20-21swapper/206:51:222
370799686,35cyclictest39-21ksoftirqd/212:15:332
370799686,35cyclictest39-21ksoftirqd/212:15:332
3707996846,15cyclictest3684-21cyclictest10:51:112
3707996846,12cyclictest0-21swapper/211:06:192
3707996838,7cyclictest181rcu_preempt09:09:232
3707996838,7cyclictest181rcu_preempt09:09:232
3697996847,13cyclictest19852-21ssh10:56:160
3697996846,12cyclictest0-21swapper/011:41:170
369799684,31cyclictest18848-21sshd10:01:100
369799684,31cyclictest18848-21sshd10:01:100
3697996810,22cyclictest9420-21rm10:39:220
3707996746,15cyclictest2338-21diskmemload11:21:142
3707996746,15cyclictest2338-21diskmemload11:21:142
3707996745,11cyclictest0-21swapper/209:56:182
370799673,37cyclictest39-21ksoftirqd/209:20:572
370799673,37cyclictest39-21ksoftirqd/209:20:572
3697996721,8cyclictest0-21swapper/007:35:550
3697996721,8cyclictest0-21swapper/007:35:550
3697996711,22cyclictest17098-21rm09:57:160
371499663,40cyclictest917-21kworker/3:1+events11:36:113
371499663,40cyclictest917-21kworker/3:1+events11:36:113
370799665,26cyclictest39-21ksoftirqd/208:01:182
370799664,43cyclictest352-21runrttasks07:00:282
370799663,48cyclictest12622-21sendmail-mta10:44:562
370799662,35cyclictest39-21ksoftirqd/210:11:332
3697996643,13cyclictest0-21swapper/008:26:300
369799662,28cyclictest24310-21df07:56:120
3707996544,12cyclictest0-21swapper/207:06:112
3707996544,12cyclictest0-21swapper/207:06:112
3707996533,16cyclictest24042-21ssh11:02:342
3697996512,17cyclictest8185-21ssh12:25:210
370799643,34cyclictest39-21ksoftirqd/209:27:102
369799649,24cyclictest0-21swapper/008:20:550
369799647,25cyclictest20133-21taskset07:42:270
369799646,15cyclictest7598-21sendmail08:45:530
369799646,15cyclictest7598-21sendmail08:45:530
369799643,43cyclictest27111-21modprobe08:05:530
3697996421,32cyclictest18339-21sh11:46:460
3697996421,32cyclictest18339-21sh11:46:460
3707996343,10cyclictest0-21swapper/211:11:092
370799632,38cyclictest39-21ksoftirqd/211:47:562
370799632,38cyclictest39-21ksoftirqd/211:47:562
3697996342,11cyclictest0-21swapper/008:36:090
369799633,40cyclictest3936-21grep08:31:300
369799632,51cyclictest23420-21timerandwakeup07:52:340
369799632,42cyclictest14432-21latency07:26:200
369799632,42cyclictest14432-21latency07:26:200
371499622,35cyclictest917-21kworker/3:1+events07:46:273
3697996234,20cyclictest11188-21grep07:16:200
369799622,51cyclictest32460-21fschecks_time08:21:150
371499615,34cyclictest0-21swapper/308:52:103
3707996145,11cyclictest0-21swapper/208:21:232
371499604,41cyclictest28329-21taskset12:04:313
3697996015,30cyclictest17910-21memory07:36:220
3697996015,30cyclictest17910-21memory07:36:220
371499594,35cyclictest20272-21chrt10:56:273
371499593,37cyclictest917-21kworker/3:1+events07:41:083
371499584,36cyclictest632-21chrt12:11:283
371499584,36cyclictest632-21chrt12:11:283
371499583,42cyclictest29348-21taskset11:11:263
371499583,36cyclictest10024-21chrt09:46:163
371499582,42cyclictest19163-21taskset11:49:033
371499582,42cyclictest19163-21taskset11:49:033
371499582,38cyclictest28767-21chrt08:10:523
371499582,38cyclictest28767-21chrt08:10:523
371499582,37cyclictest917-21kworker/3:1+events07:01:113
371499573,40cyclictest21450-21chrt10:05:533
371499573,40cyclictest21450-21chrt10:05:533
371499567,34cyclictest19329-21chrt09:08:053
371499567,34cyclictest19329-21chrt09:08:053
371499564,38cyclictest9149-21taskset11:31:283
371499564,37cyclictest3359-21taskset08:31:183
371499563,36cyclictest19288-21taskset10:55:543
371499563,33cyclictest9688-21chrt07:11:223
371499563,33cyclictest9688-21chrt07:11:223
371499553,37cyclictest4624-21chrt08:36:043
371499552,39cyclictest10506-21taskset10:41:153
371499552,35cyclictest13412-21chrt09:51:263
371499552,35cyclictest13412-21chrt09:51:263
371499544,35cyclictest3341-21chrt10:29:073
371499543,35cyclictest4087-21chrt06:56:163
371499543,34cyclictest4717-21chrt10:31:183
371499542,39cyclictest14013-21taskset07:26:053
371499542,39cyclictest14013-21taskset07:26:053
371499533,38cyclictest9945-21chrt10:40:503
371499533,33cyclictest6467-21chrt09:40:573
371499532,38cyclictest29597-21taskset10:18:383
371499532,35cyclictest8329-21chrt08:46:213
371499532,34cyclictest5715-21chrt12:21:053
360425310,26sleep30-21swapper/306:55:563
371499524,37cyclictest24677-21taskset07:56:233
371499524,34cyclictest27896-21taskset09:21:563
371499523,40cyclictest24289-21chrt11:56:373
371499522,33cyclictest7173-21chrt08:41:313
371499522,33cyclictest7173-21chrt08:41:313
371499515,29cyclictest917-21kworker/3:1+events11:20:563
371499514,33cyclictest9475-21chrt09:45:553
371499513,36cyclictest30979-21chrt08:16:193
371499513,36cyclictest23724-21taskset09:16:123
371499513,36cyclictest23724-21taskset09:16:123
371499513,35cyclictest6468-21chrt11:27:073
371499513,35cyclictest3488-21chrt12:16:273
371499513,32cyclictest1220-21chrt08:25:553
371499512,37cyclictest31522-21chrt09:28:363
371499503,36cyclictest18480-21taskset10:00:553
371499503,34cyclictest21572-21chrt09:11:303
371499503,33cyclictest22832-21chrt11:55:523
371499503,29cyclictest26556-21chrt08:01:293
371499493,34cyclictest32026-21chrt10:22:023
371499493,34cyclictest2161-21chrt08:26:283
371499493,29cyclictest13963-21chrt07:25:563
371499492,34cyclictest31203-21chrt12:09:053
371499492,33cyclictest24742-21taskset10:11:043
371499482,35cyclictest23335-21chrt10:07:523
371499482,33cyclictest3941-21chrt11:23:303
371499482,33cyclictest3941-21chrt11:23:303
371499474,31cyclictest18183-21chrt07:36:303
371499474,31cyclictest18183-21chrt07:36:303
371499473,32cyclictest16961-21chrt09:04:573
371499472,31cyclictest26392-21chrt11:06:283
371499453,30cyclictest16953-21chrt11:45:553
371499432,27cyclictest29362-21taskset08:11:173
371499412,28cyclictest12146-21taskset07:20:543
371499412,26cyclictest7836-21taskset07:06:163
371499412,26cyclictest7836-21taskset07:06:163
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional