You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-23 - 01:16
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Sat Aug 22, 2026 00:44:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
12603213912,87sleep212604-21cron19:10:002
12058212215,65sleep112124-21cat19:05:471
127609911531,12cyclictest0-21swapper/023:00:100
127609911433,12cyclictest0-21swapper/021:57:230
127609911414,78cyclictest29789-21apt-get22:15:260
127609911414,78cyclictest29789-21apt-get22:15:260
127609911148,56cyclictest13351-21ntp_kernel_pll_23:30:280
127609910828,11cyclictest0-21swapper/023:10:270
127609910828,11cyclictest0-21swapper/023:10:270
127609910732,9cyclictest0-21swapper/021:00:230
127609910732,11cyclictest0-21swapper/020:35:030
127609910543,54cyclictest0-21swapper/019:50:040
12760991054,34cyclictest23001-21cat19:40:040
127609910537,11cyclictest0-21swapper/000:31:460
127609910537,11cyclictest0-21swapper/000:18:090
12760991053,44cyclictest9854-21fschecks_time23:25:210
12760991053,44cyclictest9854-21fschecks_time23:25:210
12760991053,33cyclictest27848-21modprobe19:54:590
12760991043,38cyclictest16884-21cat23:35:350
127609910419,28cyclictest3646-21cat23:15:260
127749910383,14cyclictest3692-21sh21:35:022
127749910383,14cyclictest3692-21sh21:35:022
12760991034,43cyclictest4644-21timerandwakeup22:25:350
12760991034,35cyclictest3715-21latency_hist21:35:010
12760991034,35cyclictest3715-21latency_hist21:35:010
127609910334,8cyclictest0-21swapper/021:40:300
127609910239,14cyclictest29939-21proc_pri23:05:330
127609910234,9cyclictest0-21swapper/019:40:160
12760991023,31cyclictest350-21runrttasks00:13:530
127609910231,15cyclictest0-21swapper/022:50:280
12760991022,40cyclictest20722-21fschecks_count21:10:210
12760991022,34cyclictest12492-21sort20:45:200
127609910058,33cyclictest1516-21kworker/u17:2+events_unbound22:14:590
12760991004,31cyclictest31098-21modprobe20:05:000
127609910037,8cyclictest0-21swapper/023:45:030
127609910036,7cyclictest0-21swapper/022:35:170
12760991003,35cyclictest16789-21fschecks_count19:20:200
12760991003,33cyclictest350-21runrttasks22:58:520
12760991003,33cyclictest13376-21latency_hist21:50:030
1276099993,37cyclictest22848-21sh22:05:000
1276099993,37cyclictest22848-21sh22:05:000
1276099993,34cyclictest20001-21grep19:30:210
1276099993,33cyclictest25091-21sh00:39:590
1276099993,33cyclictest25091-21sh00:39:590
1276099993,33cyclictest22585-21cut23:45:200
1276099993,33cyclictest22585-21cut23:45:200
1276099992,34cyclictest30269-21fschecks_count21:25:200
12760999840,51cyclictest0-21swapper/022:30:260
1276099983,35cyclictest18770-21/usr/sbin/munin21:05:320
1276099983,33cyclictest31895-21/usr/sbin/munin00:00:100
12760999831,10cyclictest0-21swapper/000:25:310
1276099974,30cyclictest6206-21processes20:25:320
1276099974,30cyclictest6206-21processes20:25:320
1276099973,34cyclictest31723-21taskset20:05:260
1276099973,34cyclictest31723-21taskset20:05:260
12765999649,40cyclictest11002-21ssh21:45:311
1276099963,35cyclictest19766-21latency_hist19:30:030
1276099963,34cyclictest13290-21grep19:10:250
1276099963,34cyclictest12976-21cut00:20:580
1276099963,33cyclictest28664-21/usr/sbin/munin23:55:230
1276099963,31cyclictest3974-21latency_hist20:20:040
1276099962,34cyclictest2292-21latency_hist20:15:030
12760999613,74cyclictest9150-21runrttasks20:36:020
12765999536,49cyclictest21375-21latency_hist19:35:041
1276099953,36cyclictest6829-21cut23:20:250
1276099953,35cyclictest17448-21timerwakeupswit22:45:350
1276099953,34cyclictest13871-21netstat22:40:270
1276099953,33cyclictest15197-21fschecks_count19:15:240
1276099952,37cyclictest3305-21/usr/sbin/munin00:05:310
1276099952,37cyclictest3305-21/usr/sbin/munin00:05:310
12765999341,44cyclictest0-21swapper/119:20:261
12765999341,44cyclictest0-21swapper/100:20:481
12765999333,8cyclictest0-21swapper/123:59:591
1276099933,33cyclictest10944-21fschecks_time20:40:250
1276099933,31cyclictest25643-21cstates23:50:160
12760999330,19cyclictest15548-21kworker/u17:1+nfsiod21:15:320
1276099932,34cyclictest4744-21ssh21:35:330
12765999232,8cyclictest0-21swapper/120:20:361
12765999232,8cyclictest0-21swapper/120:20:361
12765999232,51cyclictest0-21swapper/123:30:371
1276599922,29cyclictest31947-21sshd22:18:141
1276599922,29cyclictest31947-21sshd22:18:141
1276099922,34cyclictest14412-21ntp_kernel_err20:50:280
12774999145,16cyclictest181rcu_preempt21:17:582
1277499913,51cyclictest39-21ksoftirqd/220:00:322
1276599915,72cyclictest19043-21apt-get00:30:141
12765999139,45cyclictest350-21runrttasks21:43:261
12765999138,46cyclictest11504-21timerandwakeup20:40:381
12765999133,8cyclictest0-21swapper/122:05:011
12765999133,8cyclictest0-21swapper/122:05:011
12765999131,8cyclictest0-21swapper/119:30:031
1276099913,29cyclictest350-21runrttasks21:52:050
12765999071,13cyclictest10086-21/usr/sbin/munin22:35:321
12765999043,39cyclictest0-21swapper/123:50:211
12765999036,47cyclictest0-21swapper/121:39:161
12765999032,51cyclictest0-21swapper/122:25:321
12765999027,7cyclictest0-21swapper/121:55:321
12765999025,11cyclictest0-21swapper/121:05:341
1276099904,36cyclictest4711-21switchtime20:20:340
1276099904,36cyclictest4711-21switchtime20:20:340
1276099903,35cyclictest12837-21latency_hist19:10:050
12765998929,8cyclictest0-21swapper/123:10:231
12765998929,8cyclictest0-21swapper/123:10:231
1276599892,36cyclictest350-21runrttasks20:47:341
1276599892,32cyclictest2442-21cpuspeed20:15:181
12765998839,40cyclictest0-21swapper/119:15:121
12765998835,46cyclictest23093-21sh23:45:321
12765998835,46cyclictest23093-21sh23:45:321
12765998833,8cyclictest0-21swapper/119:35:311
12765998831,8cyclictest0-21swapper/121:31:111
12765998831,8cyclictest0-21swapper/121:31:111
12765998830,11cyclictest0-21swapper/120:55:341
12760998817,24cyclictest201-21systemd-journal21:25:000
12774998766,15cyclictest15751-21latency_hist23:35:022
12774998762,18cyclictest29517-21apt-key22:15:042
12765998762,19cyclictest3559-21latency_hist22:25:021
1276599873,33cyclictest6773-21timerandwakeup00:10:361
12765998725,11cyclictest0-21swapper/122:40:321
1276599872,39cyclictest18669-21sort00:30:021
1276599872,35cyclictest9422-21cut20:36:261
1276599872,24cyclictest5085-21ssh23:17:361
1277899866,65cyclictest29924-21chrt22:15:323
1277899866,65cyclictest29924-21chrt22:15:323
12774998666,13cyclictest11979-21sh21:46:522
12774998648,17cyclictest181rcu_preempt21:05:352
1276599864,31cyclictest16479-21/usr/sbin/munin22:45:311
12765998637,42cyclictest0-21swapper/121:20:231
12765998634,44cyclictest0-21swapper/123:25:331
12765998634,44cyclictest0-21swapper/123:25:331
1276599863,35cyclictest21053-21ssh21:10:281
1276599863,33cyclictest14525-21latency_hist19:15:041
1276599863,30cyclictest29512-21gpgv22:15:031
1276599863,28cyclictest20164-21grep23:40:341
1276599862,34cyclictest7009-21cpuspeed22:30:161
12765998619,21cyclictest24756-21sort19:45:161
1276099864,32cyclictest350-21runrttasks22:07:410
1276099864,32cyclictest350-21runrttasks22:07:410
12774998552,14cyclictest181rcu_preempt23:49:452
12774998552,14cyclictest181rcu_preempt23:49:452
12765998538,41cyclictest0-21swapper/123:10:001
1276599852,33cyclictest29070-21grep19:55:361
1276599852,33cyclictest29070-21grep19:55:361
12765998521,13cyclictest0-21swapper/100:20:001
12765998519,21cyclictest7791-21diskmemload23:21:181
12774998444,11cyclictest181rcu_preempt00:15:032
1277499843,39cyclictest39-21ksoftirqd/220:45:102
1276599848,62cyclictest26513-21apt-get19:50:261
12765998463,12cyclictest0-21swapper/120:11:181
1276599843,36cyclictest465-21munin-run21:30:001
1276599843,35cyclictest350-21runrttasks00:01:581
1276599843,35cyclictest29736-21/usr/sbin/munin20:00:201
1276599843,31cyclictest350-21runrttasks22:08:501
1276599843,31cyclictest350-21runrttasks22:08:501
1276599843,31cyclictest26782-21ps23:00:321
1276599843,28cyclictest350-21runrttasks21:00:291
12765998427,12cyclictest0-21swapper/123:38:591
12765998422,10cyclictest0-21swapper/100:35:371
12765998422,10cyclictest0-21swapper/100:35:371
12774998351,9cyclictest181rcu_preempt21:50:172
12765998329,8cyclictest0-21swapper/120:50:291
12765998328,7cyclictest0-21swapper/120:30:261
12765998327,8cyclictest0-21swapper/100:09:361
12765998327,8cyclictest0-21swapper/100:09:361
12765998327,48cyclictest0-21swapper/120:05:121
12765998327,48cyclictest0-21swapper/120:05:121
12774998257,19cyclictest6698-21sh23:20:222
1276599823,26cyclictest23187-21tune2fs22:55:201
1276599822,34cyclictest14251-21ps21:50:331
12774998165,8cyclictest181rcu_preempt19:25:302
12774998148,11cyclictest181rcu_preempt19:10:352
1276599813,34cyclictest5608-21/usr/sbin/munin20:25:241
1276599813,34cyclictest5608-21/usr/sbin/munin20:25:241
1276599813,31cyclictest23722-21cat19:40:331
12765998131,7cyclictest0-21swapper/121:15:271
12774998040,17cyclictest181rcu_preempt00:05:232
12774998040,17cyclictest181rcu_preempt00:05:232
12774998026,10cyclictest181rcu_preempt23:00:212
1276599803,25cyclictest20028-21/usr/sbin/munin22:50:231
12774997957,15cyclictest20135-21diskmemload21:57:342
12774997956,16cyclictest18806-21sh23:40:002
12774997955,17cyclictest25910-21latency_hist23:00:022
12774997950,22cyclictest18222-21kworker/u19:1+nfsiod21:28:162
12774997929,13cyclictest181rcu_preempt19:15:242
12774997851,11cyclictest181rcu_preempt23:27:072
12774997851,11cyclictest181rcu_preempt23:27:072
12774997845,15cyclictest181rcu_preempt23:53:542
12774997845,11cyclictest181rcu_preempt21:02:322
12774997844,14cyclictest181rcu_preempt22:05:352
12774997844,14cyclictest181rcu_preempt22:05:352
12774997835,7cyclictest181rcu_preempt21:40:322
12774997835,13cyclictest181rcu_preempt20:35:042
12774997830,12cyclictest181rcu_preempt21:21:092
12774997828,8cyclictest181rcu_preempt22:02:512
12774997828,8cyclictest181rcu_preempt22:02:512
12774997743,8cyclictest181rcu_preempt00:29:202
12774997736,18cyclictest181rcu_preempt00:04:422
12774997729,13cyclictest181rcu_preempt20:50:262
12760997738,29cyclictest0-21swapper/022:24:590
1277499766,60cyclictest32710-21apt-get20:10:142
12774997645,13cyclictest181rcu_preempt20:59:482
12774997643,13cyclictest181rcu_preempt22:35:352
12774997642,8cyclictest181rcu_preempt20:25:272
12774997642,8cyclictest181rcu_preempt20:25:272
12774997639,9cyclictest0-21swapper/219:45:242
1277499763,38cyclictest39-21ksoftirqd/223:05:262
12774997632,17cyclictest181rcu_preempt23:14:522
12774997632,17cyclictest181rcu_preempt23:14:522
12774997621,13cyclictest181rcu_preempt22:15:122
12774997621,13cyclictest181rcu_preempt22:15:122
12774997558,11cyclictest31899-21ntp_states20:05:302
12774997558,11cyclictest31899-21ntp_states20:05:302
12774997547,8cyclictest181rcu_preempt21:10:102
12774997539,24cyclictest25151-21systemd-run00:40:012
12774997539,24cyclictest25151-21systemd-run00:40:012
12774997533,15cyclictest181rcu_preempt23:44:262
12774997532,17cyclictest181rcu_preempt22:29:012
12774997529,12cyclictest181rcu_preempt19:35:172
1277499752,20cyclictest39-21ksoftirqd/220:20:372
1277499752,20cyclictest39-21ksoftirqd/220:20:372
1277499747,32cyclictest0-21swapper/219:30:222
12774997449,12cyclictest181rcu_preempt22:44:212
12774997442,11cyclictest181rcu_preempt00:15:202
12774997440,8cyclictest0-21swapper/223:55:152
12774997434,8cyclictest181rcu_preempt20:36:062
12774997432,14cyclictest181rcu_preempt22:52:462
12774997428,12cyclictest181rcu_preempt19:20:242
12774997340,11cyclictest181rcu_preempt22:30:112
12774997337,15cyclictest181rcu_preempt21:38:412
1277499732,50cyclictest30550-21kworker/u18:1+ext4-rsv-conversion00:31:172
12774997245,13cyclictest181rcu_preempt20:41:372
12774997233,13cyclictest181rcu_preempt00:20:502
12774997152,12cyclictest20135-21diskmemload22:20:322
12774997139,11cyclictest181rcu_preempt22:49:592
12774997139,10cyclictest181rcu_preempt23:19:342
12774997134,13cyclictest0-21swapper/219:50:412
1277499706,29cyclictest39-21ksoftirqd/220:18:292
12774996947,8cyclictest181rcu_preempt19:43:382
12774996939,8cyclictest181rcu_preempt19:55:332
12774996939,8cyclictest181rcu_preempt19:55:332
12760996744,15cyclictest0-21swapper/019:55:350
12760996744,15cyclictest0-21swapper/019:55:350
1277899667,29cyclictest12485-21taskset00:20:153
12778996632,27cyclictest0-21swapper/320:36:063
1276099654,38cyclictest16182-21mailstats20:55:330
1277899613,42cyclictest18813-21taskset23:39:593
1277899593,39cyclictest13146-21chrt22:40:033
1277899583,37cyclictest7885-21taskset22:30:353
1277899573,37cyclictest29703-21chrt23:55:353
1277899573,36cyclictest25144-21chrt00:40:003
1277899573,36cyclictest25144-21chrt00:40:003
1277899573,36cyclictest1839-21chrt23:12:283
1277899573,36cyclictest1839-21chrt23:12:283
1277899573,35cyclictest21149-21chrt21:10:323
1277899572,41cyclictest8031-21chrt00:13:223
1277899572,37cyclictest13644-21chrt23:30:353
12778995718,21cyclictest0-21swapper/300:30:143
1277899563,32cyclictest18035-21chrt19:25:023
258212550,8sleep30-21swapper/321:18:143
1277899553,39cyclictest1595-21taskset21:30:383
1277899553,39cyclictest1595-21taskset21:30:383
1277899553,35cyclictest19414-21chrt23:40:203
1277899553,34cyclictest32390-21chrt00:00:253
1277899553,33cyclictest24939-21chrt23:49:233
1277899553,33cyclictest24939-21chrt23:49:233
1277899552,40cyclictest30198-21chrt20:00:263
1277899552,36cyclictest21952-21taskset19:35:273
1196825510,27sleep30-21swapper/319:05:453
1277899543,38cyclictest7448-21chrt20:30:223
1277899543,36cyclictest6734-21chrt23:20:223
1277899542,37cyclictest27889-21chrt23:53:493
1277899542,37cyclictest27225-21chrt19:50:543
1277899542,36cyclictest29554-21chrt22:15:033
1277899542,36cyclictest17817-21chrt22:46:073
1277899534,34cyclictest4159-21chrt22:25:243
1277899533,38cyclictest10703-21taskset23:25:373
1277899533,38cyclictest10703-21taskset23:25:373
1277899533,37cyclictest19566-21taskset21:05:343
1277899533,36cyclictest14125-21chrt21:50:283
1277899533,36cyclictest11663-21taskset20:40:393
1277899532,39cyclictest9768-21chrt21:44:203
1277899532,36cyclictest18614-21chrt21:57:293
1277899532,33cyclictest9846-21chrt00:15:323
1277899523,35cyclictest3156-21chrt20:15:363
1277899523,32cyclictest20070-21chrt22:00:163
1277899523,32cyclictest20070-21chrt22:00:163
1277899522,36cyclictest29199-21taskset21:23:413
1277899522,36cyclictest16949-21chrt00:26:063
1277899522,32cyclictest18612-21chrt19:25:233
1277899514,35cyclictest5682-21chrt21:37:073
1277899514,35cyclictest16127-21chrt22:44:533
1277899513,36cyclictest21495-21chrt22:52:233
1277899513,33cyclictest29604-21chrt23:05:233
1277899512,33cyclictest13005-21chrt19:10:163
12778995112,21cyclictest0-21swapper/320:10:553
1277899503,30cyclictest15660-21taskset20:55:173
1277899503,30cyclictest14762-21chrt19:15:103
1277899503,29cyclictest5795-21chrt20:25:203
1277899503,29cyclictest5795-21chrt20:25:203
1277899502,35cyclictest11180-21chrt21:45:343
1277899493,33cyclictest25306-21taskset22:58:593
1277899483,33cyclictest3381-21taskset23:15:203
1277899483,29cyclictest832-21chrt22:20:223
1277899482,34cyclictest17336-21taskset21:00:193
1277899482,31cyclictest32589-21chrt21:29:133
1277899463,30cyclictest25674-21chrt22:09:083
1277899463,30cyclictest25674-21chrt22:09:083
1277899463,30cyclictest14699-21chrt20:50:353
1277899453,29cyclictest28459-21taskset19:55:243
1277899453,29cyclictest28459-21taskset19:55:243
1277899452,29cyclictest26693-21taskset23:00:293
1277899443,29cyclictest13325-21taskset20:45:453
1277899432,28cyclictest19834-21taskset19:30:133
1277899423,28cyclictest4463-21taskset20:20:263
1277899423,28cyclictest4463-21taskset20:20:263
1277899422,27cyclictest24675-21taskset19:45:113
1277899403,24cyclictest23039-21taskset19:40:053
1277899402,27cyclictest32189-21chrt20:05:363
1277899402,27cyclictest32189-21chrt20:05:363
1277899402,27cyclictest2852-21chrt00:05:193
1277899402,27cyclictest2852-21chrt00:05:193
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional