You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-17 - 22:06
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7.osadl.org (updated Fri Jul 17, 2026 12:44:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22638213610,91sleep222656-21unin-run06:56:522
227609910852,48cyclictest0-21swapper/210:07:312
227609910852,48cyclictest0-21swapper/210:07:312
227479910556,36cyclictest331-21apt-get11:42:070
227529910482,15cyclictest15075-21idleruntime-cro12:06:491
2234821036,17sleep10-21swapper/106:53:411
227529910210,67cyclictest331-21apt-get11:42:101
227609910137,11cyclictest0-21swapper/211:37:112
227609910038,13cyclictest0-21swapper/210:48:362
227609910029,12cyclictest0-21swapper/210:06:512
22752999870,19cyclictest27424-21switchtime08:47:241
2276099974,39cyclictest29989-21latency_hist08:56:532
2276099974,39cyclictest29989-21latency_hist08:56:532
2276099974,36cyclictest26583-21/usr/sbin/munin10:37:262
22747999760,31cyclictest22736-21cyclictest09:21:480
2276099964,36cyclictest24260-21latency_hist12:21:532
2276099954,38cyclictest27154-21netstat08:47:162
2276099953,70cyclictest19780-21ssh10:27:152
2276099952,40cyclictest3684-21latency_hist07:36:532
2276099944,34cyclictest15646-21fschecks_time08:12:122
2276099943,40cyclictest31146-21timerandwakeup08:57:262
2276099943,39cyclictest26357-21modprobe07:06:502
2276099943,33cyclictest8349-21latency_hist11:01:522
22760999426,17cyclictest0-21swapper/207:21:532
2276099942,36cyclictest17019-21ntp_kernel_pll_10:22:182
2276099942,35cyclictest20361-21latency_hist11:21:522
22752999430,27cyclictest0-21swapper/110:37:251
22760999338,8cyclictest0-21swapper/210:33:262
22760999338,8cyclictest0-21swapper/210:33:262
2276099933,40cyclictest32191-21switchtime07:22:262
2276099933,38cyclictest27568-21latency_hist09:46:512
2276099933,36cyclictest26434-21latency_hist11:31:522
2276099933,36cyclictest26434-21latency_hist11:31:522
2276099933,32cyclictest5634-21seq07:42:132
22760999332,13cyclictest0-21swapper/207:51:532
22752999369,16cyclictest26615-21latency_hist08:46:531
22752999335,22cyclictest22736-21cyclictest11:31:421
22752999335,22cyclictest22736-21cyclictest11:31:421
2276099923,43cyclictest7115-21mailstats11:52:232
22760999234,11cyclictest0-21swapper/212:14:352
2276099923,37cyclictest15344-21latency_hist08:11:542
2276099914,32cyclictest11374-21timerandwakeup07:57:492
22760999128,13cyclictest0-21swapper/208:32:252
22760999113,32cyclictest3411-21cpu11:47:052
22752999128,30cyclictest14273-21sed10:17:251
22747999168,15cyclictest12688-21ssh12:02:120
2274799912,68cyclictest3206-21ssh10:53:340
2276099904,31cyclictest3707-21latency_hist09:06:542
2276099904,31cyclictest3707-21latency_hist09:06:542
2276099903,36cyclictest18470-21latency_hist08:21:532
2276099903,35cyclictest30715-21latency_hist09:51:532
2276099903,35cyclictest30715-21latency_hist09:51:532
2276099903,29cyclictest21578-21sh08:31:502
2276099894,34cyclictest10052-21fschecks_count09:17:122
2276099893,37cyclictest24393-21latency_hist07:01:522
2276099893,37cyclictest24393-21latency_hist07:01:522
2276099893,35cyclictest29907-21diskmemload09:57:082
2276099892,38cyclictest1972-21latency_hist07:32:392
2276099886,34cyclictest449-21sh11:42:192
22752998846,32cyclictest20419-21grep08:27:121
2276099875,37cyclictest19445-21timerwakeupswit08:22:262
2276099873,65cyclictest2745-21chrt10:52:382
2276099873,38cyclictest3943-21cstates07:37:082
22760998656,21cyclictest29907-21diskmemload10:42:132
2276099864,28cyclictest12397-21ssh12:02:032
2276099863,34cyclictest16608-21sh09:27:262
2276099863,34cyclictest16608-21sh09:27:262
22752998642,32cyclictest7922-21grep07:47:271
22747998659,21cyclictest7207-21sh09:12:150
2276099854,31cyclictest29249-21latency_hist11:36:532
2276099853,36cyclictest24499-21latency_hist09:41:532
2276099853,35cyclictest19616-21sensors_temp09:32:262
2276099843,35cyclictest13791-21unixbench_multi09:22:272
22747998460,15cyclictest5562-21ssh10:57:080
22747998361,15cyclictest22736-21cyclictest09:46:470
22747998349,12cyclictest181rcu_preempt11:52:250
214042838,15sleep30-21swapper/306:52:123
2276099824,32cyclictest352-21runrttasks08:43:312
22752998256,20cyclictest1846-21sh09:57:171
22752998223,27cyclictest0-21swapper/109:43:431
22747998260,9cyclictest181rcu_preempt11:37:170
22747998257,14cyclictest22494-21proc_pri09:37:220
22747998236,14cyclictest181rcu_preempt09:32:220
22747998164,11cyclictest27059-21cron12:26:490
22747998159,16cyclictest30522-21fschecks_time08:57:120
22747998151,21cyclictest21667-21fschecks_time12:17:110
22760998061,13cyclictest7594-21switchtime09:12:242
2275299803,52cyclictest19683-21apt-get10:27:031
22747998061,13cyclictest22736-21cyclictest11:28:570
22747998061,13cyclictest22736-21cyclictest11:28:570
22747998037,12cyclictest181rcu_preempt10:28:230
22752997961,12cyclictest111-21hwrng09:38:451
22752997920,23cyclictest29907-21diskmemload12:11:111
22747997962,11cyclictest22736-21cyclictest08:42:240
22747997953,9cyclictest181rcu_preempt08:10:310
22747997950,12cyclictest181rcu_preempt08:33:420
22747997950,11cyclictest181rcu_preempt10:22:020
2274799793,44cyclictest19676-21snmpd11:02:260
2274799793,44cyclictest19676-21snmpd11:02:260
22747997917,28cyclictest10180-21dpkg07:56:520
22752997863,9cyclictest23232-21kworker/u18:011:26:491
22752997858,11cyclictest0-21swapper/109:07:131
22747997863,10cyclictest11459-21ssh12:00:100
22747997856,8cyclictest181rcu_preempt09:11:320
2274799785,41cyclictest15-21ksoftirqd/011:07:050
22747997851,11cyclictest181rcu_preempt07:47:500
22747997850,23cyclictest14539-21ssh11:12:000
22747997850,23cyclictest14539-21ssh11:12:000
22747997849,10cyclictest181rcu_preempt08:16:530
22747997844,22cyclictest181rcu_preempt09:22:360
22760997763,10cyclictest22736-21cyclictest09:08:022
2275299777,60cyclictest2514-21apt-get10:52:141
22752997747,21cyclictest352-21runrttasks11:10:401
22752997742,27cyclictest0-21swapper/109:02:141
22752997742,27cyclictest0-21swapper/109:02:141
22752997725,18cyclictest9055-21sh09:15:401
22747997762,11cyclictest19745-21kworker/u17:0+rpciod10:36:530
22747997762,11cyclictest19745-21kworker/u17:0+rpciod10:36:530
22747997759,12cyclictest29907-21diskmemload11:47:230
22747997751,11cyclictest181rcu_preempt10:12:080
22747997749,9cyclictest181rcu_preempt07:06:530
22747997734,13cyclictest181rcu_preempt11:36:520
22752997655,15cyclictest1-21systemd10:06:501
22752997655,14cyclictest27499-21latency_hist09:46:531
22752997655,14cyclictest27499-21latency_hist09:46:531
22752997654,15cyclictest352-21runrttasks11:47:111
22747997653,17cyclictest1972-21latency_hist07:32:380
22747997647,9cyclictest181rcu_preempt09:54:380
2274799763,43cyclictest30522-21ssh09:51:500
2274799763,43cyclictest30522-21ssh09:51:500
22747997631,33cyclictest1075-21fschecks_time09:02:140
22747997631,33cyclictest1075-21fschecks_time09:02:140
22760997556,14cyclictest24432-21cpu12:22:052
22752997536,29cyclictest15661-21cut08:12:121
22752997517,31cyclictest10737-21forks07:57:301
22747997562,9cyclictest22736-21cyclictest07:22:130
22747997552,8cyclictest181rcu_preempt08:37:080
22747997543,11cyclictest181rcu_preempt09:27:070
22747997543,11cyclictest181rcu_preempt09:27:070
22747997542,12cyclictest181rcu_preempt08:02:160
22747997527,8cyclictest0-21swapper/011:22:040
2275299748,56cyclictest28552-21apt-get08:52:051
2275299748,56cyclictest28552-21apt-get08:52:051
22752997460,8cyclictest0-21swapper/109:26:501
22752997452,15cyclictest10513-21cpuspeed10:12:071
22747997457,12cyclictest22736-21cyclictest08:47:240
22747997455,13cyclictest352-21runrttasks07:17:070
22752997359,10cyclictest31-21ksoftirqd/107:37:121
22752997331,18cyclictest352-21runrttasks10:32:281
22752997331,18cyclictest352-21runrttasks10:32:281
22747997360,9cyclictest29295-21kworker/u18:0-rpciod12:09:530
22747997350,9cyclictest181rcu_preempt11:19:170
22747997345,20cyclictest17201-21tune2fs08:17:130
2274799734,32cyclictest2368-21timerwakeupswit09:57:280
22747997336,12cyclictest181rcu_preempt07:45:020
2274799733,40cyclictest19676-21snmpd10:07:090
2274799733,40cyclictest19676-21snmpd10:07:090
22747997329,23cyclictest181rcu_preempt10:44:550
22752997243,19cyclictest32479-21latency_hist11:41:531
22747997230,12cyclictest181rcu_preempt10:02:520
2275299715,25cyclictest0-21swapper/108:57:011
22752997143,19cyclictest31961-21ntp_kernel_pll_07:22:201
22752997122,21cyclictest17727-21sh10:23:011
2274799718,20cyclictest23115-21tune2fs06:57:120
2274799718,20cyclictest23115-21tune2fs06:57:120
22747997156,9cyclictest19081-21diskmemload12:12:220
22747997144,20cyclictest1735-21sh10:51:140
2274799713,50cyclictest21583-21apt08:31:500
2274799713,45cyclictest15-21ksoftirqd/008:26:520
22760997055,9cyclictest17568-21kworker/u17:3-nfsiod11:24:022
22752997050,10cyclictest0-21swapper/109:17:241
22752997049,11cyclictest0-21swapper/112:26:511
2275299702,35cyclictest15135-21latency_hist08:11:501
22752997016,21cyclictest21936-21cstates08:32:061
22747997056,10cyclictest22736-21cyclictest07:07:260
22747997047,9cyclictest181rcu_preempt07:36:520
2276099692,30cyclictest12612-21netstat08:02:192
22752996948,16cyclictest22736-21cyclictest07:46:531
22752996941,23cyclictest0-21swapper/110:46:491
22752996939,22cyclictest0-21swapper/112:17:221
2274799695,33cyclictest352-21runrttasks07:57:420
2274799693,56cyclictest22749-21taskset06:56:540
2274799693,33cyclictest13875-21cut10:17:160
2276099683,45cyclictest28956-21wc07:12:252
2275299686,43cyclictest24315-21sh07:01:501
2275299686,43cyclictest24315-21sh07:01:501
2275299686,43cyclictest23235-21kworker/u18:3+rpciod11:36:491
22752996846,13cyclictest0-21swapper/111:02:121
22752996846,13cyclictest0-21swapper/111:02:121
2275299682,40cyclictest0-21swapper/111:52:131
22747996813,8cyclictest0-21swapper/010:37:020
2276099673,42cyclictest14532-21/usr/sbin/munin11:12:092
2276099673,42cyclictest14532-21/usr/sbin/munin11:12:092
2276099672,51cyclictest8533-21ssh11:02:022
2276099672,51cyclictest8533-21ssh11:02:022
2275299674,39cyclictest17226-21latency_hist11:16:531
2275299674,39cyclictest17226-21latency_hist11:16:531
22752996736,23cyclictest0-21swapper/112:01:521
2274799674,41cyclictest29594-21latency_hist07:16:520
2276599663,45cyclictest31994-21taskset10:47:123
22760996644,13cyclictest24287-21timerwakeupswit08:37:272
2276099663,48cyclictest27306-21mailstats07:07:252
2276099662,46cyclictest13095-21modprobe10:16:492
22752996644,15cyclictest1-21systemd08:02:201
22752996644,11cyclictest0-21swapper/107:32:381
22752996643,16cyclictest11085-21ntpd11:00:231
22752996639,18cyclictest24221-21threads08:37:271
2275299663,42cyclictest17973-21grep08:17:291
2275299662,44cyclictest21553-21latency_hist09:36:511
2274799663,43cyclictest4586-21switchtime07:37:260
2274799663,43cyclictest28812-21fschecks_count08:53:110
2274799663,43cyclictest28812-21fschecks_count08:53:110
22760996548,12cyclictest0-21swapper/210:17:162
2276099654,44cyclictest9627-21fschecks_count11:57:122
2276099653,27cyclictest16064-21awk12:07:222
22752996542,13cyclictest0-21swapper/110:51:521
2275299653,41cyclictest24964-21fschecks_count07:02:021
22752996518,21cyclictest0-21swapper/110:07:531
22752996518,21cyclictest0-21swapper/110:07:531
2275299651,29cyclictest0-21swapper/107:17:061
2276599646,39cyclictest0-21swapper/311:42:053
22760996430,12cyclictest181rcu_preempt11:10:412
22760996421,10cyclictest181rcu_preempt07:52:062
2275299643,43cyclictest18815-21fschecks_count08:22:121
22752996346,9cyclictest0-21swapper/109:56:521
22752996345,11cyclictest0-21swapper/107:52:301
2275299633,39cyclictest3046-21timerandwakeup07:32:551
2275299621,22cyclictest20172-21ssh11:21:421
22752996211,37cyclictest29599-21munin-run07:16:501
2276099612,37cyclictest31640-21ssh09:52:262
2275299613,41cyclictest15808-21/usr/sbin/munin09:27:131
2275299613,41cyclictest15808-21/usr/sbin/munin09:27:131
2275299613,30cyclictest0-21swapper/107:09:161
2275299603,31cyclictest19121-21grep12:12:221
2276599563,40cyclictest7806-21taskset09:12:263
213032560,6sleep30-21swapper/312:16:533
2276599543,41cyclictest12514-21taskset09:21:513
2276599543,38cyclictest5620-21chrt07:42:123
2276599534,36cyclictest9527-21taskset10:10:163
2276599534,36cyclictest9527-21taskset10:10:163
2276599523,39cyclictest2208-21chrt09:57:263
2276599523,34cyclictest29458-21chrt11:36:533
2276599522,39cyclictest28354-21chrt09:47:173
2276599522,39cyclictest28354-21chrt09:47:173
2276599522,36cyclictest27599-21chrt08:47:253
2276599522,33cyclictest19497-21chrt10:26:533
22765995214,23cyclictest0-21swapper/310:53:053
2276599513,38cyclictest26869-21taskset12:26:173
2276599513,34cyclictest12886-21chrt09:22:073
2276599504,35cyclictest27664-21chrt09:46:523
2276599504,33cyclictest31237-21chrt09:52:153
2276599503,37cyclictest2019-21chrt07:31:513
2276599503,37cyclictest17505-21taskset09:29:043
2276599503,37cyclictest17505-21taskset09:29:043
2276599503,35cyclictest20036-21chrt10:27:593
2276599503,34cyclictest9873-21taskset11:03:093
2276599503,34cyclictest9873-21taskset11:03:093
2276599503,33cyclictest10895-21chrt10:12:183
2276599502,35cyclictest7854-21chrt07:47:273
2276599502,33cyclictest507-21chrt07:26:533
2276599502,32cyclictest21757-21chrt09:36:553
22765994937,8cyclictest215322sleep309:36:523
2276599493,35cyclictest27881-21chrt10:40:273
2276599493,34cyclictest15415-21chrt12:07:003
2276599493,33cyclictest29645-21chrt11:37:053
2276599492,38cyclictest25264-21taskset07:02:153
2276599492,38cyclictest13948-21taskset10:17:173
2276599492,37cyclictest15438-21taskset11:12:253
2276599492,37cyclictest15438-21taskset11:12:253
2276599483,35cyclictest22498-21chrt08:32:233
2276599483,33cyclictest8713-21chrt07:52:053
2276599483,32cyclictest4829-21chrt11:48:243
2276599482,35cyclictest917-21kworker/3:1+events10:42:473
2276599482,33cyclictest12467-21chrt12:02:063
2276599474,34cyclictest21990-21chrt12:17:173
2276599473,31cyclictest6906-21chrt10:58:153
2276599473,31cyclictest18553-21chrt08:21:543
2276599472,32cyclictest23904-21chrt10:32:453
2276599472,32cyclictest23904-21chrt10:32:453
2276599472,32cyclictest15892-21chrt08:12:183
2276599464,31cyclictest9524-21chrt11:57:073
2276599463,30cyclictest6129-21chrt09:10:523
2276599462,33cyclictest31366-21chrt08:57:343
2276599462,32cyclictest4818-21chrt10:02:173
2276599453,32cyclictest745-21chrt09:02:003
2276599453,32cyclictest745-21chrt09:02:003
2276599453,31cyclictest12401-21chrt08:02:133
2276599448,27cyclictest7503-21taskset11:52:293
2276599443,31cyclictest24112-21taskset08:37:253
2276599433,28cyclictest20389-21taskset08:27:083
2276599433,27cyclictest25965-21chrt08:42:273
2276599433,27cyclictest10552-21chrt07:57:033
2276599432,31cyclictest19460-21taskset08:22:263
2276599423,30cyclictest30581-21chrt07:17:263
2276599423,30cyclictest20955-21taskset11:22:143
2276599423,28cyclictest17753-21taskset11:17:113
2276599423,27cyclictest26656-21chrt07:07:053
2276599423,27cyclictest11495-21taskset11:06:543
2276599422,31cyclictest14237-21chrt08:07:163
2276599422,23cyclictest3800-21taskset07:36:543
2276599403,29cyclictest917-21kworker/3:1+events07:16:373
2276599403,28cyclictest23606-21chrt06:57:253
2276599403,28cyclictest23606-21chrt06:57:253
2276599403,26cyclictest25182-21chrt11:28:513
2276599403,26cyclictest25182-21chrt11:28:513
2276599402,29cyclictest29982-21chrt08:56:533
2276599402,29cyclictest29982-21chrt08:56:533
2276599402,26cyclictest4394-21chrt07:37:223
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional