You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-11 - 20:32
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Thu Dec 11, 2025 12:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
301529913369,12cyclictest30780-21ntp_kernel_pll_10:53:340
301529913369,12cyclictest30780-21ntp_kernel_pll_10:53:340
28677213310,33sleep028679-21apt-get07:03:190
301529912063,11cyclictest30141-21cyclictest08:08:090
301529912063,11cyclictest30141-21cyclictest08:08:090
29276210911,69sleep229337-21mailstats07:03:502
90102990,7sleep10-21swapper/112:12:491
30160999615,47cyclictest22974-21seq09:40:452
3016099943,82cyclictest0-21swapper/208:53:262
3016099943,79cyclictest0-21swapper/212:23:242
3015799933,80cyclictest0-21swapper/110:43:211
30160999248,39cyclictest314-21in:imuxsock11:38:052
30160999150,35cyclictest16660-21proc_pri08:03:382
30160999150,35cyclictest16660-21proc_pri08:03:382
3015799913,78cyclictest0-21swapper/110:58:221
30160999043,39cyclictest12463-21sh12:18:262
3015799904,74cyclictest0-21swapper/110:33:181
3015799904,74cyclictest0-21swapper/110:33:181
30160998870,11cyclictest0-21swapper/212:28:232
30160998845,36cyclictest0-21swapper/210:23:302
30160998811,45cyclictest0-21swapper/209:47:302
30157998866,12cyclictest0-21swapper/108:28:341
3015799883,74cyclictest0-21swapper/108:53:261
3015799883,74cyclictest0-21swapper/107:18:191
30152998865,16cyclictest691-21cron09:58:060
30152998853,28cyclictest1382-21systemctl08:58:060
30160998738,40cyclictest0-21swapper/211:49:212
30160998641,36cyclictest4605-21modprobe09:08:062
30157998665,12cyclictest0-21swapper/110:39:161
30157998665,12cyclictest0-21swapper/110:39:161
30157998660,17cyclictest292-21dbus-daemon07:38:061
30160998564,15cyclictest13749-21sh09:23:352
3016099854,67cyclictest6203-21apt-get11:08:192
3016099853,47cyclictest355-21runrttasks09:09:082
3016099853,47cyclictest355-21runrttasks09:09:082
3015799854,69cyclictest0-21swapper/107:53:241
30157998546,33cyclictest4625-21diskmemload09:19:541
30157998545,33cyclictest309-21systemd-logind11:28:061
3015299859,44cyclictest15-21ksoftirqd/011:21:280
30152998543,33cyclictest17954-21grep08:08:280
30152998543,33cyclictest17954-21grep08:08:280
30160998448,31cyclictest0-21swapper/207:53:062
3016099842,74cyclictest0-21swapper/208:13:202
3015799844,49cyclictest0-21swapper/108:08:311
3015799844,49cyclictest0-21swapper/108:08:311
30160998360,10cyclictest0-21swapper/208:38:302
30160998342,34cyclictest0-21swapper/211:53:402
30160998342,34cyclictest0-21swapper/211:53:402
3016099833,74cyclictest0-21swapper/207:53:232
3016099833,69cyclictest0-21swapper/209:13:182
3016099832,75cyclictest0-21swapper/210:43:212
30157998343,33cyclictest0-21swapper/111:08:081
30157998338,38cyclictest0-21swapper/112:38:091
3015799833,69cyclictest0-21swapper/109:23:221
30157998336,40cyclictest0-21swapper/107:08:111
3015799833,34cyclictest30588-21fschecks_time07:08:281
30157998319,34cyclictest355-21runrttasks12:17:131
30157998319,34cyclictest355-21runrttasks12:17:131
30152998360,16cyclictest18029-21latency_hist12:28:090
30160998243,33cyclictest14573-21cstates07:58:242
30160998238,33cyclictest0-21swapper/210:58:332
3016099823,68cyclictest0-21swapper/209:48:212
3016099823,68cyclictest0-21swapper/209:48:212
3016099822,68cyclictest0-21swapper/210:33:212
3016099822,68cyclictest0-21swapper/210:33:212
30157998263,12cyclictest11018-21modprobe11:18:061
30157998259,13cyclictest7442-21sh09:13:091
30157998259,13cyclictest7442-21sh09:13:091
3015799823,68cyclictest0-21swapper/107:58:181
3015799823,66cyclictest0-21swapper/112:18:181
30152998262,14cyclictest21589-21latency_hist10:38:090
30152998262,14cyclictest21589-21latency_hist10:38:090
3016099812,48cyclictest1772-21expr08:58:232
30157998160,12cyclictest0-21swapper/111:43:281
3015799814,71cyclictest0-21swapper/109:53:181
3015799813,64cyclictest0-21swapper/108:58:211
3015799813,57cyclictest28017-21apt-get11:48:231
3015799812,39cyclictest86-21kswapd011:53:231
3015799812,39cyclictest86-21kswapd011:53:231
30152998160,15cyclictest18783-21sh12:28:390
30152998160,14cyclictest3356-21sh11:03:100
30152998159,16cyclictest14156-21timerwakeupswit09:23:430
30152998159,15cyclictest9348-21rm10:14:170
30160998063,8cyclictest0-21swapper/210:39:102
30160998063,8cyclictest0-21swapper/210:39:102
3016099803,66cyclictest0-21swapper/208:34:132
3016099803,59cyclictest29510-21apt-get09:53:182
3016099802,45cyclictest0-21swapper/210:32:042
3015799805,69cyclictest0-21swapper/111:08:191
30157998038,35cyclictest0-21swapper/109:28:241
3015799803,66cyclictest0-21swapper/107:48:211
3015799803,64cyclictest0-21swapper/108:43:201
3015799803,64cyclictest0-21swapper/108:43:201
3015799802,33cyclictest15200-21chrt10:25:321
3015299809,39cyclictest28017-21apt-get11:48:530
30152998057,17cyclictest31220-21sh11:53:330
30152998057,17cyclictest31220-21sh11:53:330
30160997968,7cyclictest0-21swapper/211:13:462
30160997959,9cyclictest0-21swapper/207:38:092
30160997956,13cyclictest0-21swapper/210:18:082
3016099794,65cyclictest0-21swapper/207:28:222
3016099794,65cyclictest0-21swapper/207:28:222
3016099793,63cyclictest0-21swapper/208:48:182
3016099793,63cyclictest0-21swapper/208:48:182
30160997934,37cyclictest0-21swapper/210:48:392
3015799794,64cyclictest0-21swapper/112:28:171
3015799792,66cyclictest7667-21apt-get09:13:181
30152997963,11cyclictest10913-21kworker/u17:0+xprtiod11:28:290
30152997963,11cyclictest10913-21kworker/u17:0+xprtiod11:28:290
30152997957,15cyclictest14181-21modprobe07:58:060
30160997862,9cyclictest0-21swapper/211:03:342
30160997854,13cyclictest0-21swapper/212:33:232
3016099783,69cyclictest0-21swapper/211:43:242
3016099783,66cyclictest0-21swapper/211:38:212
3016099782,48cyclictest0-21swapper/209:22:332
30157997858,14cyclictest30141-21cyclictest08:18:271
30157997837,34cyclictest0-21swapper/108:38:301
3015799783,68cyclictest0-21swapper/109:48:211
3015799783,68cyclictest0-21swapper/109:48:211
3015799783,63cyclictest0-21swapper/109:03:191
3015799782,33cyclictest9793-21ssh10:15:401
30152997859,14cyclictest27726-21unixbench_singl09:48:430
30152997859,14cyclictest27726-21unixbench_singl09:48:430
30152997849,20cyclictest32196-21modprobe08:53:050
30152997849,20cyclictest32196-21modprobe08:53:050
3015299782,43cyclictest8696-21taskset11:13:230
288727816,54sleep02901-21sh07:23:060
30160997748,20cyclictest6423-21tail10:08:422
3016099773,61cyclictest0-21swapper/207:18:192
3015799773,63cyclictest0-21swapper/108:03:161
3015799773,63cyclictest0-21swapper/108:03:161
3015799772,34cyclictest20628-21seq09:37:131
30152997761,12cyclictest30141-21cyclictest09:41:300
30152997754,17cyclictest5725-21fschecks_time10:08:280
30160997653,16cyclictest0-21swapper/211:18:282
30160997649,19cyclictest16752-21latency_hist11:28:092
3016099763,68cyclictest0-21swapper/209:58:212
3016099763,68cyclictest0-21swapper/209:58:212
30160997632,33cyclictest0-21swapper/212:13:072
30160997629,41cyclictest0-21swapper/207:44:062
3016099762,43cyclictest0-21swapper/207:38:352
3015799764,66cyclictest22323-21ssh11:38:211
3015799763,7cyclictest0-21swapper/109:43:231
30157997636,32cyclictest0-21swapper/112:28:091
30157997634,35cyclictest0-21swapper/110:28:281
3015799762,61cyclictest1150-21apt-get11:58:181
3015799762,35cyclictest19749-21/usr/sbin/munin08:13:331
3015799762,31cyclictest3188-21cpu07:23:231
3015799762,31cyclictest21836-21ntp_kernel_pll_09:38:351
30152997662,9cyclictest9017-21kworker/u17:3+xprtiod09:18:330
30152997637,33cyclictest161ktimers/008:58:420
3016099753,66cyclictest0-21swapper/210:03:182
30160997528,39cyclictest0-21swapper/208:33:102
30157997548,19cyclictest5680-21unixbench_multi07:28:421
30157997548,19cyclictest5680-21unixbench_multi07:28:421
3015799753,61cyclictest3905-21ssh12:03:191
3015799753,61cyclictest3905-21ssh12:03:191
3015799752,30cyclictest30969-21mailstats10:53:391
3015799752,30cyclictest30969-21mailstats10:53:391
3015799752,27cyclictest11589-21sensors_temp10:18:411
30152997558,11cyclictest4466-21sed12:03:370
30152997558,11cyclictest4466-21sed12:03:370
30152997538,28cyclictest0-21swapper/011:33:410
30160997439,29cyclictest316-21rs:main2
30160997439,29cyclictest316-21rs:main2
3016099743,59cyclictest0-21swapper/207:08:192
30160997434,33cyclictest0-21swapper/211:33:052
30160997434,33cyclictest0-21swapper/211:33:052
30160997432,35cyclictest0-21swapper/208:23:422
30160997432,34cyclictest0-21swapper/212:13:222
30160997432,34cyclictest0-21swapper/212:13:222
30160997429,37cyclictest0-21swapper/208:43:312
30160997429,37cyclictest0-21swapper/208:43:312
3016099742,62cyclictest0-21swapper/208:18:182
30157997433,34cyclictest0-21swapper/111:18:391
3015799742,33cyclictest32097-21munin-node07:13:151
3015799742,33cyclictest27488-21latency_hist08:38:091
3015799742,32cyclictest6691-21chrt10:09:191
3015799742,30cyclictest22065-21cat11:38:071
30152997455,12cyclictest369-21ntpd07:43:170
30152997452,15cyclictest8159-21latency09:13:330
30152997448,19cyclictest17883-21sh09:32:180
3015299743,30cyclictest22162-21apt-get10:38:250
3015299743,30cyclictest22162-21apt-get10:38:250
3016099733,59cyclictest0-21swapper/207:23:192
30157997333,33cyclictest0-21swapper/109:58:281
30157997333,33cyclictest0-21swapper/109:58:281
3015799732,65cyclictest0-21swapper/108:48:181
3015799732,65cyclictest0-21swapper/108:48:181
3015799732,33cyclictest22941-21latency08:23:331
3015799732,32cyclictest19310-21latency_hist11:33:071
3015799732,32cyclictest19310-21latency_hist11:33:071
3015799732,25cyclictest2720-21grep10:03:231
30152997356,12cyclictest30141-21cyclictest08:13:290
30152997348,18cyclictest30078-21latency_hist10:53:090
30152997347,20cyclictest32168-21processes07:13:170
30152997347,19cyclictest30679-21latency_hist08:48:080
30152997347,19cyclictest30679-21latency_hist08:48:080
3015299734,59cyclictest605-21grep09:58:400
3015299734,59cyclictest605-21grep09:58:400
30152997338,26cyclictest21915-21ssh12:33:440
30152997314,38cyclictest26002-21apt-get08:33:390
30160997229,36cyclictest0-21swapper/210:53:222
30160997229,36cyclictest0-21swapper/210:53:222
3015799722,33cyclictest9574-21latency_hist07:43:091
30152997256,10cyclictest355-21runrttasks12:09:160
3015299724,54cyclictest14281-21awk10:23:410
3015299724,35cyclictest11609-21kernelversion07:48:320
30152997243,11cyclictest181rcu_preempt09:47:290
3015299723,54cyclictest12971-21kworker/u17:1+rpciod10:33:090
3015299723,49cyclictest25276-21kworker/u17:0+xprtiod12:18:080
3015299723,49cyclictest25276-21kworker/u17:0+xprtiod12:18:080
3015299723,41cyclictest23255-21timerwakeupswit11:38:420
3015299723,38cyclictest355-21runrttasks12:20:340
3016099713,64cyclictest0-21swapper/209:33:192
3016099713,59cyclictest16324-21/usr/sbin/munin09:28:302
30160997132,32cyclictest0-21swapper/212:03:412
30160997132,32cyclictest0-21swapper/212:03:412
3015799712,32cyclictest11141-21cut07:48:091
3015799712,29cyclictest28043-21/usr/sbin/munin10:48:341
30152997151,14cyclictest4625-21diskmemload10:43:400
30152997149,16cyclictest2462-21sh11:59:290
3015299713,56cyclictest11294-21latency10:18:330
30152997112,48cyclictest0-21swapper/010:58:380
3016099703,61cyclictest0-21swapper/207:13:222
30152997055,9cyclictest7920-21ssh11:10:490
3015299705,40cyclictest18406-21kworker/u17:2+rpciod09:38:090
30152997012,29cyclictest181rcu_preempt08:38:430
30160996953,9cyclictest0-21swapper/210:18:352
30160996930,32cyclictest0-21swapper/212:03:092
3015299694,31cyclictest23882-21modprobe08:28:060
30152996939,18cyclictest4498-21modprobe07:28:060
3015299684,55cyclictest8717-21grep07:38:400
3015299683,34cyclictest25053-21find11:43:190
3015299674,29cyclictest2867-21fschecks_count10:03:280
30152996648,12cyclictest21881-21unixbench_singl08:18:420
30152996645,11cyclictest0-21swapper/011:23:320
30152996644,11cyclictest0-21swapper/007:33:080
30152996644,11cyclictest0-21swapper/007:33:080
3015299664,32cyclictest15427-21unixbench_singl07:58:430
30152996640,17cyclictest6406-21ssh09:10:010
30152996640,17cyclictest6406-21ssh09:10:010
3015299663,31cyclictest7743-21modprobe07:38:060
3016599653,43cyclictest895-21kworker/3:1+events08:18:303
3016599653,36cyclictest895-21kworker/3:1+events10:23:363
30152996545,13cyclictest25775-21apt-key08:33:100
3015299653,42cyclictest31850-21latency_hist07:13:090
2917226524,24sleep30-21swapper/307:03:423
3015299642,43cyclictest4618-21latency_hist09:08:090
3016599625,39cyclictest19601-21chrt08:13:303
3016599614,36cyclictest31090-21taskset10:53:413
3016599614,36cyclictest31090-21taskset10:53:413
3016599613,42cyclictest1369-21chrt08:58:053
30165996115,38cyclictest0-21swapper/310:38:243
30165996115,38cyclictest0-21swapper/310:38:243
3016599587,42cyclictest0-21swapper/308:33:383
3016599583,36cyclictest19146-21chrt10:33:203
3016599583,36cyclictest19146-21chrt10:33:203
3016599574,39cyclictest3406-21chrt09:03:243
3016599573,37cyclictest3892-21chrt07:23:413
3016599573,37cyclictest27759-21chrt08:38:253
3016599572,35cyclictest7836-21taskset09:13:253
3016599564,36cyclictest1586-21chrt07:18:233
3016599563,40cyclictest11957-21taskset12:18:063
3016599563,40cyclictest11957-21taskset12:18:063
3016599563,37cyclictest3309-21chrt11:03:093
3016599554,36cyclictest15242-21taskset12:23:253
3016599554,34cyclictest19469-21chrt09:33:443
3016599553,38cyclictest2398-21taskset11:59:173
3016599553,36cyclictest16141-21taskset09:28:253
3016599544,38cyclictest30687-21taskset11:53:093
3016599544,36cyclictest15045-21chrt12:23:083
3016599543,36cyclictest1268-21chrt07:18:063
3016599543,35cyclictest5306-21chrt07:28:353
3016599543,35cyclictest5306-21chrt07:28:353
3016599543,34cyclictest20977-21chrt12:33:103
3016599543,34cyclictest10941-21chrt11:17:553
3016599542,38cyclictest32260-21taskset09:58:153
3016599542,38cyclictest32260-21taskset09:58:153
3016599534,37cyclictest14885-21chrt07:58:323
3016599533,38cyclictest3774-21chrt10:03:503
3016599533,37cyclictest30797-21taskset11:53:173
3016599533,37cyclictest30797-21taskset11:53:173
3016599533,37cyclictest25442-21chrt11:43:323
3016599533,36cyclictest22235-21taskset11:38:093
3016599533,33cyclictest5704-21taskset10:08:283
3016599533,33cyclictest2165-21taskset08:58:343
3016599532,40cyclictest29767-21chrt08:43:363
3016599532,40cyclictest29767-21chrt08:43:363
3016599524,32cyclictest17546-21taskset11:28:373
3016599524,32cyclictest17546-21taskset11:28:373
3016599523,38cyclictest8063-21taskset12:09:433
3016599523,38cyclictest26375-21chrt09:48:063
3016599523,37cyclictest15612-21chrt11:24:563
3016599523,37cyclictest10633-21chrt10:18:083
3016599523,35cyclictest13398-21taskset09:23:263
3016599522,35cyclictest16208-21chrt08:03:223
3016599522,35cyclictest16208-21chrt08:03:223
3016599514,35cyclictest3742-21taskset11:03:293
3016599513,35cyclictest30300-21chrt09:53:413
3016599513,35cyclictest11864-21chrt07:48:403
3016599513,34cyclictest8632-21chrt11:13:093
3016599513,34cyclictest7220-21chrt09:12:443
3016599513,34cyclictest7220-21chrt09:12:443
3016599513,34cyclictest21591-21chrt09:38:303
3016599513,34cyclictest13834-21taskset07:53:463
3016599513,33cyclictest30491-21chrt07:08:263
3016599503,37cyclictest12187-21chrt09:20:473
3016599503,34cyclictest6485-21chrt12:08:083
3016599503,34cyclictest6485-21chrt12:08:083
3016599503,34cyclictest11847-21taskset11:18:323
3016599502,36cyclictest12755-21chrt10:21:283
3016599502,34cyclictest9897-21chrt07:43:293
3016599502,34cyclictest23394-21chrt08:23:433
3016599502,33cyclictest29175-21chrt10:50:413
3016599494,35cyclictest28824-21taskset09:52:073
3016599494,35cyclictest28824-21taskset09:52:073
3016599493,33cyclictest31410-21taskset08:48:383
3016599493,33cyclictest31410-21taskset08:48:383
3016599493,33cyclictest21316-21taskset12:33:303
3016599493,30cyclictest9528-21taskset07:43:093
3016599492,34cyclictest25014-21chrt10:43:283
3016599453,29cyclictest24617-21taskset08:28:333
3016599433,27cyclictest18236-21chrt08:08:363
3016599433,27cyclictest18236-21chrt08:08:363
3016599413,29cyclictest895-21kworker/3:1+events11:38:313
3016599402,29cyclictest16840-21taskset10:28:343
3016599394,25cyclictest6527-21taskset07:33:253
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional