You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-19 - 22:03
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Sat Sep 19, 2026 12:44:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
249449912464,19cyclictest17401-21idleruntime-cro11:23:532
24928991202,25cyclictest30774-21/usr/sbin/munin07:25:140
249289911855,56cyclictest1576-21cstates10:04:110
24928991183,30cyclictest16352-21wc09:34:300
24928991152,30cyclictest4003-21ssh11:00:310
24928991142,24cyclictest25909-21rm11:37:370
24928991133,27cyclictest16981-21ssh11:22:440
24928991123,25cyclictest25495-21taskset08:44:330
24928991123,24cyclictest32540-21ssh10:01:010
24928991123,24cyclictest32540-21ssh10:01:010
24928991122,32cyclictest8546-21runrttasks11:09:110
24928991113,25cyclictest9552-21taskset10:16:330
24928991103,23cyclictest2376-21rm09:12:290
24928991102,79cyclictest11470-21/usr/sbin/munin11:14:170
24928991102,48cyclictest9234-21apt-get12:04:040
24928991102,48cyclictest9234-21apt-get12:04:040
24928991102,27cyclictest13936-21taskset08:09:320
24928991092,28cyclictest16654-21ssh12:15:290
24928991092,28cyclictest16654-21ssh12:15:290
24928991092,27cyclictest14211-21ssh12:12:020
24928991092,26cyclictest29083-21sh12:36:410
24928991083,31cyclictest6471-21/usr/sbin/munin07:50:070
24928991083,25cyclictest3259-21taskset09:14:120
24928991083,24cyclictest7812-21ssh11:07:520
24928991083,24cyclictest7812-21ssh11:07:520
24928991083,24cyclictest15350-21ssh10:25:500
24928991082,25cyclictest31919-21ssh10:53:590
24928991082,25cyclictest27359-21ssh10:45:150
24928991082,25cyclictest27359-21ssh10:45:150
24928991072,25cyclictest22252-21ssh11:30:460
24928991072,23cyclictest4732-21ssh11:55:380
24928991072,23cyclictest4732-21ssh11:55:380
24928991063,27cyclictest19147-21ssh10:33:080
24928991063,27cyclictest19147-21ssh10:33:080
24928991063,25cyclictest8377-21ssh09:22:210
24928991063,24cyclictest2276-21ssh11:52:070
24928991062,26cyclictest24089-21ssh09:48:260
24928991062,24cyclictest27164-21taskset07:14:110
24928991062,24cyclictest19592-21ssh11:26:420
24928991062,23cyclictest8356-21ssh12:02:200
24928991062,23cyclictest29285-21ssh11:43:380
24928991062,22cyclictest24563-21fschecks_time12:29:170
24928991062,22cyclictest24563-21fschecks_time12:29:170
24928991062,22cyclictest19599-21ssh12:20:100
24928991062,21cyclictest25495-21seq10:43:250
24928991053,26cyclictest12424-21runrttasks10:21:060
24928991052,23cyclictest18841-21timerandwakeup08:24:290
151021050,6sleep30-21swapper/311:49:573
24928991043,26cyclictest343-21runrttasks10:12:080
24928991043,23cyclictest30521-21taskset09:01:420
24928991042,27cyclictest27186-21ssh09:53:390
24928991042,26cyclictest30599-21ssh10:50:580
24928991042,26cyclictest14771-21seq08:14:020
24928991042,26cyclictest14771-21seq08:14:020
24928991042,24cyclictest21863-21ssh10:37:220
24928991042,24cyclictest14032-21ssh09:30:420
24928991042,24cyclictest14032-21ssh09:30:420
24928991033,6cyclictest0-21swapper/008:54:080
24928991032,26cyclictest29812-21seq07:19:520
24928991032,26cyclictest29812-21seq07:19:520
24928991032,24cyclictest20685-21taskset08:30:030
24928991032,23cyclictest23621-21ssh12:28:070
24928991023,23cyclictest11170-21ssh09:26:060
24928991022,27cyclictest30240-21ssh09:58:460
24928991022,27cyclictest30240-21ssh09:58:460
24928991022,25cyclictest2440-21seq07:35:030
24928991022,25cyclictest2440-21seq07:35:030
24928991022,24cyclictest22411-21taskset08:36:360
249369910111,76cyclictest22427-21apt-get10:39:091
24928991014,23cyclictest26294-21taskset07:11:590
24928991014,23cyclictest26294-21taskset07:11:590
24928991013,24cyclictest27423-21taskset08:53:370
24928991012,24cyclictest4216-21taskset07:41:560
24928991012,23cyclictest17521-21taskset08:20:420
24928991012,22cyclictest20071-21ssh09:40:400
2492899992,24cyclictest31196-21ssh11:45:360
2492899992,22cyclictest5724-21taskset07:45:390
2492899992,22cyclictest5724-21taskset07:45:390
2492899973,7cyclictest0-21swapper/009:04:050
2492899962,20cyclictest11501-21sh08:04:130
2492899953,23cyclictest863-21runrttasks07:30:290
2492899952,25cyclictest24086-21taskset08:42:080
24944999415,34cyclictest381ktimers/209:24:232
2492899933,82cyclictest24930-21latency_hist07:08:570
246042936,16sleep20-21swapper/207:06:332
24944999152,13cyclictest181rcu_preempt09:41:482
2492899912,29cyclictest8709-21/usr/sbin/munin07:54:270
2492899912,25cyclictest9730-21apt-get07:59:040
2492899912,25cyclictest9730-21apt-get07:59:040
24944998770,11cyclictest30187-21systemd-run07:23:552
24944998770,11cyclictest30187-21systemd-run07:23:552
24944998747,17cyclictest181rcu_preempt10:37:122
2493699873,63cyclictest5986-21apt-get07:49:071
2375428714,30sleep10-21swapper/107:04:241
24936998568,11cyclictest526-21rs:main1
2494499844,65cyclictest30952-21ssh09:59:162
2494499844,65cyclictest30952-21ssh09:59:162
24936998467,11cyclictest5999-21latency_hist09:18:561
24944998348,13cyclictest181rcu_preempt11:16:192
24936998366,11cyclictest1-21systemd11:18:531
24936998359,17cyclictest9269-21cpu12:04:091
24936998359,17cyclictest9269-21cpu12:04:091
24936998358,19cyclictest21112-21latency_hist08:33:561
24936998358,18cyclictest6102-21apt-key07:48:561
24936998358,18cyclictest6102-21apt-key07:48:561
2493699833,49cyclictest24310-21latency_hist09:48:551
24944998260,15cyclictest4811-21kworker/u17:3+rpciod10:39:112
24944998257,15cyclictest15989-21latency09:34:212
24944998244,17cyclictest181rcu_preempt11:10:152
2494499823,42cyclictest14793-21apt-get08:14:082
2494499823,42cyclictest14793-21apt-get08:14:082
2494499813,64cyclictest6489-21apt-get07:49:072
24944998118,34cyclictest39-21ksoftirqd/210:10:032
2494499804,59cyclictest30642-21apt-get07:24:082
24944998041,9cyclictest12686-21ssh09:29:142
24944998041,9cyclictest12686-21ssh09:29:142
2493699806,63cyclictest30135-21apt-get07:24:081
24936998056,16cyclictest17219-21threads08:19:481
2495199793,53cyclictest0-21swapper/310:39:113
24944997956,13cyclictest0-21swapper/210:08:562
24944997949,9cyclictest181rcu_preempt08:24:582
24944997948,15cyclictest32601-21ssh10:54:262
2494499794,35cyclictest2780-21fschecks_count10:59:152
24944997923,30cyclictest28566-21latency_hist07:18:562
2493699793,68cyclictest4695-21apt-get10:09:121
2495199782,41cyclictest0-21swapper/310:09:243
24944997853,18cyclictest526-21rs:main2
24944997853,17cyclictest0-21swapper/209:19:332
24944997846,9cyclictest181rcu_preempt10:29:222
24944997846,9cyclictest181rcu_preempt10:29:222
2494499783,48cyclictest28262-21ntp_states08:54:262
24944997831,36cyclictest26890-21modprobe12:33:532
24944997831,36cyclictest26890-21modprobe12:33:532
24936997859,12cyclictest0-21swapper/112:34:321
2493699784,60cyclictest9497-21apt-get09:24:161
24944997758,14cyclictest32324-21diskmemload12:24:312
24936997762,9cyclictest29321-21ntp_offset07:19:231
24936997762,9cyclictest29321-21ntp_offset07:19:231
24944997657,12cyclictest0-21swapper/212:09:172
24944997651,13cyclictest11438-21processes10:19:272
24944997642,12cyclictest181rcu_preempt12:07:242
24944997642,12cyclictest181rcu_preempt12:07:242
24936997656,13cyclictest21736-21unixbench_multi11:29:331
24944997548,17cyclictest0-21swapper/208:34:152
24944997545,9cyclictest8356-21ssh12:02:202
24944997540,25cyclictest418-21kworker/u19:1+nfsiod11:56:162
24944997540,25cyclictest418-21kworker/u19:1+nfsiod11:56:162
24944997538,8cyclictest181rcu_preempt12:14:162
24944997538,8cyclictest181rcu_preempt12:14:162
2494499752,20cyclictest23256-21kernelversion08:39:212
24936997553,16cyclictest8942-21idleruntime-cro09:23:531
24936997512,25cyclictest32590-21taskset10:54:251
24936997511,28cyclictest9712-21/usr/sbin/munin07:59:261
24936997511,28cyclictest9712-21/usr/sbin/munin07:59:261
24944997453,15cyclictest30621-21latency_hist09:58:572
24944997453,15cyclictest30621-21latency_hist09:58:572
24944997431,24cyclictest27274-21cron09:53:532
24944997411,33cyclictest29934-21wc12:38:552
24936997444,24cyclictest31575-21processes09:04:261
2493699742,49cyclictest26904-21munin-run12:33:531
2493699742,49cyclictest26904-21munin-run12:33:531
24936997420,31cyclictest32324-21diskmemload11:54:191
24936997420,31cyclictest32324-21diskmemload11:54:191
24944997347,15cyclictest0-21swapper/210:24:272
24944997345,20cyclictest22570-21unixbench_multi09:44:302
24944997335,14cyclictest181rcu_preempt08:29:202
24944997335,13cyclictest181rcu_preempt09:13:542
2493699737,30cyclictest30887-21apt-get09:59:091
2493699737,30cyclictest30887-21apt-get09:59:091
24936997356,11cyclictest19999-21fschecks_count10:34:171
24936997355,11cyclictest29421-21systemd-run11:43:541
24936997348,19cyclictest3251-21sendmail_mailst10:59:271
2494499724,45cyclictest14637-21apt-config08:13:572
24944997239,9cyclictest181rcu_preempt07:39:122
24944997238,9cyclictest181rcu_preempt11:41:222
24944997238,12cyclictest181rcu_preempt10:44:322
24944997238,12cyclictest181rcu_preempt10:44:322
24944997236,13cyclictest181rcu_preempt08:04:182
2494499723,43cyclictest24114-21kernelversion11:34:212
24944997233,17cyclictest6380-21threads11:04:292
24944997233,17cyclictest6380-21threads11:04:292
24944997229,12cyclictest0-21swapper/208:19:102
24936997253,13cyclictest4462-21latency_hist07:43:561
24936997251,15cyclictest20797-21sh09:42:421
24936997251,14cyclictest0-21swapper/108:09:291
2493699724,58cyclictest18270-21ssh12:19:051
24936997242,21cyclictest19456-21latency_hist08:28:561
2493699723,45cyclictest32324-21diskmemload11:28:571
2493699723,34cyclictest26096-21/usr/sbin/munin08:49:171
24936997221,25cyclictest32324-21diskmemload09:12:461
24944997151,12cyclictest24919-21cyclictest08:53:532
2494499713,42cyclictest17683-21sh11:24:022
24936997156,11cyclictest24919-21cyclictest09:30:271
24936997156,11cyclictest24919-21cyclictest09:30:271
24936997153,11cyclictest30808-21sh11:44:321
24936997151,13cyclictest0-21swapper/107:29:281
24944997039,9cyclictest181rcu_preempt11:32:312
2494499703,32cyclictest743-21grep07:29:302
2494499703,30cyclictest10459-21rm10:18:532
24944997029,12cyclictest181rcu_preempt08:03:532
24944997029,12cyclictest181rcu_preempt08:03:532
24944997027,7cyclictest181rcu_preempt07:38:042
24944997027,7cyclictest181rcu_preempt07:38:042
24936997045,17cyclictest32324-21diskmemload10:33:571
24936997045,17cyclictest32324-21diskmemload10:33:571
159532700,10sleep1291rcuc/112:14:271
159532700,10sleep1291rcuc/112:14:271
2494499696,39cyclictest25440-21if_eth007:09:182
2494499696,39cyclictest25440-21if_eth007:09:182
24944996932,13cyclictest181rcu_preempt11:47:152
2494499692,47cyclictest18473-21/usr/sbin/munin12:19:152
2493699699,25cyclictest0-21swapper/108:54:111
2493699697,25cyclictest0-21swapper/111:04:291
2493699697,25cyclictest0-21swapper/111:04:291
24936996950,12cyclictest343-21runrttasks08:39:241
24936996949,13cyclictest24919-21cyclictest09:58:251
24936996949,13cyclictest24919-21cyclictest09:58:251
24936996948,14cyclictest32324-21diskmemload09:34:131
24944996850,10cyclictest0-21swapper/211:53:532
24944996844,18cyclictest29254-21fschecks_time10:49:162
24944996844,11cyclictest181rcu_preempt09:01:192
2494499683,40cyclictest32313-21latency_hist09:08:572
24936996845,13cyclictest0-21swapper/110:04:161
2493699683,31cyclictest10755-21apt-get10:19:051
2495199672,38cyclictest0-21swapper/309:59:123
2495199672,38cyclictest0-21swapper/309:59:123
24944996741,18cyclictest0-21swapper/207:58:562
24944996739,19cyclictest24723-21cut08:44:172
24936996755,8cyclictest24919-21cyclictest09:50:021
24936996749,12cyclictest26624-21open_files10:44:251
24936996749,12cyclictest26624-21open_files10:44:251
24936996748,11cyclictest0-21swapper/112:24:291
24936996747,11cyclictest0-21swapper/107:58:571
24936996742,16cyclictest3013-21latency_hist11:53:551
24936996740,19cyclictest2738-21modprobe07:38:531
24936996740,19cyclictest2738-21modprobe07:38:531
2493699673,37cyclictest21472-21fschecks_count08:34:161
2493699672,37cyclictest27348-21fschecks_count07:14:171
24936996719,36cyclictest26610-21latency_hist07:13:561
24936996719,36cyclictest26610-21latency_hist07:13:561
24936996713,24cyclictest14376-21ssh10:24:231
24944996628,11cyclictest4913-21sort07:44:182
24944996628,11cyclictest4913-21sort07:44:182
24936996646,15cyclictest5896-21kworker/u17:4+events_unbound12:13:531
2493699663,28cyclictest0-21swapper/110:51:121
2493699662,34cyclictest32324-21diskmemload11:34:311
231592660,7sleep30-21swapper/311:33:203
2493699657,51cyclictest6530-21kworker/u19:0+ext4-rsv-conversion08:14:161
2493699657,51cyclictest6530-21kworker/u19:0+ext4-rsv-conversion08:14:161
24936996517,18cyclictest0-21swapper/112:02:491
24951996424,28cyclictest17177-21taskset10:29:183
24951996424,28cyclictest17177-21taskset10:29:183
24936996442,12cyclictest0-21swapper/108:04:291
2493699643,41cyclictest24566-21ls08:44:121
225422640,8sleep30-21swapper/310:38:543
24951996329,21cyclictest6560-21taskset07:49:523
2493699637,27cyclictest0-21swapper/108:59:151
24936996340,14cyclictest8868-21ssh11:09:191
24951996226,21cyclictest4285-21chrt10:08:553
24951996225,25cyclictest10272-21taskset07:59:243
24951996225,25cyclictest10272-21taskset07:59:243
24951996127,21cyclictest19025-21chrt08:24:303
24951996125,23cyclictest11500-21chrt08:04:133
24951996124,25cyclictest27698-21taskset09:54:123
24951996124,25cyclictest27698-21taskset09:54:123
24936996141,10cyclictest0-21swapper/110:14:191
24951996028,21cyclictest23974-21chrt12:28:553
24951996026,21cyclictest7900-21chrt09:21:013
24951996026,21cyclictest28772-21chrt11:42:113
24951996025,22cyclictest4646-21chrt09:15:253
2495199593,41cyclictest26634-21taskset10:44:263
2495199593,41cyclictest26634-21taskset10:44:263
24951995926,20cyclictest27878-21chrt08:54:153
24951995926,20cyclictest17942-21taskset11:24:173
24951995925,21cyclictest5424-21chrt11:57:353
24951995925,21cyclictest5424-21chrt11:57:353
24951995925,21cyclictest26618-21chrt09:52:053
24951995922,24cyclictest3019-21taskset07:39:033
24951995922,23cyclictest2611-21chrt07:37:163
24951995922,23cyclictest2611-21chrt07:37:163
2364425912,27sleep30-21swapper/307:04:223
2495199583,39cyclictest17326-21chrt09:36:293
24951995828,18cyclictest6039-21chrt07:48:553
24951995828,18cyclictest6039-21chrt07:48:553
24951995826,21cyclictest18387-21chrt12:19:113
24951995825,21cyclictest827-21chrt09:09:253
24951995825,21cyclictest24209-21chrt11:34:213
24951995825,19cyclictest25362-21chrt08:44:313
24951995824,21cyclictest6617-21chrt11:04:313
24951995824,21cyclictest6617-21chrt11:04:313
24951995824,20cyclictest32254-21chrt07:29:063
24951995822,25cyclictest29305-21taskset12:37:223
24951995822,24cyclictest31254-21taskset10:52:483
24951995821,24cyclictest28175-21taskset07:14:573
24951995726,20cyclictest17028-21chrt08:19:453
24951995725,21cyclictest15782-21taskset10:27:033
24951995725,20cyclictest22198-21chrt08:34:313
24951995724,21cyclictest24286-21chrt09:48:533
24951995724,21cyclictest11384-21chrt10:19:253
24951995724,20cyclictest9307-21chrt07:57:213
24951995723,21cyclictest26187-21chrt07:10:363
24951995723,21cyclictest26187-21chrt07:10:363
24951995722,23cyclictest32036-21taskset09:05:293
24951995722,23cyclictest3162-21chrt10:59:253
24951995721,23cyclictest20697-21taskset08:30:133
24951995626,20cyclictest26426-21chrt08:49:173
24951995625,21cyclictest32602-21chrt10:54:263
24951995624,21cyclictest9257-21chrt12:04:073
24951995624,21cyclictest9257-21chrt12:04:073
24951995624,21cyclictest12523-21chrt09:29:073
24951995624,21cyclictest12523-21chrt09:29:073
24951995624,20cyclictest30689-21chrt07:24:413
24951995624,20cyclictest29962-21chrt08:59:253
24951995624,20cyclictest13990-21chrt08:10:093
24951995624,19cyclictest7904-21chrt10:14:153
2495199562,39cyclictest12671-21taskset11:14:443
24951995622,22cyclictest21189-21chrt09:43:473
24951995610,27cyclictest0-21swapper/309:24:163
2495199553,34cyclictest24496-21chrt12:29:163
2495199553,34cyclictest24496-21chrt12:29:163
24951995525,20cyclictest14796-21chrt08:14:063
24951995525,20cyclictest14796-21chrt08:14:063
24951995525,19cyclictest13132-21chrt12:09:303
24951995524,20cyclictest8316-21chrt12:02:133
24951995523,21cyclictest16661-21chrt12:15:303
24951995523,21cyclictest16661-21chrt12:15:303
24951995423,20cyclictest30058-21chrt07:23:073
24951995423,20cyclictest30058-21chrt07:23:073
24951995422,20cyclictest23957-21chrt08:40:263
24951995422,20cyclictest10349-21chrt11:11:363
24951995421,22cyclictest29720-21chrt11:44:063
24951995418,25cyclictest14753-21chrt11:19:063
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional