You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-19 - 15:21
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot7.osadl.org (updated Sun Jul 19, 2026 12:44:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
14851991193,53cyclictest6075-21ssh10:16:560
14851991193,53cyclictest6075-21ssh10:16:560
148519911833,11cyclictest0-21swapper/011:17:540
148519911595,14cyclictest24527-21unixbench_multi09:52:180
148519911427,11cyclictest0-21swapper/011:31:590
148519911427,11cyclictest0-21swapper/011:31:590
148519911361,46cyclictest13946-21ssh09:36:390
148519911350,57cyclictest14844-21cyclictest11:51:550
148519911350,57cyclictest14844-21cyclictest11:51:550
148649911273,32cyclictest11268-21kworker/u17:2-rpciod10:32:172
14851991104,27cyclictest14853-21latency_hist06:56:450
148519911034,9cyclictest0-21swapper/011:09:150
148519911034,8cyclictest0-21swapper/009:42:560
148519911034,8cyclictest0-21swapper/009:42:560
148519910952,50cyclictest22751-21ssh11:37:300
148519910952,50cyclictest22751-21ssh11:37:300
148519910940,61cyclictest0-21swapper/011:47:180
148649910855,46cyclictest0-21swapper/208:12:202
148519910836,8cyclictest0-21swapper/009:18:350
14851991082,32cyclictest31845-21fschecks_time09:12:040
14619210813,66sleep214620-21sendmail-mta06:55:362
148519910645,55cyclictest297-21systemd-logind07:51:430
148519910643,55cyclictest0-21swapper/010:36:420
148649910556,41cyclictest0-21swapper/210:11:452
14851991044,34cyclictest8267-21processes12:07:140
14851991044,34cyclictest8267-21processes12:07:140
14851991044,29cyclictest10041-21unixbench_multi10:22:180
148519910431,9cyclictest0-21swapper/007:43:420
14851991033,41cyclictest15328-21tail08:32:180
14851991033,33cyclictest25413-21apt-get07:26:540
14851991033,22cyclictest11438-21fschecks_time08:22:030
14851991033,22cyclictest11438-21fschecks_time08:22:030
14851991032,35cyclictest21799-21find10:42:150
148649910217,32cyclictest546-21find07:47:442
148519910235,62cyclictest0-21swapper/011:22:150
14851991023,30cyclictest416-21latency_hist11:01:440
148519910230,64cyclictest0-21swapper/009:26:430
148519910227,9cyclictest0-21swapper/009:37:130
148519910227,9cyclictest0-21swapper/009:37:130
148519910225,19cyclictest0-21swapper/007:06:440
148519910220,24cyclictest2658-21ssh11:57:200
148649910147,32cyclictest14844-21cyclictest08:07:172
148519910174,21cyclictest17498-21latency_hist08:41:440
14851991014,32cyclictest27067-21/usr/sbin/munin10:52:030
14851991003,35cyclictest8290-21/usr/sbin/munin09:27:340
14851991003,35cyclictest26952-21latency_hist10:51:450
14851991003,31cyclictest19674-21unixbench_singl07:07:200
14851991003,31cyclictest18073-21apt-get10:36:520
148519910030,13cyclictest0-21swapper/007:19:240
148519910030,13cyclictest0-21swapper/007:19:240
14864999948,43cyclictest0-21swapper/210:02:042
14864999948,43cyclictest0-21swapper/210:02:042
14864999920,22cyclictest0-21swapper/207:17:122
14864999920,22cyclictest0-21swapper/207:17:122
14851999935,57cyclictest0-21swapper/009:57:060
14851999922,22cyclictest25108-21modprobe07:26:410
1485199984,38cyclictest13040-21fschecks_time08:27:050
1485199984,33cyclictest7215-21grep08:07:170
1485199984,32cyclictest22043-21find07:16:460
1485199984,32cyclictest22043-21find07:16:460
1485199983,69cyclictest10896-21sh12:12:100
1485199983,40cyclictest2261-21find07:52:180
1485199983,36cyclictest29241-21idleruntime07:38:100
1485199983,36cyclictest29241-21idleruntime07:38:100
1485199983,33cyclictest2835-21latency_hist10:11:430
1485199983,32cyclictest9687-21apt-key11:16:450
1485199983,30cyclictest1317-21find11:02:140
14851999829,13cyclictest0-21swapper/008:47:110
14851999823,11cyclictest0-21swapper/009:49:540
14864999782,11cyclictest14844-21cyclictest07:26:592
14864999746,42cyclictest0-21swapper/210:52:042
14864999745,44cyclictest0-21swapper/207:52:202
1485199978,33cyclictest29333-21kworker/u17:0+xprtiod11:27:050
1485199978,33cyclictest29333-21kworker/u17:0+xprtiod11:27:050
14851999746,45cyclictest0-21swapper/008:06:440
1485199973,37cyclictest16503-21latency_hist07:01:450
1485199973,34cyclictest30328-21grep10:02:150
1485199973,34cyclictest30328-21grep10:02:150
14851999729,12cyclictest0-21swapper/010:30:360
14851999729,12cyclictest0-21swapper/010:30:360
1485199972,37cyclictest19677-21kernelversion08:47:250
1485199972,35cyclictest23010-21wc08:57:070
1485199972,35cyclictest23010-21wc08:57:070
14851999717,21cyclictest19607-21seq12:26:430
1485199964,33cyclictest3352-21fschecks_time10:12:040
1485199963,36cyclictest27956-21latency_hist11:46:450
1485199963,33cyclictest27873-21wc07:32:190
1485199963,33cyclictest27873-21wc07:32:190
1485199962,33cyclictest5162-21ssh12:02:120
1485199962,33cyclictest5162-21ssh12:02:120
14864999535,7cyclictest0-21swapper/210:16:542
14864999535,7cyclictest0-21swapper/210:16:542
1486499953,36cyclictest17460-21sshd10:27:112
1486499953,36cyclictest17460-21sshd10:27:112
1485199954,29cyclictest14105-21fschecks_time12:17:050
1485199953,34cyclictest30749-21ssh09:10:220
14851999531,9cyclictest0-21swapper/008:12:190
14864999444,42cyclictest0-21swapper/211:17:512
1486499944,35cyclictest3399-21fschecks_time10:12:052
14857999474,14cyclictest2374-21systemd-journal11:00:321
1485199943,30cyclictest25528-21/usr/sbin/munin09:01:530
14864999372,13cyclictest0-21swapper/208:41:412
1486499933,67cyclictest8312-21apt-get09:27:062
14864999326,10cyclictest0-21swapper/212:22:092
1485199935,31cyclictest3094-21/usr/sbin/munin07:57:030
1485199935,31cyclictest3094-21/usr/sbin/munin07:57:030
1487099927,55cyclictest0-21swapper/311:37:003
1487099927,55cyclictest0-21swapper/311:37:003
14864999268,14cyclictest0-21swapper/208:26:452
14864999268,14cyclictest0-21swapper/208:26:452
1486499922,38cyclictest31303-21timerwakeupswit07:42:182
1485199924,31cyclictest9554-21/usr/sbin/munin08:17:050
14864999169,11cyclictest0-21swapper/207:01:452
14864999137,47cyclictest0-21swapper/209:46:452
14864999137,47cyclictest0-21swapper/209:46:452
1486499913,38cyclictest11536-21fschecks_count09:32:052
1486499913,37cyclictest17889-21tune2fs08:42:052
1486499913,36cyclictest1683-21cstates11:56:582
1486499913,32cyclictest19044-21if_eth007:07:072
14864999132,52cyclictest0-21swapper/210:25:372
1486499912,34cyclictest24043-21runrttasks10:46:482
1485199913,26cyclictest21597-21sed08:52:160
1486499903,33cyclictest5702-21/usr/sbin/munin08:02:192
14864999033,11cyclictest0-21swapper/208:32:182
1486499902,34cyclictest27624-21processes07:32:162
1486499902,34cyclictest27624-21processes07:32:162
1486499893,36cyclictest9812-21fschecks_time08:17:042
1486499893,33cyclictest14602-21sed12:17:182
1486499893,30cyclictest31457-21sort09:11:452
14864998931,11cyclictest0-21swapper/209:58:582
14857998969,14cyclictest20207-21munin-plugin-st09:46:411
14857998969,14cyclictest20207-21munin-plugin-st09:46:411
14857998958,12cyclictest181rcu_preempt08:26:421
14857998958,12cyclictest181rcu_preempt08:26:421
14864998873,9cyclictest0-21swapper/212:12:332
1486499884,31cyclictest28018-21/usr/sbin/munin11:47:072
1486499883,34cyclictest21270-21runrttasks11:36:012
1486499883,34cyclictest21270-21runrttasks11:36:012
1486499883,32cyclictest3378-21latency_hist11:06:432
1486499883,29cyclictest3175-21head09:17:202
14864998832,12cyclictest0-21swapper/207:38:092
14864998832,12cyclictest0-21swapper/207:38:092
1486499882,35cyclictest3604-21ntp_kernel_pll_07:57:102
1486499882,35cyclictest3604-21ntp_kernel_pll_07:57:102
1486499882,35cyclictest16964-21latency_hist09:41:452
1486499882,35cyclictest16964-21latency_hist09:41:452
1486499882,29cyclictest20844-21fschecks_time09:47:042
14857998814,49cyclictest31-21ksoftirqd/111:58:031
1486499875,31cyclictest25314-21fschecks_time11:42:032
14864998735,45cyclictest0-21swapper/209:12:192
1486499873,35cyclictest25308-21latency_hist09:01:442
1486499873,35cyclictest25308-21latency_hist09:01:442
1486499873,32cyclictest24014-21fschecks_time07:22:042
1486499873,31cyclictest21020-21switchtime07:12:162
1486499873,31cyclictest21020-21switchtime07:12:162
1485799874,47cyclictest10789-21apt-get12:12:011
14857998710,69cyclictest31745-21kworker/u19:0+ext4-rsv-conversion11:37:041
14857998710,69cyclictest31745-21kworker/u19:0+ext4-rsv-conversion11:37:041
1486499864,37cyclictest25528-21/usr/sbin/munin09:02:082
1486499864,34cyclictest352-21runrttasks09:52:032
14864998634,14cyclictest5114-21cpu09:22:002
1486499863,35cyclictest7427-21latency_hist12:06:452
1486499863,35cyclictest7427-21latency_hist12:06:452
1486499863,33cyclictest19674-21kernelversion08:47:252
1486499863,33cyclictest16872-21unixbench_multi11:27:182
1486499863,33cyclictest16872-21unixbench_multi11:27:182
1486499862,33cyclictest21118-21fschecks_time08:52:042
1486499862,32cyclictest22431-21fschecks_count11:37:232
1486499862,32cyclictest22431-21fschecks_count11:37:232
1486499853,34cyclictest17089-21cpu07:02:002
1486499853,33cyclictest3936-21fschecks_time11:07:042
1486499853,33cyclictest31062-21rm11:51:572
1486499853,33cyclictest31062-21rm11:51:572
1486499853,30cyclictest13011-21cut08:27:052
1486499852,31cyclictest7845-21fschecks_time12:07:032
1486499852,31cyclictest7845-21fschecks_time12:07:032
1485799852,59cyclictest31-21ksoftirqd/111:17:281
1357028512,30sleep10-21swapper/106:52:081
1486499843,32cyclictest12818-21ssh11:21:512
1486499843,30cyclictest6856-21fschecks_count11:12:042
14864998427,11cyclictest0-21swapper/210:42:152
1486499842,35cyclictest18075-21rm10:36:522
1486499834,31cyclictest352-21runrttasks10:59:332
14857998355,21cyclictest5392-21fschecks_time09:22:071
14857998346,12cyclictest181rcu_preempt11:50:201
14857998247,16cyclictest181rcu_preempt08:32:441
1485799823,50cyclictest31-21ksoftirqd/107:50:561
1487099813,44cyclictest10028-21chrt11:17:233
1485799816,26cyclictest31-21ksoftirqd/110:07:481
14857998156,17cyclictest0-21swapper/107:26:431
14857998151,14cyclictest181rcu_preempt10:27:181
14857998151,14cyclictest181rcu_preempt10:27:181
14857998136,13cyclictest181rcu_preempt11:15:541
14857998059,13cyclictest14844-21cyclictest09:39:361
14857998059,13cyclictest14844-21cyclictest09:39:361
14857998057,16cyclictest14844-21cyclictest08:15:221
14857998014,11cyclictest0-21swapper/108:41:551
14857998011,34cyclictest31-21ksoftirqd/110:23:301
1485799797,33cyclictest31-21ksoftirqd/111:42:031
14857997955,15cyclictest32183-21sh09:12:141
1485799795,43cyclictest31-21ksoftirqd/108:07:411
14857997945,12cyclictest181rcu_preempt07:30:431
1485799793,68cyclictest7750-21apt-get09:26:591
1485799793,38cyclictest31-21ksoftirqd/110:48:061
14857997915,39cyclictest31-21ksoftirqd/109:54:201
1485799787,37cyclictest31-21ksoftirqd/111:36:301
1485799787,37cyclictest31-21ksoftirqd/111:36:301
1485799785,21cyclictest31-21ksoftirqd/111:01:581
14857997840,10cyclictest181rcu_preempt12:03:211
14857997840,10cyclictest181rcu_preempt12:03:211
1485799783,33cyclictest31-21ksoftirqd/107:17:121
1485799783,33cyclictest31-21ksoftirqd/107:17:121
1485799782,31cyclictest31-21ksoftirqd/109:34:231
14857997814,28cyclictest31-21ksoftirqd/108:55:481
1395327824,36sleep30-21swapper/306:52:233
14857997744,11cyclictest181rcu_preempt08:05:141
1485799772,49cyclictest31-21ksoftirqd/107:56:311
1485799771,47cyclictest31-21ksoftirqd/111:28:051
1485799771,47cyclictest31-21ksoftirqd/111:28:051
14857997710,46cyclictest31-21ksoftirqd/107:43:221
1485799763,30cyclictest31-21ksoftirqd/110:14:451
1485799762,33cyclictest31-21ksoftirqd/110:52:101
14857997617,10cyclictest301ktimers/111:21:561
14857997612,36cyclictest31-21ksoftirqd/112:10:321
14857997612,36cyclictest31-21ksoftirqd/112:10:321
1485799756,20cyclictest31-21ksoftirqd/108:16:591
14857997551,16cyclictest14844-21cyclictest10:06:431
14857997551,16cyclictest14844-21cyclictest10:06:431
1485799752,53cyclictest28859-21apt-get07:36:551
1485799752,53cyclictest28859-21apt-get07:36:551
1485799752,27cyclictest31-21ksoftirqd/111:56:031
1485799752,27cyclictest31-21ksoftirqd/111:56:031
14857997518,14cyclictest181rcu_preempt12:26:451
14857997457,11cyclictest14136-21cron08:31:411
14857997452,13cyclictest0-21swapper/112:17:181
14857997449,17cyclictest17659-21grep07:02:161
1485799743,37cyclictest31-21ksoftirqd/107:15:551
1485799743,37cyclictest31-21ksoftirqd/107:15:551
1485799742,36cyclictest31-21ksoftirqd/108:38:321
14857997410,27cyclictest31-21ksoftirqd/108:57:241
14857997410,27cyclictest31-21ksoftirqd/108:57:241
14857997344,12cyclictest181rcu_preempt09:09:401
14857997339,16cyclictest181rcu_preempt06:57:251
14857997312,40cyclictest31-21ksoftirqd/107:58:541
14857997312,40cyclictest31-21ksoftirqd/107:58:541
1487099722,36cyclictest28866-21chrt07:36:573
1487099722,36cyclictest28866-21chrt07:36:573
1485799729,26cyclictest31-21ksoftirqd/110:44:081
14857997144,16cyclictest0-21swapper/110:17:201
14857997144,16cyclictest0-21swapper/110:17:201
1485799713,46cyclictest31-21ksoftirqd/110:35:411
1485799712,43cyclictest31-21ksoftirqd/109:17:191
14857997050,13cyclictest22245-21diskmemload09:05:011
14857997045,17cyclictest0-21swapper/108:51:451
14857997043,18cyclictest0-21swapper/111:07:181
1485799703,29cyclictest31-21ksoftirqd/110:37:091
1487099692,36cyclictest2179-21taskset11:57:123
1485799699,27cyclictest31-21ksoftirqd/109:47:401
1485799695,26cyclictest31-21ksoftirqd/109:58:411
1485799693,49cyclictest19692-21grep07:07:201
14857996917,8cyclictest301ktimers/107:36:431
14857996917,8cyclictest301ktimers/107:36:431
1487099683,27cyclictest16815-21chrt08:37:163
1487099682,33cyclictest15721-21chrt09:38:133
1487099682,33cyclictest15721-21chrt09:38:133
1487099673,33cyclictest31730-21chrt07:45:523
1487099673,24cyclictest8282-21chrt09:26:493
1487099673,23cyclictest32666-21chrt07:47:343
1487099653,31cyclictest16708-21taskset10:33:463
1487099653,26cyclictest31538-21chrt10:58:183
1487099653,24cyclictest819-21chrt10:07:153
1487099647,44cyclictest0-21swapper/312:01:583
1487099647,44cyclictest0-21swapper/312:01:583
1487099643,28cyclictest24099-21chrt10:46:553
1487099643,27cyclictest12410-21chrt12:13:463
1487099643,23cyclictest16781-21chrt12:21:523
1487099643,22cyclictest21156-21chrt09:47:133
1487099633,27cyclictest915-21chrt09:14:203
1487099633,23cyclictest16482-21chrt11:27:123
1487099633,23cyclictest16482-21chrt11:27:123
1487099633,22cyclictest6710-21chrt08:07:073
1487099633,22cyclictest20301-21chrt08:47:413
1487099632,28cyclictest19369-21chrt09:44:253
1487099632,28cyclictest19369-21chrt09:44:253
1487099632,27cyclictest11299-21chrt10:25:353
1487099632,24cyclictest3117-21chrt07:56:543
1487099632,24cyclictest3117-21chrt07:56:543
1487099628,44cyclictest0-21swapper/311:22:133
1487099623,28cyclictest12335-21chrt08:24:323
1487099623,28cyclictest12335-21chrt08:24:323
1487099623,27cyclictest27026-21taskset07:31:583
1487099623,27cyclictest27026-21taskset07:31:583
1487099623,26cyclictest4724-21chrt08:01:563
1487099623,26cyclictest31078-21chrt10:03:383
1487099623,26cyclictest31078-21chrt10:03:383
1487099623,25cyclictest30948-21chrt09:10:563
1487099623,25cyclictest28535-21chrt09:59:533
1487099623,23cyclictest14430-21chrt08:31:583
1487099623,22cyclictest28173-21chrt11:46:583
1487099623,22cyclictest27238-21chrt09:03:583
1487099623,21cyclictest24691-21chrt09:00:133
1487099623,21cyclictest24691-21chrt09:00:133
1487099622,25cyclictest8556-21chrt11:14:393
1487099622,24cyclictest13979-21chrt12:17:023
1487099615,45cyclictest0-21swapper/307:26:543
1487099613,27cyclictest26513-21taskset11:43:213
1487099613,24cyclictest564-21chrt11:54:493
1487099613,24cyclictest564-21chrt11:54:493
1487099613,23cyclictest21184-21chrt11:35:473
1487099613,23cyclictest21184-21chrt11:35:473
1487099613,22cyclictest3753-21chrt09:18:553
1487099612,27cyclictest27121-21chrt10:51:573
1487099612,24cyclictest5249-21chrt10:15:223
1487099612,24cyclictest3979-21chrt11:07:063
1487099612,22cyclictest11477-21chrt09:32:003
1487099607,44cyclictest0-21swapper/307:17:193
1487099607,44cyclictest0-21swapper/307:17:193
1487099603,47cyclictest21238-21taskset08:52:073
1487099603,25cyclictest25101-21chrt07:26:403
1487099603,24cyclictest10362-21chrt12:11:433
1487099603,24cyclictest10362-21chrt12:11:433
1487099603,23cyclictest7360-21chrt10:17:533
1487099603,23cyclictest7360-21chrt10:17:533
1487099602,25cyclictest19907-21chrt07:09:553
1487099602,25cyclictest18373-21chrt07:06:143
1487099602,24cyclictest13794-21chrt08:27:203
1487099602,23cyclictest22580-21chrt10:43:263
1487099602,21cyclictest13532-21chrt10:28:233
1487099602,21cyclictest13532-21chrt10:28:233
1487099602,21cyclictest10652-21chrt08:18:333
1487099602,20cyclictest26060-21chrt09:56:213
1487099598,42cyclictest0-21swapper/308:12:053
1487099593,20cyclictest18726-21taskset08:43:323
1487099592,23cyclictest5894-21chrt09:22:193
1487099592,22cyclictest3060-21chrt11:06:043
1487099592,21cyclictest20573-21taskset10:41:113
1487099589,39cyclictest0-21swapper/307:12:043
1487099589,39cyclictest0-21swapper/307:12:043
1487099583,23cyclictest2532-21chrt07:52:493
1487099582,23cyclictest15618-21chrt06:57:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional