You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-16 - 21:05
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7.osadl.org (updated Thu Jul 16, 2026 12:44:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
7380218216,129sleep17398-21ls06:56:581
7380218216,129sleep17398-21ls06:56:581
7472991153,54cyclictest30193-21ssh09:22:062
74729910567,23cyclictest0-21swapper/211:07:122
74729910547,15cyclictest32736-21sh10:19:052
7472991045,49cyclictest8982-21apt-get07:02:092
74729910339,14cyclictest0-21swapper/207:26:572
74729910319,36cyclictest27946-21sh11:58:272
74609910226,42cyclictest18836-21ssh09:57:090
74609910221,31cyclictest18016-21apt-get07:27:050
74729910137,12cyclictest0-21swapper/207:42:292
747299983,66cyclictest555-21apt-get08:12:192
7460999719,31cyclictest31178-21apt-get08:07:060
747299962,43cyclictest12081-21grep07:07:252
71332966,15sleep20-21swapper/206:54:342
71332966,15sleep20-21swapper/206:54:342
7465999549,8cyclictest181rcu_preempt10:02:561
7465999549,8cyclictest181rcu_preempt10:02:561
7460999522,28cyclictest10245-21apt-get08:42:060
7460999522,28cyclictest10245-21apt-get08:42:060
7460999515,38cyclictest0-21swapper/007:07:160
7472999466,19cyclictest2374-21systemd-journal10:23:192
7472999466,19cyclictest2374-21systemd-journal10:23:192
7460999430,20cyclictest26869-21latency_hist09:17:190
7460999430,20cyclictest26869-21latency_hist09:17:190
747299932,43cyclictest19270-21latency09:57:202
747299932,40cyclictest17594-21sed10:47:292
7472999174,12cyclictest17173-21idleruntime-cro11:41:542
7472999174,12cyclictest17173-21idleruntime-cro11:41:542
746099918,43cyclictest23894-21rm10:57:500
7472999057,24cyclictest5285-21latency_hist11:21:572
7465999070,13cyclictest24731-21journal-offline07:47:271
7460999062,21cyclictest4424-21grep09:32:260
7472998965,17cyclictest1-21systemd10:46:542
747899882,42cyclictest10193-21chrt12:22:323
7472998764,17cyclictest5498-21threads10:27:302
7460998722,22cyclictest20513-21apt-get11:47:090
7460998721,21cyclictest28939-21apt-get11:07:270
747299865,38cyclictest25034-21df_inode10:07:132
746599862,54cyclictest31-21ksoftirqd/109:42:401
7460998658,20cyclictest10240-21latency09:42:200
7460998618,38cyclictest26847-21runrttasks07:52:540
7465998567,12cyclictest3624-21latency_hist09:31:571
7465998567,12cyclictest3624-21latency_hist09:31:571
7465998548,13cyclictest181rcu_preempt07:33:201
7465998512,49cyclictest31-21ksoftirqd/109:20:001
746099854,69cyclictest25680-21runrttasks10:07:290
7460998517,19cyclictest15280-21rm10:43:590
7460998510,35cyclictest13497-21dpkg08:52:040
7472998462,16cyclictest31538-21kernelversion08:07:202
7460998455,22cyclictest3544-21latency_hist09:31:570
7460998455,22cyclictest3544-21latency_hist09:31:570
7460998440,23cyclictest14851-21diskmemload09:49:570
7460998437,26cyclictest0-21swapper/009:23:190
7460998423,32cyclictest0-21swapper/012:08:180
7460998423,26cyclictest2815-21/usr/sbin/munin11:17:160
7460998416,25cyclictest0-21swapper/010:47:320
7465998358,8cyclictest181rcu_preempt11:32:181
7465998322,25cyclictest31-21ksoftirqd/106:59:271
7465998322,25cyclictest31-21ksoftirqd/106:59:271
7472998250,11cyclictest181rcu_preempt07:37:082
7460998226,30cyclictest0-21swapper/009:08:150
7460998226,30cyclictest0-21swapper/009:08:150
7465998163,11cyclictest24590-21ssh11:52:321
7465998149,9cyclictest181rcu_preempt11:56:581
746599813,57cyclictest555-21apt-get08:12:191
7460998163,12cyclictest18191-21ssh09:02:110
7460998127,18cyclictest29500-21ssh12:02:040
7460998126,29cyclictest10603-21sh12:23:400
7460998122,28cyclictest23518-21apt-get11:52:100
7460998120,27cyclictest8600-21runrttasks09:39:340
7460998114,28cyclictest20674-21unixbench_multi10:52:290
7460998114,25cyclictest352-21runrttasks10:23:570
7460998114,25cyclictest352-21runrttasks10:23:570
746599807,45cyclictest31-21ksoftirqd/111:38:281
746599807,45cyclictest31-21ksoftirqd/111:38:281
7465998041,17cyclictest31-21ksoftirqd/110:49:201
7465998012,42cyclictest31-21ksoftirqd/108:51:221
7460998018,27cyclictest6633-21sh11:22:400
7460998013,30cyclictest9919-21apt-get07:02:380
7460998011,30cyclictest318192chrt10:17:510
747899793,31cyclictest19743-21chrt11:45:443
7472997960,12cyclictest58-21kcompactd010:52:172
746599799,42cyclictest31-21ksoftirqd/110:27:321
7465997960,13cyclictest16113-21sh08:57:301
7465997960,13cyclictest16113-21sh08:57:301
7465997936,10cyclictest181rcu_preempt08:37:241
7460997935,34cyclictest0-21swapper/010:27:210
7460997934,37cyclictest29536-21apt-get08:02:100
7460997921,27cyclictest12306-21sh10:39:040
7460997918,22cyclictest27062-21ssh11:57:230
7460997914,29cyclictest28503-21/usr/sbin/munin07:57:260
7460997912,21cyclictest0-21swapper/009:20:070
7460997910,32cyclictest11492-21/usr/sbin/munin11:32:030
7472997827,26cyclictest10056-21taskset08:41:572
7465997849,8cyclictest181rcu_preempt11:06:581
7465997849,8cyclictest181rcu_preempt11:06:581
7465997839,8cyclictest181rcu_preempt12:07:131
7465997832,26cyclictest7449-21cyclictest12:16:301
7465997830,9cyclictest181rcu_preempt10:33:521
746599782,43cyclictest31-21ksoftirqd/108:07:181
7465997810,43cyclictest31-21ksoftirqd/111:11:111
7460997820,23cyclictest21783-21/usr/sbin/munin07:37:240
7460997816,33cyclictest352-21runrttasks10:03:320
7460997816,33cyclictest352-21runrttasks10:03:320
7460997814,24cyclictest28237-21/usr/sbin/munin10:12:180
7460997813,29cyclictest9122-21ssh11:27:240
747899772,33cyclictest6586-21chrt09:36:573
747899772,33cyclictest26667-21chrt09:16:223
747899772,33cyclictest26667-21chrt09:16:223
7478997720,34cyclictest0-21swapper/310:17:153
7472997756,14cyclictest22496-21kworker/u17:3-rpciod11:53:162
7465997756,14cyclictest26869-21latency_hist09:17:251
7465997756,14cyclictest26869-21latency_hist09:17:251
7465997747,8cyclictest181rcu_preempt08:06:551
7465997738,12cyclictest181rcu_preempt09:52:031
7465997738,12cyclictest181rcu_preempt09:52:031
7465997736,14cyclictest0-21swapper/110:00:591
7465997735,13cyclictest181rcu_preempt09:03:081
7465997718,32cyclictest31-21ksoftirqd/112:01:581
7460997710,27cyclictest0-21swapper/011:42:180
736927710,43sleep07378-21munin-run06:56:570
736927710,43sleep07378-21munin-run06:56:570
747899763,31cyclictest13077-21taskset07:11:583
747899762,28cyclictest18677-21chrt10:50:003
747299763,45cyclictest13200-21ssh09:47:192
7465997663,9cyclictest58-21kcompactd010:07:291
7465997651,15cyclictest0-21swapper/108:52:301
7465997643,11cyclictest181rcu_preempt12:25:331
7465997615,33cyclictest31-21ksoftirqd/109:10:311
7465997615,33cyclictest31-21ksoftirqd/109:10:311
7465997612,42cyclictest31-21ksoftirqd/107:37:131
746099765,26cyclictest0-21swapper/007:32:150
7460997647,19cyclictest8358-21modprobe08:36:540
7460997644,24cyclictest1904-21cron08:16:540
7460997616,26cyclictest27417-21ssh11:04:160
7460997616,26cyclictest27417-21ssh11:04:160
7460997615,26cyclictest9216-21rm10:33:520
7460997615,23cyclictest24439-21runrttasks07:46:570
7460997611,29cyclictest3536-21idleruntime-cro08:21:540
7460997611,28cyclictest11900-21grep08:47:100
7478997521,11cyclictest0-21swapper/311:07:063
7472997535,12cyclictest181rcu_preempt10:40:152
7465997557,10cyclictest0-21swapper/111:12:301
746599755,46cyclictest31-21ksoftirqd/111:44:351
7465997553,15cyclictest2374-21systemd-journal11:24:201
7465997552,15cyclictest544-21cron10:46:541
7465997548,19cyclictest14500-21modprobe07:16:541
746099758,47cyclictest7492-21rm12:18:210
7460997516,22cyclictest17074-21ssh08:59:460
7460997516,22cyclictest17074-21ssh08:59:460
7460997515,25cyclictest17532-21taskset07:24:360
7460997513,23cyclictest18044-21ssh09:55:410
7460997513,23cyclictest18044-21ssh09:55:410
7460997511,28cyclictest8002-21cut06:57:200
7460997511,28cyclictest8002-21cut06:57:200
7460997511,27cyclictest1233-21sshd11:14:190
7460997510,29cyclictest15216-21sendmail_mailst11:37:260
7460997510,29cyclictest15216-21sendmail_mailst11:37:260
747299743,51cyclictest23435-21ssh09:10:432
747299743,51cyclictest23435-21ssh09:10:432
7472997431,10cyclictest181rcu_preempt08:27:102
7465997460,8cyclictest181rcu_preempt10:17:201
7465997452,16cyclictest23063-21fschecks_time07:42:181
7465997451,9cyclictest181rcu_preempt07:27:291
7465997446,9cyclictest181rcu_preempt11:47:301
7465997440,9cyclictest181rcu_preempt08:17:201
7465997440,11cyclictest7449-21cyclictest11:01:391
7465997411,29cyclictest31-21ksoftirqd/109:38:591
7460997418,26cyclictest5400-21/usr/sbin/munin08:27:190
7460997411,24cyclictest14966-21tune2fs07:17:140
747899733,32cyclictest22333-21chrt11:49:293
747899733,23cyclictest7535-21chrt06:56:593
747899733,23cyclictest7535-21chrt06:56:593
7472997351,11cyclictest0-21swapper/209:32:192
747299734,50cyclictest26101-21kernelversion11:02:192
747299734,50cyclictest26101-21kernelversion11:02:192
747299733,38cyclictest25412-21latency_hist11:01:552
7465997354,12cyclictest297-21systemd-logind11:31:541
7465997329,14cyclictest181rcu_preempt09:32:221
746099738,28cyclictest3765-21/usr/sbin/munin08:22:190
7460997318,22cyclictest9189-21/usr/sbin/munin08:37:240
7460997312,24cyclictest3646-21ntpq12:12:210
747299726,31cyclictest22430-21/usr/sbin/munin10:02:242
747299726,31cyclictest22430-21/usr/sbin/munin10:02:242
7472997257,10cyclictest26884-21kworker/u19:109:16:542
7472997257,10cyclictest26884-21kworker/u19:109:16:542
7472997251,11cyclictest0-21swapper/209:52:232
7472997251,11cyclictest0-21swapper/209:52:232
7472997249,14cyclictest28422-21sed10:12:222
7472997247,17cyclictest0-21swapper/209:21:572
7472997242,22cyclictest352-21runrttasks07:47:572
746599723,49cyclictest29406-21latency_hist08:01:571
7465997233,12cyclictest181rcu_preempt12:19:371
7465997232,7cyclictest181rcu_preempt08:45:061
7465997232,7cyclictest181rcu_preempt08:45:061
746599722,36cyclictest9616-21munin-node07:02:041
7478997133,10cyclictest270072sleep310:10:293
7472997150,14cyclictest14851-21diskmemload11:42:482
7472997148,17cyclictest7632-21acpi06:57:052
7472997148,17cyclictest7632-21acpi06:57:052
747299713,47cyclictest31108-21latency_hist08:06:582
747299713,46cyclictest8420-21latency_hist08:36:562
7472997115,14cyclictest15156-21apt-get08:57:072
7472997115,14cyclictest15156-21apt-get08:57:072
7465997140,10cyclictest181rcu_preempt10:52:211
7465997134,10cyclictest0-21swapper/110:22:291
7465997134,10cyclictest0-21swapper/110:22:291
746099717,27cyclictest13157-21acpi07:12:040
7472997050,11cyclictest2937-21ssh09:30:322
7472997050,11cyclictest2937-21ssh09:30:322
7472997035,9cyclictest350-21fschecks_time12:07:142
7472997025,26cyclictest19858-21fschecks_time07:32:162
747299702,37cyclictest8281-21/usr/sbin/munin10:32:262
7465997050,7cyclictest181rcu_preempt09:25:381
7465997048,14cyclictest2374-21systemd-journal09:48:191
7465997047,8cyclictest181rcu_preempt08:27:121
7465997041,12cyclictest181rcu_preempt10:12:191
7465997037,16cyclictest181rcu_preempt07:52:471
7472996946,13cyclictest0-21swapper/209:02:112
747299694,43cyclictest21481-21grep11:47:302
7472996939,21cyclictest1-21systemd09:46:562
7465996950,14cyclictest12323-21threads07:07:311
7465996946,8cyclictest181rcu_preempt07:17:111
7465996942,12cyclictest181rcu_preempt11:17:111
746599692,36cyclictest31-21ksoftirqd/110:38:391
746599692,36cyclictest31-21ksoftirqd/108:22:591
747899683,38cyclictest0-21swapper/307:02:093
7478996813,16cyclictest0-21swapper/308:56:543
7472996846,13cyclictest0-21swapper/208:47:162
7465996848,15cyclictest8586-21latency_hist08:36:581
7472996751,9cyclictest0-21swapper/212:22:262
7472996741,14cyclictest0-21swapper/208:42:172
7472996741,14cyclictest0-21swapper/208:42:172
747299673,45cyclictest8738-21fschecks_count11:27:162
746099677,19cyclictest24176-21apt-get07:47:060
747899668,40cyclictest0-21swapper/308:12:193
7472996644,14cyclictest0-21swapper/212:17:302
747299663,24cyclictest14130-21unixbench_singl07:12:312
747899653,37cyclictest917-21kworker/3:1+events08:22:313
7472996546,13cyclictest2156-21/usr/sbin/munin08:17:172
747299654,44cyclictest13758-21fschecks_time08:52:162
747299654,32cyclictest3349-21fschecks_time12:12:152
7472996530,26cyclictest4539-21find08:22:292
747299652,43cyclictest11953-21latency11:32:182
746599659,24cyclictest31-21ksoftirqd/107:22:041
7472996444,14cyclictest31969-21cpu11:12:092
747299644,30cyclictest6723-21/usr/sbin/munin09:37:152
7472996442,12cyclictest0-21swapper/212:02:142
747299633,45cyclictest27659-21modprobe07:56:542
747299633,44cyclictest19388-21unin-run07:31:552
747299633,41cyclictest15158-21latency07:17:182
747299623,45cyclictest28506-21grep07:57:262
747899613,40cyclictest27882-21taskset07:56:583
747299613,41cyclictest5787-21fschecks_time11:22:152
747899606,43cyclictest18214-21chrt09:56:093
747899606,43cyclictest18214-21chrt09:56:093
7478996040,12cyclictest13775-21chrt07:12:263
747899603,39cyclictest6208-21chrt11:22:263
747899602,41cyclictest0-21swapper/307:47:083
747899593,39cyclictest29180-21chrt12:01:533
747899573,41cyclictest23019-21taskset10:57:173
747899573,38cyclictest1351-21taskset09:27:243
747899573,38cyclictest1351-21taskset09:27:243
747899573,36cyclictest12641-21chrt09:46:583
747899563,40cyclictest16035-21chrt08:57:293
747899563,40cyclictest16035-21chrt08:57:293
747899562,41cyclictest5476-21taskset12:16:083
747899562,39cyclictest8761-21taskset09:40:013
747899553,38cyclictest30697-21chrt10:16:563
747899553,37cyclictest23671-21chrt10:04:363
747899553,37cyclictest23671-21chrt10:04:363
747899553,34cyclictest20282-21chrt07:32:273
747899544,36cyclictest32748-21taskset08:11:563
747899544,32cyclictest7729-21chrt06:57:113
747899544,32cyclictest7729-21chrt06:57:113
747899543,39cyclictest21594-21taskset09:07:183
747899543,39cyclictest21594-21taskset09:07:183
747899543,37cyclictest15634-21chrt07:17:293
747899543,36cyclictest6915-21chrt08:31:573
747899543,33cyclictest2372-21taskset08:17:153
747899543,32cyclictest23823-21chrt11:52:173
747899542,37cyclictest23387-21taskset07:42:283
747899538,33cyclictest13555-21chrt11:35:103
747899533,37cyclictest28161-21chrt11:06:213
747899533,37cyclictest28161-21chrt11:06:213
747899533,36cyclictest13311-21chrt10:41:533
747899533,35cyclictest10691-21chrt11:30:323
747899533,34cyclictest22150-21chrt10:56:203
747899532,36cyclictest32620-21chrt12:07:083
747899523,35cyclictest17035-21chrt07:22:273
747899523,33cyclictest1789-21chrt11:15:533
747899513,35cyclictest7421-21chrt12:18:103
747899513,34cyclictest11698-21chrt08:46:563
747899513,34cyclictest11698-21chrt08:46:563
747899513,33cyclictest21715-21chrt10:01:573
747899513,33cyclictest18770-21chrt09:02:243
747899513,33cyclictest14041-21taskset10:42:183
747899513,30cyclictest29659-21chrt08:02:123
747899512,37cyclictest5539-21chrt10:27:313
747899512,35cyclictest13699-21chrt09:47:303
747899504,32cyclictest2218-21chrt10:22:243
747899504,32cyclictest2218-21chrt10:22:243
747899503,34cyclictest28878-21chrt09:19:093
747899503,32cyclictest9093-21chrt08:37:203
747899502,34cyclictest30369-21taskset09:22:133
747899493,31cyclictest30567-21chrt12:02:303
747899492,37cyclictest28793-21chrt07:57:303
747899483,30cyclictest7345-21chrt08:32:183
747899482,33cyclictest8866-21chrt10:32:543
747899482,30cyclictest21295-21chrt07:37:093
747899473,32cyclictest15841-21chrt11:38:103
747899473,32cyclictest15841-21chrt11:38:103
747899442,31cyclictest4010-21chrt11:18:413
747899423,29cyclictest18792-21taskset07:27:293
747899372,25cyclictest11887-21taskset08:47:083
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional