You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-11 - 09:15
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Thu Jun 11, 2026 00:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
7137991264,46cyclictest32537-21ssh23:14:480
7137991264,46cyclictest32537-21ssh23:14:480
7137991174,35cyclictest24406-21sh21:14:340
71379911157,48cyclictest14990-21diskmemload23:49:190
71379911139,65cyclictest0-21swapper/023:29:470
7137991083,30cyclictest21400-21ssh21:09:310
71379910644,55cyclictest3373-21latency_hist20:24:220
7137991054,30cyclictest16606-21/usr/sbin/munin21:01:370
7137991053,30cyclictest352-21runrttasks21:31:130
7137991053,23cyclictest9888-21/usr/sbin/munin21:44:290
71379910452,45cyclictest0-21swapper/000:09:550
7137991044,29cyclictest10531-21ssh00:24:560
7137991043,36cyclictest30526-21awk00:04:470
7137991043,36cyclictest30526-21awk00:04:470
7137991034,34cyclictest7691-21chrt22:34:310
7137991033,27cyclictest352-21runrttasks22:29:030
7137991033,21cyclictest26174-21apt-get23:05:060
71379910323,73cyclictest2985-21ssh23:19:310
71379910243,53cyclictest27891-21acpi22:14:290
7137991023,28cyclictest15890-21/usr/sbin/munin21:54:400
7137991023,28cyclictest15890-21/usr/sbin/munin21:54:400
7137991022,19cyclictest30588-21apt-get22:19:380
7137991022,19cyclictest30588-21apt-get22:19:380
7137991013,33cyclictest12466-21apt-key19:14:230
7137991013,27cyclictest12538-21runrttasks22:42:040
7137991013,27cyclictest12538-21runrttasks22:42:040
7137991012,28cyclictest24690-21/usr/sbin/munin23:54:510
7137991012,28cyclictest24690-21/usr/sbin/munin23:54:510
7137991005,25cyclictest27397-21sh21:19:340
7137991004,35cyclictest352-21runrttasks23:09:430
7137991004,35cyclictest352-21runrttasks23:09:430
7137991003,27cyclictest768-21latency_hist21:29:230
7137991002,21cyclictest10391-21apt-get20:44:310
7137991002,19cyclictest7896-21/usr/sbin/munin21:39:560
713799994,31cyclictest352-21runrttasks23:51:580
713799993,30cyclictest7735-21latency18:59:440
713799984,30cyclictest24131-21sh23:00:070
713799984,23cyclictest29817-21ssh00:04:220
713799983,32cyclictest16050-21/usr/sbin/munin19:24:530
713799983,31cyclictest4956-21fschecks_time22:29:400
713799982,21cyclictest25978-21/usr/sbin/munin19:54:290
7137999818,24cyclictest7369-21fschecks_count20:34:430
713799974,31cyclictest8920-21munin-node19:04:310
713799973,42cyclictest27591-21/usr/sbin/munin19:59:430
713799973,32cyclictest29573-21kernelversion20:04:440
713799973,31cyclictest15750-21ntp_states23:40:160
713799973,31cyclictest15750-21ntp_states23:40:160
713799972,30cyclictest1514-21latency_hist20:19:230
713799972,19cyclictest31473-21wc20:09:510
713799963,29cyclictest17753-21unixbench_multi22:49:560
713799963,29cyclictest17753-21unixbench_multi22:49:560
713799963,21cyclictest13539-21latency_hist20:54:230
713799963,13cyclictest13023-21ssh21:49:360
713799962,37cyclictest14203-21/usr/sbin/munin20:54:520
713799962,34cyclictest352-21runrttasks22:12:520
713799962,33cyclictest6641-21sshd00:19:350
713799962,33cyclictest6641-21sshd00:19:350
713799962,26cyclictest22246-21modprobe19:44:200
65602968,61sleep06641-21awk18:55:060
593129613,52sleep25959-21/usr/sbin/munin18:54:482
713799954,30cyclictest3983-21cut20:25:370
713799953,30cyclictest14649-21cron23:39:190
713799952,30cyclictest22878-21latency_hist22:59:240
7137999520,23cyclictest6921-21/usr/sbin/munin23:24:550
7137999520,23cyclictest6921-21/usr/sbin/munin23:24:550
713799944,27cyclictest3504-21/usr/sbin/munin00:14:450
713799943,32cyclictest22187-21fschecks_time22:04:420
713799943,32cyclictest10325-21cat20:44:230
713799943,32cyclictest10325-21cat20:44:230
713799943,31cyclictest12831-21/usr/sbin/munin19:15:090
713799943,29cyclictest18883-21/usr/sbin/munin21:59:560
713799943,29cyclictest18629-21fschecks_count21:04:420
713799943,26cyclictest16572-21latency_hist22:49:220
7156999369,9cyclictest181rcu_preempt21:19:432
713799933,37cyclictest25894-21apt-key19:54:240
713799933,37cyclictest25894-21apt-key19:54:240
713799933,33cyclictest19888-21grep19:34:520
713799933,32cyclictest22689-21fschecks_count19:44:410
713799933,32cyclictest22689-21fschecks_count19:44:410
713799933,19cyclictest5541-21find20:29:300
713799922,30cyclictest15033-21grep19:19:510
713799922,22cyclictest5007-21ssh21:34:570
713799913,32cyclictest544-21cron19:34:200
715699903,52cyclictest39-21ksoftirqd/221:08:162
7156998962,10cyclictest181rcu_preempt22:48:582
7156998862,19cyclictest782-21fschecks_count00:09:392
7151998860,18cyclictest25773-21apt-key19:54:241
7151998860,18cyclictest25773-21apt-key19:54:241
7156998753,25cyclictest31672-21fschecks_time22:20:262
7156998753,25cyclictest31672-21fschecks_time22:20:262
7156998656,22cyclictest15924-21latency_hist19:24:232
7156998545,13cyclictest181rcu_preempt23:05:542
7156998450,14cyclictest181rcu_preempt23:29:542
7156998448,13cyclictest58-21kcompactd021:52:092
715699843,56cyclictest39-21ksoftirqd/219:39:552
7156998358,8cyclictest181rcu_preempt23:54:362
7156998358,8cyclictest181rcu_preempt23:54:362
7156998354,12cyclictest181rcu_preempt00:23:242
7156998354,12cyclictest181rcu_preempt00:23:242
7156998352,9cyclictest181rcu_preempt19:14:492
7151998353,21cyclictest13394-21modprobe22:44:191
7151998353,21cyclictest13394-21modprobe22:44:191
7156998257,17cyclictest12812-21sh21:49:242
715699823,46cyclictest25975-21cat23:04:232
715699822,40cyclictest39-21ksoftirqd/220:49:512
715699821,41cyclictest20062-21find19:34:552
7156998159,15cyclictest20702-40mandb23:49:212
7156998135,16cyclictest181rcu_preempt00:01:132
7151998157,16cyclictest21379-21if_eth023:49:421
67322816,61sleep10-21swapper/118:55:571
7156998056,15cyclictest25525-21apt-key19:54:212
7156998056,15cyclictest25525-21apt-key19:54:212
7156998050,22cyclictest352-21runrttasks23:52:412
7156998046,12cyclictest181rcu_preempt20:21:142
7156998042,13cyclictest0-21swapper/220:30:112
7156998016,33cyclictest381ktimers/218:59:502
7156997947,11cyclictest181rcu_preempt21:12:012
7156997930,27cyclictest39-21ksoftirqd/223:44:062
7156997930,27cyclictest39-21ksoftirqd/223:44:062
715699792,44cyclictest39-21ksoftirqd/222:50:032
715699792,44cyclictest39-21ksoftirqd/222:50:032
715199798,57cyclictest12849-21apt-get19:14:371
7151997956,14cyclictest20648-21apt23:49:191
715699786,35cyclictest39-21ksoftirqd/221:34:372
7156997837,17cyclictest181rcu_preempt21:57:392
7156997837,17cyclictest181rcu_preempt21:57:392
7151997861,11cyclictest300-21rs:main1
7156997749,18cyclictest9749-21latency19:04:482
7156997747,9cyclictest181rcu_preempt23:21:232
7156997741,11cyclictest181rcu_preempt00:08:312
7156997741,11cyclictest181rcu_preempt00:08:312
7156997740,9cyclictest0-21swapper/223:15:042
7156997740,9cyclictest0-21swapper/223:15:042
715699773,43cyclictest39-21ksoftirqd/221:24:472
7156997729,25cyclictest39-21ksoftirqd/219:55:322
7156997714,12cyclictest381ktimers/221:29:562
7151997749,18cyclictest0-21swapper/119:49:231
7151997749,18cyclictest0-21swapper/119:49:231
7151997740,25cyclictest19121-21grep21:59:411
7151997720,23cyclictest14990-21diskmemload23:02:371
7156997653,16cyclictest15040-21systemctl20:59:212
7156997652,14cyclictest21920-21/usr/sbin/munin22:04:362
7156997650,8cyclictest181rcu_preempt20:44:212
7156997650,8cyclictest181rcu_preempt20:44:212
7156997641,11cyclictest181rcu_preempt22:34:352
7151997663,8cyclictest0-21swapper/122:20:041
7151997663,8cyclictest0-21swapper/122:20:041
7156997551,14cyclictest0-21swapper/223:24:452
7156997551,14cyclictest0-21swapper/223:24:452
7156997534,11cyclictest21759-21sed22:04:232
715699752,36cyclictest39-21ksoftirqd/200:14:352
7151997547,20cyclictest1242-21sh00:09:511
7151997510,54cyclictest3682-21apt-get20:24:351
7156997436,16cyclictest181rcu_preempt22:34:222
7156997430,13cyclictest0-21swapper/221:41:412
7156997423,13cyclictest0-21swapper/222:10:542
7151997459,10cyclictest7127-21cyclictest21:19:411
7151997458,10cyclictest7127-21cyclictest23:40:171
7151997458,10cyclictest7127-21cyclictest23:40:171
7151997458,10cyclictest23702-21kworker/u17:2-xprtiod22:34:561
7151997455,13cyclictest352-21runrttasks23:19:411
7151997455,12cyclictest0-21swapper/122:04:571
7151997453,15cyclictest1347-21latency_hist20:19:241
7156997343,8cyclictest181rcu_preempt22:24:482
715699733,36cyclictest39-21ksoftirqd/220:25:512
7151997355,10cyclictest7127-21cyclictest21:19:231
7156997245,10cyclictest181rcu_preempt19:13:042
7156997242,11cyclictest181rcu_preempt22:39:372
7156997242,11cyclictest181rcu_preempt22:39:372
7156997239,9cyclictest0-21swapper/223:10:522
7156997239,9cyclictest0-21swapper/223:10:522
7156997239,10cyclictest181rcu_preempt21:14:292
7156997238,11cyclictest181rcu_preempt19:29:312
7151997257,10cyclictest7127-21cyclictest19:19:301
7151997254,12cyclictest2493-21switchtime22:24:551
7156997134,13cyclictest181rcu_preempt20:44:312
715699712,44cyclictest39-21ksoftirqd/221:01:252
7156997113,21cyclictest39-21ksoftirqd/219:28:412
715199716,55cyclictest5556-21apt-get20:29:381
7151997150,14cyclictest15607-21idleruntime-cro21:54:201
715199713,39cyclictest17004-21ssh22:49:411
715199713,39cyclictest17004-21ssh22:49:411
7151997111,50cyclictest25997-21apt-get19:54:361
716199703,54cyclictest2431-21chrt20:21:103
7156997049,7cyclictest181rcu_preempt22:18:172
7156997030,17cyclictest181rcu_preempt19:45:312
7156997030,17cyclictest181rcu_preempt19:45:312
7151997022,35cyclictest20020-21diskmemload22:54:371
716199693,50cyclictest26542-21taskset21:17:553
7156996954,10cyclictest20690-21kernelversion22:55:352
7156996950,7cyclictest181rcu_preempt00:24:242
7156996940,8cyclictest0-21swapper/223:39:222
7156996940,8cyclictest0-21swapper/220:14:232
7151996953,10cyclictest14990-21diskmemload21:34:531
7151996949,15cyclictest7127-21cyclictest23:09:411
7151996949,15cyclictest7127-21cyclictest23:09:411
7151996949,14cyclictest14990-21diskmemload00:04:201
7151996938,22cyclictest20640-21modprobe19:39:201
716199683,50cyclictest406-21chrt21:28:533
716199682,53cyclictest26183-21chrt23:04:303
7156996846,8cyclictest181rcu_preempt20:04:472
715699682,40cyclictest39-21ksoftirqd/219:59:562
7151996844,18cyclictest13754-21sh22:44:361
716199673,49cyclictest8930-21chrt20:39:373
716199673,49cyclictest8930-21chrt20:39:373
716199673,48cyclictest32746-21chrt20:14:423
716199673,47cyclictest7295-21taskset22:34:093
716199672,49cyclictest5582-21taskset20:29:453
7156996712,31cyclictest39-21ksoftirqd/220:34:372
7151996753,10cyclictest2-21kthreadd20:54:201
7151996747,14cyclictest0-21swapper/123:04:361
7151996747,13cyclictest8768-21latency_hist23:29:221
7151996747,13cyclictest8768-21latency_hist23:29:221
7151996744,12cyclictest0-21swapper/120:39:201
715199672,24cyclictest310-21runrttasks21:28:381
7151996720,33cyclictest6901-21rm21:39:301
716199663,51cyclictest23697-21chrt23:54:193
716199662,51cyclictest20921-21taskset19:39:353
716199662,50cyclictest5009-21taskset21:34:583
716199662,50cyclictest18729-21taskset19:30:273
716199662,49cyclictest29755-21taskset20:04:503
7156996638,14cyclictest181rcu_preempt20:16:012
7151996648,10cyclictest7127-21cyclictest20:09:291
7151996647,11cyclictest0-21swapper/121:01:241
7151996646,14cyclictest0-21swapper/100:09:211
7151996646,14cyclictest0-21swapper/100:09:211
7151996645,15cyclictest14662-21idleruntime-cro23:39:191
715199663,43cyclictest28702-21switchtime22:14:541
7151996611,19cyclictest23076-21sh21:11:351
716199653,49cyclictest19089-21chrt21:59:393
716199653,47cyclictest8463-21chrt21:41:143
716199653,46cyclictest24888-21chrt22:09:283
716199652,50cyclictest9001-21chrt23:29:313
716199652,50cyclictest17970-21taskset23:44:313
716199652,49cyclictest15450-21taskset22:46:423
716199652,49cyclictest14997-21taskset23:39:323
716199652,49cyclictest14997-21taskset23:39:323
716199652,48cyclictest4966-21taskset20:28:433
716199652,48cyclictest15496-21chrt20:59:263
716199652,48cyclictest15452-21taskset19:19:583
7151996549,11cyclictest7127-21cyclictest22:34:211
7151996548,12cyclictest12466-21apt-key19:14:231
7151996517,10cyclictest0-21swapper/119:24:421
716199644,47cyclictest24225-21chrt22:08:233
716199643,48cyclictest29270-21taskset00:03:153
716199643,48cyclictest19404-21chrt21:04:573
716199643,47cyclictest7874-21chrt22:34:383
716199643,47cyclictest28468-21taskset21:19:583
716199643,47cyclictest22387-21taskset21:09:563
716199642,49cyclictest15931-21chrt21:54:323
716199642,49cyclictest15931-21chrt21:54:323
716199642,48cyclictest28482-21taskset22:14:473
716199642,48cyclictest1322-21taskset00:09:523
716199642,47cyclictest7773-21taskset18:59:453
716199642,47cyclictest17150-21chrt19:26:103
7151996440,13cyclictest0-21swapper/100:14:461
7151996438,15cyclictest2163-21cut20:21:041
715199643,47cyclictest9294-21latency_hist00:24:221
715199643,47cyclictest9294-21latency_hist00:24:221
7151996424,27cyclictest10308-21latency_hist20:44:221
7151996424,27cyclictest10308-21latency_hist20:44:221
7151996419,15cyclictest9905-21ssh21:44:321
716199633,48cyclictest10794-21chrt22:39:373
716199633,48cyclictest10794-21chrt22:39:373
716199633,47cyclictest3637-21chrt21:34:213
716199633,47cyclictest12317-21chrt23:34:423
716199633,46cyclictest7323-21chrt23:25:383
716199633,46cyclictest7323-21chrt23:25:383
716199633,46cyclictest13283-21chrt20:53:183
716199632,49cyclictest16930-21taskset22:49:383
716199632,49cyclictest16930-21taskset22:49:383
716199632,48cyclictest9919-21chrt21:44:353
716199632,48cyclictest9493-21taskset00:24:273
716199632,47cyclictest9721-21chrt19:04:473
716199632,46cyclictest32463-21chrt23:14:363
716199632,46cyclictest32463-21chrt23:14:363
7151996346,10cyclictest0-21swapper/121:54:461
7151996346,10cyclictest0-21swapper/121:54:461
7151996345,13cyclictest29312-21cstates20:04:371
716199623,46cyclictest23119-21chrt22:59:353
716199622,46cyclictest20091-21chrt22:54:493
715199623,37cyclictest24972-21cpu22:09:351
7151996223,29cyclictest28040-21cat19:59:461
716199613,46cyclictest26482-21chrt23:58:493
716199613,46cyclictest26482-21chrt23:58:493
716199613,45cyclictest12326-21chrt19:14:153
716199612,47cyclictest3495-21chrt00:14:263
716199612,47cyclictest30303-21chrt23:09:583
716199612,47cyclictest30303-21chrt23:09:583
716199612,46cyclictest31939-21chrt00:07:203
716199612,46cyclictest31939-21chrt00:07:203
716199612,46cyclictest12927-21chrt21:49:333
716199612,46cyclictest11592-21chrt20:47:393
716199612,45cyclictest8590-21chrt00:22:363
716199612,45cyclictest8590-21chrt00:22:363
716199612,45cyclictest14965-21taskset20:59:183
715199614,24cyclictest31-21ksoftirqd/119:05:391
7151996136,15cyclictest0-21swapper/123:15:001
7151996136,15cyclictest0-21swapper/123:15:001
715199613,22cyclictest7772-21memory18:59:451
716199603,45cyclictest4598-21chrt22:29:233
716199603,43cyclictest32149-21taskset20:13:573
716199602,46cyclictest19920-21taskset19:34:533
716199602,45cyclictest1024-21chrt22:23:273
716199602,45cyclictest1024-21chrt22:23:273
716199602,44cyclictest7711-21chrt20:34:513
716199602,44cyclictest23557-21chrt19:45:383
716199602,44cyclictest23557-21chrt19:45:383
715199605,27cyclictest31-21ksoftirqd/119:34:121
715199604,25cyclictest31-21ksoftirqd/119:42:261
7151996041,12cyclictest0-21swapper/100:24:441
715199603,39cyclictest23961-21/usr/sbin/munin23:54:401
715199603,39cyclictest23961-21/usr/sbin/munin23:54:401
716199593,44cyclictest26609-21chrt19:55:473
716199592,45cyclictest28097-21chrt19:59:483
716199592,43cyclictest13417-21chrt19:15:083
715199593,33cyclictest21319-21ssh21:09:241
715199593,31cyclictest9044-21cpu23:29:351
7151995912,34cyclictest1187-21fschecks_count21:29:421
716199582,45cyclictest4092-21chrt23:19:593
716199582,43cyclictest25405-21taskset19:53:203
716199582,43cyclictest25405-21taskset19:53:203
715199583,43cyclictest10660-21fschecks_time20:44:421
716199503,32cyclictest7186-21chrt18:59:243
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional