You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-26 - 14:11
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Fri Jun 26, 2026 00:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3726214512,82sleep23757-21kernelversion18:53:492
3726214512,82sleep23757-21kernelversion18:53:492
4860999556,33cyclictest2339-21systemd-run23:23:191
4856999581,10cyclictest4847-21cyclictest22:23:340
4856999581,10cyclictest4847-21cyclictest22:23:340
486099933,31cyclictest26532-21/usr/sbin/munin00:03:451
486099913,32cyclictest25775-21open_inodes22:13:521
486099904,35cyclictest14880-21cron19:28:191
486099904,35cyclictest14880-21cron19:28:191
4860999042,41cyclictest0-21swapper/100:18:181
4860999042,41cyclictest0-21swapper/100:18:181
486099903,33cyclictest5311-21fschecks_time18:58:401
486099902,35cyclictest24658-21unixbench_singl23:58:561
486499893,58cyclictest13548-21apt-get22:48:382
486499893,58cyclictest13548-21apt-get22:48:382
4860998941,40cyclictest0-21swapper/121:05:511
4860998941,40cyclictest0-21swapper/121:05:511
486099893,34cyclictest22828-21grep19:49:101
486099893,34cyclictest22828-21grep19:49:101
486099893,33cyclictest31693-21runrttasks22:24:301
486099893,33cyclictest31693-21runrttasks22:24:301
4856998961,20cyclictest544-21cron23:43:180
4856998961,20cyclictest544-21cron23:43:180
486099884,36cyclictest15018-21ssh23:43:431
486099884,36cyclictest15018-21ssh23:43:431
486099883,33cyclictest19555-21timerwakeupswit21:08:551
486499874,58cyclictest23715-21apt-get19:53:372
486099875,28cyclictest12961-21ssh21:53:211
486099874,30cyclictest7832-21fschecks_count20:43:381
486099874,29cyclictest12537-21/usr/sbin/munin20:58:351
4860998736,43cyclictest0-21swapper/121:43:291
486099873,35cyclictest352-21runrttasks22:33:541
486099873,30cyclictest5620-21/usr/sbin/munin23:28:281
486099872,76cyclictest11849-21apt-get23:39:241
486099872,76cyclictest11849-21apt-get23:39:241
486099872,34cyclictest14088-21/usr/sbin/munin22:49:471
486099872,34cyclictest14088-21/usr/sbin/munin22:49:471
486099872,32cyclictest13837-21wc21:53:541
4856998719,24cyclictest25825-21true23:08:190
4860998669,11cyclictest1-21systemd23:38:191
4860998639,40cyclictest0-21swapper/122:43:571
486099863,33cyclictest24396-21latency_hist21:18:221
486099863,33cyclictest24396-21latency_hist21:18:221
486099863,32cyclictest29561-21ssh00:08:301
486099863,31cyclictest16074-21/usr/sbin/munin21:58:551
486099863,31cyclictest16074-21/usr/sbin/munin21:58:551
486099863,30cyclictest7354-21fschecks_time19:03:431
486099863,30cyclictest18541-21latency_hist19:38:221
486099862,31cyclictest2836-21grep23:23:391
486099862,31cyclictest2836-21grep23:23:391
486099862,30cyclictest25848-21grep19:58:471
4860998615,21cyclictest4578-21wc21:38:451
4856998659,19cyclictest9771-21sendmail21:48:180
486099854,36cyclictest23406-21fschecks_time23:03:411
486099854,30cyclictest11473-21grep20:53:511
486099854,30cyclictest11227-21grep19:13:561
486099854,29cyclictest956-21taskset21:33:211
486099853,44cyclictest8694-21/usr/sbin/munin19:08:371
486099853,35cyclictest352-21runrttasks20:33:581
486099853,35cyclictest22934-21latency_hist23:03:211
486099853,34cyclictest28357-21grep22:18:401
486099853,32cyclictest7858-21/usr/sbin/munin22:38:521
486099853,32cyclictest7858-21/usr/sbin/munin22:38:521
486099853,32cyclictest18152-21latency23:48:501
4860998523,9cyclictest0-21swapper/121:23:341
486099852,35cyclictest15429-21fschecks_time19:28:401
486099852,35cyclictest15429-21fschecks_time19:28:401
486099852,34cyclictest24805-21apt22:13:181
72772840,4sleep2371rcuc/223:30:262
4864998462,16cyclictest13960-21latency_hist22:48:222
486499844,41cyclictest39-21ksoftirqd/223:08:152
486099844,28cyclictest26656-21awk23:08:451
486099843,42cyclictest6570-21ntp_kernel_err00:23:471
486099843,42cyclictest6570-21ntp_kernel_err00:23:471
486099843,33cyclictest1426-21tune2fs20:23:411
486099843,32cyclictest352-21runrttasks19:53:241
486099843,30cyclictest26995-21sort20:03:351
486099843,30cyclictest1331-21fschecks_count21:33:401
486099843,30cyclictest1331-21fschecks_count21:33:401
486099843,28cyclictest20462-21fschecks_time19:43:401
486099843,28cyclictest20462-21fschecks_time19:43:401
486099842,33cyclictest4927-21latency_hist18:58:231
486099842,33cyclictest4927-21latency_hist18:58:231
486099842,33cyclictest24800-21ssh21:18:391
486099842,32cyclictest4152-21latency_hist20:33:211
485699844,47cyclictest5103-21unixbench_multi21:38:550
4856998438,35cyclictest10323-21sshd19:13:290
486499832,47cyclictest39-21ksoftirqd/223:00:272
486099834,32cyclictest17086-21/usr/sbin/munin22:53:471
486099834,30cyclictest29371-21fschecks_count23:13:401
486099834,29cyclictest31505-21modprobe20:18:181
486099834,29cyclictest21051-21ssh23:53:451
486099834,29cyclictest21051-21ssh23:53:451
486099833,32cyclictest1853-21/usr/sbin/munin22:28:511
486099833,32cyclictest18117-21apt-get19:38:321
4856998330,20cyclictest0-21swapper/022:32:560
4856998315,31cyclictest10231-21head20:48:540
486099823,35cyclictest19078-21/usr/sbin/munin22:03:361
4860998218,11cyclictest0-21swapper/100:18:241
4856998249,25cyclictest15550-21ssh22:49:530
4856998249,25cyclictest15550-21ssh22:49:530
4856998232,41cyclictest0-21swapper/018:58:230
4856998232,41cyclictest0-21swapper/018:58:230
4856998214,30cyclictest26503-21/usr/sbin/munin23:08:420
4864998161,12cyclictest7355-21kworker/u17:0-nfsiod23:23:442
4864998161,12cyclictest7355-21kworker/u17:0-nfsiod23:23:442
4864998160,12cyclictest6763-21apt21:43:182
486099814,31cyclictest9750-21awk20:48:451
486099814,29cyclictest32002-21/usr/sbin/munin20:19:451
486099813,33cyclictest7003-21grep20:38:541
486099813,33cyclictest7003-21grep20:38:541
486099812,30cyclictest29299-21grep20:08:521
4856998147,21cyclictest12562-21apt-get20:58:310
4856998133,16cyclictest0-21swapper/020:01:330
4856998119,28cyclictest27248-21rm22:16:490
469528113,43sleep30-21swapper/318:58:193
469528113,43sleep30-21swapper/318:58:193
4864998057,13cyclictest0-21swapper/220:53:552
4864998053,17cyclictest298-21in:imuxsock00:23:172
486099802,31cyclictest11909-21/usr/sbin/munin19:18:451
4856998022,22cyclictest5596-21/usr/sbin/munin18:58:500
4856998014,32cyclictest7558-21munin-run22:38:180
4856997957,15cyclictest4847-21cyclictest23:32:490
4856997951,20cyclictest12132-21fschecks_count19:18:390
4856997920,25cyclictest0-21swapper/000:08:200
4856997919,28cyclictest9614-21rm22:40:430
4856997919,28cyclictest9614-21rm22:40:430
4856997918,30cyclictest13138-21sh21:53:340
4856997918,21cyclictest12204-21seq22:44:360
4856997855,16cyclictest298-21in:imuxsock20:03:300
485699784,41cyclictest12333-21latency_hist20:58:210
4856997820,23cyclictest8125-21seq19:04:470
4856997819,23cyclictest4788-21sh00:20:470
4856997819,23cyclictest15941-21ssh23:44:320
4856997819,23cyclictest15941-21ssh23:44:320
4856997818,24cyclictest21182-21rm22:06:400
4856997817,28cyclictest1042-21rm23:19:480
4856997816,26cyclictest22653-21taskset22:08:460
4856997816,26cyclictest0-21swapper/023:33:440
4856997813,24cyclictest22748-21modprobe23:03:180
4864997755,15cyclictest4847-21cyclictest22:21:172
486499772,52cyclictest39-21ksoftirqd/222:36:582
4856997723,24cyclictest9754-21seq19:09:370
4856997721,46cyclictest21608-21awk19:48:180
4856997721,46cyclictest21608-21awk19:48:180
4856997721,19cyclictest25257-21ssh00:00:340
4856997720,23cyclictest29701-21ssh22:20:180
4856997718,36cyclictest1550-21ssh00:15:020
4856997718,36cyclictest1550-21ssh00:15:020
4856997718,23cyclictest2908-21rm21:35:540
4856997718,23cyclictest2908-21rm21:35:540
4856997717,26cyclictest32734-21rm21:31:550
4864997652,17cyclictest17306-40ogrotate23:48:182
4864997652,17cyclictest17306-40ogrotate23:48:182
486499762,35cyclictest39-21ksoftirqd/221:50:482
4856997652,15cyclictest18124-21/usr/sbin/munin19:38:190
4856997638,33cyclictest0-21swapper/023:48:380
4856997633,22cyclictest12248-21diskmemload23:54:100
4856997633,22cyclictest12248-21diskmemload23:54:100
4856997620,41cyclictest12248-21diskmemload22:01:240
4856997620,41cyclictest12248-21diskmemload22:01:240
4856997620,28cyclictest31819-21ssh00:12:150
4856997620,27cyclictest8629-21ssh00:28:150
4856997620,27cyclictest8629-21ssh00:28:150
4856997619,22cyclictest29909-21ssh21:27:270
4856997619,20cyclictest22988-21rm21:14:490
4856997619,20cyclictest22988-21rm21:14:490
4856997617,24cyclictest11342-21rm21:49:170
4856997615,29cyclictest18600-21/usr/sbin/munin19:38:290
486899753,58cyclictest15528-21taskset23:43:543
486899753,58cyclictest15528-21taskset23:43:543
4864997558,12cyclictest352-21runrttasks23:13:412
4864997553,14cyclictest0-21swapper/200:23:442
4864997553,14cyclictest0-21swapper/200:23:442
4864997534,10cyclictest31581-21ssh22:24:112
4864997534,10cyclictest31581-21ssh22:24:112
486499752,47cyclictest39-21ksoftirqd/223:22:382
486499752,34cyclictest39-21ksoftirqd/221:15:142
486499752,34cyclictest39-21ksoftirqd/221:15:142
4856997540,27cyclictest2647-21ssh23:23:330
4856997540,27cyclictest2647-21ssh23:23:330
4864997454,12cyclictest0-21swapper/223:58:182
4864997454,12cyclictest0-21swapper/223:58:182
4864997443,9cyclictest181rcu_preempt19:58:542
486499743,25cyclictest9499-21grep20:48:402
4856997419,19cyclictest31727-21ssh23:18:130
4856997419,19cyclictest20580-21ssh21:11:270
4856997418,19cyclictest17878-21ssh21:07:200
4856997418,19cyclictest17878-21ssh21:07:200
4856997417,26cyclictest18838-21sh22:55:420
4856997413,25cyclictest0-21swapper/021:18:390
4864997354,12cyclictest277-21dbus-daemon21:08:202
4864997354,12cyclictest277-21dbus-daemon21:08:202
4864997346,18cyclictest25358-21fschecks_count22:13:412
4864997343,21cyclictest544-21cron20:38:192
4864997335,16cyclictest181rcu_preempt21:24:562
486499733,36cyclictest39-21ksoftirqd/221:46:412
4856997317,21cyclictest2458-21seq20:27:430
486899723,56cyclictest2091-21chrt23:22:453
486899723,39cyclictest21569-21taskset22:59:593
4864997245,19cyclictest29426-21latency_hist00:08:222
4864997244,19cyclictest8307-21kernelversion22:38:462
4864997244,19cyclictest8307-21kernelversion22:38:462
4864997242,21cyclictest30101-21latency_hist20:13:212
4864997242,20cyclictest17323-21fschecks_count22:53:412
4864997216,33cyclictest39-21ksoftirqd/219:49:352
4864997216,33cyclictest39-21ksoftirqd/219:49:352
4856997252,14cyclictest23393-21latency_hist19:53:210
4856997252,14cyclictest23393-21latency_hist19:53:210
4856997217,21cyclictest16446-21taskset19:32:410
4856997217,21cyclictest16446-21taskset19:32:410
4864997150,15cyclictest18656-21timerwakeupswit23:49:012
4864997142,21cyclictest12248-21diskmemload22:13:182
486499712,43cyclictest39-21ksoftirqd/223:39:512
486499712,43cyclictest39-21ksoftirqd/223:39:512
486499712,36cyclictest39-21ksoftirqd/220:23:502
486499711,22cyclictest39-21ksoftirqd/220:19:412
4856997134,23cyclictest13538-21apt-get19:23:310
4856997134,23cyclictest13538-21apt-get19:23:310
4856997112,19cyclictest0-21swapper/019:54:130
4864997046,17cyclictest18394-21apt-key19:38:222
4864997044,7cyclictest181rcu_preempt00:14:022
4864997044,7cyclictest181rcu_preempt00:14:022
4864997044,18cyclictest20643-21latency19:43:442
4864997044,18cyclictest20643-21latency19:43:442
486499702,38cyclictest39-21ksoftirqd/220:13:292
486499702,36cyclictest39-21ksoftirqd/223:09:372
4856997017,25cyclictest4006-21taskset20:31:330
4856997016,17cyclictest5422-21taskset20:34:010
4864996955,10cyclictest4847-21cyclictest19:08:422
4864996948,16cyclictest8372-21switchtime20:43:512
4864996944,20cyclictest4847-21cyclictest00:08:452
486499694,27cyclictest39-21ksoftirqd/219:07:472
4864996942,19cyclictest24833-21fschecks_time21:18:402
486499692,36cyclictest39-21ksoftirqd/221:37:312
486499692,36cyclictest39-21ksoftirqd/221:37:312
4856996917,20cyclictest818-21seq20:22:200
4856996916,19cyclictest29752-21taskset20:11:250
486899682,34cyclictest18423-21chrt22:54:323
486899682,32cyclictest13713-21chrt23:41:393
486899682,32cyclictest13713-21chrt23:41:393
4864996848,15cyclictest17137-21unixbench_multi21:58:562
4864996848,15cyclictest17137-21unixbench_multi21:58:562
4864996846,12cyclictest0-21swapper/220:08:212
4864996844,15cyclictest16506-21latency_hist19:33:202
4864996844,15cyclictest16506-21latency_hist19:33:202
486499683,34cyclictest39-21ksoftirqd/221:58:162
486899673,34cyclictest6164-21chrt22:34:263
486899673,33cyclictest1587-21chrt20:23:453
486899672,35cyclictest4608-21chrt21:38:453
486899672,34cyclictest13170-21taskset22:47:183
486499672,33cyclictest39-21ksoftirqd/223:59:262
486499672,27cyclictest39-21ksoftirqd/219:01:472
4856996716,18cyclictest7267-21taskset20:42:050
4856996716,18cyclictest7267-21taskset20:42:050
4856996715,22cyclictest8735-21taskset20:45:180
486899663,33cyclictest684-21taskset00:13:503
486899663,33cyclictest684-21taskset00:13:503
486899663,33cyclictest16166-21taskset22:51:363
486899663,33cyclictest16166-21taskset22:51:363
486899663,32cyclictest8818-21taskset00:28:213
486899663,32cyclictest8818-21taskset00:28:213
486899663,32cyclictest23923-21taskset23:58:423
486899662,34cyclictest23505-21chrt21:16:163
486899662,34cyclictest23505-21chrt21:16:163
486899662,33cyclictest15005-21taskset21:02:423
486899662,33cyclictest10352-21chrt22:42:483
486899662,33cyclictest10352-21chrt22:42:483
486899662,32cyclictest18585-21chrt21:08:293
4864996646,9cyclictest0-21swapper/219:28:212
4864996646,9cyclictest0-21swapper/219:28:212
4864996646,13cyclictest11893-21latency_hist19:18:232
486499663,40cyclictest19515-21timerwakeupswit19:39:412
486499663,24cyclictest39-21ksoftirqd/222:29:562
4864996631,22cyclictest13352-21grep19:23:212
4864996625,30cyclictest20664-21rm22:05:142
4864996619,35cyclictest3104-21idleruntime20:28:402
486899653,33cyclictest9315-21chrt23:33:523
486899652,32cyclictest17040-21taskset21:05:013
486899652,32cyclictest17040-21taskset21:05:013
486899652,32cyclictest14685-21chrt21:55:153
486899652,27cyclictest23746-21taskset19:53:473
486499659,36cyclictest39-21ksoftirqd/221:01:032
4864996530,10cyclictest181rcu_preempt21:32:082
486499652,34cyclictest39-21ksoftirqd/221:08:302
486499652,25cyclictest39-21ksoftirqd/223:34:172
486899643,32cyclictest25834-21taskset21:19:243
486899643,30cyclictest28194-21taskset00:05:273
486899642,33cyclictest25608-21taskset23:07:533
486899642,30cyclictest31414-21chrt22:23:443
486899642,30cyclictest31414-21chrt22:23:443
486899642,30cyclictest14821-21chrt19:27:473
486899642,30cyclictest14821-21chrt19:27:473
4856996425,18cyclictest19676-21snmpd20:17:050
486899633,30cyclictest7192-21chrt20:41:103
486899633,30cyclictest7192-21chrt20:41:103
486899633,27cyclictest4646-21chrt22:33:203
486899632,32cyclictest29930-21taskset23:13:533
486899632,31cyclictest24665-21chrt22:12:573
486899632,31cyclictest23143-21taskset19:52:343
486899632,31cyclictest23143-21taskset19:52:343
486899632,30cyclictest29755-21taskset21:27:023
486899632,30cyclictest29322-21taskset22:19:143
486899632,30cyclictest17821-21chrt19:34:393
486899632,29cyclictest29576-21taskset20:09:063
486499632,43cyclictest6472-21load20:38:432
486499632,43cyclictest6472-21load20:38:432
486899623,30cyclictest8674-21chrt21:45:183
486899623,30cyclictest25325-21chrt19:58:293
486899622,31cyclictest20603-21chrt22:05:033
486899622,29cyclictest32034-21chrt00:12:533
486899622,28cyclictest28220-21chrt20:07:413
486899622,22cyclictest4688-21chrt20:33:413
486899616,39cyclictest18627-21chrt19:38:323
486899613,46cyclictest56372sleep323:28:283
486899613,30cyclictest16414-21taskset19:32:163
486899613,30cyclictest16414-21taskset19:32:163
486899613,27cyclictest945-21chrt20:23:203
486899612,22cyclictest22215-21chrt23:55:223
486899612,22cyclictest22215-21chrt23:55:223
486899602,34cyclictest5298-21chrt00:22:133
486899602,31cyclictest8221-21taskset19:05:553
486899602,27cyclictest32017-21chrt21:29:543
486899602,25cyclictest8849-21taskset20:46:453
486899602,25cyclictest3658-21taskset23:23:543
486899602,25cyclictest3658-21taskset23:23:543
486899602,25cyclictest31210-21chrt20:14:293
486899602,24cyclictest19691-21chrt23:51:373
486899595,43cyclictest0-21swapper/322:18:183
486899593,26cyclictest28004-21chrt23:11:103
486899593,23cyclictest12143-21chrt19:18:393
486899593,23cyclictest10747-21chrt21:48:503
486899592,24cyclictest11430-21chrt20:53:503
486899592,21cyclictest17417-21chrt21:59:323
486899592,21cyclictest17417-21chrt21:59:323
486899582,24cyclictest3982-21chrt20:31:183
486899582,23cyclictest8872-21chrt19:08:393
486899573,28cyclictest6047-21taskset18:59:153
486899573,24cyclictest11427-21chrt19:15:273
486899572,24cyclictest10428-21chrt20:50:593
486899572,23cyclictest20390-21chrt19:43:393
486899572,23cyclictest20390-21chrt19:43:393
486899572,22cyclictest1667-21chrt21:33:473
486899572,22cyclictest1667-21chrt21:33:473
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional