You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-08 - 17:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Tue Sep 08, 2026 12:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
146649913762,39cyclictest524-21in:imuxsock07:49:392
13213212012,77sleep013167-21apt-get07:05:180
146579911358,48cyclictest524-21in:imuxsock11:17:051
146579911046,57cyclictest21794-21diskmemload10:29:421
146579910535,10cyclictest0-21swapper/110:59:411
146579910338,10cyclictest0-21swapper/108:05:021
146579910336,13cyclictest0-21swapper/109:10:381
14657991013,46cyclictest31171-21latency_hist09:24:401
14657991013,46cyclictest31171-21latency_hist09:24:401
1464899999,65cyclictest20973-21apt-get09:59:540
14648999966,23cyclictest4170-21latency_hist08:14:410
14648999966,23cyclictest4170-21latency_hist08:14:410
139192999,55sleep113957-21switchtime07:06:211
1465799984,39cyclictest18410-21latency11:40:051
1466499973,33cyclictest4543-21fschecks_time08:14:592
1466499963,37cyclictest343-21runrttasks08:19:532
1465799964,43cyclictest11106-21latency_hist09:44:411
14657999639,19cyclictest31020-21threads07:55:141
14657999639,19cyclictest31020-21threads07:55:141
1464899969,65cyclictest26544-21apt-get07:44:560
247312950,4sleep30-21swapper/310:58:263
1320429514,50sleep30-21swapper/307:05:173
1317529413,53sleep212665-21apt-get07:04:552
14664999347,38cyclictest0-21swapper/210:25:102
1466499934,34cyclictest20179-21sh09:04:382
1466499934,34cyclictest20179-21sh09:04:382
1465799934,36cyclictest19197-21runrttasks12:35:001
14648999316,56cyclictest24678-21apt-get07:39:530
1466499923,40cyclictest1737-21uptime12:05:162
1466499923,33cyclictest3046-21ssh11:15:052
1465799914,35cyclictest343-21runrttasks09:55:561
14648999156,27cyclictest28618-21ssh11:04:410
14664999048,35cyclictest0-21swapper/211:25:152
14664999048,35cyclictest0-21swapper/211:25:152
14664999045,37cyclictest0-21swapper/209:50:162
14664999045,37cyclictest0-21swapper/209:50:162
1466499903,37cyclictest21961-21latency_hist12:39:402
1465799903,39cyclictest17353-21sshd11:39:041
1465799903,39cyclictest17353-21sshd11:39:041
1465799903,39cyclictest11592-21rm10:36:161
1464899907,48cyclictest14568-21apt-get09:50:090
1464899907,48cyclictest14568-21apt-get09:50:090
14648998960,20cyclictest24848-21latency_hist07:39:410
14648998926,25cyclictest29128-21fschecks_time11:05:000
1466499883,29cyclictest14325-21apt-config09:49:422
14664998767,13cyclictest23422-21cstates07:34:552
1466499873,42cyclictest343-21runrttasks09:39:542
1466499873,38cyclictest31042-21timerandwakeup07:55:142
1466499873,38cyclictest31042-21timerandwakeup07:55:142
14664998713,34cyclictest29446-21ntp_states11:05:082
14657998767,13cyclictest27959-21cron09:19:381
14648998723,20cyclictest10783-21unixbench_multi12:20:130
14648998723,20cyclictest10783-21unixbench_multi12:20:130
14664998664,15cyclictest25174-21cron10:59:382
1466499864,35cyclictest13959-21/usr/sbin/munin08:44:562
1466499864,34cyclictest19895-21/usr/sbin/munin10:50:062
1466499864,34cyclictest19895-21/usr/sbin/munin10:50:062
1466499863,35cyclictest7027-21/usr/sbin/munin10:30:092
1466499863,35cyclictest24138-21ssh11:49:572
1466499862,37cyclictest22612-21grep07:30:172
14648998620,23cyclictest746-21latency_hist10:19:430
14648998620,23cyclictest746-21latency_hist10:19:430
1466499853,40cyclictest343-21runrttasks07:29:412
1466499853,37cyclictest26919-21cat07:44:422
1466499853,35cyclictest19067-21modprobe10:49:382
1466499853,32cyclictest15531-21modprobe12:29:372
1466499853,27cyclictest20650-21cmp09:59:412
1466499852,35cyclictest20894-21/usr/sbin/munin11:45:072
14657998555,21cyclictest10471-21latency_hist08:34:381
14648998562,16cyclictest14636-21cyclictest10:59:370
14648998522,24cyclictest21641-21store12:39:220
14648998522,23cyclictest17487-21find07:15:130
1466499844,34cyclictest11980-21/usr/sbin/munin11:29:592
1466499843,36cyclictest15057-21fschecks_time07:10:002
1466499843,33cyclictest5817-21/usr/sbin/munin11:19:572
1466499842,36cyclictest15151-21grep11:35:012
1466499842,36cyclictest15151-21grep11:35:012
14664998423,54cyclictest0-21swapper/210:21:492
1466499842,31cyclictest13641-21grep10:40:042
14657998461,16cyclictest25632-21latency07:40:401
1465799843,55cyclictest25775-21apt-get10:59:561
14648998419,22cyclictest5736-21cstates11:19:550
1467099838,54cyclictest0-21swapper/309:49:543
1467099838,54cyclictest0-21swapper/309:49:543
1466499834,36cyclictest31872-21/usr/sbin/munin11:10:042
1466499834,35cyclictest23886-21latency_hist10:04:402
1466499833,39cyclictest30454-21taskset10:15:022
1466499833,39cyclictest30454-21taskset10:15:022
1466499833,37cyclictest5761-21ssh09:35:122
1466499833,37cyclictest5761-21ssh09:35:122
1466499833,33cyclictest12982-21latency_hist10:39:402
1466499832,24cyclictest8248-21switchtime08:25:132
1465799838,64cyclictest14568-21apt-get09:49:551
1465799838,64cyclictest14568-21apt-get09:49:551
14657998340,32cyclictest8885-21kworker/u18:2+nfsiod11:30:421
1466499824,41cyclictest9129-21apt-get08:29:482
1466499824,37cyclictest24146-21taskset09:12:422
1466499823,37cyclictest21801-21idleruntime-cro09:09:382
1466499823,37cyclictest21801-21idleruntime-cro09:09:382
1466499823,37cyclictest15744-21taskset08:49:562
1466499823,37cyclictest10914-21fschecks_count08:35:002
1466499823,34cyclictest4527-21cat12:10:132
1466499823,34cyclictest4527-21cat12:10:132
1466499823,34cyclictest17821-21unixbench_singl07:15:162
1466499823,32cyclictest9432-21latency_hist12:19:412
1466499823,32cyclictest17687-21sh12:32:142
1466499822,34cyclictest19048-21runrttasks07:20:102
14664998212,27cyclictest30438-21seq09:22:572
14664998212,27cyclictest30438-21seq09:22:572
1465799825,67cyclictest20407-21apt-get09:59:531
14657998241,12cyclictest181rcu_preempt09:47:201
14648998251,24cyclictest14636-21cyclictest07:10:140
14648998223,22cyclictest2199-21ssh12:06:290
14648998218,23cyclictest17024-21ssh12:30:250
1466499815,33cyclictest28856-21cut07:49:592
1466499814,32cyclictest3248-21ps08:10:112
1466499814,32cyclictest3248-21ps08:10:112
1466499813,37cyclictest25266-21grep09:14:552
1466499813,35cyclictest32079-21ssh09:25:112
1466499813,34cyclictest27490-21fschecks_time10:10:052
1466499813,34cyclictest27490-21fschecks_time10:10:052
14664998128,45cyclictest0-21swapper/211:00:372
14664998123,50cyclictest0-21swapper/211:54:572
14657998154,18cyclictest358-21ntpd11:05:131
14648998132,17cyclictest30058-21latency_hist10:14:410
14648998132,17cyclictest30058-21latency_hist10:14:410
14648998114,30cyclictest23079-21grep09:10:360
1466499804,34cyclictest30068-21rm11:59:542
1466499803,37cyclictest26856-21taskset10:09:392
1466499803,35cyclictest2408-21idleruntime-cro08:09:382
1466499803,34cyclictest2113-21ls09:29:562
1466499803,34cyclictest17396-21grep08:54:572
14657998059,7cyclictest181rcu_preempt10:20:041
14648998054,16cyclictest26478-21kworker/u19:0+events_unbound07:59:380
14648998054,16cyclictest26478-21kworker/u19:0+events_unbound07:59:380
14648998036,31cyclictest6701-21apt-get12:14:480
14648998029,41cyclictest0-21swapper/010:19:490
14648998021,24cyclictest12115-21ssh11:30:020
14648998020,22cyclictest31925-21sh11:09:530
14648998016,25cyclictest0-21swapper/009:30:080
14648998014,25cyclictest0-21swapper/009:55:120
1466499793,35cyclictest10794-21unixbench_multi12:20:132
1466499793,35cyclictest10794-21unixbench_multi12:20:132
1466499792,19cyclictest31894-21apt-get07:59:542
14648997953,18cyclictest23833-21latency_hist11:49:410
14648997922,18cyclictest13102-21wc08:40:150
14648997917,23cyclictest132422sleep009:47:360
1466499784,31cyclictest12583-21fschecks_count08:40:022
1466499783,31cyclictest343-21runrttasks11:42:292
14657997862,10cyclictest12077-21sh12:23:311
14657997862,10cyclictest12077-21sh12:23:311
14657997858,14cyclictest30208-21/usr/sbin/munin10:15:121
14657997858,14cyclictest30208-21/usr/sbin/munin10:15:121
14657997858,11cyclictest16933-21cpuspeed07:14:571
14648997851,19cyclictest23178-21latency_hist07:34:410
1464899784,41cyclictest0-21swapper/010:09:310
1464899783,44cyclictest343-21runrttasks09:17:350
14648997822,15cyclictest5706-21ssh09:35:090
14648997822,15cyclictest5706-21ssh09:35:090
14648997821,26cyclictest9299-21forks08:29:580
14648997821,22cyclictest21490-21latency_hist07:29:400
14648997821,21cyclictest17307-21sed10:45:140
14648997819,41cyclictest0-21swapper/008:54:410
14648997819,23cyclictest897-21latency_hist08:04:410
14657997760,10cyclictest21794-21diskmemload12:10:121
14657997760,10cyclictest21794-21diskmemload12:10:121
1464899779,36cyclictest0-21swapper/007:20:020
14648997718,26cyclictest6245-21ssh10:28:250
14648997710,24cyclictest0-21swapper/009:21:130
14648997710,24cyclictest0-21swapper/009:21:130
14657997659,12cyclictest32169-21fschecks_time11:09:591
14657997656,10cyclictest16043-21latency_hist10:44:401
1464899769,29cyclictest31612-21chrt12:01:300
14648997623,24cyclictest0-21swapper/008:05:130
14648997616,28cyclictest14039-21sort08:44:550
14648997614,26cyclictest0-21swapper/011:35:030
14648997614,26cyclictest0-21swapper/011:35:030
1464899754,32cyclictest21953-21apt-get09:10:110
1464899754,32cyclictest21953-21apt-get09:10:110
14648997543,15cyclictest10923-21cron09:44:380
14648997522,24cyclictest10161-21taskset10:34:560
14648997520,18cyclictest23980-21ssh11:49:530
14648997518,21cyclictest28534-21ssh11:56:290
14648997512,24cyclictest0-21swapper/011:19:320
14648997511,25cyclictest7049-21apt-get10:29:550
14657997458,10cyclictest21794-21diskmemload10:45:091
14657997458,10cyclictest200-21systemd-journal08:46:551
14657997455,14cyclictest14636-21cyclictest08:26:101
14648997421,24cyclictest10181-21ssh11:26:160
14648997421,24cyclictest10181-21ssh11:26:160
14648997419,22cyclictest20572-21ssh10:50:310
14648997419,22cyclictest20572-21ssh10:50:310
14648997418,19cyclictest4170-21cat12:10:030
14648997418,19cyclictest4170-21cat12:10:030
14648997418,19cyclictest20224-21ssh11:43:390
14657997349,8cyclictest0-21swapper/107:10:041
14657997327,31cyclictest2292-21grep09:30:011
14648997345,19cyclictest7434-21latency_hist08:24:410
14648997336,28cyclictest0-21swapper/010:44:410
1464899733,57cyclictest31381-21/usr/sbin/munin09:25:120
14648997312,24cyclictest19795-21awk09:00:140
14648997312,24cyclictest19795-21awk09:00:140
14657997250,14cyclictest29902-21cron10:14:381
14657997250,14cyclictest29902-21cron10:14:381
14657997249,13cyclictest0-21swapper/109:34:561
14657997249,13cyclictest0-21swapper/109:34:561
14648997241,18cyclictest12819-21apt-get12:24:500
1467099714,38cyclictest0-21swapper/310:59:563
14657997154,11cyclictest15833-21/usr/sbin/munin12:30:041
14657997149,12cyclictest0-21swapper/112:06:301
14657997145,12cyclictest0-21swapper/108:14:411
14657997145,12cyclictest0-21swapper/108:14:411
14657997142,21cyclictest11533-21cat08:35:141
14657997135,27cyclictest23258-21cat07:34:421
1465799713,48cyclictest4750-21netstat08:15:041
14648997121,18cyclictest18688-21latency_hist08:59:410
14648997118,19cyclictest0-21swapper/008:35:150
14657997055,9cyclictest27737-21mailstats11:55:121
14657997048,15cyclictest58-21kcompactd012:16:001
14657997048,12cyclictest0-21swapper/111:49:591
14657997042,9cyclictest181rcu_preempt07:34:521
14657996918,33cyclictest19598-21cat09:00:121
14657996918,33cyclictest19598-21cat09:00:121
14648996933,24cyclictest28652-21apt-get07:49:530
27942680,7sleep30-21swapper/309:30:133
14657996847,15cyclictest23736-21latency_hist11:49:401
1465799684,45cyclictest343-21runrttasks09:06:101
1465799684,45cyclictest343-21runrttasks09:06:101
14657996839,21cyclictest13139-21cat08:40:151
14648996843,14cyclictest7527-21apt-get08:24:510
1465799674,42cyclictest343-21runrttasks07:23:571
14657996738,20cyclictest29984-21modprobe07:54:381
14657996723,14cyclictest788-21modprobe08:04:381
14648996712,25cyclictest5618-21modprobe08:19:380
14670996624,33cyclictest0-21swapper/307:40:303
1465799664,41cyclictest27742-21sendmail_mailqu07:46:111
1465799663,44cyclictest25042-21sort10:05:141
14657996548,10cyclictest31266-21kworker/u17:0-rpciod12:03:591
14657996546,14cyclictest25419-21kworker/u17:0-xprtiod09:25:001
14657996545,11cyclictest0-21swapper/111:25:001
14657996545,11cyclictest0-21swapper/111:25:001
1465799644,36cyclictest343-21runrttasks08:53:251
14657996443,12cyclictest0-21swapper/107:25:051
14657996440,17cyclictest14636-21cyclictest12:28:401
14657996436,9cyclictest0-21swapper/110:30:161
14657996423,33cyclictest6760-21seq11:20:201
14657996342,15cyclictest21794-21diskmemload10:50:091
14657996342,15cyclictest21794-21diskmemload10:50:091
14670996214,26cyclictest0-21swapper/307:45:373
14670996135,20cyclictest0-21swapper/310:00:503
1465799614,43cyclictest5902-21/usr/sbin/munin08:20:121
1465799612,38cyclictest18094-21unixbench_multi08:55:121
1467099583,39cyclictest5260-21taskset11:19:383
1467099574,39cyclictest21661-21chrt12:39:063
1467099574,38cyclictest6926-21chrt10:29:413
1467099573,40cyclictest29890-21chrt11:05:153
1467099573,37cyclictest32040-21taskset07:59:563
1467099564,37cyclictest27779-21chrt11:55:133
1467099564,35cyclictest32755-21chrt12:04:373
1467099564,34cyclictest18209-21chrt11:40:013
1467099563,40cyclictest9122-21taskset10:32:533
1467099563,38cyclictest953-21taskset10:19:533
1467099563,37cyclictest12229-21chrt11:30:043
1467099563,35cyclictest14266-21taskset08:45:023
1467099563,31cyclictest15820-21chrt12:29:463
1467099554,35cyclictest901-21kworker/3:1+events12:24:533
1467099553,41cyclictest8900-21chrt08:29:393
1467099553,38cyclictest22494-21chrt11:46:333
1467099553,37cyclictest901-21kworker/3:1+events12:10:093
1467099553,37cyclictest901-21kworker/3:1+events12:10:093
1467099553,34cyclictest9167-21chrt12:18:563
1467099544,39cyclictest10161-21chrt10:34:563
1467099544,35cyclictest6864-21chrt08:20:163
1467099543,38cyclictest9605-21chrt11:25:133
1467099543,38cyclictest9605-21chrt11:25:133
1467099533,37cyclictest30574-21chrt07:55:023
1467099533,37cyclictest30574-21chrt07:55:023
1467099533,35cyclictest425-21chrt09:26:163
1467099533,34cyclictest1563-21chrt08:05:063
1467099533,32cyclictest28453-21taskset09:19:563
1467099533,32cyclictest28453-21taskset09:19:563
1467099532,39cyclictest16073-21chrt10:44:403
1467099524,36cyclictest7211-21chrt09:37:593
1467099524,36cyclictest7211-21chrt09:37:593
1467099524,36cyclictest23256-21taskset07:34:423
1467099523,38cyclictest8211-21taskset09:39:533
1467099523,35cyclictest32097-21chrt11:09:573
1467099514,34cyclictest6218-21chrt11:20:063
1467099514,33cyclictest17128-21chrt07:15:033
1467099513,37cyclictest29905-21chrt10:14:383
1467099513,37cyclictest29905-21chrt10:14:383
1467099513,35cyclictest20444-21chrt10:50:163
1467099513,35cyclictest20444-21chrt10:50:163
1467099504,34cyclictest9683-21taskset08:30:083
1467099504,30cyclictest901-21kworker/3:1+events08:50:133
1467099503,37cyclictest4928-21taskset08:15:103
1467099503,33cyclictest11546-21chrt12:22:043
1467099503,33cyclictest11546-21chrt12:22:043
1467099503,31cyclictest25103-21chrt09:14:413
1467099502,33cyclictest18471-21chrt09:55:133
1467099494,34cyclictest18617-21chrt07:19:563
1467099493,35cyclictest26283-21taskset09:15:183
1467099493,32cyclictest20902-21taskset09:05:053
1467099493,32cyclictest20902-21taskset09:05:053
1467099493,30cyclictest20367-21taskset09:04:413
1467099493,30cyclictest20367-21taskset09:04:413
1467099492,34cyclictest30207-21taskset10:14:503
1467099492,34cyclictest30207-21taskset10:14:503
1467099492,34cyclictest11372-21chrt09:44:563
1467099483,32cyclictest13862-21chrt08:44:413
14670994824,13cyclictest0-21swapper/311:39:413
14670994824,13cyclictest0-21swapper/311:39:413
1467099474,33cyclictest17621-21chrt08:55:023
1467099473,34cyclictest23961-21chrt07:35:103
1467099473,33cyclictest25222-21chrt10:05:223
1467099464,29cyclictest2770-21taskset08:09:563
1467099464,29cyclictest2770-21taskset08:09:563
1467099462,34cyclictest1811-21chrt12:05:263
1467099462,29cyclictest24147-21chrt11:49:583
1467099454,32cyclictest30006-21taskset07:54:383
1467099453,33cyclictest15946-21taskset07:11:553
1467099452,30cyclictest17743-21chrt10:46:103
14670994324,10cyclictest0-21swapper/308:34:553
1467099383,27cyclictest21426-21taskset07:29:323
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional