You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-15 - 16:23
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Tue Sep 15, 2026 12:44:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1756221610,21sleep30-21swapper/307:04:563
16683215212,95sleep016653-21/usr/sbin/munin07:04:290
17676212810,92sleep20-21swapper/207:05:002
183099911038,12cyclictest0-21swapper/210:34:332
183099910940,14cyclictest0-21swapper/212:04:262
183099910940,14cyclictest0-21swapper/212:04:262
182999910577,21cyclictest11147-21sh12:19:391
182999910577,21cyclictest11147-21sh12:19:391
182999910482,15cyclictest18260-21cyclictest09:54:131
18299991043,59cyclictest18011-21apt-get07:09:261
182999910345,8cyclictest0-21swapper/109:39:431
182999910345,8cyclictest0-21swapper/109:39:431
182999910339,23cyclictest4270-21cron12:09:091
182999910339,23cyclictest4270-21cron12:09:091
182849910383,13cyclictest317-21dbus-daemon10:29:110
18299999931,12cyclictest0-21swapper/107:59:451
1828499993,66cyclictest6357-21kworker/u17:3+rpciod11:29:280
1829999983,39cyclictest13576-21ssh12:24:201
1830999974,67cyclictest18283-21apt-get10:45:112
18299999736,9cyclictest0-21swapper/107:19:461
18299999638,8cyclictest0-21swapper/109:09:131
18299999632,13cyclictest0-21swapper/107:59:131
18299999632,12cyclictest0-21swapper/112:14:451
18299999542,43cyclictest0-21swapper/109:59:451
18299999542,43cyclictest0-21swapper/109:59:451
18299999535,11cyclictest0-21swapper/109:29:471
18299999532,9cyclictest0-21swapper/107:09:161
18299999435,51cyclictest0-21swapper/108:09:481
18299999434,9cyclictest0-21swapper/112:09:311
18299999431,11cyclictest0-21swapper/111:54:261
1829999942,46cyclictest13887-21apt-get09:44:251
1829999942,46cyclictest13887-21apt-get09:44:251
1829999942,34cyclictest2932-21latency_hist10:19:131
18299999341,11cyclictest0-21swapper/111:39:371
18299999334,16cyclictest9491-21sh10:29:351
18299999334,16cyclictest9491-21sh10:29:351
1829999933,37cyclictest8286-21threads08:14:451
18299999326,14cyclictest0-21swapper/110:57:411
18299999326,14cyclictest0-21swapper/110:57:411
18299999265,19cyclictest12708-21apt-key11:29:141
1829999924,33cyclictest18077-21latency_hist10:44:141
18299999236,9cyclictest0-21swapper/107:14:371
18299999233,13cyclictest0-21swapper/110:24:361
18284999269,17cyclictest5780-21latency_hist08:09:130
18309999139,10cyclictest0-21swapper/208:29:092
18299999138,16cyclictest29528-21sh10:09:281
1828499913,78cyclictest17533-21apt-get09:49:250
18309999044,19cyclictest11571-21ssh09:39:332
18309999044,19cyclictest11571-21ssh09:39:332
1829999904,29cyclictest6528-21latency_hist11:19:121
1829999904,29cyclictest6528-21latency_hist11:19:121
18299999037,15cyclictest18260-21cyclictest11:31:271
18299999035,12cyclictest7243-21latency11:19:361
1829999903,38cyclictest20805-21kernelversion08:54:371
1829999903,35cyclictest9384-21fschecks_count08:19:341
1829999903,34cyclictest31465-21grep11:05:171
1829999903,31cyclictest16889-21timerwakeupswit11:34:471
18299999028,12cyclictest0-21swapper/109:19:331
18309998956,9cyclictest181rcu_preempt07:44:232
18309998956,9cyclictest181rcu_preempt07:44:232
1829999893,37cyclictest1534-21sendmail_mailtr11:09:461
1829999893,36cyclictest25700-21fschecks_time07:29:311
1829999893,32cyclictest22315-21fschecks_time08:59:321
1829999893,32cyclictest21170-21cat10:49:131
18284998964,19cyclictest19617-21sh12:34:270
1829999885,28cyclictest12340-21fschecks_time10:34:331
1829999884,32cyclictest19290-21needreboot08:49:371
1829999883,34cyclictest18592-21idleruntime-cro08:49:091
18299998826,14cyclictest0-21swapper/107:49:441
18299998826,14cyclictest0-21swapper/107:49:441
1829999882,36cyclictest28586-21latency_hist07:39:131
1829999873,38cyclictest343-21runrttasks09:09:391
1829999873,38cyclictest343-21runrttasks09:09:391
1829999873,30cyclictest1364-21latency_hist12:04:111
18284998765,16cyclictest7920-21sh12:14:330
1829999864,35cyclictest28123-21ssh10:06:381
1829999864,30cyclictest343-21runrttasks12:33:321
1829999864,30cyclictest24084-21latency_hist10:54:121
1829999863,47cyclictest28854-21sh09:15:041
1829999863,47cyclictest28854-21sh09:15:041
1829999863,37cyclictest28943-21tune2fs07:39:321
1829999863,35cyclictest30878-21sshd07:44:401
1829999863,35cyclictest30878-21sshd07:44:401
1829999863,32cyclictest20406-21/usr/sbin/munin09:54:441
1829999863,32cyclictest19522-21/usr/sbin/munin12:34:441
1829999863,32cyclictest15044-21sshd08:35:401
1829999863,31cyclictest22365-21fschecks_count11:44:331
18284998663,11cyclictest0-21swapper/011:59:090
1828499864,62cyclictest11845-21latency_hist10:34:120
1828499864,62cyclictest11845-21latency_hist10:34:120
18309998557,18cyclictest4495-21fschecks_count08:04:322
18299998548,11cyclictest181rcu_preempt09:28:431
1829999853,35cyclictest12374-21find08:29:221
18299998515,29cyclictest4719-21latency08:04:361
18309998455,19cyclictest21957-21sh11:44:122
1829999842,33cyclictest25093-21/usr/sbin/munin11:49:511
18284998410,34cyclictest27145-21awk10:04:430
1829999833,34cyclictest24769-21unixbench_multi07:24:461
1829999833,33cyclictest30559-21fschecks_count11:05:011
1829999833,32cyclictest3117-21/usr/sbin/munin10:19:581
18299998259,17cyclictest11072-21latency_hist09:39:131
18284998116,21cyclictest4213-21chrt08:04:130
1828499809,47cyclictest24817-21systemd-run11:49:110
1828499809,24cyclictest8077-21ssh09:34:130
18284998061,13cyclictest12999-21kworker/u17:2+xprtiod11:14:130
18284998051,22cyclictest18588-21latency_hist11:39:140
18284998049,22cyclictest10959-21seq11:25:050
1828499802,53cyclictest14419-21apt-get09:44:260
1828499802,53cyclictest14419-21apt-get09:44:260
18309997961,10cyclictest7835-21idleruntime08:14:342
18309997951,19cyclictest3010-21latency_hist10:19:142
18309997941,8cyclictest0-21swapper/209:04:122
18284997955,16cyclictest1849-21fschecks_count12:04:320
18284997955,16cyclictest1849-21fschecks_count12:04:320
1828499792,39cyclictest11989-21switchtime09:39:440
1828499792,39cyclictest11989-21switchtime09:39:440
20472780,15sleep0211rcuc/009:24:130
18309997843,7cyclictest0-21swapper/207:14:492
1828499789,37cyclictest25437-21/usr/sbin/munin07:29:490
18284997864,9cyclictest22265-21ssh10:49:470
18284997853,16cyclictest0-21swapper/010:39:350
1828499785,23cyclictest0-21swapper/008:39:460
1828499785,23cyclictest0-21swapper/008:39:460
1828499784,36cyclictest24635-21if_eth010:54:350
1828499784,36cyclictest24635-21if_eth010:54:350
18284997820,23cyclictest13328-21grep08:29:490
18284997817,11cyclictest12119-21latency_hist08:29:130
18309997760,10cyclictest13242-21entropy11:29:472
18284997759,11cyclictest9394-21fschecks_time08:19:350
18284997754,16cyclictest12294-21ssh10:34:320
18284997753,15cyclictest2389-21ssh09:24:310
18284997752,15cyclictest19979-21ssh10:46:270
18284997724,48cyclictest0-21swapper/011:14:230
18284997724,48cyclictest0-21swapper/011:14:230
18309997662,10cyclictest5990-21kworker/u18:1-rpciod12:34:432
18309997658,11cyclictest2942-21ssh11:12:492
1830999764,53cyclictest28825-21ssh09:15:002
1830999764,53cyclictest28825-21ssh09:15:002
18309997644,8cyclictest39-21ksoftirqd/210:12:182
18309997640,11cyclictest11694-21kworker/u17:3-ext4-rsv-conversion11:09:132
1830999763,55cyclictest25051-21diskmemload10:19:332
1828499767,25cyclictest8850-21ps09:34:430
18284997660,10cyclictest31359-21fschecks_time11:59:320
18284997654,14cyclictest18260-21cyclictest10:03:470
18284997654,14cyclictest18260-21cyclictest10:03:470
18284997652,16cyclictest25051-21diskmemload12:24:300
1828499762,49cyclictest20460-21sort07:14:220
1828499762,41cyclictest429-21modprobe11:09:090
18309997552,15cyclictest30476-21fschecks_count11:05:002
18284997544,23cyclictest19286-21kworker/u17:3+nfsiod11:43:280
18284997525,37cyclictest32334-21ssh10:14:220
18284997525,36cyclictest20071-21cat07:14:130
18309997455,13cyclictest11916-21sshd11:27:492
18309997445,20cyclictest21978-21sendmail_mailqu10:49:432
1828499743,52cyclictest3265-21ssh10:19:430
1828499742,55cyclictest1731-21systemctl07:54:460
18284997417,18cyclictest17213-21awk12:29:450
18284997416,21cyclictest27255-21apt-get10:59:220
18284997354,10cyclictest7547-21rm11:19:440
18284997322,37cyclictest9106-21cat08:19:130
18316997213,47cyclictest0-21swapper/309:44:273
18316997213,47cyclictest0-21swapper/309:44:273
18309997255,10cyclictest26801-21munin-plugin-st07:34:102
18309997249,15cyclictest26184-21latency_hist10:04:122
18309997249,15cyclictest26184-21latency_hist10:04:122
1828499723,34cyclictest31221-21grep07:44:440
1828499723,34cyclictest31221-21grep07:44:440
1828499723,34cyclictest28053-21apt-get09:14:220
1828499723,34cyclictest28053-21apt-get09:14:220
18284997218,18cyclictest29070-21cut07:39:360
18284997217,20cyclictest29463-21cstates10:09:250
1830999714,49cyclictest343-21runrttasks09:39:012
18309997124,35cyclictest7378-21latency_hist12:14:112
1829999712,31cyclictest11718-21unixbench_singl08:24:471
1828499718,29cyclictest14750-21grep08:34:470
1828499714,20cyclictest26204-21grep11:49:500
1828499713,40cyclictest7476-21runrttasks12:14:120
18284997124,11cyclictest0-21swapper/009:59:130
18284997118,15cyclictest22475-21fschecks_time07:19:330
18316997012,32cyclictest0-21swapper/310:44:293
18309997043,19cyclictest14863-21sh12:25:182
18309997040,17cyclictest23796-21kworker/u17:2-writeback09:19:352
1830999703,46cyclictest11920-21latency_hist10:34:132
1830999703,46cyclictest11920-21latency_hist10:34:132
1830999703,41cyclictest28343-21latency_hist09:14:142
1830999703,41cyclictest28343-21latency_hist09:14:142
18309996955,10cyclictest18260-21cyclictest10:07:042
18309996947,17cyclictest18736-21apt-key11:39:132
18309996947,16cyclictest18653-21unixbench_singl09:50:102
1830999694,51cyclictest28087-21ssh11:54:222
18309996926,13cyclictest181rcu_preempt07:24:372
18299996929,28cyclictest16414-21cat08:39:461
18299996929,28cyclictest16414-21cat08:39:461
18284996940,20cyclictest23414-21modprobe09:04:090
1828499693,35cyclictest20778-21if_eth008:54:350
18309996853,10cyclictest5990-21kworker/u18:1-rpciod10:27:132
18309996847,15cyclictest22127-21apt11:44:222
1830999684,43cyclictest343-21runrttasks10:54:202
1830999684,43cyclictest343-21runrttasks10:54:202
18309996840,22cyclictest1248-21fschecks_count07:54:342
1830999681,27cyclictest13318-21unixbench_singl08:29:492
1828499683,30cyclictest7264-21apt08:14:100
1828499682,32cyclictest25625-21fschecks_count09:09:330
1828499682,32cyclictest25625-21fschecks_count09:09:330
18309996744,13cyclictest0-21swapper/209:29:392
18309996742,15cyclictest3788-21/usr/sbin/munin11:14:262
18309996742,15cyclictest3788-21/usr/sbin/munin11:14:262
1828499675,41cyclictest19812-21unixbench_singl08:49:470
1828499674,42cyclictest343-21runrttasks12:20:510
1828499674,42cyclictest343-21runrttasks12:20:510
1828499672,33cyclictest31887-21/usr/sbin/munin07:49:330
1828499672,33cyclictest31887-21/usr/sbin/munin07:49:330
41222660,3sleep30-21swapper/312:08:443
41222660,3sleep30-21swapper/312:08:443
18309996651,9cyclictest25058-21awk09:09:102
18309996645,14cyclictest14587-21ssh09:45:052
18309996645,14cyclictest14587-21ssh09:45:052
18309996642,11cyclictest0-21swapper/208:39:462
18309996642,11cyclictest0-21swapper/208:39:462
1830999663,32cyclictest10749-21expr12:19:272
1830999663,32cyclictest10749-21expr12:19:272
18284996627,31cyclictest27772-21switchtime07:34:450
1828499662,28cyclictest18088-21sort08:44:450
1830999653,41cyclictest27245-21fschecks_count07:34:332
1830999653,39cyclictest32139-21fschecks_time07:49:322
1830999653,39cyclictest32139-21fschecks_time07:49:322
1830999652,47cyclictest18124-21latency_hist10:44:142
230622640,6sleep30-21swapper/308:59:483
1831699645,47cyclictest0-21swapper/307:09:343
18309996445,13cyclictest2164-21acpi09:24:202
1830999642,40cyclictest343-21runrttasks07:21:042
1830999637,23cyclictest19034-21fschecks_count08:49:322
18309996348,10cyclictest18260-21cyclictest12:14:382
1830999634,32cyclictest19429-21latency_hist12:34:132
18309996341,12cyclictest0-21swapper/211:59:422
18309996340,12cyclictest0-21swapper/211:19:462
18309996336,14cyclictest0-21swapper/207:44:122
1830999633,43cyclictest14205-21fschecks_count08:34:342
18309996323,30cyclictest25392-21grep11:49:342
1828499633,43cyclictest25287-21latency_hist07:29:120
18284996317,13cyclictest25108-21latency_hist09:09:120
18316996211,38cyclictest0-21swapper/309:14:533
18316996211,38cyclictest0-21swapper/309:14:533
18309996235,18cyclictest9156-21/usr/sbin/munin08:19:342
1830999623,32cyclictest4165-21latency_hist08:04:132
1831699613,42cyclictest32238-21taskset07:49:343
1831699613,42cyclictest32238-21taskset07:49:343
1831699613,30cyclictest0-21swapper/311:29:283
18309996132,21cyclictest20540-21sort09:54:292
1831699605,38cyclictest24700-21chrt10:54:363
1831699605,38cyclictest24700-21chrt10:54:363
18309996043,11cyclictest200-21systemd-journal07:13:292
1831699594,37cyclictest24050-21chrt07:24:313
1830999592,37cyclictest21069-21grep08:54:442
1831699584,38cyclictest14152-21taskset12:24:373
1831699582,38cyclictest19790-21taskset11:39:503
18309995843,9cyclictest6405-21ntp_kernel_err08:09:372
1831699574,36cyclictest10613-21taskset12:19:223
1831699574,36cyclictest10613-21taskset12:19:223
1831699573,41cyclictest23128-21chrt11:44:493
1830999572,29cyclictest18060-21timerwakeupswit08:44:452
1831699564,36cyclictest22137-21taskset07:19:133
1831699563,39cyclictest1964-21chrt07:54:493
1831699563,39cyclictest11487-21chrt09:39:313
1831699563,39cyclictest11487-21chrt09:39:313
1831699563,36cyclictest17766-21chrt10:44:103
1831699563,35cyclictest5474-21chrt12:09:503
1831699563,35cyclictest28641-21chrt10:08:073
1831699562,39cyclictest18897-21chrt11:39:133
18316995615,28cyclictest10845-21taskset11:24:483
1831699553,36cyclictest29547-21chrt07:39:463
1831699552,39cyclictest8974-21chrt09:34:453
1831699543,38cyclictest30445-21chrt11:58:223
1831699543,37cyclictest32679-21chrt09:19:463
1831699543,36cyclictest32294-21chrt10:14:193
1831699543,35cyclictest27811-21taskset10:59:393
1831699542,37cyclictest6434-21taskset10:24:333
1831699542,35cyclictest7767-21chrt12:14:283
18316995423,20cyclictest3277-21chrt07:59:433
18316995418,25cyclictest23698-21chrt09:04:223
18316995418,22cyclictest17236-21chrt08:44:253
18316995415,26cyclictest16525-21taskset12:29:193
1831699534,36cyclictest31865-21chrt11:59:443
1831699533,37cyclictest27936-21chrt09:13:543
1831699533,37cyclictest27936-21chrt09:13:543
1831699533,35cyclictest20381-21taskset08:54:133
1831699532,35cyclictest26847-21chrt11:51:373
1831699532,34cyclictest12838-21taskset08:29:393
1831699532,33cyclictest27076-21chrt07:34:273
18316995317,24cyclictest31500-21taskset07:47:363
18316995317,24cyclictest31500-21taskset07:47:363
1831699524,36cyclictest2353-21taskset09:24:283
1831699522,32cyclictest22790-21chrt09:58:263
18316995216,23cyclictest12074-21chrt10:34:223
18316995214,23cyclictest14095-21taskset08:34:293
1831699515,35cyclictest10645-21taskset10:31:053
1831699515,35cyclictest10645-21taskset10:31:053
1831699514,36cyclictest30922-21taskset11:05:063
1831699513,35cyclictest24057-21chrt10:54:123
1831699513,35cyclictest23497-21chrt09:59:273
1831699513,35cyclictest23497-21chrt09:59:273
1831699512,35cyclictest17779-21chrt09:49:503
18316995118,21cyclictest21697-21chrt12:37:473
18316995117,21cyclictest7674-21chrt08:14:293
18316995117,18cyclictest7290-21taskset11:19:373
18316995114,24cyclictest26575-21taskset07:31:323
1831699504,33cyclictest10920-21chrt08:24:293
1831699502,36cyclictest4644-21chrt10:20:563
18316995016,22cyclictest2863-21chrt11:12:363
18316995013,25cyclictest31040-21taskset10:11:273
18316995013,22cyclictest4879-21chrt11:14:513
18316995013,22cyclictest4879-21chrt11:14:513
1831699493,35cyclictest21169-21chrt08:54:463
1831699492,34cyclictest5227-21chrt09:29:273
1831699492,31cyclictest4546-21chrt08:04:323
1831699483,27cyclictest10652-21chrt08:24:123
18316994816,19cyclictest15694-21chrt08:39:273
18316994816,19cyclictest15694-21chrt08:39:273
18316994618,19cyclictest60852sleep308:09:313
18316994415,19cyclictest23286-21chrt07:20:303
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional