You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-05 - 18:50
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Tue May 05, 2026 12:44:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2109124120,12sleep221092-21sh07:01:472
2109124120,12sleep221092-21sh07:01:472
21228991184,37cyclictest17970-21ssh11:32:010
21228991145,36cyclictest2699-21fschecks_count09:12:100
21228991144,35cyclictest28355-21modprobe09:01:470
21228991103,27cyclictest32384-21sort11:01:570
21228991103,27cyclictest32384-21sort11:01:570
212289911032,10cyclictest0-21swapper/010:42:210
212289911031,11cyclictest0-21swapper/010:06:250
212289910947,54cyclictest0-21swapper/011:12:220
212289910947,54cyclictest0-21swapper/011:12:220
21228991094,39cyclictest8442-21apt-get09:21:580
21228991084,35cyclictest774-21latency_hist07:36:490
21228991084,35cyclictest774-21latency_hist07:36:490
212289910745,55cyclictest5044-21idleruntime-cro10:16:470
21228991073,37cyclictest26802-21cat10:52:120
21228991064,31cyclictest11792-21latency_hist11:21:500
212289910632,12cyclictest0-21swapper/008:12:100
212289910537,61cyclictest0-21swapper/010:37:210
212289910537,61cyclictest0-21swapper/010:37:210
21228991052,45cyclictest21845-21ls09:47:110
21228991044,35cyclictest15965-21rm12:22:110
21228991044,32cyclictest25462-21runrttasks10:50:140
21228991043,34cyclictest29765-21find09:02:440
21228991043,33cyclictest18823-21latency_hist08:31:500
21228991033,42cyclictest24410-21cat11:42:140
21228991033,38cyclictest352-21runrttasks12:13:420
21228991033,36cyclictest19878-21grep08:32:240
21228991033,33cyclictest352-21runrttasks07:52:280
21228991024,35cyclictest11085-21grep08:07:080
212289910241,53cyclictest0-21swapper/010:22:190
212289910238,56cyclictest0-21swapper/007:41:500
21228991023,38cyclictest6408-21/usr/sbin/munin12:07:110
212289910233,7cyclictest0-21swapper/011:41:490
212289910233,7cyclictest0-21swapper/011:41:490
21228991023,36cyclictest26955-21fschecks_time07:17:110
21228991023,32cyclictest14181-21latency_hist09:31:490
21228991023,29cyclictest14575-21forks10:32:090
212289910228,13cyclictest0-21swapper/007:22:150
21228991015,40cyclictest28354-21diskmemload09:17:130
21228991014,39cyclictest352-21runrttasks12:01:010
21228991014,35cyclictest29606-21fschecks_count10:57:090
21228991014,34cyclictest12814-21ssh12:17:340
21228991013,42cyclictest5389-21taskset10:17:030
21228991013,36cyclictest21390-21/usr/sbin/munin07:02:250
212289910125,12cyclictest0-21swapper/008:52:180
212289910125,12cyclictest0-21swapper/008:52:180
21228991008,32cyclictest0-21swapper/009:11:330
21228991004,33cyclictest29903-21/usr/sbin/munin11:52:130
21228991004,32cyclictest11314-21/usr/sbin/munin10:27:030
21228991004,28cyclictest32038-21/usr/sbin/munin10:07:090
21228991004,28cyclictest32038-21/usr/sbin/munin10:07:090
212289910035,60cyclictest0-21swapper/007:43:070
21228991003,37cyclictest4163-21find12:02:190
21228991002,37cyclictest20796-21runrttasks12:30:410
21228991002,33cyclictest15749-21sort08:22:040
212289910021,20cyclictest966-1kworker/0:1H+mmc_complete07:31:500
2122899994,27cyclictest12152-21/usr/sbin/munin11:22:080
21228999936,55cyclictest26577-21latency_hist07:16:500
2122899993,39cyclictest16938-21latency09:37:130
2122899993,36cyclictest26923-21/usr/sbin/munin09:57:120
2122899993,35cyclictest22045-21latency_hist08:41:500
2122899992,41cyclictest9642-21grep08:02:130
2124499987,78cyclictest12739-21taskset12:17:093
2124499982,56cyclictest2773-21chrt07:42:023
21238999871,18cyclictest28354-21diskmemload10:17:052
2122899984,33cyclictest24794-21latency_hist07:11:510
2122899984,31cyclictest2910-21/usr/sbin/munin11:07:070
2122899983,39cyclictest14306-21cut08:17:100
2123899973,56cyclictest31762-21apt-get07:32:092
2123899973,56cyclictest31762-21apt-get07:32:092
2122899974,34cyclictest26894-21/usr/sbin/munin11:47:160
2122899974,34cyclictest26894-21/usr/sbin/munin11:47:160
2122899974,34cyclictest25098-21latency_hist08:51:510
2122899973,32cyclictest15978-21grep11:27:220
204432978,59sleep120497-21sed06:57:321
204432978,59sleep120497-21sed06:57:321
2122899963,31cyclictest22322-21grep08:42:080
2122899962,34cyclictest4645-21fschecks_time07:47:120
2122899962,33cyclictest21161-21latency_hist09:46:490
2122899953,33cyclictest26399-21latency_hist09:56:500
2122899952,32cyclictest7799-21fschecks_count07:57:100
2123299943,66cyclictest29211-21ssh09:02:241
2123299942,65cyclictest2974-21ssh10:13:101
2122899944,33cyclictest16388-21latency_hist09:36:510
21238999365,22cyclictest21297-21latency_hist12:31:492
2122899922,36cyclictest15578-21sshd09:35:130
2122899913,26cyclictest21262-21latency_hist07:01:520
2122899913,26cyclictest21262-21latency_hist07:01:520
2123899898,62cyclictest12674-21apt-get12:17:052
21238998868,14cyclictest19567-21kworker/u17:3-ext4-rsv-conversion11:51:502
21238998868,14cyclictest19567-21kworker/u17:3-ext4-rsv-conversion11:51:502
2123899882,64cyclictest28909-21apt-get09:02:032
2123299887,63cyclictest2764-21apt-get07:42:021
21232998866,14cyclictest1-21systemd11:25:121
2123299863,64cyclictest12674-21apt-get12:17:011
21232998216,26cyclictest0-21swapper/110:27:211
21238998111,57cyclictest2265-21apt-get07:42:022
21232998158,15cyclictest21216-21cyclictest10:52:241
21232998023,37cyclictest30646-21grep11:52:201
21238997959,13cyclictest2374-21systemd-journal09:43:132
21238997951,18cyclictest16328-21latency_hist09:36:512
21238997951,18cyclictest16328-21latency_hist09:36:512
21232997953,18cyclictest1-21systemd09:25:121
21232997926,40cyclictest0-21swapper/108:37:021
21232997858,15cyclictest653-21idleruntime-cro07:36:471
21232997858,15cyclictest653-21idleruntime-cro07:36:471
21232997856,14cyclictest32032-21ssh09:07:041
21238997758,13cyclictest528-21ssh11:57:032
21238997757,14cyclictest31498-21latency_hist07:31:512
21232997759,11cyclictest15180-21sshd12:02:121
21238997654,16cyclictest21216-21cyclictest07:47:112
21238997653,15cyclictest6243-21ssh09:17:222
21238997651,19cyclictest11239-21sh09:26:492
21238997649,19cyclictest15941-21unixbench_multi11:27:222
21232997661,11cyclictest21216-21cyclictest09:27:261
21238997551,17cyclictest2539-21apt-key07:41:512
21238997550,13cyclictest0-21swapper/208:46:512
21238997547,17cyclictest0-21swapper/207:07:112
21238997544,8cyclictest181rcu_preempt10:37:022
21238997544,8cyclictest181rcu_preempt10:37:022
21238997533,31cyclictest12181-21cron08:11:472
21232997558,11cyclictest352-21runrttasks07:37:231
21232997557,12cyclictest31714-21df_inode10:07:021
21232997557,12cyclictest31714-21df_inode10:07:021
21238997414,38cyclictest29212-21latency_hist10:01:502
2124499734,57cyclictest11348-21chrt10:26:593
21238997353,10cyclictest0-21swapper/209:47:152
21238997351,16cyclictest32515-21timerwakeupswit10:07:192
21238997351,16cyclictest32515-21timerwakeupswit10:07:192
21238997351,15cyclictest21158-21fschecks_count11:37:082
21238997351,15cyclictest21158-21fschecks_count11:37:082
21232997329,38cyclictest0-21swapper/107:57:041
21238997243,18cyclictest0-21swapper/212:07:122
21232997257,9cyclictest170-21jbd2/mmcblk2p2-809:57:011
21232997255,11cyclictest24651-21ssh11:42:211
21232997253,13cyclictest3185-21fschecks_count11:07:071
21232997250,16cyclictest17741-21sh12:25:271
2123899719,47cyclictest352-21runrttasks10:13:142
21238997148,17cyclictest21216-21cyclictest09:10:232
21238997148,14cyclictest15130-21sshd08:18:132
21238997148,14cyclictest0-21swapper/208:22:102
21238997142,20cyclictest352-21runrttasks11:11:172
21232997151,11cyclictest0-21swapper/110:05:131
21232997149,16cyclictest19152-21idleruntime-cro09:41:471
21238997053,11cyclictest18653-21systemctl08:31:472
21232997036,23cyclictest26915-21apt-get11:46:591
21232997036,23cyclictest26915-21apt-get11:46:591
21232997035,22cyclictest0-21swapper/108:26:501
21232997026,31cyclictest19005-21cat08:32:051
21232997018,40cyclictest5932-21ssh10:17:161
2124499693,52cyclictest6509-21taskset11:12:133
2124499693,52cyclictest6509-21taskset11:12:133
2124499693,52cyclictest21192-21chrt12:31:463
21238996952,12cyclictest5299-21latency_hist09:16:502
21238996951,13cyclictest21464-21vmstat10:42:262
21238996928,29cyclictest26936-21cat08:56:502
21238996928,29cyclictest26936-21cat08:56:502
21238996917,11cyclictest28354-21diskmemload10:52:372
21232996955,10cyclictest27886-21kworker/u17:3-rpciod10:22:151
21232996949,14cyclictest17383-21cpu10:37:021
21232996949,14cyclictest17383-21cpu10:37:021
21232996948,15cyclictest21216-21cyclictest11:06:481
21232996948,15cyclictest21216-21cyclictest11:06:481
21232996939,20cyclictest352-21runrttasks07:02:101
21232996930,31cyclictest0-21swapper/108:16:591
2124499683,50cyclictest29516-21taskset10:01:593
2124499682,52cyclictest9375-21chrt08:02:063
21238996853,8cyclictest0-21swapper/211:42:042
21238996847,11cyclictest0-21swapper/212:06:462
2123899683,43cyclictest26962-21fschecks_time07:17:112
21232996850,14cyclictest2108-21kworker/u17:2+events_unbound07:51:471
21232996827,35cyclictest0-21swapper/108:27:011
2124499673,52cyclictest26967-21taskset07:17:123
2124499673,49cyclictest32147-21chrt07:32:473
2124499673,49cyclictest32147-21chrt07:32:473
21244996728,29cyclictest0-21swapper/309:02:243
2124499672,53cyclictest7345-21taskset10:19:543
2124499672,51cyclictest15575-21taskset10:32:433
2124499672,50cyclictest12008-21taskset08:09:433
2124499672,49cyclictest19987-21taskset08:33:193
21244996718,38cyclictest0-21swapper/310:13:143
21238996753,9cyclictest21216-21cyclictest07:52:232
21238996749,10cyclictest0-21swapper/210:24:122
21238996746,11cyclictest0-21swapper/210:32:212
21238996746,10cyclictest0-21swapper/207:22:232
2123299679,25cyclictest0-21swapper/109:54:181
21232996746,13cyclictest0-21swapper/108:51:511
21232996745,12cyclictest0-21swapper/111:37:031
21232996745,12cyclictest0-21swapper/111:37:031
21232996744,15cyclictest2374-21systemd-journal10:45:131
2123299673,46cyclictest352-21runrttasks09:45:191
21232996722,17cyclictest15710-21sh10:33:061
22392660,7sleep30-21swapper/311:05:453
22392660,7sleep30-21swapper/311:05:453
2124499663,50cyclictest18993-21chrt10:38:543
2124499663,50cyclictest18993-21chrt10:38:543
2124499663,50cyclictest11521-21taskset12:15:063
2124499662,51cyclictest20721-21taskset10:42:113
21238996651,9cyclictest23460-21sh10:47:042
21238996646,14cyclictest19676-21snmpd08:51:102
21238996643,15cyclictest0-21swapper/211:32:232
2123899663,46cyclictest6084-21cstates11:12:032
2123899663,46cyclictest6084-21cstates11:12:032
2123899663,43cyclictest32373-21/usr/sbin/munin11:02:112
2123899663,43cyclictest32373-21/usr/sbin/munin11:02:112
2123899663,43cyclictest32084-21munin-run11:01:472
21238996626,26cyclictest30580-21awk11:52:192
21232996648,14cyclictest2-21kthreadd09:16:491
21232996648,13cyclictest352-21runrttasks07:07:141
21232996626,34cyclictest3199-21latency_hist12:01:491
2123299662,47cyclictest16841-21runrttasks11:29:411
2124499653,50cyclictest31276-21chrt10:59:413
2124499653,49cyclictest21742-21chrt08:40:123
2124499653,48cyclictest25632-21chrt11:44:063
2124499652,50cyclictest29220-21taskset11:50:473
2124499652,50cyclictest29220-21taskset11:50:473
2124499652,49cyclictest28176-21taskset10:54:223
21238996549,10cyclictest12692-21mailstats11:22:212
21238996545,15cyclictest21216-21cyclictest12:12:052
21238996539,14cyclictest0-21swapper/207:06:492
21238996538,17cyclictest0-21swapper/208:06:502
2123899653,43cyclictest11523-21cpuspeed09:27:052
2123899653,42cyclictest26395-21latency_hist09:56:502
21238996519,33cyclictest10646-21seq11:19:032
21232996536,22cyclictest0-21swapper/111:12:071
21232996536,22cyclictest0-21swapper/111:12:071
2123299653,44cyclictest352-21runrttasks08:07:331
21232996527,29cyclictest19149-21ssh12:27:161
21232996527,29cyclictest13832-21idleruntime-cro08:16:471
21232996523,31cyclictest26919-21latency_hist08:56:501
21232996523,31cyclictest26919-21latency_hist08:56:501
21232996519,37cyclictest22506-21grep09:47:251
2124499643,48cyclictest21806-21chrt11:37:223
2124499643,48cyclictest21806-21chrt11:37:223
2124499642,50cyclictest14946-21chrt11:27:003
2124499642,49cyclictest8473-21chrt12:10:003
2124499642,49cyclictest18598-21taskset08:31:333
21238996448,9cyclictest0-21swapper/210:27:212
21238996446,9cyclictest0-21swapper/209:01:512
21232996444,11cyclictest0-21swapper/108:42:231
21232996434,19cyclictest23341-21apt-get10:46:581
21232996430,23cyclictest8962-21apt-get11:16:591
21232996422,34cyclictest0-21swapper/107:17:051
2124499633,47cyclictest31531-21chrt11:53:473
2124499633,47cyclictest16701-21chrt08:22:433
2124499632,49cyclictest28434-21taskset07:22:063
2124499632,48cyclictest5671-21taskset07:51:253
2124499632,48cyclictest11956-21chrt09:27:153
2124499632,48cyclictest10805-21taskset09:25:573
2124499632,47cyclictest9852-21taskset10:23:313
2124499632,47cyclictest2114-21chrt07:40:043
21238996350,9cyclictest21216-21cyclictest08:32:052
2123899633,48cyclictest16465-21ssh09:36:582
2123899633,41cyclictest12652-21fschecks_count08:12:092
2123899632,44cyclictest21487-21head08:37:222
21232996341,12cyclictest0-21swapper/112:11:471
21232996331,24cyclictest30550-21run-parts07:27:201
21232996329,27cyclictest6209-21fschecks_count07:52:091
21232996328,29cyclictest0-21swapper/108:57:031
2123299632,46cyclictest20841-21sh11:36:501
2124499623,47cyclictest24149-21taskset10:47:213
2124499623,47cyclictest22063-21chrt09:47:163
2124499623,47cyclictest19579-21chrt11:33:533
2124499623,46cyclictest5223-21chrt12:04:163
2124499623,46cyclictest15366-21taskset08:21:173
2124499622,48cyclictest8656-21chrt07:58:013
2124499622,48cyclictest19700-21taskset09:42:423
2124499622,47cyclictest28911-21chrt10:00:583
2124499622,47cyclictest25398-21chrt08:52:023
2124499622,47cyclictest25398-21chrt08:52:023
2124499622,47cyclictest13654-21taskset08:14:533
21238996242,10cyclictest0-21swapper/212:22:032
2123299623,42cyclictest9211-21/usr/sbin/munin08:02:201
21232996229,25cyclictest7989-21ssh09:21:261
21232996227,10cyclictest181rcu_preempt12:14:591
2124499613,46cyclictest32157-21chrt10:07:143
2124499613,46cyclictest32157-21chrt10:07:143
2124499613,46cyclictest25346-21chrt09:54:213
2124499613,45cyclictest11359-21chrt11:21:053
2124499613,44cyclictest7245-21chrt07:55:343
2124499612,47cyclictest28266-21chrt09:01:003
2124499612,47cyclictest17508-21taskset09:37:243
2124499612,46cyclictest24286-21taskset08:47:163
2124499612,46cyclictest22506-21chrt07:03:513
2124499612,46cyclictest17977-21chrt12:26:073
2124499612,45cyclictest2829-21chrt12:00:563
2124499612,45cyclictest24449-21chrt07:07:403
21238996143,13cyclictest25979-21unixbench_multi07:12:242
21232996127,23cyclictest16375-21ssh09:36:511
21232996127,23cyclictest16375-21ssh09:36:511
21232996126,30cyclictest0-21swapper/107:22:001
21232996126,25cyclictest26544-21latency_hist07:16:501
21232996124,28cyclictest29363-21apt-get10:56:591
2124499603,46cyclictest4628-21chrt11:09:013
2124499603,45cyclictest13545-21chrt11:23:483
2124499602,45cyclictest31140-21taskset07:30:483
2124499602,45cyclictest23204-21chrt08:43:153
2124499602,44cyclictest5590-21chrt09:17:063
2124499602,44cyclictest25088-21chrt07:12:013
21238996038,15cyclictest21216-21cyclictest07:57:062
2124499592,44cyclictest617-21taskset09:07:373
2124499592,44cyclictest14751-21chrt09:32:543
2124499592,44cyclictest14751-21chrt09:32:543
21238995840,13cyclictest28354-21diskmemload10:03:152
2124499563,41cyclictest21371-21chrt07:01:533
2124499562,42cyclictest5200-21chrt09:16:493
1991325110,24sleep30-21swapper/306:57:133
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional