You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-17 - 12:07
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Fri Jul 17, 2026 00:44:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
29339213913,89sleep029386-21wc18:52:360
2355021260,7sleep10-21swapper/100:08:011
301159911356,50cyclictest0-21swapper/021:46:540
301289910965,37cyclictest0-21swapper/219:01:552
301159910943,59cyclictest25719-21grep23:17:290
301159910943,59cyclictest25719-21grep23:17:290
30115991092,30cyclictest4702-21kernelversion23:37:180
30115991084,47cyclictest10252-21/usr/sbin/munin23:47:210
301159910746,53cyclictest0-21swapper/020:41:520
30115991073,27cyclictest18366-21latency_hist23:06:560
30115991053,41cyclictest20825-21sh00:03:510
30115991053,41cyclictest20825-21sh00:03:510
301159910430,9cyclictest0-21swapper/023:22:470
301159910429,12cyclictest0-21swapper/021:26:560
301159910344,52cyclictest0-21swapper/000:17:190
30115991034,32cyclictest10792-21latency_hist21:06:550
30115991033,33cyclictest11450-21fschecks_time19:37:140
301159910321,22cyclictest4011-21/usr/sbin/munin19:12:270
301159910321,22cyclictest4011-21/usr/sbin/munin19:12:270
301289910282,14cyclictest6110-21sh21:52:172
301289910264,32cyclictest0-21swapper/220:37:142
30123991028,66cyclictest25472-21apt-get00:12:101
30115991022,34cyclictest27458-21fschecks_time22:27:550
30115991014,39cyclictest17580-21grep19:56:550
30115991014,28cyclictest31922-21switchtime19:01:580
301159910141,56cyclictest30106-21cyclictest23:27:260
301159910141,56cyclictest30106-21cyclictest23:27:260
30115991013,41cyclictest6959-21sendmail_mailqu19:22:240
30115991013,37cyclictest17105-21/usr/sbin/munin21:17:430
30115991013,33cyclictest8083-21switchtime23:42:270
30115991013,33cyclictest8083-21switchtime23:42:270
301159910127,12cyclictest0-21swapper/022:41:550
30115991004,45cyclictest29205-21latency_hist20:31:540
30115991003,35cyclictest9209-21ssh22:51:250
30115991003,30cyclictest24431-21unin-run23:16:530
301159910030,8cyclictest0-21swapper/019:47:280
301159910030,11cyclictest0-21swapper/023:06:210
301159910029,11cyclictest0-21swapper/020:47:150
301159910022,13cyclictest0-21swapper/019:32:170
301159910021,73cyclictest6471-21mailstats21:52:270
3011599995,23cyclictest13997-21sendmail_mailst23:52:290
3011599994,35cyclictest26369-21latency_hist22:26:560
3011599994,35cyclictest26369-21latency_hist22:26:560
3011599994,32cyclictest3646-21fschecks_count20:52:140
3011599993,36cyclictest20938-21fschecks_count22:17:130
3011599993,35cyclictest4719-21unixbench_multi22:42:300
3011599993,35cyclictest4719-21unixbench_multi22:42:300
3011599993,35cyclictest28243-21latency_hist00:16:540
3011599993,35cyclictest21374-21cron23:11:510
3011599993,33cyclictest16216-21/usr/sbin/munin23:57:280
3011599993,22cyclictest27185-21unixbench_multi21:32:310
3011599993,22cyclictest27185-21unixbench_multi21:32:310
30115999923,21cyclictest9723-21sh22:52:080
3011599983,37cyclictest20874-21sendmail20:06:520
3011599983,35cyclictest5401-21fschecks_time20:57:120
3011599983,35cyclictest5401-21fschecks_time20:57:120
3011599983,32cyclictest30534-21fschecks_count22:32:390
3011599983,32cyclictest30534-21fschecks_count22:32:390
3011599983,29cyclictest25220-21dpkg00:11:550
3011599983,29cyclictest2091-21/usr/sbin/munin23:32:270
30115999831,8cyclictest0-21swapper/019:17:080
3012399973,70cyclictest30173-21apt-get22:32:121
3012399973,70cyclictest30173-21apt-get22:32:121
30115999737,53cyclictest0-21swapper/020:32:270
3011599973,31cyclictest4585-21taskset21:49:400
30115999731,11cyclictest0-21swapper/022:12:100
30115999731,10cyclictest0-21swapper/022:11:550
30115999731,10cyclictest0-21swapper/022:11:550
30115999730,8cyclictest0-21swapper/020:12:210
3011599972,31cyclictest29447-21fschecks_time21:37:140
2881029712,57sleep228846-21/usr/sbin/munin18:52:172
118882970,8sleep10-21swapper/123:48:561
30128999675,15cyclictest6151-21sh22:46:202
30128999675,15cyclictest6151-21sh22:46:202
30128999641,46cyclictest0-21swapper/220:12:292
3011599964,37cyclictest26325-21cstates20:22:340
3011599964,33cyclictest30282-21/usr/sbin/munin18:57:280
3011599964,32cyclictest32630-21/usr/sbin/munin20:42:200
3011599964,32cyclictest32630-21/usr/sbin/munin20:42:200
30115999636,11cyclictest4794-21diskmemload22:57:030
3011599963,32cyclictest21335-21fschecks_count20:07:140
3011599963,32cyclictest11712-21ntp_kernel_pll_21:07:210
3011599963,32cyclictest11712-21ntp_kernel_pll_21:07:210
30115999631,10cyclictest14841-21sendmail_mailqu21:12:250
30128999543,45cyclictest0-21swapper/220:21:552
30128999539,51cyclictest0-21swapper/219:52:162
3011599954,37cyclictest1501-21/usr/sbin/munin19:07:220
3011599954,37cyclictest1501-21/usr/sbin/munin19:07:220
30128999445,42cyclictest6687-21kernelversion19:22:162
30128999441,45cyclictest0-21swapper/222:07:162
30128999441,45cyclictest0-21swapper/222:07:162
3012899942,39cyclictest32589-21fschecks_time19:02:172
3011599945,33cyclictest24981-21mailstats20:17:260
3011599945,26cyclictest23124-21/usr/sbin/munin21:27:220
3011599944,36cyclictest19328-21latency_hist20:01:560
3011599944,36cyclictest19328-21latency_hist20:01:560
3011599944,33cyclictest12773-21/usr/sbin/munin19:42:150
3011599944,33cyclictest12773-21/usr/sbin/munin19:42:150
3011599943,35cyclictest8171-21fschecks_count19:27:130
3011599943,32cyclictest8883-21/usr/sbin/munin21:57:110
3011599943,32cyclictest8883-21/usr/sbin/munin21:57:110
30128999344,41cyclictest0-21swapper/221:01:562
30128999344,41cyclictest0-21swapper/221:01:562
3011599932,23cyclictest317-21ssh00:23:070
30128999236,47cyclictest0-21swapper/221:42:162
30123999265,19cyclictest544-21cron22:56:521
30115999237,8cyclictest11700-21ssh22:02:050
2996729212,48sleep130003-21munin-run18:56:531
30128999146,38cyclictest0-21swapper/223:12:212
30128999141,42cyclictest19096-21apt-key20:01:542
30128999141,42cyclictest19096-21apt-key20:01:542
30128999046,37cyclictest0-21swapper/200:11:542
3012899904,36cyclictest23727-21grep22:22:082
3012899904,36cyclictest23727-21grep22:22:082
30128999041,43cyclictest0-21swapper/223:47:162
3012899903,35cyclictest28017-21tune2fs20:27:132
3012899903,33cyclictest2374-21systemd-journal20:06:522
3012899902,34cyclictest420-21latency_hist22:36:542
3012899902,34cyclictest420-21latency_hist22:36:542
30128998940,42cyclictest8073-21cstates19:27:092
30128998939,43cyclictest0-21swapper/223:01:542
30128998935,45cyclictest0-21swapper/223:11:542
3012899893,37cyclictest22465-21modprobe20:11:522
3012899893,33cyclictest6089-21idleruntime-cro19:21:522
3012899893,32cyclictest10088-21ntp_kernel_pll_19:32:222
30123998964,16cyclictest26190-21ssh21:32:091
30123998964,16cyclictest26190-21ssh21:32:091
30123998956,26cyclictest0-21swapper/122:28:091
30128998872,10cyclictest8731-21ssh21:57:082
30128998872,10cyclictest8731-21ssh21:57:082
3012899883,36cyclictest28741-21fschecks_time00:17:132
3012899883,35cyclictest19832-21modprobe21:21:522
3012899883,33cyclictest23851-21cut21:27:242
30128998826,9cyclictest0-21swapper/221:07:052
30128998826,9cyclictest0-21swapper/221:07:052
30128998824,8cyclictest0-21swapper/223:25:232
3012899874,36cyclictest4236-21/usr/sbin/munin23:37:202
30128998738,42cyclictest2042-21fschecks_count20:47:132
3012899873,33cyclictest13401-21cstates23:52:122
30128998640,39cyclictest0-21swapper/221:41:552
30128998634,45cyclictest2327-21unixbench_singl23:32:302
3012899863,32cyclictest11453-21fschecks_time19:37:142
3012899863,29cyclictest11671-21/usr/sbin/munin22:02:122
3012899862,37cyclictest28997-21ssh21:36:562
3012899862,37cyclictest28997-21ssh21:36:562
3012899855,33cyclictest352-21runrttasks21:15:562
3012899854,33cyclictest26171-21/usr/sbin/munin20:22:332
30128998537,41cyclictest27184-21diskmemload22:27:452
3012899853,36cyclictest20667-21/usr/sbin/munin22:17:212
3012899853,35cyclictest1163-21latency22:37:192
3012899853,33cyclictest2863-21latency_hist19:11:552
3012899853,33cyclictest2863-21latency_hist19:11:552
3012899853,31cyclictest352-21runrttasks00:26:222
3012899853,31cyclictest29662-21fschecks_time20:32:142
3012899853,27cyclictest6735-21/usr/sbin/munin22:47:092
3012899853,27cyclictest24685-21/usr/sbin/munin23:17:172
3012899853,27cyclictest24685-21/usr/sbin/munin23:17:172
30128998529,8cyclictest0-21swapper/223:02:222
30128998529,8cyclictest0-21swapper/223:02:222
30128998529,11cyclictest0-21swapper/200:02:292
30128998529,11cyclictest0-21swapper/200:02:292
30123998515,28cyclictest0-21swapper/123:55:281
3012899845,33cyclictest4532-21latency_hist19:16:542
3012899845,33cyclictest4532-21latency_hist19:16:542
3012899844,31cyclictest17409-21sh23:57:412
3012899844,26cyclictest9675-21/usr/sbin/munin22:52:272
30128998437,41cyclictest20217-21sort21:22:092
3012899843,35cyclictest3974-21taskset20:52:212
3012899843,34cyclictest18292-21grep22:12:212
3012899843,32cyclictest15934-21latency_hist19:51:552
30128998424,8cyclictest0-21swapper/200:16:422
3012899842,35cyclictest8351-21fschecks_count21:02:152
30123998463,15cyclictest30106-21cyclictest23:42:171
30123998463,15cyclictest30106-21cyclictest23:42:171
30128998343,34cyclictest0-21swapper/223:27:562
30128998343,34cyclictest0-21swapper/223:27:562
3012899834,32cyclictest5473-21latency_hist21:51:542
30123998316,28cyclictest0-21swapper/123:36:431
3013299813,36cyclictest26364-21taskset21:32:153
3013299813,36cyclictest26364-21taskset21:32:153
3012899813,34cyclictest7705-21sed23:42:172
3012899813,34cyclictest7705-21sed23:42:172
3012899812,37cyclictest14132-21latency_hist19:46:562
3012899812,37cyclictest14132-21latency_hist19:46:562
3012899812,30cyclictest454-21fschecks_time20:42:142
3012899812,30cyclictest454-21fschecks_time20:42:142
30123998161,14cyclictest21925-21sendmail00:06:521
30123998161,14cyclictest21925-21sendmail00:06:521
3013299803,35cyclictest26854-21chrt00:13:473
30123997921,21cyclictest10480-21seq21:59:231
30123997921,21cyclictest10480-21seq21:59:231
3013299784,33cyclictest15921-21chrt19:51:553
30123997851,20cyclictest30106-21cyclictest22:57:191
30123997832,33cyclictest32341-21apt-get19:02:061
3013299773,32cyclictest1645-21chrt21:44:553
3012399776,53cyclictest25693-21apt-get20:22:061
30123997757,14cyclictest20502-21latency_hist22:16:541
30123997744,26cyclictest15892-21forks23:02:131
30123997744,26cyclictest15892-21forks23:02:131
30123997716,27cyclictest24523-21date23:16:541
30123997623,22cyclictest1282-21seq21:43:551
3013299753,33cyclictest29122-21chrt00:17:233
30123997557,12cyclictest30106-21cyclictest22:20:211
3012399753,52cyclictest19486-21apt-get20:02:091
30123997529,34cyclictest0-21swapper/119:57:061
30123997529,34cyclictest0-21swapper/119:57:061
30123997518,23cyclictest0-21swapper/119:25:171
30123997454,14cyclictest1660-21ssh00:26:511
3013299734,34cyclictest7978-21taskset21:01:553
3013299734,34cyclictest7978-21taskset21:01:553
3013299733,30cyclictest10275-21chrt23:47:043
30123997360,9cyclictest30106-21cyclictest00:00:121
3013299724,28cyclictest14547-21chrt21:12:173
30123997252,13cyclictest2374-21systemd-journal19:51:531
30123997155,9cyclictest0-21swapper/123:27:291
30123997155,9cyclictest0-21swapper/123:27:291
30123997151,13cyclictest30106-21cyclictest21:12:131
30123997125,38cyclictest13314-21ssh21:10:311
30123997125,38cyclictest13314-21ssh21:10:311
30123997122,19cyclictest30711-21seq20:36:121
30123997110,29cyclictest23266-21ntpq20:12:211
30123997046,13cyclictest0-21swapper/122:02:301
30123997038,22cyclictest28460-21apt-get00:17:061
3012399703,49cyclictest14134-21apt19:46:521
3012399703,49cyclictest14134-21apt19:46:521
30123997034,29cyclictest16038-21apt-get19:52:081
30123997030,29cyclictest5102-21ssh20:57:011
30123997030,29cyclictest5102-21ssh20:57:011
30123996830,33cyclictest0-21swapper/122:07:031
30123996830,33cyclictest0-21swapper/122:07:031
30123996829,29cyclictest18699-21apt-get23:07:011
30123996825,36cyclictest0-21swapper/119:37:031
30123996815,19cyclictest4794-21diskmemload21:04:441
30123996748,11cyclictest352-21runrttasks21:54:551
3012399674,33cyclictest7956-21/usr/sbin/munin19:27:281
30123996729,27cyclictest3131-21apt-get19:12:031
30123996729,27cyclictest3131-21apt-get19:12:031
3012399672,44cyclictest3231-21latency_hist20:51:541
30123996717,24cyclictest0-21swapper/121:30:421
30123996711,27cyclictest0-21swapper/121:17:211
3012399667,44cyclictest24329-21/usr/sbin/munin20:17:201
30123996611,26cyclictest0-21swapper/122:47:191
30123996546,13cyclictest352-21runrttasks21:22:521
30123996536,20cyclictest27771-21cpu23:22:081
3012399653,46cyclictest31211-21tail18:57:291
30123996521,21cyclictest6034-21seq23:39:231
30123996446,13cyclictest1036-21sh22:37:171
30123996443,12cyclictest0-21swapper/123:21:561
30123996443,12cyclictest0-21swapper/123:21:561
30123996442,16cyclictest5766-21sh22:45:161
30123996442,16cyclictest5766-21sh22:45:161
3012399643,40cyclictest21195-21cpuspeed20:07:091
30123996420,19cyclictest352-21runrttasks20:52:081
30123996346,11cyclictest300-21rs:main1
30123996331,10cyclictest181rcu_preempt22:22:181
30123996331,10cyclictest181rcu_preempt22:22:181
3012399632,39cyclictest446-21sort20:42:141
3012399632,39cyclictest446-21sort20:42:141
30123996322,30cyclictest6080-21modprobe19:21:521
30123996246,9cyclictest0-21swapper/119:36:531
3012399622,44cyclictest28523-21switchtime20:27:261
3012399622,44cyclictest1796-21fschecks_time19:07:131
3012399622,44cyclictest1796-21fschecks_time19:07:131
30123996130,22cyclictest31044-21apt-get20:37:071
3013299603,43cyclictest9966-21chrt23:46:513
3013299603,43cyclictest9966-21chrt23:46:513
3013299603,43cyclictest31442-21taskset22:33:073
3013299603,43cyclictest31442-21taskset22:33:073
3013299598,39cyclictest29150-21chrt23:23:293
30123995934,16cyclictest0-21swapper/121:51:511
3013299584,42cyclictest17463-21chrt23:57:503
3013299573,38cyclictest20788-21taskset20:06:213
3013299565,22cyclictest0-21swapper/322:27:073
3013299563,36cyclictest14773-21chrt23:00:153
3013299563,36cyclictest1021-21taskset22:37:163
3013299562,41cyclictest19345-21taskset21:20:363
3013299554,35cyclictest22567-21chrt00:07:143
3013299553,38cyclictest31971-21chrt23:27:553
3013299553,38cyclictest31971-21chrt23:27:553
3013299553,38cyclictest13277-21chrt23:52:063
3013299553,37cyclictest27527-21taskset23:21:553
3013299553,37cyclictest27527-21taskset23:21:553
3013299553,36cyclictest5636-21chrt19:17:283
3013299553,35cyclictest3670-21chrt22:42:023
3013299553,35cyclictest3670-21chrt22:42:023
3013299552,41cyclictest24070-21chrt22:22:163
3013299552,41cyclictest24070-21chrt22:22:163
30132995520,24cyclictest1545-21chrt20:46:523
30132995520,24cyclictest1545-21chrt20:46:523
3013299544,33cyclictest32549-21taskset19:02:173
3013299543,38cyclictest19590-21taskset00:02:163
3013299543,38cyclictest19590-21taskset00:02:163
3013299543,37cyclictest29967-21chrt20:32:223
3013299543,36cyclictest9197-21chrt22:51:233
3013299534,36cyclictest21346-21chrt20:07:143
3013299533,38cyclictest6696-21taskset21:52:293
3013299533,30cyclictest11148-21chrt19:36:563
3013299532,38cyclictest12374-21chrt22:02:263
3013299532,34cyclictest21264-21chrt23:11:333
3013299524,36cyclictest15922-21chrt22:07:493
3013299524,36cyclictest15922-21chrt22:07:493
3013299524,32cyclictest1841-21chrt23:32:213
3013299523,36cyclictest19175-21chrt22:13:333
3013299523,35cyclictest9732-21taskset22:52:083
3013299523,35cyclictest30486-21chrt21:38:113
3013299523,34cyclictest21861-21chrt23:12:103
3013299523,33cyclictest15807-21chrt23:02:093
3013299523,33cyclictest15807-21chrt23:02:093
3013299523,31cyclictest14143-21chrt19:46:523
3013299523,31cyclictest14143-21chrt19:46:523
3013299522,37cyclictest17780-21taskset19:57:093
3013299522,37cyclictest17780-21taskset19:57:093
3013299522,34cyclictest2019-21chrt19:07:193
3013299522,34cyclictest2019-21chrt19:07:193
3013299514,34cyclictest26059-21chrt20:21:563
3013299513,34cyclictest23313-21chrt20:12:243
3013299513,34cyclictest21787-21chrt22:17:303
3013299504,32cyclictest26754-21chrt20:22:453
3013299503,35cyclictest11619-21chrt21:07:193
3013299503,35cyclictest11619-21chrt21:07:193
3013299503,33cyclictest31648-21chrt20:37:243
30132995026,16cyclictest81312sleep319:27:133
3013299502,33cyclictest10958-21chrt22:00:443
3013299502,33cyclictest10958-21chrt22:00:443
3013299494,33cyclictest6619-21chrt19:22:143
3013299493,35cyclictest6194-21chrt23:39:503
3013299493,35cyclictest4872-21chrt21:50:273
2900024911,22sleep30-21swapper/318:52:223
3013299483,34cyclictest31969-21chrt00:22:183
3013299483,31cyclictest2357-21taskset20:47:213
3013299483,29cyclictest4830-21taskset20:56:533
3013299474,32cyclictest22793-21chrt21:26:523
3013299453,29cyclictest31658-21chrt19:01:523
3013299434,26cyclictest4656-21taskset19:16:553
3013299434,26cyclictest4656-21taskset19:16:553
3013299432,29cyclictest27983-21chrt20:27:113
3013299423,30cyclictest24900-21chrt21:29:193
3013299423,29cyclictest8633-21chrt21:02:203
3013299423,29cyclictest17059-21taskset19:52:563
3013299412,30cyclictest11682-21taskset19:37:203
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional