You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-20 - 06:58
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Thu Aug 20, 2026 00:44:25)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16420212014,70sleep016130-21/usr/sbin/munin19:05:280
17608991193,96cyclictest11049-21/usr/sbin/munin22:31:100
176089911525,77cyclictest17791-21apt-get20:50:100
2657721140,4sleep026578-21ps00:35:290
16451211010,71sleep116497-21/usr/sbin/munin19:05:291
176179910182,13cyclictest25638-21latency_hist00:34:582
176089910015,59cyclictest22149-21apt-get00:30:120
17617999857,34cyclictest0-21swapper/222:14:582
17617999849,41cyclictest0-21swapper/221:14:592
17612999780,11cyclictest24504-21diskmemload21:55:001
17612999749,41cyclictest351-21runrttasks00:14:581
17612999749,41cyclictest351-21runrttasks00:14:581
17612999745,43cyclictest0-21swapper/100:25:241
17617999653,37cyclictest21260-21cut20:59:592
1761799962,38cyclictest5340-21cut20:10:192
17612999644,44cyclictest0-21swapper/122:05:231
17617999541,48cyclictest0-21swapper/223:40:142
17617999456,31cyclictest0-21swapper/222:05:262
1761799944,33cyclictest21459-21/usr/sbin/munin19:20:292
17612999471,15cyclictest29849-21kworker/u17:1-xprtiod22:15:181
1761299943,30cyclictest4105-21apt-get23:10:081
17617999348,37cyclictest0-21swapper/219:55:172
1761799933,39cyclictest19482-21/usr/sbin/munin00:25:142
1761799933,38cyclictest25903-21grep00:35:122
17612999339,45cyclictest0-21swapper/123:20:241
17617999247,39cyclictest351-21runrttasks21:38:102
17617999247,39cyclictest351-21runrttasks21:38:102
1761799923,35cyclictest26672-21fschecks_time23:45:192
1761799922,38cyclictest30292-21runrttasks19:45:312
17612999245,42cyclictest0-21swapper/122:00:141
17608999267,17cyclictest27662-21cron21:14:570
17608999257,24cyclictest28306-21timerandwakeup22:05:330
1761799914,33cyclictest24422-21latency_hist19:29:572
1761799913,36cyclictest7919-21fschecks_count22:25:172
1761799913,35cyclictest8471-21ls20:20:142
1761799913,34cyclictest14977-21find22:35:322
1761799913,34cyclictest14977-21find22:35:322
17612999176,11cyclictest17601-21cyclictest23:00:341
17612999140,44cyclictest0-21swapper/123:50:241
1761299913,33cyclictest18056-21fschecks_time19:10:191
1761799903,36cyclictest26549-21fschecks_time19:35:192
1761799903,35cyclictest23972-21cstates22:50:142
1761799903,34cyclictest19790-21fschecks_count19:15:092
1761799902,37cyclictest1093-21find23:55:322
1761799902,37cyclictest1093-21find23:55:322
17612999067,15cyclictest202-21systemd-journal22:49:471
1761299903,24cyclictest16130-21sh23:29:041
17617998942,39cyclictest0-21swapper/200:24:582
17617998937,45cyclictest0-21swapper/223:00:132
1761799893,35cyclictest27058-21latency_hist22:04:592
1761799893,33cyclictest20511-21latency_hist22:44:592
1761799893,33cyclictest1734-21ssh23:05:302
17617998920,29cyclictest4506-21sh23:10:202
17612998968,10cyclictest0-21swapper/121:20:201
17612998961,20cyclictest18057-21apt-key20:50:001
1761299894,37cyclictest27101-21mailstats23:45:301
1761299893,31cyclictest13183-21/usr/sbin/munin20:35:301
1761299893,31cyclictest13183-21/usr/sbin/munin20:35:301
1761299892,38cyclictest19088-21switchtime20:51:171
17608998959,20cyclictest1-21systemd20:48:480
17608998917,29cyclictest5113-21ssh21:30:090
17617998869,10cyclictest0-21swapper/221:30:152
1761799884,35cyclictest14139-21grep20:35:322
1761799884,35cyclictest14139-21grep20:35:322
1761799884,34cyclictest24939-21fschecks_time19:30:172
1761799884,34cyclictest14864-21fschecks_count21:45:162
1761799883,35cyclictest13420-21rm23:24:592
1761799883,33cyclictest29483-21/usr/sbin/munin23:50:332
1761799883,33cyclictest12068-21awk21:40:252
1761799882,36cyclictest11664-21fschecks_time22:31:052
17612998870,12cyclictest23871-21/usr/sbin/munin21:59:581
17612998836,44cyclictest0-21swapper/119:40:171
1761299883,38cyclictest15216-21ntp_kernel_pll_21:45:221
1761299883,32cyclictest17787-21fschecks_time22:40:161
1761299883,23cyclictest11398-21latency_hist21:40:011
17612998831,48cyclictest0-21swapper/120:34:481
1761299882,37cyclictest4950-21latency_hist21:30:001
1761299882,35cyclictest17142-21ls23:30:171
1761299882,35cyclictest17142-21ls23:30:171
17608998845,13cyclictest0-21swapper/022:54:590
1761799874,35cyclictest29921-21modprobe22:59:572
1761799874,35cyclictest29921-21modprobe22:59:572
1761799874,31cyclictest5037-21grep20:10:002
1761799874,30cyclictest14818-21/usr/sbin/munin20:40:072
1761799874,30cyclictest14818-21/usr/sbin/munin20:40:072
17617998737,44cyclictest0-21swapper/221:50:312
1761799873,38cyclictest11577-21/usr/sbin/munin20:30:232
1761799873,37cyclictest1896-21ntpq22:15:252
1761799873,35cyclictest1915-21/usr/sbin/munin21:25:252
1761799873,34cyclictest21685-21grep21:55:302
1761799873,33cyclictest31235-21sh21:20:122
1761799873,32cyclictest6731-21/usr/sbin/munin20:15:192
1761799873,32cyclictest6731-21/usr/sbin/munin20:15:192
1761799873,32cyclictest16702-21grep23:30:002
17617998730,50cyclictest17789-21latency_hist20:49:592
17617998717,30cyclictest22915-21latency_hist23:39:582
17612998773,10cyclictest17601-21cyclictest20:05:291
17612998772,8cyclictest0-21swapper/122:30:001
1761299874,35cyclictest23257-21fschecks_count19:25:191
1761299874,33cyclictest917-21/usr/sbin/munin23:05:301
17612998740,40cyclictest0-21swapper/100:00:251
17612998735,45cyclictest0-21swapper/119:45:191
1761299873,37cyclictest6081-21unixbench_singl20:10:331
1761299873,35cyclictest257-21dbus-daemon23:19:561
1761299873,35cyclictest19954-21/usr/sbin/munin23:35:311
1761299873,34cyclictest15809-21grep20:40:331
1761299873,34cyclictest15809-21grep20:40:331
1761299873,28cyclictest8617-21fschecks_time21:35:201
17608998762,17cyclictest202-21systemd-journal21:28:480
17608998761,17cyclictest10363-21latency_hist23:20:000
17617998667,9cyclictest0-21swapper/219:10:232
1761799863,36cyclictest10260-21fschecks_time20:25:202
1761799863,35cyclictest10782-21unixbench_multi00:10:322
1761799863,35cyclictest10782-21unixbench_multi00:10:322
1761799863,34cyclictest5416-21ssh22:20:322
1761799863,30cyclictest351-21runrttasks00:18:242
1761799863,26cyclictest20676-21ssh22:45:092
17617998631,8cyclictest0-21swapper/200:00:152
17617998612,35cyclictest30360-21ssh21:18:432
17617998612,35cyclictest30360-21ssh21:18:432
1761299864,36cyclictest7036-21ls20:15:211
1761299864,36cyclictest7036-21ls20:15:211
1761299864,33cyclictest9975-21/usr/sbin/munin20:25:161
1761299864,33cyclictest31398-21fschecks_time19:50:191
1761299864,32cyclictest24674-21latency_hist21:09:591
1761299864,31cyclictest24112-21unixbench_multi00:31:331
1761299863,35cyclictest27018-21switchtime19:35:311
1761299863,35cyclictest1100-21latency_hist22:15:001
1761299863,34cyclictest26138-21rm00:35:181
1761299863,34cyclictest16396-21rm00:20:181
1761299863,33cyclictest25372-21ssh23:43:191
1761299863,33cyclictest19390-21munin-node19:15:091
1761299863,32cyclictest30080-21latency_hist23:00:001
1761299863,32cyclictest30080-21latency_hist23:00:001
1761299862,36cyclictest351-21runrttasks21:10:161
1761299862,35cyclictest1094-21threads23:55:321
1761299862,35cyclictest1094-21threads23:55:321
1761299862,35cyclictest1054-21wc19:55:311
1761299862,33cyclictest12518-21grep22:31:371
1761799852,36cyclictest2544-21wc20:00:322
1761299855,30cyclictest14229-21/usr/sbin/munin22:35:221
1761299855,30cyclictest14229-21/usr/sbin/munin22:35:221
1761299854,32cyclictest5232-21cstates21:30:151
1761299853,35cyclictest28375-21sh21:15:201
1761299853,35cyclictest28375-21sh21:15:201
1761299853,29cyclictest23033-21latency_hist21:04:591
1761299853,29cyclictest23033-21latency_hist21:04:591
1761799843,35cyclictest18622-21fschecks_time20:51:042
1761799843,31cyclictest32006-21timerwakeupswit19:50:322
1761799842,33cyclictest6889-21fschecks_time00:05:192
1761299844,32cyclictest12898-21/usr/sbin/munin00:15:201
1761299843,33cyclictest23814-21/usr/sbin/munin22:50:141
1761299842,33cyclictest2699-21timerandwakeup20:00:351
1761299842,32cyclictest25294-21processes19:30:271
17608998429,40cyclictest19974-21apt-get23:35:080
1761799834,34cyclictest16764-21/usr/sbin/munin23:30:252
1761799834,34cyclictest16764-21/usr/sbin/munin23:30:252
1761799833,33cyclictest23131-21/usr/sbin/munin21:05:072
1761799833,32cyclictest10275-21latency_hist23:19:592
1761799833,30cyclictest22968-21wc21:04:582
1761799833,30cyclictest22968-21wc21:04:582
1761299834,33cyclictest21670-21fschecks_count19:20:181
1761299833,35cyclictest11765-21fschecks_time21:40:191
1761299833,27cyclictest6574-21/usr/sbin/munin00:05:151
17612998327,49cyclictest0-21swapper/120:23:271
17608998320,19cyclictest28266-21sshd22:55:530
17608998320,19cyclictest28266-21sshd22:55:530
1761799823,35cyclictest29365-21latency_hist19:44:592
1761299823,31cyclictest20526-21runrttasks20:55:301
1761299822,31cyclictest4525-21cpu22:20:131
17608998258,16cyclictest17601-21cyclictest19:30:170
17608998256,16cyclictest9887-21latency_hist20:24:590
17608998246,26cyclictest17601-21cyclictest22:40:160
17608998240,30cyclictest0-21swapper/000:00:230
17608998216,37cyclictest0-21swapper/021:50:140
1761799813,27cyclictest17738-21latency_hist19:10:022
17608997957,14cyclictest12461-21ssh23:22:470
17608997936,37cyclictest19050-21latency_hist00:24:580
1760899783,43cyclictest28610-21ntp_offset21:15:250
1760899783,43cyclictest28610-21ntp_offset21:15:250
17608997814,25cyclictest22361-21cat21:00:330
17608997814,25cyclictest22361-21cat21:00:330
17608997739,28cyclictest0-21swapper/023:00:210
17608997728,32cyclictest23447-21uname19:25:220
17608997717,19cyclictest8283-21apt-get21:35:130
17608997717,19cyclictest8283-21apt-get21:35:130
1760899769,28cyclictest0-21swapper/000:10:190
1760899769,28cyclictest0-21swapper/000:10:190
1760899766,35cyclictest20983-21/usr/sbin/munin21:55:320
1760899766,33cyclictest14963-21processes22:35:310
1760899766,33cyclictest14963-21processes22:35:310
17608997656,12cyclictest7230-21kworker/u17:0+rpciod23:25:310
17608997638,29cyclictest0-21swapper/019:15:080
1760899758,28cyclictest26711-21sort19:35:220
1760899757,31cyclictest25075-21/usr/sbin/munin22:00:320
1760899752,33cyclictest5204-21processes22:20:290
17608997519,8cyclictest0-21swapper/022:27:000
17608997516,17cyclictest0-21swapper/022:45:320
17608997513,28cyclictest27058-21ssh23:45:290
1760899746,35cyclictest13681-21grep00:15:300
17608997457,11cyclictest2982-21ssh23:59:470
17608997457,11cyclictest2982-21ssh23:59:470
17608997451,15cyclictest17601-21cyclictest20:10:330
17608997444,19cyclictest17020-21fschecks_count23:30:150
17608997444,19cyclictest17020-21fschecks_count23:30:150
1760899744,33cyclictest7667-21grep00:05:330
17608997440,24cyclictest13201-21apt-get20:35:090
17608997440,24cyclictest13201-21apt-get20:35:090
17608997435,29cyclictest0-21swapper/019:24:590
1760899742,40cyclictest4669-21ntp_kernel_err23:10:240
17608997413,27cyclictest11513-21ssh21:40:120
17625997313,39cyclictest0-21swapper/320:50:183
1760899735,30cyclictest31224-21rm23:52:060
17608997348,16cyclictest16967-21ssh21:48:380
1760899733,34cyclictest1583-21fschecks_time22:15:180
1760899732,38cyclictest23568-21latency21:05:220
291512720,8sleep30-21swapper/322:58:093
291512720,8sleep30-21swapper/322:58:093
1760899723,33cyclictest31832-21grep21:20:270
1760899719,27cyclictest3517-21acpi20:05:070
1760899718,30cyclictest20560-21cat20:55:300
17608997137,23cyclictest0-21swapper/000:25:180
17608997116,9cyclictest0-21swapper/023:40:300
17625997012,37cyclictest0-21swapper/300:31:013
17608997044,17cyclictest0-21swapper/020:40:180
17608997044,17cyclictest0-21swapper/020:40:180
17608997020,11cyclictest0-21swapper/022:15:010
1616327022,32sleep30-21swapper/319:05:193
17608996936,26cyclictest0-21swapper/023:05:290
17608996923,38cyclictest29531-21apt-get19:45:090
17608996912,19cyclictest19219-21wc19:14:590
1760899685,23cyclictest0-21swapper/020:00:230
17608996820,11cyclictest0-21swapper/020:25:140
1760899675,32cyclictest28342-21latency19:40:210
17608996721,32cyclictest32676-21cat19:55:000
1760899664,26cyclictest12937-21latency_hist20:34:590
1760899663,44cyclictest32721-21/usr/sbin/munin19:55:340
1760899653,45cyclictest7019-21fschecks_time20:15:200
1760899653,45cyclictest7019-21fschecks_time20:15:200
17625996411,35cyclictest0-21swapper/322:31:103
17625996144,9cyclictest12142sleep323:05:183
1762599603,41cyclictest19194-21chrt00:25:003
17625995743,9cyclictest451rcuc/323:16:373
17625995736,13cyclictest451rcuc/321:32:573
1762599572,46cyclictest30002-21chrt22:09:223
1762599545,33cyclictest26234-21chrt19:35:003
1762599544,35cyclictest18502-21chrt19:10:313
17625995434,12cyclictest451rcuc/300:28:373
1762599543,38cyclictest6898-21taskset00:05:193
1762599534,38cyclictest26222-21chrt21:11:163
1762599534,36cyclictest24660-21taskset22:00:233
1762599533,37cyclictest5003-21taskset21:30:003
1762599533,35cyclictest11396-21chrt21:40:013
1762599524,34cyclictest24005-21chrt19:25:333
1762599523,38cyclictest32665-21chrt19:55:003
1762599523,34cyclictest6181-21taskset23:13:003
1762599523,34cyclictest16403-21chrt20:45:003
17625995232,12cyclictest451rcuc/322:46:143
1762599513,36cyclictest23945-21chrt23:40:313
1762599513,35cyclictest3547-21chrt20:05:123
1762599513,35cyclictest27060-21chrt23:45:293
1762599513,34cyclictest23342-21chrt21:58:413
1762599513,32cyclictest19842-21chrt23:35:003
1762599513,32cyclictest19842-21chrt23:35:003
1762599513,31cyclictest23031-21taskset19:25:003
1762599512,36cyclictest13399-21chrt21:42:363
17625995034,10cyclictest451rcuc/321:04:573
17625995034,10cyclictest451rcuc/321:04:573
1762599503,34cyclictest3275-21chrt00:00:003
1762599503,34cyclictest3275-21chrt00:00:003
1762599503,34cyclictest31234-21chrt21:20:123
1762599503,34cyclictest29495-21chrt23:50:073
1762599503,34cyclictest26708-21chrt22:54:563
1762599503,32cyclictest5742-21taskset22:20:533
17625995033,10cyclictest451rcuc/319:48:583
1762599503,30cyclictest6749-21chrt20:15:083
1762599503,30cyclictest6749-21chrt20:15:083
1762599502,36cyclictest9197-21chrt22:26:363
17625994933,9cyclictest451rcuc/320:47:203
1762599493,36cyclictest10850-21chrt20:25:333
1762599493,36cyclictest10718-21chrt23:20:173
1762599493,35cyclictest706-21chrt19:55:213
1762599493,34cyclictest20829-21chrt19:15:373
1762599493,33cyclictest29455-21chrt19:45:003
1762599493,33cyclictest22921-21chrt23:39:583
1762599493,33cyclictest10168-21chrt00:10:213
1762599493,33cyclictest10168-21chrt00:10:213
1762599493,32cyclictest13174-21chrt20:35:003
1762599493,32cyclictest13174-21chrt20:35:003
17625994931,12cyclictest451rcuc/321:07:043
1762599492,38cyclictest15397-21chrt00:19:003
1762599483,35cyclictest5253-21chrt20:10:143
1762599483,32cyclictest8806-21chrt20:20:233
1762599483,31cyclictest16740-21taskset21:48:033
1762599482,34cyclictest3436-21chrt20:05:003
1762599482,32cyclictest15510-21chrt22:35:563
1762599482,32cyclictest15510-21chrt22:35:563
1762599473,35cyclictest28493-21chrt00:39:253
17625994730,12cyclictest451rcuc/320:59:023
17625994730,10cyclictest451rcuc/319:36:073
1762599472,34cyclictest5523-21chrt00:03:043
1762599472,34cyclictest14627-21taskset23:25:323
1762599472,33cyclictest19244-21chrt21:51:193
17625994629,9cyclictest451rcuc/320:33:063
17625994529,9cyclictest451rcuc/320:43:553
1762599452,35cyclictest1542-21chrt22:15:183
1762599452,32cyclictest31989-21chrt22:11:213
1762599452,30cyclictest10048-21taskset21:37:133
1762599443,29cyclictest19179-21chrt22:42:003
1762599424,29cyclictest31837-21chrt23:01:493
17625994229,9cyclictest451rcuc/321:19:443
17625994229,9cyclictest451rcuc/321:19:443
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional