You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-10 - 00:59
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7.osadl.org (updated Thu Apr 09, 2026 12:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
176621030,9sleep21756-21munin-run09:53:312
2911921027,17sleep10-21swapper/107:00:181
28808210010,61sleep228873-21cat06:59:172
2952699984,82cyclictest0-21swapper/107:48:441
29522999616,62cyclictest10034-21cat11:54:060
29522999534,26cyclictest5365-21sh11:47:130
2952699934,82cyclictest0-21swapper/110:58:451
29526999056,28cyclictest298-21in:imuxsock09:40:161
2952699904,79cyclictest0-21swapper/111:03:441
2952699895,76cyclictest0-21swapper/107:33:441
29531998864,15cyclictest10197-21sh09:13:312
2952699874,75cyclictest0-21swapper/112:18:431
29522998764,12cyclictest0-21swapper/008:48:540
2952699863,75cyclictest22547-21ssh09:33:431
2952699863,37cyclictest29130-21ssh09:44:001
2952699863,37cyclictest29130-21ssh09:44:001
2952699862,42cyclictest8583-21latency_hist10:58:331
29522998655,24cyclictest22537-21ssh09:33:420
29522998631,27cyclictest13149-21grep11:59:070
29522998631,27cyclictest13149-21grep11:59:070
2952699855,75cyclictest0-21swapper/108:28:461
2952699855,73cyclictest0-21swapper/108:58:451
2952699854,74cyclictest23758-21ssh11:23:431
2952699853,8cyclictest0-21swapper/108:48:471
2952699853,38cyclictest28938-21latency_hist10:38:361
2952699853,37cyclictest5088-21grep09:04:011
2952699853,37cyclictest23415-21ssh10:28:491
2952699845,69cyclictest0-21swapper/111:28:441
29526998441,34cyclictest0-21swapper/111:58:351
2952699843,7cyclictest0-21swapper/109:13:461
2952699842,37cyclictest9034-21ssh10:04:071
2952699842,36cyclictest27576-21/usr/sbin/munin12:23:571
2952699842,34cyclictest20370-21switchtime09:29:141
2952699842,34cyclictest20370-21switchtime09:29:141
2952699835,71cyclictest0-21swapper/108:14:101
29526998339,36cyclictest0-21swapper/110:48:461
2952699833,39cyclictest15570-21ssh12:04:061
2952699833,39cyclictest15477-21/usr/sbin/munin11:09:031
2952699833,39cyclictest15477-21/usr/sbin/munin11:09:031
2952699833,38cyclictest18180-21ssh10:19:421
2952699833,35cyclictest23174-21date10:28:351
2952699833,35cyclictest23174-21date10:28:351
2952699832,41cyclictest16782-21munin-run10:18:321
2952699832,39cyclictest30703-21ntp_kernel_pll_12:28:591
2952699832,39cyclictest30703-21ntp_kernel_pll_12:28:591
2952699832,38cyclictest14819-21timerandwakeup07:54:071
29522998341,36cyclictest24642-21rm10:29:490
29522998331,35cyclictest19545-21sh09:28:460
29522998331,35cyclictest19545-21sh09:28:460
268302830,6sleep00-21swapper/012:23:300
2952699825,72cyclictest0-21swapper/108:03:471
2952699824,9cyclictest0-21swapper/107:03:481
2952699823,74cyclictest0-21swapper/111:18:461
2952699823,74cyclictest0-21swapper/111:18:461
2952699823,39cyclictest32461-21grep07:09:091
2952699822,37cyclictest1702-21/usr/sbin/munin08:54:071
2952699822,36cyclictest2348-21sort07:18:341
2952699822,34cyclictest24865-21/usr/sbin/munin08:24:071
29522998254,20cyclictest27180-21ssh12:23:440
29522998242,26cyclictest24842-21ssh11:24:090
29522998234,22cyclictest27851-21rm09:42:340
29531998156,15cyclictest0-21swapper/211:48:542
29526998165,10cyclictest28496-21kworker/u17:0-ext4-rsv-conversion11:53:321
2952699815,69cyclictest0-21swapper/107:58:471
29526998141,32cyclictest0-21swapper/109:59:581
29526998140,33cyclictest0-21swapper/110:09:071
2952699813,38cyclictest32710-21ssh11:38:461
2952699813,37cyclictest31992-21latency09:48:561
2952699813,37cyclictest29992-21/usr/sbin/munin10:39:391
2952699813,36cyclictest32437-21runrttasks10:43:421
2952699813,36cyclictest32437-21runrttasks10:43:421
2952699813,30cyclictest3272-21/usr/sbin/munin11:43:471
2952699813,29cyclictest6353-21grep07:29:031
2952699812,38cyclictest19835-21modprobe12:10:311
2952699812,38cyclictest19835-21modprobe12:10:311
2952699812,34cyclictest21227-21/usr/sbin/munin12:13:561
2952699812,33cyclictest19053-21/usr/sbin/munin08:08:531
2952699812,33cyclictest19053-21/usr/sbin/munin08:08:531
29522998164,10cyclictest8082-21ssh10:03:420
29522998163,7cyclictest0-21swapper/007:48:350
29522998163,7cyclictest0-21swapper/007:48:350
29522998163,10cyclictest0-21swapper/011:23:350
29522998163,10cyclictest0-21swapper/011:23:350
29522998152,24cyclictest544-21cron07:38:320
29522998126,22cyclictest0-21swapper/010:53:530
29531998065,11cyclictest29507-21cyclictest07:49:162
29526998040,33cyclictest0-21swapper/111:13:511
2952699803,70cyclictest4195-21diskmemload09:08:471
2952699803,66cyclictest10805-21/usr/sbin/munin07:44:031
2952699803,66cyclictest10805-21/usr/sbin/munin07:44:031
2952699803,38cyclictest9501-21fschecks_count07:39:591
2952699803,38cyclictest9501-21fschecks_count07:39:591
2952699803,38cyclictest352-21runrttasks09:55:201
2952699803,38cyclictest352-21runrttasks09:55:201
2952699803,37cyclictest27437-21fschecks_time08:33:531
2952699803,37cyclictest27437-21fschecks_time08:33:531
2952699803,36cyclictest19252-21ssh09:28:331
2952699803,34cyclictest22592-21grep08:18:541
2952699802,39cyclictest31726-21runrttasks11:36:431
2952699802,32cyclictest87-21kswapd012:03:321
2952699802,32cyclictest87-21kswapd012:03:321
2952699802,30cyclictest30679-21fschecks_time08:43:541
29522998044,27cyclictest5676-21latency_hist07:28:350
29522998041,26cyclictest1517-21ssh09:52:550
29531997955,17cyclictest297-21systemd-logind08:43:322
2952699796,63cyclictest0-21swapper/108:38:451
2952699795,69cyclictest0-21swapper/107:23:461
2952699793,37cyclictest2510-21find07:18:401
29522997957,15cyclictest2962-21cpu10:48:450
29531997858,14cyclictest6572-21sh10:54:042
29531997856,16cyclictest320-21idleruntime-cro12:33:312
29531997856,16cyclictest320-21idleruntime-cro12:33:312
29526997837,33cyclictest0-21swapper/109:23:341
29522997846,7cyclictest181rcu_preempt12:12:170
29522997846,7cyclictest181rcu_preempt12:12:170
29522997846,23cyclictest17637-21/usr/sbin/munin08:03:570
29522997839,32cyclictest32650-21taskset12:33:110
29522997839,32cyclictest32650-21taskset12:33:110
29522997838,32cyclictest4195-21diskmemload11:33:340
29522997832,38cyclictest0-21swapper/010:03:350
2952299782,58cyclictest17461-21ssh10:19:050
29531997756,15cyclictest20155-21latency_hist10:23:342
29522997752,18cyclictest28755-21latency_hist08:38:350
29522997752,18cyclictest28755-21latency_hist08:38:350
29522997748,20cyclictest16903-21apt-key10:18:350
29522997741,25cyclictest541-21ntp_kernel_pll_10:43:590
29522997741,25cyclictest541-21ntp_kernel_pll_10:43:590
29522997740,32cyclictest28938-21latency_hist10:38:350
29522997739,28cyclictest8036-21netstat09:08:590
29531997654,16cyclictest803-21sendmail-mta11:10:502
29531997654,16cyclictest803-21sendmail-mta11:10:502
29531997653,18cyclictest0-21swapper/207:38:572
29531997653,18cyclictest0-21swapper/207:38:572
29522997650,17cyclictest9768-21rm10:59:080
29522997641,28cyclictest29507-21cyclictest11:04:460
29522997636,32cyclictest9195-21/usr/sbin/munin07:40:010
29522997636,32cyclictest9195-21/usr/sbin/munin07:40:010
29522997626,25cyclictest12276-21sh09:15:560
29531997558,11cyclictest21842-21journal-offline10:25:212
29531997558,11cyclictest21842-21journal-offline10:25:212
29531997555,14cyclictest29068-21sh10:38:352
29531997555,13cyclictest2952-21systemd-journal10:45:182
29531997555,13cyclictest2952-21systemd-journal10:45:182
29531997554,15cyclictest10006-21sh10:59:112
29531997548,17cyclictest20591-21latency_hist08:13:352
29531997548,17cyclictest20591-21latency_hist08:13:352
29531997522,37cyclictest10495-21seq11:54:512
29522997556,14cyclictest2029-21kworker/u18:0+events_unbound07:18:320
29522997555,14cyclictest4190-21idleruntime-cro09:03:320
29522997541,28cyclictest5504-21/usr/sbin/munin09:04:090
29531997454,14cyclictest27074-21latency_hist08:33:352
29531997453,13cyclictest365-21ntpd10:39:482
29522997443,24cyclictest5988-21tune2fs07:28:530
29522997439,28cyclictest13586-21grep09:18:480
29522997438,30cyclictest22983-21ssh10:28:320
29522997438,30cyclictest22983-21ssh10:28:320
29522997437,31cyclictest0-21swapper/008:43:310
29522997436,31cyclictest28496-21kworker/u17:0+xprtiod11:37:410
29531997355,11cyclictest297-21systemd-logind07:28:332
29531997349,18cyclictest20846-21sh11:18:482
29531997349,18cyclictest20846-21sh11:18:482
29531997319,21cyclictest27744-21unixbench_multi11:29:092
29522997340,26cyclictest3612-21sshd09:55:180
29522997340,26cyclictest3612-21sshd09:55:180
29522997339,25cyclictest30271-21memory10:39:460
29522997332,33cyclictest0-21swapper/007:53:590
29531997242,22cyclictest7305-21latency_hist07:33:352
2953199723,54cyclictest2029-21kworker/u18:0+ext4-rsv-conversion08:13:502
29522997241,23cyclictest15380-21dpkg12:03:560
29522997240,23cyclictest8637-21ssh11:53:050
2953599714,53cyclictest7066-21taskset10:54:133
29531997142,22cyclictest18756-21latency_hist08:08:352
29522997155,10cyclictest24236-21fschecks_time08:23:530
29522997148,12cyclictest0-21swapper/008:33:320
29522997143,21cyclictest13986-21latency_hist07:53:350
29522997141,21cyclictest21291-21/usr/sbin/munin08:14:220
29522997140,21cyclictest31220-21cat07:08:350
29522997138,26cyclictest31179-21switchtime08:44:060
29522997138,24cyclictest22339-21users12:14:090
29522997124,24cyclictest18674-21xargs11:14:050
29531997054,10cyclictest19676-21snmpd12:02:182
29531997054,10cyclictest19676-21snmpd12:02:182
2953199703,48cyclictest14546-21/usr/sbin/munin11:08:322
2953199703,42cyclictest7308-21ssh10:02:172
29531997030,32cyclictest25402-21cat08:28:342
29522997059,7cyclictest0-21swapper/007:09:070
29522997055,9cyclictest16661-21cstates09:23:480
29522997028,29cyclictest1-21systemd10:09:060
29531996951,11cyclictest0-21swapper/211:14:072
29531996950,12cyclictest29896-21latency_hist12:28:332
29531996947,16cyclictest8932-21latency_hist07:38:352
29522996942,20cyclictest29707-21rm09:44:210
29522996942,20cyclictest29707-21rm09:44:210
29522996940,23cyclictest15910-21/usr/sbin/munin11:09:090
29522996940,23cyclictest15910-21/usr/sbin/munin11:09:090
29522996940,21cyclictest1622-21ls08:54:050
29522996937,25cyclictest3847-21chrt07:23:270
29522996937,22cyclictest32751-21grep11:38:470
2953599684,50cyclictest30070-21taskset09:45:223
2953599684,50cyclictest30070-21taskset09:45:223
2953599683,52cyclictest31550-21taskset09:48:463
29531996834,25cyclictest21725-21wc12:13:572
2953199683,30cyclictest26513-21latency_hist11:28:342
29522996841,20cyclictest23832-21latency_hist08:23:340
29522996840,21cyclictest20319-21unin-run08:13:330
29522996840,21cyclictest20319-21unin-run08:13:330
2953599679,45cyclictest3594-21taskset11:43:563
29531996753,10cyclictest29507-21cyclictest08:59:012
29531996749,12cyclictest28485-21/usr/sbin/munin09:44:072
29531996749,12cyclictest28485-21/usr/sbin/munin09:44:072
29531996742,19cyclictest23242-21sh09:34:052
29531996740,17cyclictest14264-21fschecks_count07:53:532
29531996727,29cyclictest11938-21cat10:09:072
2952299676,45cyclictest29385-21latency_hist07:03:360
29522996742,19cyclictest16161-21ntp_kernel_err07:59:000
50562660,6sleep20-21swapper/210:52:012
2953599663,50cyclictest9609-21taskset10:05:203
2953599663,50cyclictest31144-21taskset11:35:043
2953599663,46cyclictest25738-21taskset08:28:513
2953199667,18cyclictest1614-21cat07:14:052
29531996649,11cyclictest2952-21systemd-journal08:50:092
29531996644,15cyclictest20513-21runrttasks12:12:252
29531996644,15cyclictest20513-21runrttasks12:12:252
2953599653,49cyclictest7011-21taskset10:01:263
2953599653,48cyclictest24928-21chrt11:24:223
2953599652,49cyclictest11425-21taskset07:44:033
2953599652,49cyclictest11425-21taskset07:44:033
29531996551,9cyclictest31840-21ssh11:37:022
29531996551,8cyclictest0-21swapper/212:19:092
29531996550,8cyclictest0-21swapper/209:54:072
29531996550,8cyclictest0-21swapper/209:54:072
29531996544,15cyclictest16198-21switchtime12:04:212
29531996543,12cyclictest0-21swapper/210:13:562
29531996526,32cyclictest23296-21apt-get10:28:442
2953599644,46cyclictest19114-21chrt11:14:413
2953599643,47cyclictest30377-21taskset07:04:063
2953599642,49cyclictest26301-21chrt10:33:453
2953599642,49cyclictest21554-21taskset08:14:293
2953599642,48cyclictest19115-21chrt09:28:193
2953599642,46cyclictest20475-21taskset10:23:483
2953599642,46cyclictest20475-21taskset10:23:483
29531996449,8cyclictest0-21swapper/209:38:592
29531996449,8cyclictest0-21swapper/209:23:532
29531996445,13cyclictest352-21runrttasks07:03:532
2953199644,26cyclictest10522-21/usr/sbin/munin09:13:442
29531996439,17cyclictest23028-21mailstats08:19:062
29531996437,19cyclictest27572-21kernelversion08:33:562
29531996437,19cyclictest27572-21kernelversion08:33:562
2953599633,48cyclictest31774-21chrt08:48:313
2953599633,47cyclictest24235-21chrt08:23:533
2953599633,46cyclictest14358-21taskset11:08:083
2953599633,45cyclictest2563-21chrt08:58:323
2953599633,45cyclictest0-21swapper/310:58:483
2953599632,49cyclictest8639-21chrt07:37:473
2953599632,49cyclictest25509-21chrt12:19:443
2953599632,48cyclictest9298-21chrt07:39:423
2953599632,48cyclictest9298-21chrt07:39:423
2953599632,47cyclictest28261-21chrt12:24:103
29531996347,8cyclictest0-21swapper/210:03:522
29531996344,13cyclictest352-21runrttasks11:44:212
29531996342,12cyclictest0-21swapper/209:29:152
29531996342,12cyclictest0-21swapper/209:29:152
2953599623,48cyclictest22169-21chrt11:19:563
2953599623,48cyclictest22169-21chrt11:19:563
2953599623,46cyclictest30207-21taskset08:43:333
2953599623,45cyclictest15250-21taskset07:56:393
2953599622,48cyclictest2843-21taskset09:54:053
2953599622,48cyclictest2843-21taskset09:54:053
2953599622,47cyclictest9089-21chrt11:53:373
2953599622,47cyclictest7179-21taskset07:33:343
2953599622,47cyclictest24163-21chrt10:29:073
2953599622,47cyclictest23417-21chrt08:19:523
2953599622,47cyclictest17722-21chrt10:19:263
2953599622,46cyclictest18519-21chrt08:07:243
29531996249,9cyclictest29507-21cyclictest09:18:572
29531996243,13cyclictest2696-21fschecks_count07:18:512
29531996241,10cyclictest0-21swapper/209:08:312
29531996240,15cyclictest12346-21latency_hist07:48:352
29531996240,15cyclictest12346-21latency_hist07:48:352
29531996234,15cyclictest0-21swapper/208:43:532
29531996222,31cyclictest32681-21apt-get11:38:462
2953599617,41cyclictest15368-21chrt12:03:553
2953599614,44cyclictest24606-21chrt09:36:503
2953599613,45cyclictest5312-21chrt07:26:383
2953599613,45cyclictest21156-21chrt09:30:383
2953599613,45cyclictest21156-21chrt09:30:383
2953599613,44cyclictest1745-21chrt10:46:023
2953599613,44cyclictest1745-21chrt10:46:023
2953599612,47cyclictest13156-21chrt07:49:143
2953599612,47cyclictest11472-21chrt10:08:563
2953599612,46cyclictest8648-21chrt11:53:083
2953599612,46cyclictest2501-21taskset07:18:363
2953599612,46cyclictest15752-21chrt10:15:413
2953599612,44cyclictest741-21chrt11:38:573
2953599612,32cyclictest29511-21chrt10:38:493
29531996138,18cyclictest2793-21latency_hist08:58:352
2953599604,44cyclictest18211-21chrt12:08:373
2953599604,44cyclictest18211-21chrt12:08:373
2953599603,45cyclictest18865-21chrt08:08:423
2953599603,45cyclictest18865-21chrt08:08:423
2953599603,45cyclictest15810-21chrt07:58:503
2953599603,44cyclictest2846-21chrt08:58:483
2953599603,44cyclictest15936-21chrt09:22:483
2953599602,46cyclictest9354-21chrt09:11:123
2953599602,46cyclictest3045-21chrt10:48:463
2953599602,46cyclictest23701-21chrt12:18:023
2953599602,46cyclictest16655-21taskset11:11:123
2953599602,46cyclictest16655-21taskset11:11:123
2953599602,45cyclictest32332-21chrt12:32:173
2953599602,45cyclictest32332-21chrt12:32:173
2953599602,45cyclictest27359-21taskset08:33:493
2953599602,45cyclictest27359-21taskset08:33:493
2953599602,45cyclictest26749-21taskset11:28:473
2953599602,44cyclictest32047-21chrt08:48:433
29531996040,14cyclictest761-21systemd-journal07:13:342
2953599593,44cyclictest26689-21taskset09:39:183
2953599592,46cyclictest12072-21chrt09:15:223
2953599592,44cyclictest4815-21chrt09:03:543
2953599592,44cyclictest32264-21chrt07:09:043
2953599572,42cyclictest895-21taskset07:13:383
29531995737,15cyclictest15903-21fschecks_time07:58:542
2953599562,44cyclictest12882-21chrt11:59:043
2953599562,44cyclictest12882-21chrt11:59:043
2836224810,23sleep30-21swapper/306:59:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional