You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-16 - 23:24
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Sun Aug 16, 2026 12:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
5346212511,81sleep15425-21/usr/sbin/munin07:05:161
67869910535,22cyclictest16647-21grep07:35:311
67829910456,42cyclictest14580-21ssh09:10:180
3167121030,6sleep10-21swapper/109:36:121
6782991024,82cyclictest8831-21apt-get08:55:070
6786999982,11cyclictest287-21dbus-daemon09:09:551
6782999931,20cyclictest18593-21apt-get11:50:110
6782999931,20cyclictest18593-21apt-get11:50:110
6782999768,21cyclictest6848-21latency_hist07:09:580
6791999569,19cyclictest6774-21cyclictest09:20:312
6786999539,49cyclictest0-21swapper/109:10:051
6782999560,23cyclictest23698-21latency_hist07:59:580
6782999560,23cyclictest23698-21latency_hist07:59:580
679199943,35cyclictest27543-21chrt12:04:282
6791999414,31cyclictest287-21dbus-daemon11:29:552
6786999442,45cyclictest0-21swapper/110:00:341
679199934,47cyclictest14509-21ssh12:35:082
679199934,47cyclictest14509-21ssh12:35:082
679199934,33cyclictest27560-21sshd11:13:192
679199933,33cyclictest3261-21/usr/sbin/munin10:35:062
679199933,33cyclictest3261-21/usr/sbin/munin10:35:062
6786999331,56cyclictest0-21swapper/112:09:561
6786999331,56cyclictest0-21swapper/112:09:561
6786999328,11cyclictest0-21swapper/109:25:271
6782999366,19cyclictest2492-21latency_hist11:24:570
6791999243,42cyclictest0-21swapper/207:15:002
679199923,36cyclictest30513-21grep09:35:152
679199923,32cyclictest9634-21tune2fs08:56:022
679199922,37cyclictest6461-21cut11:30:482
6791999141,43cyclictest0-21swapper/209:15:322
6791999141,43cyclictest0-21swapper/209:15:322
679199913,35cyclictest14884-21grep07:30:292
679199913,33cyclictest19063-21/usr/sbin/munin11:00:332
678699913,41cyclictest3970-21ps10:35:281
678699913,41cyclictest3970-21ps10:35:281
679199903,33cyclictest11618-21fschecks_time12:30:152
678699905,39cyclictest23812-21seq08:00:101
678699904,35cyclictest21306-21latency09:20:201
678699904,32cyclictest14698-21ps07:30:271
678699903,32cyclictest2430-21taskset12:15:231
6782999018,50cyclictest0-21swapper/008:25:290
679199894,33cyclictest1314-21fschecks_time09:40:172
679199894,32cyclictest6089-21tune2fs08:45:172
6791998937,44cyclictest0-21swapper/212:24:442
6791998937,44cyclictest0-21swapper/212:24:442
679199892,38cyclictest28871-21cat12:05:292
679199892,38cyclictest28871-21cat12:05:292
679199892,37cyclictest30121-21latency_hist08:19:572
678699894,39cyclictest21975-21latency_hist11:04:561
678699894,35cyclictest353-21runrttasks10:55:181
678699894,29cyclictest21746-21taskset11:55:081
678699893,34cyclictest353-21runrttasks12:10:181
6786998928,12cyclictest0-21swapper/112:39:101
6786998928,12cyclictest0-21swapper/112:39:101
6786998927,12cyclictest0-21swapper/112:20:361
6786998927,12cyclictest0-21swapper/112:20:361
6786998926,14cyclictest0-21swapper/109:40:271
678699892,31cyclictest2651-21sh11:25:091
678699892,29cyclictest8602-21apt-key07:14:591
6791998872,12cyclictest6774-21cyclictest07:40:162
679199884,36cyclictest28349-21modprobe08:14:542
679199884,35cyclictest7844-21timerwakeupswit07:10:312
679199884,32cyclictest710-21ntp_kernel_pll_10:30:212
6791998839,40cyclictest0-21swapper/210:10:312
6791998836,45cyclictest0-21swapper/212:25:192
6791998835,45cyclictest0-21swapper/211:05:072
679199883,34cyclictest15769-21fschecks_time11:45:182
679199883,33cyclictest25585-21fschecks_count08:05:152
679199883,32cyclictest12737-21/usr/sbin/munin10:50:052
679199883,31cyclictest13645-21/usr/sbin/munin10:00:232
6791998825,9cyclictest0-21swapper/211:40:122
679199882,35cyclictest17408-21ssh10:05:242
679199882,35cyclictest17408-21ssh10:05:242
6786998872,10cyclictest0-21swapper/108:45:201
678699884,39cyclictest10357-21grep08:56:181
678699883,40cyclictest9294-21cpu07:15:241
678699883,35cyclictest27723-21ntp_kernel_pll_09:30:241
678699883,34cyclictest27274-21tune2fs08:10:171
678699883,33cyclictest18823-21ls07:44:571
678699883,32cyclictest25237-21grep12:00:181
678699883,32cyclictest23093-21/usr/sbin/munin10:15:301
678699883,32cyclictest23093-21/usr/sbin/munin10:15:301
6786998831,9cyclictest0-21swapper/110:05:281
6786998831,9cyclictest0-21swapper/110:05:281
678699882,39cyclictest26609-21ssh11:10:511
678699882,34cyclictest21065-21ntpq07:50:221
678699882,31cyclictest16099-21/usr/sbin/munin11:45:271
679199874,33cyclictest8444-21unixbench_singl08:50:312
679199874,33cyclictest12523-21ssh10:49:562
679199873,35cyclictest31918-21/usr/sbin/munin11:20:182
679199873,35cyclictest16182-21/usr/sbin/munin07:35:222
679199873,35cyclictest14851-21fschecks_count09:10:302
679199873,35cyclictest11607-21grep07:20:292
679199873,34cyclictest7308-21/usr/sbin/munin09:50:332
679199873,34cyclictest7308-21/usr/sbin/munin09:50:332
6791998732,48cyclictest0-21swapper/210:25:322
678699874,35cyclictest4154-21/usr/sbin/munin09:45:121
678699874,32cyclictest13008-21fschecks_count10:50:161
6786998735,44cyclictest0-21swapper/111:05:311
678699873,36cyclictest20291-21modprobe07:49:541
678699873,36cyclictest10971-21apt09:00:061
678699873,36cyclictest10971-21apt09:00:061
678699873,35cyclictest13405-21unixbench_multi07:25:321
678699873,35cyclictest12255-21ssh12:30:291
678699873,34cyclictest30431-21timerwakeupswit10:25:311
678699873,34cyclictest10107-21ssh10:45:221
678699873,31cyclictest21385-21cron11:54:541
678699873,31cyclictest21385-21cron11:54:541
6782998734,29cyclictest28753-21apt-get11:15:110
6782998714,34cyclictest13043-21mailstats11:40:260
6791998642,37cyclictest0-21swapper/208:34:562
679199863,37cyclictest21910-21idleruntime-cro07:54:552
679199863,36cyclictest26879-21ntpq10:20:242
679199863,36cyclictest25932-21modprobe10:19:542
679199863,36cyclictest25932-21modprobe10:19:542
6791998633,46cyclictest0-21swapper/208:35:302
679199863,32cyclictest31766-21ntp_kernel_err12:10:222
679199862,38cyclictest2834-21timerandwakeup12:15:312
679199862,35cyclictest18848-21fschecks_count11:50:172
679199862,35cyclictest18848-21fschecks_count11:50:172
6791998615,23cyclictest17988-21sh10:58:022
678699864,32cyclictest12553-21fschecks_count11:40:141
678699863,36cyclictest353-21runrttasks10:30:181
678699863,34cyclictest1534-21awk08:30:231
678699863,34cyclictest10505-21taskset09:55:091
678699863,32cyclictest5955-21/usr/sbin/munin11:31:051
678699862,34cyclictest29500-21timerwakeupswit08:15:321
678699862,32cyclictest11102-21latency_hist12:29:561
679199853,36cyclictest9144-21ssh11:35:072
679199853,35cyclictest22575-21latency07:55:212
679199853,35cyclictest22575-21latency07:55:212
679199853,34cyclictest7194-21latency_hist09:49:572
679199853,34cyclictest5692-21latency_hist08:44:562
679199853,34cyclictest12817-21fschecks_time09:05:162
679199853,33cyclictest11704-21switchtime09:00:292
679199853,33cyclictest11704-21switchtime09:00:292
678699854,32cyclictest32510-21ssh11:20:231
678699853,32cyclictest9117-21latency_hist08:54:571
678699853,29cyclictest26520-21/usr/sbin/munin10:20:171
678699853,28cyclictest19930-21/usr/sbin/munin10:10:051
6786998528,12cyclictest0-21swapper/110:44:561
6786998526,12cyclictest0-21swapper/108:35:281
678699852,31cyclictest349-21unixbench_singl08:25:311
679199843,36cyclictest12988-21netstat07:25:232
679199843,34cyclictest11235-21mailstats09:55:282
679199843,28cyclictest28683-21runrttasks09:31:372
679199843,25cyclictest30013-21sh11:16:302
679199843,25cyclictest25046-21unixbench_singl09:25:312
679199842,28cyclictest31877-21runrttasks08:25:062
678699843,34cyclictest23068-21unixbench_multi07:55:311
678699843,34cyclictest23068-21unixbench_multi07:55:311
678699843,33cyclictest26759-21latency_hist08:09:571
678699843,32cyclictest30747-21netstat08:20:251
678699843,32cyclictest11175-21fschecks_time07:20:171
678699843,28cyclictest7308-21/usr/sbin/munin09:50:231
678699843,28cyclictest7308-21/usr/sbin/munin09:50:231
678699842,31cyclictest31180-21runrttasks11:18:541
678299843,36cyclictest5046-21/usr/sbin/munin12:20:340
678299843,36cyclictest5046-21/usr/sbin/munin12:20:340
6782998412,30cyclictest6813-21/usr/sbin/munin10:40:180
679199833,37cyclictest6694-21sort10:40:172
679199833,36cyclictest30946-21mailstats08:20:312
679199833,33cyclictest24368-21taskset11:59:282
679199833,32cyclictest19728-21grep07:45:302
6791998319,10cyclictest23865-21cpuspeed08:00:112
678699833,35cyclictest4526-21fschecks_time08:40:181
678699833,28cyclictest12221-21latency_hist11:39:581
678699832,37cyclictest204-21systemd-journal09:16:541
678699832,37cyclictest204-21systemd-journal09:16:541
6782998354,20cyclictest13935-21latency_hist07:29:570
6782998314,31cyclictest23803-21apt-get08:00:050
6782998261,15cyclictest297-21in:imuxsock09:29:540
6782998158,15cyclictest2622-21rm11:25:050
6782998110,26cyclictest13505-21grep09:05:300
679199803,26cyclictest6774-21cyclictest07:09:582
678299808,48cyclictest5976-21apt-get11:30:130
6782998063,13cyclictest6774-21cyclictest08:10:320
6782998057,15cyclictest204-21systemd-journal11:09:200
6782997957,14cyclictest9377-21ssh11:35:150
6782997957,13cyclictest30446-21rm09:35:110
6782997846,22cyclictest0-21swapper/010:00:170
6782997752,14cyclictest0-21swapper/010:15:320
6782997752,14cyclictest0-21swapper/010:15:320
678299772,55cyclictest8942-21gpgv08:54:570
6782997653,15cyclictest13365-21ssh12:32:520
6782997620,16cyclictest20696-21cstates07:50:120
679599753,31cyclictest15490-21chrt11:45:123
678299756,59cyclictest8330-21apt-get07:15:100
678299754,32cyclictest27710-21cron12:04:540
6782997519,26cyclictest26421-21sh11:10:310
6782997454,14cyclictest10649-21ssh10:45:330
6782997451,16cyclictest12260-21idleruntime-cro07:24:540
6782997450,15cyclictest26745-21kernelversion10:20:210
6782997439,27cyclictest0-21swapper/009:30:330
6782997433,30cyclictest20071-21rm11:00:320
6782997334,31cyclictest8201-21apt-get12:25:090
678299733,22cyclictest0-21swapper/011:55:320
6782997312,30cyclictest32012-21grep12:10:290
6782997311,27cyclictest3961-21cron08:39:540
679599723,28cyclictest27170-21chrt09:30:113
6782997254,10cyclictest13938-21diskmemload10:05:230
6782997254,10cyclictest13938-21diskmemload10:05:230
6782997250,16cyclictest8334-21latency_hist07:14:580
678299723,51cyclictest1224-21grep10:30:300
678299723,35cyclictest12880-21cstates10:50:120
678299723,34cyclictest14458-21/usr/sbin/munin12:35:300
678299723,34cyclictest14458-21/usr/sbin/munin12:35:300
678299723,33cyclictest15883-21/usr/sbin/munin10:55:230
6782997218,37cyclictest0-21swapper/010:35:190
6782997218,37cyclictest0-21swapper/010:35:190
6782997210,22cyclictest204-21systemd-journal10:11:190
678299716,29cyclictest18934-21modprobe07:44:580
6782997119,14cyclictest1760-21switchtime08:30:290
679599703,29cyclictest15006-21chrt12:35:203
679599703,29cyclictest15006-21chrt12:35:203
678299708,31cyclictest10290-21grep09:54:570
678299708,31cyclictest10290-21grep09:54:570
678299707,26cyclictest20875-21cpu09:20:110
6782997051,13cyclictest4506-21fschecks_time08:40:170
6782997031,32cyclictest0-21swapper/011:45:220
6782997020,31cyclictest0-21swapper/007:40:160
6782997013,30cyclictest25416-21apt-get08:05:050
665127017,34sleep30-21swapper/307:09:543
679599693,32cyclictest9238-21chrt11:35:103
679599693,26cyclictest8218-21chrt12:25:073
678299693,34cyclictest1752-21sendmail_mailst09:40:280
679599684,32cyclictest8242-21chrt08:50:293
679599683,30cyclictest24614-21chrt09:25:253
679599683,28cyclictest30992-21chrt11:18:243
679599683,27cyclictest23343-21chrt09:24:073
6782996846,13cyclictest13938-21diskmemload12:05:260
6782996846,13cyclictest13938-21diskmemload12:05:260
6782996839,20cyclictest353-21runrttasks10:25:260
678299683,43cyclictest12521-21latency_hist09:04:570
678299683,43cyclictest12521-21latency_hist09:04:570
6782996817,17cyclictest0-21swapper/009:15:310
6782996817,17cyclictest0-21swapper/009:15:310
679599673,32cyclictest5018-21chrt10:37:083
679599673,32cyclictest5018-21chrt10:37:083
679599673,23cyclictest6515-21chrt10:40:123
6782996747,10cyclictest0-21swapper/007:35:310
679599666,24cyclictest14878-21chrt10:53:083
679599663,23cyclictest20199-21chrt11:51:483
679599663,23cyclictest20199-21chrt11:51:483
679599663,22cyclictest17510-21chrt07:40:143
679599662,25cyclictest4714-21chrt08:40:213
679599662,23cyclictest14575-21chrt09:10:173
679599662,22cyclictest7045-21chrt11:31:013
6782996647,12cyclictest174-21jbd2/mmcblk2p2-808:24:250
678299663,42cyclictest4260-21cpuspeed09:45:120
679599652,26cyclictest25909-21taskset12:00:323
679599652,22cyclictest13825-21chrt10:00:133
6782996552,8cyclictest2698-21ssh12:15:300
678299653,49cyclictest7239-21idleruntime-cro08:49:540
679599644,29cyclictest21100-21taskset11:02:523
679599643,23cyclictest8731-21chrt09:51:173
679599643,23cyclictest8731-21chrt09:51:173
679599643,23cyclictest25390-21chrt08:04:593
679599643,21cyclictest25547-21chrt10:18:563
679599643,21cyclictest25547-21chrt10:18:563
679599642,20cyclictest31252-21chrt09:35:293
678299642,24cyclictest28887-21fschecks_time08:15:190
6782996417,9cyclictest13938-21diskmemload09:55:240
679599633,23cyclictest18157-21chrt10:06:083
679599633,23cyclictest18157-21chrt10:06:083
679599633,23cyclictest12998-21chrt11:40:253
679599633,22cyclictest27705-21taskset11:13:423
679599633,20cyclictest2776-21chrt12:15:313
679599632,23cyclictest19111-21chrt09:16:253
679599632,23cyclictest19111-21chrt09:16:253
679599632,21cyclictest2191-21chrt09:40:403
679599632,20cyclictest11039-21chrt09:55:233
678299634,39cyclictest353-21runrttasks07:30:100
679599629,11cyclictest0-21swapper/308:00:103
679599624,20cyclictest10658-21chrt08:59:533
679599623,22cyclictest2511-21chrt10:33:473
679599623,21cyclictest24299-21chrt11:59:183
679599622,23cyclictest30430-21chrt08:20:173
679599622,22cyclictest6878-21chrt12:22:193
679599622,22cyclictest6878-21chrt12:22:193
679599622,21cyclictest9641-21chrt10:45:103
679599622,21cyclictest29106-21chrt08:15:243
679599622,21cyclictest23255-21chrt07:56:453
679599622,21cyclictest23255-21chrt07:56:453
679599622,20cyclictest5587-21chrt09:46:193
679599613,22cyclictest13830-21chrt09:08:553
679599613,21cyclictest14962-21chrt07:30:303
679599613,20cyclictest11302-21chrt12:30:013
679599612,24cyclictest3156-21taskset11:25:213
679599612,23cyclictest28749-21chrt10:23:593
679599612,23cyclictest21728-21chrt07:52:493
679599612,22cyclictest9271-21chrt07:15:123
679599612,22cyclictest7021-21chrt08:47:303
679599612,22cyclictest3957-21chrt08:39:533
679599612,22cyclictest29616-21chrt10:25:123
679599612,21cyclictest32716-21chrt12:11:343
679599612,20cyclictest28270-21chrt08:13:583
679599612,19cyclictest19305-21chrt07:45:203
679599603,22cyclictest550-21taskset08:27:223
679599603,21cyclictest17148-21chrt10:55:513
679599603,21cyclictest13606-21chrt07:26:543
679599603,20cyclictest2071-21chrt08:31:143
679599603,20cyclictest20143-21chrt10:10:133
679599602,25cyclictest29263-21taskset12:05:463
679599602,25cyclictest29263-21taskset12:05:463
679599602,24cyclictest1649-21taskset11:23:153
679599602,22cyclictest8220-21chrt07:13:423
679599602,22cyclictest10978-21taskset09:00:093
679599602,22cyclictest10978-21taskset09:00:093
679599602,21cyclictest16879-21chrt07:37:433
679599602,21cyclictest12014-21chrt07:22:043
679599602,20cyclictest22188-21chrt11:05:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional