You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-04 - 00:25
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot7.osadl.org (updated Thu Sep 03, 2026 12:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28229915560,70cyclictest0-21swapper/007:40:270
28229913341,54cyclictest13443-21latency10:55:230
28359911642,30cyclictest0-21swapper/110:29:071
2675211311,70sleep12692-21latency_hist07:09:591
28229911143,55cyclictest0-21swapper/012:15:020
28229910746,54cyclictest2816-21cyclictest09:44:310
2822991074,10cyclictest0-21swapper/012:30:150
2822991073,24cyclictest26992-21ssh10:26:170
2822991073,22cyclictest2443-21ssh11:29:530
2822991072,24cyclictest2362-21ssh09:47:060
28229910649,52cyclictest0-21swapper/010:15:210
28229910646,51cyclictest29488-21ntp_kernel_err11:20:250
28229910646,51cyclictest10043-21ntp_offset11:40:260
2822991063,24cyclictest6006-21ssh10:44:110
2822991053,22cyclictest22955-21taskset08:09:080
2822991053,12cyclictest19368-21apt-get11:05:120
2822991052,22cyclictest12866-21runrttasks07:37:150
2822991033,24cyclictest32249-21taskset10:34:380
2822991032,24cyclictest17745-21ssh11:01:400
2822991032,24cyclictest17745-21ssh11:01:400
2822991023,27cyclictest11705-21ssh10:52:310
2822991023,26cyclictest5460-21ssh12:24:500
2822991023,21cyclictest5193-21ssh09:51:110
2822991023,21cyclictest1556-21ssh12:18:030
2822991023,21cyclictest1556-21ssh12:18:030
2822991022,26cyclictest6372-21taskset07:19:510
2822991013,28cyclictest8076-21ssh10:46:220
2822991013,27cyclictest13253-21sh09:14:350
2822991012,26cyclictest16453-21taskset07:48:380
2822991012,24cyclictest8436-21taskset09:02:480
2822991012,24cyclictest8436-21taskset09:02:480
2822991012,24cyclictest28200-21taskset11:19:020
28439910054,37cyclictest0-21swapper/212:35:472
2822991003,24cyclictest17907-21taskset07:51:380
2822991003,24cyclictest15118-21ssh09:16:140
2822991003,23cyclictest27695-21seq08:22:330
2822991003,23cyclictest14399-21sh11:47:180
2822991002,24cyclictest24936-21ssh11:13:500
2822991002,22cyclictest21581-21ssh09:26:250
2835999950,39cyclictest0-21swapper/108:05:011
2835999950,39cyclictest0-21swapper/108:05:011
2822999952,41cyclictest18948-21ntp_kernel_pll_07:55:250
282299993,24cyclictest25412-21ssh09:33:050
282299993,22cyclictest8769-21ssh09:57:130
282299993,22cyclictest24663-21ssh10:22:030
282299993,21cyclictest7078-21ssh12:25:520
282299992,24cyclictest10140-21seq09:09:050
282299992,22cyclictest4325-21ssh11:30:580
282299992,22cyclictest4325-21ssh11:30:580
234982990,7sleep223495-21ssh10:20:262
282299983,25cyclictest343-21runrttasks07:11:090
282299983,25cyclictest343-21runrttasks07:11:090
282299983,23cyclictest19509-21ssh09:24:140
282299982,23cyclictest28510-21ssh09:37:540
282299982,23cyclictest28510-21ssh09:37:540
282299982,23cyclictest23711-21ssh12:01:430
2822999733,58cyclictest12781-21netstat12:35:290
282299973,22cyclictest343-21runrttasks07:29:030
282299973,10cyclictest32734-21ssh10:35:110
282299972,27cyclictest24521-21taskset08:13:330
152429717,41sleep00-21swapper/007:05:250
2835999652,37cyclictest0-21swapper/112:30:011
283599962,8cyclictest0-21swapper/110:45:151
282299963,24cyclictest8663-21taskset11:38:570
282299963,24cyclictest18015-21sh10:11:240
282299963,24cyclictest18015-21sh10:11:240
282299962,24cyclictest11389-21taskset07:33:550
282299962,23cyclictest28443-21taskset08:25:390
2843999540,47cyclictest0-21swapper/207:55:222
2835999538,48cyclictest1-21systemd12:04:301
2822999546,43cyclictest25733-21sh12:05:230
282299954,30cyclictest15778-21/usr/sbin/munin11:50:370
284399943,43cyclictest30008-21taskset08:30:092
284399943,43cyclictest30008-21taskset08:30:092
2835999441,45cyclictest0-21swapper/110:59:581
283599943,68cyclictest8030-21apt-get07:25:121
282299943,23cyclictest30006-21apt-get08:30:090
282299943,23cyclictest30006-21apt-get08:30:090
282299943,23cyclictest1207-21cat08:40:250
282299943,14cyclictest16359-21latency_hist10:10:010
282299942,23cyclictest26115-21taskset08:18:190
2843999354,31cyclictest25754-21kworker/u17:1-rpciod11:27:312
2843999343,45cyclictest0-21swapper/210:34:402
2843999341,45cyclictest0-21swapper/210:26:222
2835999352,34cyclictest0-21swapper/110:15:261
283599933,7cyclictest0-21swapper/109:20:111
283599932,29cyclictest17173-21chrt11:51:181
283599932,26cyclictest8611-21ssh11:38:481
2822999339,48cyclictest10232-21diskmemload11:55:280
282299933,26cyclictest343-21runrttasks08:50:360
282299932,28cyclictest343-21runrttasks08:39:370
2843999238,46cyclictest0-21swapper/209:48:282
284399923,44cyclictest28918-21apt-get11:20:102
284399915,44cyclictest15827-21ssh11:50:162
2843999119,10cyclictest0-21swapper/208:45:002
2835999144,40cyclictest0-21swapper/112:34:581
282299912,23cyclictest3673-21taskset08:49:040
208302910,7sleep00-21swapper/008:00:350
208302910,7sleep00-21swapper/008:00:350
195032910,6sleep10-21swapper/111:05:151
284399903,40cyclictest13263-21fschecks_count10:55:192
2843999033,49cyclictest0-21swapper/207:20:312
2843999033,49cyclictest0-21swapper/207:20:312
282299903,27cyclictest11090-21threads10:00:340
2843998929,8cyclictest0-21swapper/209:00:262
2843998929,8cyclictest0-21swapper/209:00:262
2843998922,10cyclictest0-21swapper/208:59:592
2835998849,32cyclictest0-21swapper/112:05:211
2835998841,41cyclictest0-21swapper/109:00:311
2835998841,41cyclictest0-21swapper/109:00:311
284399874,34cyclictest13523-21grep09:15:012
284399873,29cyclictest31656-21date12:15:022
284399873,28cyclictest20396-21ssh10:15:292
2835998748,33cyclictest0-21swapper/110:40:201
282299873,24cyclictest6558-21tail08:55:340
284399864,27cyclictest22127-21/usr/sbin/munin12:00:152
284399863,31cyclictest15559-21grep07:46:212
284399863,22cyclictest200832processes11:05:302
2843998630,8cyclictest0-21swapper/212:25:282
2843998630,8cyclictest0-21swapper/209:30:252
283599863,7cyclictest0-21swapper/110:05:131
283599863,40cyclictest1426-21/usr/sbin/munin08:40:321
283599862,6cyclictest0-21swapper/112:15:571
283599862,6cyclictest0-21swapper/112:15:571
283599862,23cyclictest343-21runrttasks09:42:391
2822998631,47cyclictest0-21swapper/007:25:030
2822998631,47cyclictest0-21swapper/007:25:030
284399853,30cyclictest8824-21cut07:26:072
284399853,28cyclictest9990-21ssh10:00:012
284399853,27cyclictest10381-21ssh11:40:332
2843998530,8cyclictest0-21swapper/210:00:082
2843998527,11cyclictest0-21swapper/211:10:262
2835998562,15cyclictest2816-21cyclictest08:26:221
283599853,7cyclictest0-21swapper/111:35:111
283599853,7cyclictest0-21swapper/111:35:111
283599853,35cyclictest13117-21sendmail07:39:591
283599852,43cyclictest17248-21taskset10:10:341
283599852,43cyclictest17248-21taskset10:10:341
283599852,23cyclictest18132-21taskset07:54:341
284399843,32cyclictest4291-21ssh09:50:282
284399843,29cyclictest675-21latency_hist08:40:022
284399843,29cyclictest366-21sshd08:27:302
284399843,29cyclictest19564-21seq11:55:262
284399843,27cyclictest5526-21munin-plugin-st12:24:572
284399843,27cyclictest200-21systemd-journal09:19:582
2843998429,8cyclictest0-21swapper/212:05:262
2835998446,31cyclictest0-21swapper/108:15:011
2835998439,37cyclictest0-21swapper/107:10:281
2835998439,37cyclictest0-21swapper/107:10:281
283599843,38cyclictest26554-21apt-get08:20:151
283599843,37cyclictest14384-21taskset09:15:291
283599843,35cyclictest31662-21latency_hist12:15:021
283599843,33cyclictest8986-21cstates09:05:181
212928422,35sleep30-21swapper/307:05:453
284399834,30cyclictest20174-21cpu09:25:152
284399834,26cyclictest3389-21grep08:45:352
2843998334,42cyclictest0-21swapper/211:05:012
2843998334,42cyclictest0-21swapper/211:05:012
284399833,31cyclictest5414-21latency_hist08:55:012
284399833,27cyclictest16586-21/usr/sbin/munin10:10:362
284399833,27cyclictest16586-21/usr/sbin/munin10:10:362
284399833,26cyclictest9778-21ssh12:30:362
2843998329,7cyclictest0-21swapper/209:41:372
2843998328,9cyclictest0-21swapper/211:15:302
2843998328,9cyclictest0-21swapper/209:10:002
2843998328,8cyclictest0-21swapper/210:50:522
284399832,30cyclictest3484-21fschecks_time11:30:372
284399832,30cyclictest3484-21fschecks_time11:30:372
2835998359,17cyclictest26990-21latency09:35:241
2835998359,17cyclictest26990-21latency09:35:241
2835998345,31cyclictest1372-21diskmemload11:27:081
283599834,35cyclictest21663-21modprobe08:05:021
283599833,8cyclictest0-21swapper/110:50:131
283599833,38cyclictest619-21/usr/sbin/munin09:45:371
283599833,38cyclictest12766-21/usr/sbin/munin12:35:281
283599833,35cyclictest791-21/usr/sbin/munin10:35:251
2843998264,12cyclictest14087-21proc_pri10:05:312
284399825,27cyclictest3780-21fschecks_time10:40:202
284399824,29cyclictest29796-21ssh09:40:032
284399824,29cyclictest29796-21ssh09:40:032
284399823,31cyclictest2692-21latency_hist07:10:042
284399823,28cyclictest5271-21fschecks_count07:15:232
284399823,28cyclictest15072-21cut07:45:032
284399823,27cyclictest23033-21latency_hist08:09:582
284399823,27cyclictest11730-21/usr/sbin/munin07:35:102
2843998228,11cyclictest7062-21interrupts10:45:232
283599824,35cyclictest31767-21latency_hist11:25:011
283599823,8cyclictest0-21swapper/111:10:131
283599823,36cyclictest2700-21ssh12:20:131
283599823,36cyclictest16526-21fschecks_time11:00:231
283599823,36cyclictest16526-21fschecks_time11:00:231
283599823,34cyclictest19772-21/usr/sbin/munin11:55:301
284399814,29cyclictest343-21runrttasks11:39:042
284399813,30cyclictest27459-21grep08:20:352
284399813,28cyclictest17186-21/usr/sbin/munin07:50:242
284399813,27cyclictest10396-21fschecks_time07:30:212
284399813,25cyclictest26262-21latency_hist08:20:022
284399812,32cyclictest15589-21latency_hist11:50:012
283599814,37cyclictest7015-21apt-get09:55:101
2835998139,31cyclictest0-21swapper/109:35:011
283599813,38cyclictest25885-21/usr/sbin/munin08:15:351
283599813,33cyclictest10918-21/usr/sbin/munin09:10:221
283599813,30cyclictest2569-21/usr/sbin/munin08:45:181
283599812,38cyclictest22215-21ssh09:28:021
284399805,29cyclictest24054-21taskset08:10:322
284399804,29cyclictest457-21ssh10:35:182
284399803,33cyclictest20012-21ssh09:25:032
2843998027,9cyclictest0-21swapper/212:15:382
2843998027,9cyclictest0-21swapper/212:15:382
2843998025,8cyclictest0-21swapper/207:10:342
2843998025,8cyclictest0-21swapper/207:10:342
284399802,27cyclictest20105-21cpu08:00:162
284399802,27cyclictest20105-21cpu08:00:162
2835998040,33cyclictest0-21swapper/108:35:371
283599803,7cyclictest0-21swapper/107:15:141
283599803,37cyclictest4650-21/usr/sbin/munin08:50:321
283599803,37cyclictest18978-21ntp_states07:55:281
283599803,36cyclictest9631-21ssh11:40:171
283599803,31cyclictest13861-21/usr/sbin/munin07:40:261
283599803,27cyclictest6981-21latency_hist08:59:591
283599794,14cyclictest6688-21apt-get07:20:091
283599794,14cyclictest6688-21apt-get07:20:091
283599793,38cyclictest4069-21ssh09:50:231
283599793,35cyclictest12293-21ssh10:03:001
283599793,33cyclictest30176-21/usr/sbin/munin08:30:191
283599793,33cyclictest30176-21/usr/sbin/munin08:30:191
283599793,32cyclictest25936-21sed10:25:001
283599793,32cyclictest10554-21/usr/sbin/munin07:30:251
283599793,24cyclictest16675-21latency_hist07:50:011
283599792,33cyclictest30461-21timerandwakeup10:30:381
283599792,33cyclictest25842-21ssh11:15:141
283599783,29cyclictest12780-21/usr/sbin/munin11:45:151
284999713,35cyclictest10220-21taskset10:00:103
284999713,34cyclictest3865-21chrt09:50:133
284999713,34cyclictest25918-21chrt11:15:173
284999703,35cyclictest29942-21chrt09:40:123
284999684,33cyclictest21540-21taskset10:17:153
284999683,37cyclictest2954-21taskset08:45:283
284999673,33cyclictest9678-21chrt12:30:343
284999672,35cyclictest8021-21chrt11:37:183
284999672,34cyclictest15851-21chrt10:59:583
284999663,50cyclictest18254-21taskset11:02:583
284999663,50cyclictest18254-21taskset11:02:583
284999663,49cyclictest7278-21taskset09:00:143
284999663,49cyclictest7278-21taskset09:00:143
284999663,35cyclictest19757-21taskset07:59:493
284999663,34cyclictest7925-21taskset12:28:033
284999663,32cyclictest25290-21taskset10:23:393
284999663,32cyclictest15249-21chrt07:45:233
284999662,34cyclictest20612-21chrt08:00:303
284999662,34cyclictest20612-21chrt08:00:303
284999653,30cyclictest15649-21chrt11:50:023
284999643,32cyclictest23354-21chrt09:30:153
284999643,31cyclictest4974-21chrt07:15:103
284999643,31cyclictest21872-21chrt08:05:193
284999643,31cyclictest20986-21chrt09:25:333
284999643,31cyclictest11904-21chrt07:35:193
284999643,30cyclictest32662-21chrt08:36:213
284999643,29cyclictest8250-21chrt09:55:523
284999642,36cyclictest24761-21taskset11:13:233
284999642,36cyclictest23309-21taskset08:10:133
284999642,32cyclictest5474-21taskset10:42:483
284999642,32cyclictest4860-21chrt11:32:193
284999642,32cyclictest4860-21chrt11:32:193
284999642,29cyclictest1002-21chrt12:16:403
284999642,29cyclictest1002-21chrt12:16:403
284999633,31cyclictest24207-21taskset12:02:583
284999633,31cyclictest1466-21chrt10:35:473
284999633,30cyclictest17831-21chrt07:50:383
284999633,30cyclictest14375-21taskset09:15:283
284999633,29cyclictest30346-21taskset11:21:213
284999633,29cyclictest17535-21chrt09:20:273
284999633,29cyclictest11469-21chrt10:51:563
284999633,28cyclictest26746-21chrt12:06:233
284999633,28cyclictest1561-21chrt08:40:343
284999633,28cyclictest15222-21chrt10:07:233
284999633,27cyclictest5140-21chrt12:24:013
284999632,31cyclictest12082-21chrt09:11:353
284999623,30cyclictest3996-21chrt07:10:373
284999623,30cyclictest3996-21chrt07:10:373
284999623,29cyclictest30068-21taskset12:11:463
284999623,29cyclictest29138-21chrt10:29:473
284999623,29cyclictest20560-21chrt11:05:453
284999623,28cyclictest6664-21chrt07:20:043
284999623,28cyclictest6664-21chrt07:20:043
284999623,28cyclictest6641-21chrt08:55:493
284999623,28cyclictest17508-21chrt11:52:093
284999623,27cyclictest29485-21chrt08:26:503
284999623,26cyclictest11163-21chrt07:30:573
284999622,31cyclictest10648-21chrt11:40:503
284999622,29cyclictest31123-21chrt10:31:463
284999622,29cyclictest14676-21chrt12:38:043
284999622,29cyclictest10181-21chrt09:09:373
284999614,25cyclictest20936-21chrt11:57:483
284999613,29cyclictest28881-21chrt09:38:503
284999613,29cyclictest28881-21chrt09:38:503
284999613,28cyclictest27817-21chrt08:24:103
284999613,27cyclictest8417-21chrt10:47:143
284999612,34cyclictest0-21swapper/307:25:133
284999612,29cyclictest31208-21chrt08:33:223
284999612,29cyclictest31208-21chrt08:33:223
284999612,26cyclictest25942-21chrt08:16:093
284999603,28cyclictest2172-21chrt09:46:363
284999603,28cyclictest17830-21chrt10:10:553
284999603,28cyclictest17830-21chrt10:10:553
284999603,28cyclictest14676-21chrt07:44:343
284999602,29cyclictest976-21chrt11:26:073
284999602,28cyclictest5114-21chrt08:51:523
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional