You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-31 - 17:59
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Sun May 31, 2026 12:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
200109912163,52cyclictest11675-21latency_hist11:15:060
200109912163,52cyclictest11675-21latency_hist11:15:060
20010991183,84cyclictest0-21swapper/010:10:480
20010991164,78cyclictest19676-21snmpd11:40:100
20010991164,78cyclictest19676-21snmpd11:40:100
20010991162,77cyclictest24403-21apt-get08:50:130
20010991162,77cyclictest24403-21apt-get08:50:130
200109911541,54cyclictest28661-21ssh09:55:080
200109911361,46cyclictest1-21systemd08:25:030
200109911329,49cyclictest0-21swapper/011:25:150
20010991132,73cyclictest9901-21ssh10:16:310
20010991117,99cyclictest0-21swapper/012:00:180
20010991117,99cyclictest0-21swapper/012:00:180
20010991112,74cyclictest24516-21ssh10:40:390
200109911121,72cyclictest0-21swapper/009:25:400
20010991103,74cyclictest21218-21/usr/sbin/munin11:30:240
20010991103,74cyclictest21218-21/usr/sbin/munin11:30:240
20010991099,59cyclictest0-21swapper/007:05:020
20010991093,72cyclictest0-21swapper/009:40:160
20010991093,72cyclictest0-21swapper/009:40:160
20010991084,91cyclictest4311-21apt-get07:50:160
20010991079,71cyclictest0-21swapper/011:16:130
20010991079,71cyclictest0-21swapper/011:16:130
20010991073,96cyclictest31680-21apt-get10:00:130
20010991073,76cyclictest20545-21rm12:21:120
20010991073,71cyclictest6458-21munin-run12:00:020
200109910728,60cyclictest18346-21rm12:18:270
200109910723,68cyclictest0-21swapper/012:07:450
1720921070,9sleep117213-21timerwakeupswit09:35:381
1720921070,9sleep117213-21timerwakeupswit09:35:381
20010991067,67cyclictest0-21swapper/009:20:210
20010991063,70cyclictest19266-21ls09:40:050
20010991063,70cyclictest19266-21ls09:40:050
200109910611,59cyclictest2657-21/usr/sbin/munin07:45:230
200109910611,59cyclictest2657-21/usr/sbin/munin07:45:230
20010991053,66cyclictest4454-21/usr/sbin/munin09:15:220
20010991052,67cyclictest5520-21kworker/u17:0+xprtiod12:14:140
20010991052,67cyclictest5520-21kworker/u17:0+xprtiod12:14:140
20010991043,84cyclictest0-21swapper/010:10:070
20010991043,84cyclictest0-21swapper/010:10:070
200109910424,48cyclictest0-21swapper/007:20:040
200109910424,48cyclictest0-21swapper/007:20:040
200109910420,47cyclictest0-21swapper/008:46:060
20010991033,92cyclictest24849-21taskset12:29:540
200109910338,58cyclictest0-21swapper/008:15:050
20010991033,67cyclictest16076-21sshd08:25:150
20010991033,64cyclictest2116-21switchtime09:10:390
20010991033,64cyclictest2116-21switchtime09:10:390
20010991033,64cyclictest0-21swapper/009:30:170
20010991033,64cyclictest0-21swapper/009:30:170
20010991033,63cyclictest18092-21ntp_states10:30:320
20010991033,63cyclictest18092-21ntp_states10:30:320
20010991032,73cyclictest26112-21seq08:55:200
20010991032,62cyclictest2719-21ssh11:00:040
200109910324,49cyclictest0-21swapper/007:55:220
200109910318,55cyclictest26580-21cat10:45:190
200109910316,49cyclictest0-21swapper/011:50:130
200109910221,51cyclictest0-21swapper/008:05:380
20031991018,50cyclictest0-21swapper/309:55:223
20010991014,61cyclictest25252-21ls09:50:040
200109910123,44cyclictest0-21swapper/010:35:380
20010991004,88cyclictest27351-21diskmemload11:20:130
20010991003,90cyclictest0-21swapper/010:20:130
20010991002,59cyclictest25075-21seq07:13:340
20010991002,59cyclictest25075-21seq07:13:340
200109910020,51cyclictest1-21systemd08:20:030
200109910020,51cyclictest1-21systemd08:20:030
2001099995,55cyclictest0-21swapper/011:04:320
2001099993,62cyclictest352-21runrttasks09:00:170
2001099993,62cyclictest352-21runrttasks09:00:170
2001099992,54cyclictest14430-21ssh10:25:100
2001099982,61cyclictest30414-21/usr/sbin/munin11:45:210
20025999751,17cyclictest12638-21ssh10:20:492
2001099974,61cyclictest0-21swapper/008:45:030
2001099973,83cyclictest0-21swapper/011:35:160
2001099972,83cyclictest25476-21apt-get09:50:140
20025999638,33cyclictest39-21ksoftirqd/210:52:572
2001099953,77cyclictest0-21swapper/008:35:150
2001099943,52cyclictest0-21swapper/007:05:370
2001099942,60cyclictest471-21seq09:08:510
2001099933,81cyclictest19994-21cyclictest07:00:070
2001099932,60cyclictest527-21seq07:36:430
20010999324,62cyclictest0-21swapper/011:05:290
20025999147,14cyclictest17650-21ssh10:30:202
20025999147,14cyclictest17650-21ssh10:30:202
20019999170,15cyclictest15729-21latency_hist08:25:041
2001099912,58cyclictest31489-21seq07:33:060
20025999062,19cyclictest17460-21sshd11:14:152
20025999062,19cyclictest17460-21sshd11:14:152
2001099904,77cyclictest28662-21/usr/sbin/munin07:25:310
2001099904,54cyclictest2326-21seq07:44:120
20019998967,15cyclictest5256-21apt-key10:10:061
20019998967,15cyclictest5256-21apt-key10:10:061
2001099892,52cyclictest30648-21ssh10:50:510
20010998921,58cyclictest0-21swapper/007:20:190
24192880,7sleep30-21swapper/310:59:213
20025998861,9cyclictest181rcu_preempt08:26:332
20010998830,51cyclictest0-21swapper/008:00:340
2001099882,60cyclictest18044-21runrttasks08:30:270
20025998759,20cyclictest13707-21latency09:30:272
20025998759,20cyclictest13707-21latency09:30:272
20025998751,16cyclictest181rcu_preempt08:53:262
20025998751,16cyclictest181rcu_preempt08:53:262
20019998755,12cyclictest589-21ssh09:09:101
2001999873,55cyclictest5539-21ssh10:10:191
20025998658,13cyclictest181rcu_preempt07:00:252
20025998642,11cyclictest181rcu_preempt11:20:342
2002599863,58cyclictest10220-21apt-get12:05:212
20025998542,18cyclictest27033-21latency_hist07:20:062
20019998561,10cyclictest181rcu_preempt11:23:001
20019998549,11cyclictest181rcu_preempt09:02:051
20019998549,11cyclictest181rcu_preempt09:02:051
20019998538,10cyclictest181rcu_preempt07:20:141
20025998441,10cyclictest181rcu_preempt12:25:412
20019998460,17cyclictest27351-21diskmemload11:05:271
20019998458,20cyclictest13974-21idleruntime-cro08:20:021
20019998458,20cyclictest13974-21idleruntime-cro08:20:021
20019998457,15cyclictest0-21swapper/109:56:121
20025998343,8cyclictest181rcu_preempt07:25:052
20019998360,16cyclictest3904-21sh11:00:371
2001999832,19cyclictest19638-21runrttasks09:40:411
2001999832,19cyclictest19638-21runrttasks09:40:411
190802836,52sleep119095-21open_inodes06:55:441
20025998263,14cyclictest19994-21cyclictest12:17:022
20025998255,21cyclictest11014-21apt-get08:10:312
20025998246,17cyclictest10223-21ssh09:25:142
20025998240,10cyclictest181rcu_preempt09:20:342
20019998259,15cyclictest2374-21systemd-journal10:21:151
20019998232,10cyclictest0-21swapper/110:00:151
20025998144,12cyclictest181rcu_preempt10:17:482
20019998140,13cyclictest181rcu_preempt10:50:231
20025998046,9cyclictest181rcu_preempt09:46:102
20025998039,8cyclictest181rcu_preempt12:25:042
20019998055,17cyclictest0-21swapper/107:10:351
20019998055,17cyclictest0-21swapper/107:10:351
20025997944,25cyclictest32404-21kworker/u19:2+nfsiod11:17:042
20025997944,25cyclictest32404-21kworker/u19:2+nfsiod11:17:042
20019997951,20cyclictest22512-21fschecks_time12:25:251
20019997948,11cyclictest181rcu_preempt08:55:051
20019997944,14cyclictest181rcu_preempt12:20:181
20019997942,11cyclictest181rcu_preempt11:48:191
2001999793,51cyclictest2335-21kworker/u17:1+ext4-rsv-conversion12:00:391
2001999793,51cyclictest2335-21kworker/u17:1+ext4-rsv-conversion12:00:391
2001999792,49cyclictest12216-21apt-get11:15:561
2001999792,49cyclictest12216-21apt-get11:15:561
20025997848,12cyclictest181rcu_preempt10:04:292
20025997847,12cyclictest181rcu_preempt12:00:592
20025997847,12cyclictest181rcu_preempt12:00:592
20025997824,25cyclictest0-21swapper/210:35:232
20025997810,30cyclictest381ktimers/211:59:512
20019997835,20cyclictest32178-21fschecks_time07:35:261
20019997833,26cyclictest22719-21runrttasks07:05:331
20025997764,8cyclictest0-21swapper/209:35:382
20025997764,8cyclictest0-21swapper/209:35:382
20025997746,17cyclictest19994-21cyclictest10:29:342
20025997727,22cyclictest0-21swapper/211:05:242
20019997756,15cyclictest4088-21latency_hist09:15:051
20019997756,15cyclictest4088-21latency_hist09:15:051
20019997749,20cyclictest5653-21latency_hist07:55:051
20019997740,13cyclictest181rcu_preempt07:15:281
20019997740,13cyclictest181rcu_preempt07:15:281
2001999773,54cyclictest9682-21apt-get12:05:181
20019997730,11cyclictest23065-21tune2fs08:46:011
20019997726,17cyclictest0-21swapper/109:33:481
20019997726,17cyclictest0-21swapper/109:33:481
2003199769,41cyclictest0-21swapper/310:10:403
20025997663,9cyclictest22800-21kworker/u18:1-rpciod09:17:172
20025997656,12cyclictest2658-21ssh11:00:022
20025997642,10cyclictest181rcu_preempt11:00:252
20025997641,11cyclictest181rcu_preempt11:30:352
20025997641,11cyclictest181rcu_preempt11:30:352
20025997640,10cyclictest181rcu_preempt07:27:592
20025997639,10cyclictest181rcu_preempt09:00:132
20025997639,10cyclictest181rcu_preempt09:00:132
20019997654,15cyclictest23929-21idleruntime-cro11:35:011
20019997654,15cyclictest23929-21idleruntime-cro11:35:011
20019997653,14cyclictest181rcu_preempt08:45:051
20019997648,8cyclictest181rcu_preempt10:30:041
20019997642,9cyclictest181rcu_preempt10:19:211
191002768,34sleep20-21swapper/206:55:452
20031997518,33cyclictest0-21swapper/312:05:243
20031997514,35cyclictest0-21swapper/312:00:173
20031997514,35cyclictest0-21swapper/312:00:173
20025997544,10cyclictest181rcu_preempt10:09:232
20025997544,10cyclictest181rcu_preempt10:09:232
20025997535,12cyclictest181rcu_preempt09:50:312
2002599753,48cyclictest26170-21sh10:45:032
20025997524,26cyclictest0-21swapper/210:45:352
20019997553,9cyclictest181rcu_preempt11:51:091
20019997552,16cyclictest19994-21cyclictest08:00:361
20019997539,13cyclictest11465-21ssh11:14:291
20019997539,13cyclictest11465-21ssh11:14:291
20019997534,7cyclictest181rcu_preempt12:10:401
20019997534,7cyclictest181rcu_preempt12:10:401
2003199744,31cyclictest21131-21chrt09:42:133
2003199744,31cyclictest21131-21chrt09:42:133
2003199743,32cyclictest19497-21taskset12:20:223
20025997443,8cyclictest181rcu_preempt08:15:372
20025997443,8cyclictest181rcu_preempt08:15:372
20025997442,10cyclictest181rcu_preempt11:45:052
20025997442,10cyclictest181rcu_preempt11:45:052
20025997440,10cyclictest181rcu_preempt08:46:002
20025997435,9cyclictest181rcu_preempt08:30:372
20019997443,15cyclictest3770-21/usr/sbin/munin11:55:371
20019997439,13cyclictest301ktimers/110:44:591
20019997431,20cyclictest27351-21diskmemload09:25:371
2003199732,26cyclictest31693-21chrt10:00:133
20025997345,7cyclictest181rcu_preempt07:30:142
20025997332,18cyclictest181rcu_preempt07:13:282
20025997332,18cyclictest181rcu_preempt07:13:282
20019997338,9cyclictest181rcu_preempt11:27:591
2003199728,43cyclictest0-21swapper/311:15:313
2003199728,43cyclictest0-21swapper/311:15:313
2003199723,32cyclictest31157-21taskset07:30:393
20025997243,8cyclictest181rcu_preempt08:00:162
20025997241,8cyclictest181rcu_preempt07:15:402
20025997240,8cyclictest181rcu_preempt09:57:112
20025997239,9cyclictest181rcu_preempt08:20:412
20025997229,17cyclictest181rcu_preempt12:11:062
20025997229,17cyclictest181rcu_preempt12:11:062
20025997216,32cyclictest39-21ksoftirqd/207:45:252
20025997216,32cyclictest39-21ksoftirqd/207:45:252
20025997216,25cyclictest0-21swapper/207:50:312
20019997251,11cyclictest0-21swapper/107:45:391
20019997251,11cyclictest0-21swapper/107:45:391
20019997220,24cyclictest29991-21latency_hist11:45:041
20019997220,24cyclictest29991-21latency_hist11:45:041
2003199714,25cyclictest3680-21taskset11:55:053
2003199713,31cyclictest22370-21chrt10:37:543
20025997142,10cyclictest181rcu_preempt11:45:132
20025997138,11cyclictest181rcu_preempt08:55:262
20019997152,13cyclictest1168-21cstates07:40:191
20019997151,13cyclictest17460-21sshd10:48:141
20019997135,11cyclictest19575-21ssh10:33:281
20019997135,11cyclictest19575-21ssh10:33:281
1843027112,36sleep30-21swapper/306:55:083
20025997052,12cyclictest1546-21ssh11:50:332
20025997051,13cyclictest21796-21fschecks_time07:05:092
20025997044,8cyclictest181rcu_preempt07:35:372
2002599704,41cyclictest4940-21apt-get10:10:082
20025997043,8cyclictest181rcu_preempt09:07:182
20019997032,12cyclictest181rcu_preempt10:37:461
20019997026,7cyclictest181rcu_preempt09:54:351
20019997026,17cyclictest0-21swapper/108:10:061
2003199693,30cyclictest32198-21taskset10:55:043
2003199693,23cyclictest11267-21chrt09:25:403
2003199693,20cyclictest25015-21chrt08:50:353
2003199693,20cyclictest25015-21chrt08:50:353
2003199692,32cyclictest27387-21chrt11:40:183
2003199692,32cyclictest27387-21chrt11:40:183
20019996951,12cyclictest602-21/usr/sbin/munin10:55:311
20019996944,7cyclictest181rcu_preempt09:50:041
20019996939,9cyclictest181rcu_preempt11:38:051
20019996937,7cyclictest181rcu_preempt12:17:051
20025996844,10cyclictest181rcu_preempt07:43:342
20019996852,11cyclictest19994-21cyclictest08:55:341
20019996840,8cyclictest181rcu_preempt09:20:111
20019996824,13cyclictest0-21swapper/108:52:591
2003199673,29cyclictest14284-21chrt10:25:053
2002599674,36cyclictest19074-21threads11:25:382
20025996743,15cyclictest0-21swapper/211:35:362
2002599673,43cyclictest9341-21fschecks_count08:05:242
2002599672,38cyclictest20000-21grep09:41:072
2002599672,38cyclictest20000-21grep09:41:072
20019996740,7cyclictest181rcu_preempt07:00:241
2003199663,27cyclictest23002-21chrt07:05:403
2003199663,25cyclictest32187-21chrt09:06:473
2003199662,31cyclictest19772-21chrt10:34:013
2003199662,31cyclictest19772-21chrt10:34:013
2002599663,43cyclictest352-21runrttasks07:56:542
2002599663,43cyclictest2154-21timerandwakeup09:10:392
2002599663,43cyclictest2154-21timerandwakeup09:10:392
20019996639,10cyclictest181rcu_preempt07:30:241
20019996637,13cyclictest181rcu_preempt08:30:371
20019996635,9cyclictest181rcu_preempt09:16:501
20019996624,13cyclictest0-21swapper/107:25:251
2003199653,29cyclictest4857-21taskset09:15:313
2003199652,25cyclictest7934-21chrt09:20:333
20019996544,8cyclictest181rcu_preempt07:55:371
20019996538,9cyclictest181rcu_preempt08:26:221
20019996518,37cyclictest19702-21latency08:35:281
2003199643,26cyclictest26710-21taskset08:55:373
2003199643,23cyclictest8064-21chrt08:00:313
2003199643,20cyclictest27935-21chrt07:20:383
2003199642,25cyclictest4262-21chrt11:55:303
2003199642,25cyclictest19835-21taskset08:35:323
2003199633,25cyclictest31699-21chrt11:46:423
2003199633,23cyclictest13998-21chrt08:20:033
2003199633,23cyclictest13998-21chrt08:20:033
2003199632,26cyclictest2897-21taskset09:12:103
2003199632,26cyclictest2897-21taskset09:12:103
2003199632,25cyclictest23491-21taskset11:33:503
2003199632,25cyclictest23491-21taskset11:33:503
2003199632,24cyclictest29350-21chrt09:02:133
2003199632,24cyclictest29350-21chrt09:02:133
2003199632,21cyclictest14613-21chrt09:31:233
2003199632,21cyclictest14613-21chrt09:31:233
2002599632,44cyclictest22266-21/usr/sbin/munin08:45:042
20025996323,8cyclictest0-21swapper/208:40:062
20019996337,8cyclictest181rcu_preempt08:11:401
2003199623,24cyclictest16015-21chrt12:15:033
2003199623,24cyclictest16015-21chrt12:15:033
2003199623,24cyclictest10157-21taskset11:10:483
2003199623,24cyclictest10157-21taskset11:10:483
2003199623,22cyclictest18492-21chrt09:38:533
2003199623,22cyclictest18492-21chrt09:38:533
2003199623,21cyclictest3751-21chrt07:46:463
2003199623,21cyclictest3751-21chrt07:46:463
2003199623,21cyclictest29212-21chrt07:25:323
2003199623,20cyclictest22404-21chrt12:25:213
2003199623,19cyclictest4510-21chrt11:01:493
2003199623,19cyclictest2136-21chrt07:41:403
2003199622,24cyclictest24211-21taskset07:10:263
2003199622,24cyclictest24211-21taskset07:10:263
2003199622,24cyclictest17008-21chrt10:29:433
2003199622,23cyclictest27062-21chrt10:45:323
2003199622,23cyclictest26299-21taskset11:38:203
2003199622,22cyclictest25477-21chrt07:15:153
2003199622,22cyclictest25477-21chrt07:15:153
2003199622,21cyclictest598-21chrt07:37:353
2003199622,21cyclictest15395-21chrt11:20:213
2003199622,19cyclictest16656-21chrt08:26:293
20031996210,43cyclictest0-21swapper/307:05:033
2003199613,20cyclictest11244-21chrt08:11:213
2003199613,19cyclictest4469-21chrt07:50:233
2003199613,19cyclictest25573-21chrt10:43:293
2003199612,22cyclictest26936-21taskset09:51:383
2003199612,21cyclictest9143-21chrt08:05:173
2003199612,21cyclictest24039-21chrt09:46:593
2003199612,21cyclictest10472-21chrt10:18:083
2003199612,19cyclictest18153-21chrt11:25:073
2003199604,19cyclictest18722-21chrt08:31:073
2003199603,20cyclictest17506-21taskset12:16:053
2003199603,19cyclictest21757-21chrt08:40:383
2003199602,20cyclictest6949-21chrt07:56:103
2003199602,19cyclictest2278-21chrt10:05:193
2003199602,19cyclictest2278-21chrt10:05:193
2003199602,19cyclictest14775-21chrt08:20:363
2003199598,12cyclictest0-21swapper/311:05:363
2003199593,20cyclictest22777-21chrt08:45:203
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional