You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-09 - 13:19
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Thu Jul 09, 2026 00:44:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3231212811,88sleep23238-21modprobe18:57:252
225521259,87sleep00-21swapper/018:52:550
33979910672,13cyclictest58-21kcompactd020:57:460
33979910672,13cyclictest58-21kcompactd020:57:460
34049910349,47cyclictest0-21swapper/219:37:462
3404991033,41cyclictest15045-21cat22:52:502
239721019,62sleep12430-21ntpq18:53:001
340499962,43cyclictest11464-21ntp_states20:57:572
340499962,43cyclictest11464-21ntp_states20:57:572
340499959,64cyclictest11981-21apt-get23:42:512
3397999478,10cyclictest10522-21diskmemload21:17:280
3404999336,49cyclictest0-21swapper/200:13:012
3404999336,49cyclictest0-21swapper/200:13:012
340499923,30cyclictest9229-21ssh22:42:562
340499923,28cyclictest3743-21taskset18:57:472
3404999229,10cyclictest0-21swapper/200:22:472
340499913,66cyclictest1106-21modprobe20:27:432
340499913,37cyclictest11594-21kernelversion21:52:502
340499913,37cyclictest11594-21kernelversion21:52:502
3404999127,12cyclictest0-21swapper/220:12:132
3397999142,29cyclictest8413-21ssh23:37:160
3397999142,29cyclictest8413-21ssh23:37:160
340499903,37cyclictest28779-21/usr/sbin/munin21:27:502
340499903,34cyclictest14147-21fschecks_count19:27:472
3404999024,57cyclictest0-21swapper/219:07:452
3404999024,57cyclictest0-21swapper/219:07:452
340499893,36cyclictest8332-21cstates21:47:422
340499893,36cyclictest26073-21ssh21:22:462
3404998933,48cyclictest0-21swapper/219:52:262
340499893,32cyclictest9149-21/usr/sbin/munin20:52:512
340499893,32cyclictest5468-21fschecks_count21:42:452
340499892,60cyclictest2769-21ssh22:32:482
3404998911,27cyclictest18981-21uniq19:42:452
3402998944,11cyclictest58-21kcompactd021:00:561
3402998944,11cyclictest58-21kcompactd021:00:561
340499883,33cyclictest24019-21ntpq23:07:522
340499883,31cyclictest8626-21latency_hist23:37:282
340499883,31cyclictest8626-21latency_hist23:37:282
340499883,28cyclictest32330-21/usr/sbin/munin23:22:342
3404998829,8cyclictest0-21swapper/220:27:272
3404998821,14cyclictest1000-21sh00:17:572
3402998869,9cyclictest0-21swapper/122:12:481
3404998736,44cyclictest0-21swapper/222:58:012
340499873,35cyclictest30289-21timerandwakeup23:18:002
340499873,33cyclictest8493-21grep20:48:022
340499873,30cyclictest14871-21grep21:03:022
340499873,30cyclictest14871-21grep21:03:022
340499873,28cyclictest9779-21tail19:13:212
3404998730,12cyclictest0-21swapper/219:07:292
3404998726,11cyclictest0-21swapper/221:13:002
340499872,31cyclictest27905-21grep00:08:022
340499872,30cyclictest11900-21fschecks_time22:47:472
340499872,26cyclictest23871-21fschecks_time19:57:472
340499863,32cyclictest29121-21sendmail_mailtr20:12:582
340499863,32cyclictest25814-21latency_hist22:17:272
340499863,32cyclictest18156-21fschecks_count23:52:452
340499863,30cyclictest2962-21find21:37:582
340499863,29cyclictest352-21runrttasks19:23:162
340499863,27cyclictest30913-21timerwakeupswit20:18:012
3404998625,12cyclictest0-21swapper/223:28:082
3404998625,11cyclictest0-21swapper/220:41:042
3404998625,11cyclictest0-21swapper/220:41:042
3404998624,13cyclictest0-21swapper/222:40:512
340499862,40cyclictest22419-21cat19:52:512
340499862,33cyclictest4215-21ls20:37:272
340499862,33cyclictest4215-21ls20:37:272
340499853,37cyclictest6210-21idleruntime20:42:482
340499853,35cyclictest25198-21/usr/sbin/munin20:02:592
340499853,32cyclictest23813-21/usr/sbin/munin00:02:472
340499853,30cyclictest17329-21cat21:07:512
340499852,32cyclictest23487-21proc_pri21:17:582
340499852,32cyclictest16118-21ps19:32:552
340499852,32cyclictest16118-21ps19:32:552
340499852,31cyclictest11703-21grep19:18:462
340499852,30cyclictest32109-21sh21:32:482
340499852,29cyclictest15201-21grep23:47:462
340499852,27cyclictest11872-21apt-key23:42:282
340499844,27cyclictest17128-21ssh22:02:402
340499844,27cyclictest17128-21ssh22:02:402
340499843,34cyclictest21336-21sh23:03:002
340499843,33cyclictest26698-21fschecks_time23:12:442
340499843,30cyclictest32527-21ntpq22:27:542
340499843,30cyclictest20929-21ssh23:57:402
340499843,29cyclictest26127-21cstates22:17:422
3404998428,8cyclictest0-21swapper/221:58:022
3404998420,12cyclictest0-21swapper/222:07:552
3397998459,8cyclictest181rcu_preempt23:12:250
3402998366,11cyclictest297-21systemd-logind22:52:251
3397998362,15cyclictest26009-21fschecks_count21:22:450
340499822,30cyclictest31624-21latency_hist22:27:282
340499822,30cyclictest31624-21latency_hist22:27:282
3397998162,12cyclictest29004-21ssh22:22:400
3397998162,12cyclictest29004-21ssh22:22:400
3397998158,9cyclictest15-21ksoftirqd/022:47:510
3402998043,10cyclictest58-21kcompactd022:04:401
3402998043,10cyclictest58-21kcompactd022:04:401
3397998062,12cyclictest28554-21runrttasks22:22:090
3397998055,17cyclictest4171-21latency_hist20:37:270
3397998055,17cyclictest4171-21latency_hist20:37:270
3402997961,13cyclictest352-21runrttasks21:32:421
3402997959,14cyclictest352-21runrttasks21:13:011
3402997946,10cyclictest3386-21cyclictest00:11:371
3402997934,12cyclictest181rcu_preempt22:53:261
3402997932,10cyclictest181rcu_preempt20:02:501
3397997959,14cyclictest7062-21latency_hist19:07:280
3397997951,9cyclictest181rcu_preempt20:04:480
3402997864,9cyclictest24658-21kworker/u17:2-xprtiod23:14:361
3397997846,8cyclictest181rcu_preempt20:02:280
3402997757,13cyclictest352-21runrttasks23:37:461
3402997736,9cyclictest181rcu_preempt20:17:401
3397997760,11cyclictest16883-21ssh21:07:410
3397997758,13cyclictest9008-21latency_hist20:52:270
3397997748,14cyclictest9210-21ssh21:48:030
339799773,48cyclictest12462-21cstates23:43:370
3397997732,32cyclictest9233-21sort20:52:400
3397997663,9cyclictest3386-21cyclictest22:56:250
3397997652,11cyclictest0-21swapper/019:52:280
3402997558,12cyclictest0-21swapper/123:47:241
3402997557,11cyclictest18499-21ssh21:09:351
3402997557,10cyclictest0-21swapper/100:17:591
3402997543,12cyclictest3386-21cyclictest21:49:591
3397997557,13cyclictest17504-21kernelversion19:37:490
3397997557,11cyclictest297-21systemd-logind23:02:250
3397997556,13cyclictest297-21systemd-logind20:42:250
3397997556,13cyclictest297-21systemd-logind20:42:250
3397997554,9cyclictest0-21swapper/019:37:280
3397997554,9cyclictest0-21swapper/019:37:280
3397997551,9cyclictest0-21swapper/020:12:280
3397997532,12cyclictest0-21swapper/023:57:280
32962750,8sleep30-21swapper/322:33:063
3402997456,12cyclictest2374-21systemd-journal22:46:391
3402997453,15cyclictest5070-21threads20:38:001
3402997453,15cyclictest5070-21threads20:38:001
3402997444,10cyclictest20109-21kworker/u19:2-rpciod23:57:041
3397997451,13cyclictest0-21swapper/021:22:240
3397997451,10cyclictest181rcu_preempt21:47:130
3397997444,22cyclictest4900-21ssh23:30:390
3402997357,10cyclictest24956-21latency_hist20:02:281
3402997355,12cyclictest5572-21systemd-run23:32:261
3402997355,11cyclictest19676-21snmpd20:37:281
3402997355,11cyclictest19676-21snmpd20:37:281
3402997353,7cyclictest181rcu_preempt00:01:221
3402997351,15cyclictest31423-21cron21:32:241
3402997349,8cyclictest181rcu_preempt00:22:341
3397997359,10cyclictest3386-21cyclictest00:22:450
3397997357,10cyclictest992-21sshd21:34:460
3397997349,15cyclictest0-21swapper/019:42:460
3397997348,12cyclictest181rcu_preempt20:18:000
3397997342,14cyclictest181rcu_preempt22:42:350
3402997256,11cyclictest3386-21cyclictest20:22:591
3402997251,15cyclictest3064-21fschecks_time22:33:021
3402997241,11cyclictest3386-21cyclictest21:24:571
3397997253,13cyclictest2225-21/usr/sbin/munin21:37:550
3397997252,8cyclictest0-21swapper/020:22:460
3397997248,7cyclictest181rcu_preempt19:28:020
3402997149,14cyclictest1-21systemd23:10:401
3397997146,12cyclictest181rcu_preempt22:06:270
3397997146,12cyclictest181rcu_preempt22:06:270
3397997143,20cyclictest3615-21switchtime22:33:160
3397997055,10cyclictest27587-21ssh00:07:590
3397997051,9cyclictest0-21swapper/019:13:210
3397997051,10cyclictest0-21swapper/000:07:270
3397997049,8cyclictest181rcu_preempt22:37:460
3397997046,9cyclictest181rcu_preempt23:47:580
3397997046,17cyclictest10522-21diskmemload21:27:470
3397997046,14cyclictest27897-21sh23:14:060
3397997035,24cyclictest24658-21kworker/u17:2+nfsiod23:27:050
3397997028,33cyclictest3630-21cpuspeed18:57:410
3397997025,8cyclictest181rcu_preempt20:28:380
220527022,32sleep30-21swapper/318:52:533
3402996955,10cyclictest27826-21kworker/u17:1-xprtiod23:33:121
3402996955,10cyclictest27826-21kworker/u17:1-xprtiod23:33:121
3402996952,11cyclictest1667-21ntp_kernel_pll_20:28:451
3402996949,14cyclictest2138-21latency_hist22:32:281
3402996949,11cyclictest29495-21needreboot22:22:511
3402996949,11cyclictest29495-21needreboot22:22:511
3402996940,20cyclictest20346-21sort23:02:281
3397996926,10cyclictest0-21swapper/021:52:580
3397996926,10cyclictest0-21swapper/021:52:580
3402996853,10cyclictest58-21kcompactd022:37:421
3402996853,10cyclictest24726-21kworker/u17:3-rpciod22:01:591
3402996852,11cyclictest3386-21cyclictest18:57:471
3402996848,14cyclictest3386-21cyclictest00:05:551
3397996853,8cyclictest0-21swapper/020:47:270
3397996848,14cyclictest25736-21ssh22:17:270
3397996846,9cyclictest181rcu_preempt00:12:470
3397996846,9cyclictest181rcu_preempt00:12:470
3397996846,8cyclictest181rcu_preempt23:17:500
3397996845,15cyclictest11747-21latency_hist23:42:280
3402996751,9cyclictest0-21swapper/121:02:581
3402996751,9cyclictest0-21swapper/121:02:581
3402996751,12cyclictest3386-21cyclictest21:42:511
3402996750,11cyclictest26804-21switchtime22:18:001
3402996743,11cyclictest181rcu_preempt23:02:381
3402996728,30cyclictest32330-21/usr/sbin/munin23:22:521
3397996750,9cyclictest0-21swapper/000:18:000
3397996748,14cyclictest22017-21cpu19:52:410
3397996732,20cyclictest181rcu_preempt23:52:470
3402996649,9cyclictest0-21swapper/123:47:471
3402996649,9cyclictest0-21swapper/119:42:281
340299663,27cyclictest22816-21apt-get21:17:371
3397996654,7cyclictest0-21swapper/019:18:250
3397996647,7cyclictest181rcu_preempt19:22:460
3397996644,15cyclictest14213-21sh21:02:490
3397996644,15cyclictest14213-21sh21:02:490
339799663,23cyclictest352-21runrttasks22:11:120
3402996548,11cyclictest6271-21kernelversion20:42:501
3402996547,12cyclictest0-21swapper/119:27:271
3402996536,11cyclictest32733-21kworker/u19:2-writeback19:32:451
3402996536,11cyclictest32733-21kworker/u19:2-writeback19:32:451
3402996535,21cyclictest7631-21cat19:07:501
3402996535,21cyclictest7631-21cat19:07:501
3402996521,14cyclictest5607-21apt-get19:02:391
3397996539,19cyclictest14171-21cpu21:57:410
339799652,44cyclictest2272-21apt-config22:32:260
340299646,31cyclictest14146-21grep19:27:471
3402996433,8cyclictest181rcu_preempt21:37:361
3397996437,21cyclictest0-21swapper/023:03:210
3402996347,9cyclictest0-21swapper/100:12:581
3402996347,9cyclictest0-21swapper/100:12:581
3402996347,8cyclictest301ktimers/119:47:381
3402996346,11cyclictest181rcu_preempt19:13:201
340299633,44cyclictest352-21runrttasks20:10:261
340299633,44cyclictest20328-21latency_hist19:47:281
340299633,43cyclictest7808-21fschecks_time20:47:471
340299632,43cyclictest11213-21needreboot19:18:371
3397996338,20cyclictest3386-21cyclictest20:13:000
340299624,12cyclictest28463-21apt-get20:12:401
3397996242,14cyclictest7449-21fschecks_count19:07:460
3397996242,14cyclictest7449-21fschecks_count19:07:460
3402996147,10cyclictest3386-21cyclictest22:07:451
340299613,43cyclictest29631-21ssh23:17:461
340299604,40cyclictest352-21runrttasks20:55:541
3402996031,20cyclictest22228-21fschecks_time19:52:471
3402995940,10cyclictest0-21swapper/121:53:371
3402995940,10cyclictest0-21swapper/121:53:371
295692520,4sleep3451rcuc/322:22:533
295692520,4sleep3451rcuc/322:22:533
3411995135,10cyclictest28972sleep323:27:393
341199502,32cyclictest12242-21chrt23:43:183
341199494,30cyclictest32646-21taskset00:17:283
341199494,30cyclictest32646-21taskset00:17:283
341199493,33cyclictest18828-21taskset23:53:003
3411994932,10cyclictest62542sleep321:43:013
341199484,34cyclictest17977-21taskset21:08:063
341199483,33cyclictest29747-21taskset21:28:013
341199482,24cyclictest917-21kworker/3:1+events00:22:273
341199474,30cyclictest917-21kworker/3:1+events23:52:083
341199473,32cyclictest13846-21taskset21:02:393
341199473,32cyclictest13846-21taskset21:02:393
341199473,31cyclictest9315-21taskset20:52:423
341199473,31cyclictest32544-21taskset23:22:433
3411994731,9cyclictest257562sleep323:11:253
341199464,31cyclictest23948-21taskset21:18:083
341199464,29cyclictest31022-21chrt20:18:023
341199463,32cyclictest25038-21taskset00:03:183
341199463,31cyclictest27485-21chrt20:07:583
341199463,31cyclictest11295-21chrt19:18:403
341199462,32cyclictest15013-21chrt21:58:013
341199454,29cyclictest3640-21chrt18:57:413
341199454,28cyclictest5207-21chrt19:02:313
341199453,30cyclictest821-21taskset21:34:183
341199453,30cyclictest21222-21chrt23:57:463
341199452,31cyclictest29979-21chrt23:17:533
341199452,28cyclictest5470-21chrt00:26:113
341199443,32cyclictest28301-21taskset21:27:003
341199443,31cyclictest19919-21taskset19:45:173
341199443,29cyclictest4575-21chrt20:37:473
341199443,29cyclictest4575-21chrt20:37:473
341199443,29cyclictest32255-21chrt20:22:563
341199443,29cyclictest20491-21taskset23:02:373
341199443,27cyclictest23958-21taskset19:57:493
341199442,31cyclictest8630-21taskset22:42:393
341199442,31cyclictest18295-21chrt22:03:203
341199442,31cyclictest18295-21chrt22:03:203
341199433,30cyclictest10930-21taskset23:40:593
341199433,29cyclictest26868-21taskset00:07:393
341199433,29cyclictest20106-21taskset22:07:373
341199433,28cyclictest27079-21taskset23:12:553
341199433,28cyclictest19837-21taskset21:12:363
341199433,28cyclictest14432-21taskset22:52:283
341199433,27cyclictest31934-21taskset22:27:353
341199433,27cyclictest13440-21taskset21:56:223
341199433,27cyclictest13440-21taskset21:56:223
341199433,26cyclictest26219-21taskset20:03:123
3411994330,7cyclictest0-21swapper/323:32:423
3411994330,7cyclictest0-21swapper/323:32:423
3411994326,9cyclictest0-21swapper/320:32:283
341199432,31cyclictest7604-21taskset22:40:283
341199432,29cyclictest10863-21chrt20:57:403
341199432,29cyclictest10863-21chrt20:57:403
341199423,28cyclictest20613-21chrt19:47:483
341199423,27cyclictest28471-21taskset20:12:393
341199423,27cyclictest2216-21taskset21:37:343
341199423,27cyclictest17306-21taskset19:37:443
341199422,29cyclictest17510-21taskset22:57:353
341199422,28cyclictest7564-21taskset20:47:393
341199413,29cyclictest27353-21chrt22:18:443
341199413,28cyclictest4032-21taskset20:37:233
341199413,28cyclictest4032-21taskset20:37:233
341199413,28cyclictest15492-21chrt22:53:013
341199413,27cyclictest22431-21chrt19:52:513
341199413,26cyclictest15802-21taskset19:32:453
341199413,26cyclictest15802-21taskset19:32:453
341199413,23cyclictest917-21kworker/3:1+events19:12:333
341199413,23cyclictest917-21kworker/3:1+events19:12:333
341199412,29cyclictest24919-21taskset22:15:153
341199412,29cyclictest10771-21chrt21:52:133
341199412,27cyclictest5927-21taskset20:42:373
341199412,27cyclictest12454-21chrt19:22:413
341199403,26cyclictest9220-21taskset19:13:093
341199403,26cyclictest14387-21taskset19:27:513
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional