You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-15 - 11:46
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Sun Mar 15, 2026 00:44:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4328211013,68sleep04358-21proc_pri19:00:540
52629910838,32cyclictest0-21swapper/100:31:561
52629910838,32cyclictest0-21swapper/100:31:561
5267991072,89cyclictest22395-21kworker/u17:2+ext4-rsv-conversion21:30:382
52629910725,37cyclictest0-21swapper/122:55:161
480821076,15sleep20-21swapper/219:01:292
52629910335,34cyclictest0-21swapper/123:05:421
52629910046,44cyclictest0-21swapper/100:25:281
52629910046,44cyclictest0-21swapper/100:25:281
5262991003,61cyclictest24509-21ntpq22:16:141
5267999712,69cyclictest4400-21diskmemload23:30:342
5262999512,48cyclictest0-21swapper/122:10:341
5262999430,39cyclictest0-21swapper/122:45:131
5262999430,39cyclictest0-21swapper/122:45:131
525799943,67cyclictest8171-21apt-get00:31:250
525799943,67cyclictest8171-21apt-get00:31:250
526799923,57cyclictest23756-21apt-get22:15:562
526299924,53cyclictest0-21swapper/123:45:301
5257999270,14cyclictest13334-21diskmemload22:30:510
5257999247,37cyclictest4335-21apt-get23:30:290
5267999177,10cyclictest4361-21kworker/u18:3+ext4-rsv-conversion00:31:252
5267999177,10cyclictest4361-21kworker/u18:3+ext4-rsv-conversion00:31:252
5262999121,30cyclictest0-21swapper/100:03:201
5257999162,22cyclictest27387-21latency_hist23:15:160
526299902,51cyclictest12217-21seq19:24:291
526299902,51cyclictest12217-21seq19:24:291
525799909,55cyclictest15-21ksoftirqd/023:05:470
5267998946,14cyclictest181rcu_preempt00:01:432
5267998861,19cyclictest24529-21sh21:22:562
526799883,33cyclictest23263-21fschecks_time19:56:072
526299884,70cyclictest0-21swapper/123:50:241
526299884,70cyclictest0-21swapper/123:50:241
526299883,53cyclictest27523-21idleruntime-cro20:10:141
5262998828,32cyclictest0-21swapper/119:54:301
5267998761,18cyclictest20787-21fschecks_time22:10:372
526799873,31cyclictest6836-21latency_hist20:45:172
5267998716,32cyclictest381ktimers/219:25:272
5267998716,32cyclictest381ktimers/219:25:272
5262998728,36cyclictest0-21swapper/121:30:571
5267998663,16cyclictest25936-21fschecks_count21:25:352
5267998638,8cyclictest181rcu_preempt00:25:412
5267998638,8cyclictest181rcu_preempt00:25:412
5267998638,11cyclictest181rcu_preempt22:40:302
5267998638,11cyclictest181rcu_preempt22:40:302
5262998646,33cyclictest0-21swapper/123:15:451
526299863,71cyclictest0-21swapper/122:25:281
526299863,51cyclictest18676-21sh22:06:021
526299862,54cyclictest17124-21seq19:37:131
5257998657,21cyclictest2308-21fschecks_time20:30:360
5267998570,10cyclictest19048-40logrotate23:55:182
5267998570,10cyclictest19048-40logrotate23:55:182
5267998566,13cyclictest25015-21latency23:10:422
526799852,69cyclictest23709-21kworker/u17:3+ext4-rsv-conversion22:45:572
5262998537,36cyclictest0-21swapper/122:45:331
526299852,69cyclictest0-21swapper/119:15:281
526299852,69cyclictest0-21swapper/119:15:281
526299852,44cyclictest29072-21sshd20:11:321
5262998522,31cyclictest0-21swapper/123:31:061
5267998449,15cyclictest3057-21ssh23:28:152
526299843,69cyclictest0-21swapper/119:45:251
526299843,51cyclictest9828-21cron20:55:141
5257998441,22cyclictest181rcu_preempt21:30:390
51412849,41sleep11-21systemd19:05:151
5267998363,15cyclictest22568-21sh21:20:172
5267998357,9cyclictest30543-21/usr/sbin/munin23:20:402
5267998357,9cyclictest30543-21/usr/sbin/munin23:20:402
5267998352,23cyclictest15644-21apt-key19:35:162
5267998352,23cyclictest15644-21apt-key19:35:162
5262998359,15cyclictest21745-21sh21:18:321
5262998359,15cyclictest21745-21sh21:18:321
526299832,52cyclictest3299-21seq00:21:331
526299832,49cyclictest3289-21seq20:34:111
525799832,41cyclictest22493-21apt-config19:55:140
5267998259,9cyclictest181rcu_preempt19:20:162
5267998259,9cyclictest181rcu_preempt19:20:162
5267998257,17cyclictest13039-21idleruntime-cro23:45:122
5267998253,8cyclictest28094-21ssh00:10:142
5267998248,14cyclictest181rcu_preempt19:55:172
5267998232,29cyclictest0-21swapper/220:00:272
526299822,49cyclictest18984-21seq19:42:231
526299822,47cyclictest32056-21cat21:35:301
525799823,49cyclictest15-21ksoftirqd/019:13:350
5257998227,28cyclictest15-21ksoftirqd/000:11:120
5267998158,16cyclictest5248-21cyclictest20:23:552
5267998147,13cyclictest181rcu_preempt20:20:162
526299815,65cyclictest0-21swapper/122:35:271
526299815,65cyclictest0-21swapper/122:35:271
526299813,48cyclictest22709-21ssh21:20:281
5262998133,42cyclictest0-21swapper/119:10:191
526299812,73cyclictest0-21swapper/121:25:291
5267998054,17cyclictest8734-21fschecks_count21:50:362
5262998034,37cyclictest5074-21ssh21:45:011
5262998031,41cyclictest0-21swapper/121:45:241
5262998026,27cyclictest0-21swapper/100:15:491
526299802,48cyclictest11515-21seq20:57:441
526299802,48cyclictest11515-21seq20:57:441
525799804,32cyclictest15-21ksoftirqd/020:25:280
525799804,32cyclictest15-21ksoftirqd/020:25:280
5267997956,16cyclictest544-21cron21:00:132
5267997956,16cyclictest544-21cron21:00:132
5267997956,16cyclictest27524-21latency_hist20:10:162
5267997951,15cyclictest181rcu_preempt19:10:182
526799792,47cyclictest18108-21grep22:05:422
526799792,23cyclictest17922-21cpu19:40:552
5262997940,32cyclictest0-21swapper/121:55:421
5262997938,34cyclictest0-21swapper/121:50:521
526299793,64cyclictest7548-21df23:35:321
526299792,47cyclictest30948-21seq20:19:331
526299792,47cyclictest15542-21/usr/sbin/munin22:55:371
5257997958,15cyclictest22372-21idleruntime-cro21:20:140
5257997958,15cyclictest22372-21idleruntime-cro21:20:140
525799792,44cyclictest15-21ksoftirqd/020:35:350
127282793,9sleep00-21swapper/022:50:320
5267997859,13cyclictest544-21cron21:15:132
5267997849,19cyclictest7257-21vmstat19:10:192
5267997843,12cyclictest181rcu_preempt21:45:492
526299784,62cyclictest0-21swapper/120:35:261
526299783,66cyclictest28368-21apt-get00:10:251
526299782,46cyclictest15992-21cat19:35:181
5257997862,9cyclictest2790-21ssh21:40:360
5257997856,15cyclictest3904-21apt-key23:30:150
525799784,48cyclictest15-21ksoftirqd/000:25:410
525799784,48cyclictest15-21ksoftirqd/000:25:410
5257997841,27cyclictest22051-21modprobe00:00:120
525799783,49cyclictest15-21ksoftirqd/022:23:530
525799782,42cyclictest15-21ksoftirqd/020:03:370
5267997735,15cyclictest181rcu_preempt20:50:572
526799772,49cyclictest15549-21grep22:00:492
526799772,49cyclictest15549-21grep22:00:492
526299773,59cyclictest10874-21sed23:40:401
5257997749,19cyclictest6613-21sh22:40:350
5257997749,19cyclictest6613-21sh22:40:350
5257997738,26cyclictest2154-21cron21:40:130
525799773,34cyclictest15-21ksoftirqd/020:10:180
525799771,43cyclictest15-21ksoftirqd/020:23:050
5267997629,14cyclictest181rcu_preempt22:38:372
5267997629,14cyclictest181rcu_preempt22:38:372
5267997621,7cyclictest0-21swapper/223:05:532
5262997657,13cyclictest365-21ntpd20:30:151
5262997657,13cyclictest365-21ntpd20:30:151
5262997636,33cyclictest0-21swapper/120:40:421
5262997635,35cyclictest0-21swapper/121:05:301
526299763,45cyclictest20993-21sh23:57:151
526299763,44cyclictest32423-21taskset20:22:501
5257997658,14cyclictest5248-21cyclictest22:30:170
5257997647,7cyclictest181rcu_preempt23:38:060
5257997647,7cyclictest181rcu_preempt00:05:490
525799763,50cyclictest15-21ksoftirqd/020:20:170
5257997628,25cyclictest15-21ksoftirqd/020:15:170
5267997546,11cyclictest181rcu_preempt23:45:382
5267997542,12cyclictest181rcu_preempt19:36:182
526799752,40cyclictest8487-21awk23:35:522
526799752,30cyclictest19571-21df_inode23:55:332
526299753,60cyclictest6895-21apt-get20:45:241
526299753,45cyclictest27734-21sh00:09:221
526299752,43cyclictest13334-21diskmemload23:24:561
526299752,43cyclictest13334-21diskmemload23:24:561
525799757,33cyclictest15-21ksoftirqd/019:20:290
525799757,33cyclictest15-21ksoftirqd/019:20:290
525799755,32cyclictest15-21ksoftirqd/020:50:270
5257997550,19cyclictest20076-21ssh23:01:590
5257997544,8cyclictest181rcu_preempt19:56:230
525799754,36cyclictest23338-21apt-key22:15:170
5257997537,10cyclictest181rcu_preempt21:25:480
525799752,37cyclictest26264-21runrttasks22:19:470
5267997449,8cyclictest28837-21kworker/u19:1+rpciod22:50:282
5267997440,25cyclictest32675-21latency_hist22:30:182
5267997436,9cyclictest181rcu_preempt23:00:242
5267997435,9cyclictest181rcu_preempt21:01:092
5267997429,16cyclictest0-21swapper/219:21:032
5267997429,16cyclictest0-21swapper/219:21:032
526299744,63cyclictest12589-21grep21:01:051
5262997437,30cyclictest23709-21kworker/u17:3-xprtiod23:25:411
526299743,64cyclictest19628-21unixbench_singl23:00:501
526299743,58cyclictest26746-21apt-get22:20:251
526299742,53cyclictest24573-21apt-get20:00:231
525799742,52cyclictest15-21ksoftirqd/019:10:190
5257997425,24cyclictest15-21ksoftirqd/021:53:050
152962743,8sleep00-21swapper/021:07:210
5267997340,11cyclictest181rcu_preempt21:38:122
5267997338,14cyclictest181rcu_preempt00:16:422
526799733,39cyclictest8238-21idleruntime-cro20:50:132
5262997354,14cyclictest5248-21cyclictest23:13:181
526299732,60cyclictest16651-21apt-get21:10:251
5257997353,7cyclictest181rcu_preempt23:43:470
525799734,43cyclictest15-21ksoftirqd/000:00:390
5257997336,14cyclictest181rcu_preempt19:36:270
5257997330,24cyclictest181rcu_preempt19:30:410
5257997330,24cyclictest181rcu_preempt19:30:410
5257997328,8cyclictest181rcu_preempt22:03:080
5257997328,8cyclictest181rcu_preempt22:03:080
5257997322,23cyclictest15-21ksoftirqd/019:41:150
5267997239,10cyclictest181rcu_preempt21:15:392
5267997237,10cyclictest181rcu_preempt00:12:302
5262997243,20cyclictest13888-21modprobe19:30:131
5262997243,20cyclictest13888-21modprobe19:30:131
5262997226,35cyclictest3203-21latency_hist22:35:171
5262997223,23cyclictest0-21swapper/122:04:591
5262997223,23cyclictest0-21swapper/122:04:591
5257997255,11cyclictest19848-21ssh22:09:180
525799725,43cyclictest15-21ksoftirqd/023:17:590
5257997245,9cyclictest181rcu_preempt21:24:200
525799723,28cyclictest15-21ksoftirqd/021:00:580
5267997141,21cyclictest1773-21sh20:30:132
5267997141,21cyclictest1773-21sh20:30:132
5267997127,10cyclictest181rcu_preempt23:16:112
526299713,61cyclictest6772-21idleruntime-cro19:10:141
526299713,60cyclictest0-21swapper/119:56:011
525799715,35cyclictest352-21runrttasks22:38:520
525799715,35cyclictest352-21runrttasks22:38:520
5257997151,12cyclictest5248-21cyclictest23:46:340
5257997113,37cyclictest15-21ksoftirqd/020:56:180
5257997113,37cyclictest15-21ksoftirqd/020:56:180
5267997048,14cyclictest0-21swapper/220:15:162
5267997036,11cyclictest181rcu_preempt21:56:452
5267997034,9cyclictest181rcu_preempt19:45:382
5267997033,12cyclictest181rcu_preempt20:35:512
5267997029,12cyclictest181rcu_preempt22:20:202
526799702,40cyclictest16472-21latency_hist21:10:162
526799702,39cyclictest3253-21ssh00:21:262
526299703,58cyclictest352-21runrttasks19:34:221
5257997044,20cyclictest2690-21kworker/u17:2+nfsiod22:56:510
525799704,30cyclictest10088-21wc19:16:010
525799704,30cyclictest10088-21wc19:16:010
5257997038,10cyclictest181rcu_preempt19:45:230
525799703,41cyclictest15-21ksoftirqd/021:10:510
525799703,37cyclictest5703-21fschecks_count21:45:340
5257997023,26cyclictest0-21swapper/021:57:140
5267996931,10cyclictest181rcu_preempt22:32:352
5267996929,18cyclictest181rcu_preempt22:55:332
525799695,35cyclictest30856-21tune2fs23:20:350
525799695,35cyclictest30856-21tune2fs23:20:350
5267996741,8cyclictest181rcu_preempt21:40:242
5267996732,14cyclictest181rcu_preempt20:30:462
5257996741,19cyclictest0-21swapper/022:47:130
525799673,40cyclictest15-21ksoftirqd/023:50:380
525799673,40cyclictest15-21ksoftirqd/023:50:380
525799673,36cyclictest8221-21cron20:50:130
525799672,27cyclictest12618-21sort19:25:310
525799672,27cyclictest12618-21sort19:25:310
5257996710,25cyclictest15-21ksoftirqd/000:20:160
5257996640,18cyclictest5648-21kernelversion20:40:380
525799662,44cyclictest15-21ksoftirqd/000:20:190
287372620,7sleep30-21swapper/321:30:183
527199603,35cyclictest0-21swapper/323:30:403
5271995815,29cyclictest0-21swapper/300:31:263
5271995815,29cyclictest0-21swapper/300:31:263
527199573,39cyclictest17918-21chrt19:40:523
5271995728,21cyclictest32751-21chrt23:23:533
5271995728,21cyclictest32751-21chrt23:23:533
527199563,38cyclictest5942-21chrt00:25:503
527199563,38cyclictest5942-21chrt00:25:503
527199553,39cyclictest25500-21taskset23:10:533
527199553,38cyclictest334-21taskset00:16:423
527199553,38cyclictest10634-21taskset20:56:053
527199553,38cyclictest10634-21taskset20:56:053
527199543,32cyclictest26404-21taskset20:05:353
200182540,6sleep30-21swapper/321:15:343
200182540,6sleep30-21swapper/321:15:343
527199534,35cyclictest11958-21taskset21:55:393
527199533,37cyclictest30354-21taskset22:25:423
527199533,36cyclictest31772-21chrt21:35:163
527199532,39cyclictest17078-21chrt21:10:403
527199532,38cyclictest17448-21chrt19:40:153
527199523,36cyclictest14069-21chrt23:45:463
527199523,35cyclictest11843-21chrt19:21:123
527199523,35cyclictest11843-21chrt19:21:123
527199523,34cyclictest10640-21chrt23:40:363
375425212,23sleep30-21swapper/319:00:243
5271995135,9cyclictest451rcuc/322:36:203
5271995135,9cyclictest451rcuc/322:36:203
527199513,38cyclictest1863-21chrt23:25:483
527199513,34cyclictest9887-21chrt21:51:423
527199513,30cyclictest15874-21chrt19:35:173
527199513,30cyclictest15874-21chrt19:35:173
527199512,37cyclictest28440-21taskset00:10:303
527199512,36cyclictest9745-21taskset22:45:563
527199512,36cyclictest27954-21taskset22:21:083
527199512,36cyclictest22491-21chrt19:55:143
527199512,31cyclictest6894-21taskset20:45:243
527199503,37cyclictest25264-21taskset22:16:593
527199503,34cyclictest18837-21chrt23:00:353
527199503,32cyclictest27524-21taskset23:15:183
527199502,38cyclictest19891-21taskset19:45:383
527199502,35cyclictest15527-21chrt22:55:213
527199494,35cyclictest23771-21chrt19:56:233
527199493,35cyclictest23793-21chrt00:01:433
527199493,35cyclictest2103-21chrt00:20:313
527199493,33cyclictest20432-21chrt23:55:513
527199493,32cyclictest12275-21chrt21:00:553
527199492,37cyclictest14566-21chrt21:05:493
527199492,35cyclictest7386-21chrt22:40:503
527199492,35cyclictest7386-21chrt22:40:503
527199492,31cyclictest7727-21chrt23:35:373
527199483,31cyclictest24653-21chrt21:23:173
527199473,29cyclictest1650-21taskset21:38:493
527199472,35cyclictest19094-21chrt23:55:143
527199472,35cyclictest19094-21chrt23:55:143
527199472,32cyclictest9030-21taskset20:50:433
527199463,32cyclictest22824-21chrt22:14:153
527199463,30cyclictest24162-21taskset23:10:033
527199462,32cyclictest5699-21chrt19:05:363
527199453,30cyclictest16479-21chrt22:03:173
527199453,30cyclictest16479-21chrt22:03:173
527199453,28cyclictest3758-21taskset21:41:203
527199444,30cyclictest17497-21taskset22:05:233
527199443,31cyclictest32168-21taskset20:20:503
527199433,28cyclictest12485-21chrt22:50:183
527199433,26cyclictest26231-21taskset00:05:483
527199432,31cyclictest466-21chrt22:30:323
527199423,27cyclictest7461-21taskset19:10:223
527199422,28cyclictest28013-21taskset20:10:253
527199413,26cyclictest434-21taskset20:25:273
527199413,26cyclictest434-21taskset20:25:273
527199413,24cyclictest10542-21chrt19:18:323
527199413,24cyclictest10542-21chrt19:18:323
527199412,30cyclictest5497-21chrt21:45:263
527199412,26cyclictest3651-21taskset20:35:203
527199412,25cyclictest5680-21chrt20:40:383
527199402,29cyclictest3340-21taskset20:34:513
527199393,25cyclictest25940-21taskset20:05:143
527199392,28cyclictest13702-21taskset19:27:563
527199392,28cyclictest13702-21taskset19:27:563
527199392,27cyclictest30652-21taskset20:15:523
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional