You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-01 - 10:30
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7.osadl.org (updated Wed Jul 01, 2026 00:44:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
549221166,16sleep00-21swapper/018:55:580
58119910844,36cyclictest352-21runrttasks22:02:181
58169910150,11cyclictest181rcu_preempt23:46:292
5806991012,45cyclictest15-21ksoftirqd/023:53:190
5816999932,20cyclictest5796-21cyclictest00:08:332
5816999932,20cyclictest5796-21cyclictest00:08:332
581699992,66cyclictest31976-21apt-get22:23:172
581199982,33cyclictest26180-21runrttasks23:06:401
5811999739,30cyclictest9128-21ntp_kernel_pll_22:38:281
580699973,53cyclictest15-21ksoftirqd/020:13:220
580699973,53cyclictest15-21ksoftirqd/020:13:220
5816999674,14cyclictest5418-21awk20:33:302
5811999632,35cyclictest19026-21ssh21:08:091
581199962,26cyclictest352-21runrttasks23:34:391
581199962,26cyclictest352-21runrttasks23:34:391
5816999546,36cyclictest22552-21cat22:08:002
5816999546,36cyclictest22552-21cat22:08:002
5816999546,12cyclictest0-21swapper/223:51:192
5811999513,49cyclictest0-21swapper/121:23:121
5811999450,37cyclictest300-21rs:main1
5811999450,37cyclictest300-21rs:main1
5811999429,41cyclictest0-21swapper/121:30:141
5811999429,41cyclictest0-21swapper/121:30:141
5816999352,11cyclictest181rcu_preempt23:53:312
581199933,84cyclictest0-21swapper/121:13:091
5806999365,18cyclictest11159-21latency_hist19:13:010
581199923,76cyclictest0-21swapper/119:43:111
5811999219,62cyclictest14764-21apt-get22:48:231
5811999219,62cyclictest14764-21apt-get22:48:231
5811999147,37cyclictest15978-21sh21:03:091
5816999058,8cyclictest181rcu_preempt19:08:202
5816999042,13cyclictest181rcu_preempt23:25:122
5816999042,13cyclictest181rcu_preempt23:25:122
581199904,73cyclictest0-21swapper/118:58:141
580699908,55cyclictest15-21ksoftirqd/019:25:360
5816998965,15cyclictest32208-21ssh23:16:452
5816998965,15cyclictest32208-21ssh23:16:452
5816998942,12cyclictest181rcu_preempt23:04:222
581199893,71cyclictest0-21swapper/120:53:121
5816998855,12cyclictest181rcu_preempt22:58:322
5816998845,11cyclictest181rcu_preempt21:30:082
5816998845,11cyclictest181rcu_preempt21:30:082
581199884,71cyclictest0-21swapper/120:03:081
581199884,71cyclictest0-21swapper/120:03:081
581199884,69cyclictest0-21swapper/120:33:091
581199883,77cyclictest28782-21ssh22:18:131
581199883,77cyclictest28782-21ssh22:18:131
581199883,74cyclictest0-21swapper/119:38:101
581199883,71cyclictest0-21swapper/120:38:131
581199882,76cyclictest31976-21apt-get22:23:191
5806998868,14cyclictest13229-21mailstats23:38:310
5806998862,19cyclictest24328-21latency_hist19:53:010
5806998858,21cyclictest6383-21latency_hist20:38:000
582399873,58cyclictest0-21swapper/322:23:243
5816998745,17cyclictest0-21swapper/222:01:192
5816998742,17cyclictest181rcu_preempt23:38:202
5811998764,17cyclictest23824-21grep23:03:021
581199874,70cyclictest0-21swapper/119:33:101
5816998652,11cyclictest181rcu_preempt23:28:142
5816998650,13cyclictest181rcu_preempt00:03:162
5816998644,8cyclictest181rcu_preempt22:57:022
581199863,70cyclictest0-21swapper/121:18:111
5806998665,15cyclictest277-21dbus-daemon21:17:580
5806998661,16cyclictest2374-21systemd-journal22:37:170
5816998561,16cyclictest26647-21latency_hist00:03:012
5816998561,16cyclictest26647-21latency_hist00:03:012
5816998549,10cyclictest181rcu_preempt19:23:262
5816998548,11cyclictest181rcu_preempt22:14:272
5816998546,14cyclictest181rcu_preempt19:58:212
5816998545,8cyclictest181rcu_preempt19:31:562
5816998537,10cyclictest181rcu_preempt19:23:012
5816998533,12cyclictest181rcu_preempt21:10:512
581199853,72cyclictest352-21runrttasks23:48:101
581199852,75cyclictest6354-21ssh00:23:121
5806998513,44cyclictest15-21ksoftirqd/021:48:130
5816998455,9cyclictest181rcu_preempt00:17:592
5816998446,11cyclictest181rcu_preempt00:18:272
5816998443,14cyclictest181rcu_preempt23:22:342
5816998440,17cyclictest181rcu_preempt22:33:252
5816998440,12cyclictest181rcu_preempt21:53:222
5816998440,12cyclictest181rcu_preempt21:53:222
5816998421,31cyclictest0-21swapper/200:26:082
581199844,67cyclictest0-21swapper/119:18:131
581199844,67cyclictest0-21swapper/119:18:131
581199843,66cyclictest0-21swapper/120:48:081
581199843,36cyclictest14091-21/usr/sbin/munin21:53:201
581199843,36cyclictest14091-21/usr/sbin/munin21:53:201
581199842,6cyclictest0-21swapper/122:33:141
581199842,37cyclictest723-21seq23:18:191
581199842,37cyclictest17752-21apt-get22:53:091
5806998463,13cyclictest5796-21cyclictest22:04:440
5806998463,13cyclictest5796-21cyclictest22:04:440
5806998418,41cyclictest0-21swapper/021:43:370
5816998354,8cyclictest181rcu_preempt22:38:352
5816998334,8cyclictest181rcu_preempt20:43:202
581199834,73cyclictest0-21swapper/121:48:131
581199833,68cyclictest0-21swapper/120:43:101
581199833,34cyclictest20523-21swap22:03:301
581199833,34cyclictest20523-21swap22:03:301
581199832,35cyclictest7244-21grep23:28:301
5806998361,15cyclictest5796-21cyclictest23:35:420
5806998361,15cyclictest5796-21cyclictest23:35:420
580699835,32cyclictest15-21ksoftirqd/020:53:350
580699832,53cyclictest15-21ksoftirqd/022:46:470
580699832,53cyclictest15-21ksoftirqd/022:46:470
5816998265,11cyclictest300-21rs:main2
5816998254,20cyclictest16707-21kworker/u18:3-ext4-rsv-conversion22:13:002
5816998251,8cyclictest181rcu_preempt21:33:352
5816998248,12cyclictest181rcu_preempt20:38:142
5816998241,9cyclictest181rcu_preempt20:23:152
5816998241,9cyclictest181rcu_preempt20:23:152
5816998239,9cyclictest181rcu_preempt21:23:002
5816998237,9cyclictest181rcu_preempt19:43:262
5816998235,12cyclictest181rcu_preempt19:38:222
5816998229,19cyclictest181rcu_preempt18:58:362
581199823,63cyclictest16112-21apt-get19:28:091
5811998235,38cyclictest0-21swapper/119:53:001
581199823,37cyclictest30374-21/usr/sbin/munin23:13:211
581199823,37cyclictest30374-21/usr/sbin/munin23:13:211
581199823,28cyclictest32421-21latency_hist20:18:011
491728214,39sleep20-21swapper/218:53:402
5816998150,15cyclictest181rcu_preempt22:48:142
5816998150,15cyclictest181rcu_preempt22:48:142
5816998139,8cyclictest181rcu_preempt20:28:162
5816998139,15cyclictest181rcu_preempt19:38:012
5816998139,10cyclictest181rcu_preempt20:08:152
5816998139,10cyclictest181rcu_preempt20:08:152
5816998127,24cyclictest0-21swapper/220:07:592
5816998127,24cyclictest0-21swapper/220:07:592
581199813,34cyclictest27269-21ssh00:03:251
581199812,37cyclictest27010-21vmstat19:58:371
581199812,35cyclictest5875-21latency_hist18:58:031
5806998156,17cyclictest300-21rs:main0
580699815,50cyclictest15-21ksoftirqd/022:11:030
580699813,43cyclictest15-21ksoftirqd/019:00:320
580699812,48cyclictest15-21ksoftirqd/022:51:540
580699812,48cyclictest15-21ksoftirqd/022:51:540
580699812,44cyclictest15-21ksoftirqd/000:26:510
5816998053,19cyclictest12695-21diskmemload22:28:082
5816998053,19cyclictest12695-21diskmemload22:28:082
5816998053,12cyclictest181rcu_preempt21:42:582
5816998050,8cyclictest181rcu_preempt19:54:082
5816998041,12cyclictest181rcu_preempt22:20:322
5816998041,12cyclictest181rcu_preempt22:20:322
5816998035,13cyclictest181rcu_preempt23:09:172
5816998035,11cyclictest181rcu_preempt21:47:132
5816998022,20cyclictest0-21swapper/219:03:322
581199803,36cyclictest1784-21apt-get21:33:101
581199803,34cyclictest13210-21uname23:38:311
581199802,62cyclictest14477-21apt-get19:23:091
581199802,35cyclictest27017-21ssh23:08:111
581199802,32cyclictest16574-21sh23:43:331
580699808,40cyclictest15-21ksoftirqd/022:38:220
5806998064,11cyclictest5796-21cyclictest23:20:020
5806998057,15cyclictest12695-21diskmemload22:32:370
5806998057,15cyclictest12695-21diskmemload22:32:370
5806998027,22cyclictest15-21ksoftirqd/023:46:230
5816997947,10cyclictest181rcu_preempt21:23:182
5816997929,12cyclictest181rcu_preempt21:49:352
5811997958,15cyclictest23303-21sh23:57:351
581199794,63cyclictest29269-21apt-get20:08:101
581199794,63cyclictest29269-21apt-get20:08:101
581199793,37cyclictest7954-21df21:43:171
581199793,35cyclictest6007-21taskset23:27:291
581199793,35cyclictest6007-21taskset23:27:291
581199793,33cyclictest23374-21ntpq22:08:271
581199793,32cyclictest11637-21cstates22:43:141
581199793,32cyclictest11637-21cstates22:43:141
5811997929,40cyclictest0-21swapper/121:38:321
581199792,35cyclictest23909-21apt-get19:53:111
581199792,34cyclictest28630-21latency_hist22:18:011
581199792,34cyclictest13077-21grep20:58:151
581199792,33cyclictest4385-21runrttasks20:30:171
581199792,32cyclictest7998-21/usr/sbin/munin19:03:211
581199792,29cyclictest3716-21cat00:18:231
580699799,31cyclictest15-21ksoftirqd/021:03:330
5806997958,15cyclictest27955-21if_eth020:03:210
5806997958,15cyclictest27955-21if_eth020:03:210
5806997930,17cyclictest15-21ksoftirqd/023:01:050
580699792,39cyclictest15-21ksoftirqd/022:27:330
5806997917,37cyclictest15-21ksoftirqd/020:38:430
5816997853,8cyclictest181rcu_preempt21:03:232
5816997839,13cyclictest181rcu_preempt20:13:262
5816997837,12cyclictest181rcu_preempt19:48:322
5816997815,27cyclictest381ktimers/220:58:102
581199783,35cyclictest1095-21seq20:19:391
581199782,34cyclictest2573-21ssh22:28:131
581199782,34cyclictest2573-21ssh22:28:131
581199782,33cyclictest11067-21cat19:13:001
580699788,38cyclictest15-21ksoftirqd/023:03:560
5806997856,14cyclictest27409-21ssh23:08:230
580699782,37cyclictest15-21ksoftirqd/021:08:110
5806997822,30cyclictest15-21ksoftirqd/022:13:210
5806997812,29cyclictest15-21ksoftirqd/000:08:280
5806997812,29cyclictest15-21ksoftirqd/000:08:280
5816997752,10cyclictest181rcu_preempt21:13:312
581199773,60cyclictest308-21apt-get00:13:091
581199772,36cyclictest11267-21taskset19:13:091
581199772,36cyclictest11267-21taskset19:13:091
581199772,29cyclictest1930-21taskset20:23:211
581199772,29cyclictest1930-21taskset20:23:211
581199772,26cyclictest31063-21runrttasks00:09:051
581199772,26cyclictest31063-21runrttasks00:09:051
580699777,41cyclictest15-21ksoftirqd/019:55:270
5806997727,29cyclictest15-21ksoftirqd/022:18:160
5806997727,29cyclictest15-21ksoftirqd/022:18:160
5806997712,31cyclictest15-21ksoftirqd/021:31:420
5806997712,31cyclictest15-21ksoftirqd/021:31:420
5806997711,8cyclictest161ktimers/020:58:200
5816997646,9cyclictest181rcu_preempt22:45:332
5816997646,9cyclictest181rcu_preempt22:45:332
5816997645,8cyclictest181rcu_preempt19:22:592
580699767,37cyclictest15-21ksoftirqd/000:18:200
5806997640,22cyclictest5796-21cyclictest21:41:440
5806997629,17cyclictest15-21ksoftirqd/021:59:010
580699762,44cyclictest15-21ksoftirqd/023:58:110
580699762,44cyclictest15-21ksoftirqd/023:58:110
580699762,37cyclictest15-21ksoftirqd/023:23:480
580699762,37cyclictest15-21ksoftirqd/023:23:480
5806997619,31cyclictest15-21ksoftirqd/022:56:080
5806997618,31cyclictest15-21ksoftirqd/023:29:500
5806997611,43cyclictest15-21ksoftirqd/020:24:530
5806997611,43cyclictest15-21ksoftirqd/020:24:530
5816997553,16cyclictest544-21cron20:22:582
5806997539,10cyclictest181rcu_preempt23:13:350
5806997539,10cyclictest181rcu_preempt23:13:350
5806997536,11cyclictest181rcu_preempt23:52:540
580699753,41cyclictest15-21ksoftirqd/019:14:400
580699753,41cyclictest15-21ksoftirqd/019:14:400
5806997531,9cyclictest181rcu_preempt00:05:180
582399744,44cyclictest0-21swapper/322:48:263
582399744,44cyclictest0-21swapper/322:48:263
5806997432,13cyclictest181rcu_preempt21:24:000
580699742,33cyclictest15-21ksoftirqd/021:18:240
5816997340,8cyclictest181rcu_preempt23:35:102
5816997340,8cyclictest181rcu_preempt23:35:102
5816997335,9cyclictest0-21swapper/220:53:172
5816997227,21cyclictest0-21swapper/219:13:222
5816997227,21cyclictest0-21swapper/219:13:222
580699722,39cyclictest15-21ksoftirqd/021:35:330
580699722,39cyclictest15-21ksoftirqd/019:58:030
5806997216,31cyclictest15-21ksoftirqd/021:56:300
5806997216,31cyclictest15-21ksoftirqd/021:56:300
5806997154,13cyclictest5796-21cyclictest19:28:230
5806997149,15cyclictest1134-21switchtime00:13:330
580699713,27cyclictest15-21ksoftirqd/020:48:330
5806997110,36cyclictest15-21ksoftirqd/020:32:520
5806997050,14cyclictest544-21cron20:17:580
580699702,37cyclictest15-21ksoftirqd/020:47:470
5806997010,36cyclictest15-21ksoftirqd/019:07:390
580699673,35cyclictest15-21ksoftirqd/019:21:140
580699673,35cyclictest15-21ksoftirqd/019:21:140
582399664,38cyclictest0-21swapper/319:53:543
580699668,36cyclictest15-21ksoftirqd/019:43:240
580699662,33cyclictest15-21ksoftirqd/019:33:260
580699653,45cyclictest857-21timerwakeupswit20:18:330
582399632,45cyclictest10639-21chrt22:41:263
582399585,14cyclictest0-21swapper/323:53:163
582399563,40cyclictest8168-21taskset19:03:193
582399563,37cyclictest28018-21chrt21:23:113
582399543,35cyclictest32080-21chrt21:29:523
582399543,35cyclictest32080-21chrt21:29:523
582399537,27cyclictest0-21swapper/323:47:593
582399533,36cyclictest22979-21chrt19:48:233
582399533,36cyclictest12613-21chrt19:17:573
582399533,36cyclictest12613-21chrt19:17:573
582399533,34cyclictest12478-21chrt23:38:083
582399533,32cyclictest24053-21chrt23:03:223
582399532,38cyclictest8898-21taskset00:27:403
582399532,34cyclictest17060-21taskset19:28:353
582399523,35cyclictest26195-21chrt19:58:203
582399523,35cyclictest19370-21taskset23:48:333
582399514,38cyclictest26935-21chrt00:03:173
582399513,36cyclictest25860-21chrt21:18:333
582399513,36cyclictest23142-21chrt23:02:133
582399513,36cyclictest1687-21chrt00:14:193
582399513,35cyclictest9900-21chrt20:48:183
582399513,35cyclictest4093-21chrt22:29:513
582399513,35cyclictest4093-21chrt22:29:513
582399513,35cyclictest23728-21chrt22:08:353
582399513,31cyclictest31769-21chrt22:23:023
582399513,31cyclictest31769-21chrt22:23:023
582399512,41cyclictest12458-21chrt21:50:113
582399512,36cyclictest23695-21chrt21:15:133
582399503,34cyclictest6489-21chrt22:33:363
582399503,34cyclictest17640-21chrt21:58:343
582399503,33cyclictest7715-21chrt23:28:483
582399503,33cyclictest31490-21taskset20:13:313
582399503,32cyclictest323-21chrt20:18:213
582399502,37cyclictest13961-21taskset20:58:353
582399502,34cyclictest19695-21chrt22:55:573
582399502,32cyclictest19280-21chrt21:08:203
582399493,34cyclictest7349-21taskset19:02:593
582399493,34cyclictest6584-21chrt21:40:343
582399492,36cyclictest29796-21chrt00:08:113
582399492,36cyclictest29796-21chrt00:08:113
582399492,35cyclictest2894-21chrt21:33:373
582399492,33cyclictest26413-21taskset00:02:563
582399492,33cyclictest26413-21taskset00:02:563
582399483,35cyclictest27893-21taskset23:08:333
582399483,33cyclictest29696-21chrt20:08:243
582399483,33cyclictest29696-21chrt20:08:243
582399483,32cyclictest14521-21taskset21:53:313
582399483,32cyclictest14521-21taskset21:53:313
582399483,31cyclictest9156-21chrt21:44:233
582399482,37cyclictest22169-21taskset19:46:493
582399482,36cyclictest3353-21chrt23:23:003
582399482,34cyclictest12768-21chrt22:44:013
582399482,34cyclictest12768-21chrt22:44:013
582399482,31cyclictest6520-21chrt20:38:133
582399474,29cyclictest12018-21chrt20:53:333
582399473,35cyclictest2001-21taskset20:23:233
582399473,35cyclictest2001-21taskset20:23:233
582399473,33cyclictest9841-21chrt23:33:213
582399473,33cyclictest9841-21chrt23:33:213
582399473,31cyclictest6050-21chrt00:22:583
582399472,31cyclictest28590-21chrt20:03:343
582399472,31cyclictest28590-21chrt20:03:343
582399463,34cyclictest16182-21chrt21:03:173
582399463,33cyclictest19949-21taskset19:38:313
582399463,32cyclictest10428-21chrt19:08:343
582399463,30cyclictest27221-21chrt22:14:353
582399452,30cyclictest5866-21taskset23:27:053
582399452,30cyclictest5866-21taskset23:27:053
49752459,20sleep30-21swapper/318:53:413
582399443,27cyclictest32081-21taskset23:16:233
582399443,27cyclictest32081-21taskset23:16:233
582399443,26cyclictest18166-21chrt19:33:253
582399433,31cyclictest5095-21taskset20:33:193
582399432,31cyclictest22480-21chrt22:07:583
582399432,31cyclictest22480-21chrt22:07:583
5823994225,10cyclictest451rcuc/320:28:103
582399403,25cyclictest12874-21taskset19:18:103
582399403,25cyclictest12874-21taskset19:18:103
582399393,26cyclictest9468-21chrt20:47:583
582399393,26cyclictest15857-21chrt19:27:583
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional