You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-19 - 07:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sun Jul 19, 2026 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
507199260,25cyclictest25304-21ssh23:27:313
5071992523,1cyclictest31642-21sh23:03:573
507199250,24cyclictest31971-21diskmemload22:50:573
506799250,24cyclictest31971-21diskmemload23:06:262
506799250,24cyclictest0-21swapper/220:12:332
5065992523,1cyclictest0-21swapper/123:31:171
506599250,2cyclictest12961-21ssh00:13:361
506599250,24cyclictest0-21swapper/123:57:351
506599250,24cyclictest0-21swapper/123:05:461
506599250,1cyclictest31971-21diskmemload21:21:501
5060992520,1cyclictest151rcu_preempt22:11:580
506099250,24cyclictest31971-21diskmemload21:37:570
506099250,24cyclictest31971-21diskmemload00:11:530
506099250,24cyclictest28410-21ssh22:04:320
506099250,24cyclictest19371-21ssh00:19:450
5071992421,2cyclictest11466-21head22:17:383
507199240,23cyclictest31971-21diskmemload21:17:043
507199240,23cyclictest0-21swapper/323:43:003
5067992419,0cyclictest0-21swapper/222:20:072
506799240,24cyclictest0-21swapper/223:44:512
506799240,23cyclictest31971-21diskmemload22:25:492
506799240,23cyclictest0-21swapper/223:35:152
506799240,23cyclictest0-21swapper/222:01:212
506799240,23cyclictest0-21swapper/221:40:152
506799240,1cyclictest31971-21diskmemload23:55:412
5065992422,1cyclictest0-21swapper/122:44:061
5065992422,1cyclictest0-21swapper/100:00:321
506599240,24cyclictest0-21swapper/121:38:081
506599240,23cyclictest783-21snmpd23:52:231
506599240,23cyclictest2218-21sh21:41:301
506599240,0cyclictest0-21swapper/122:37:031
5060992424,0cyclictest0-21swapper/022:40:300
5060992423,1cyclictest8456-21ssh23:40:520
506099240,23cyclictest31971-21diskmemload00:24:220
5071992323,0cyclictest31971-21diskmemload21:20:053
5071992323,0cyclictest0-21swapper/321:54:423
5071992323,0cyclictest0-21swapper/300:22:423
5071992323,0cyclictest0-21swapper/300:17:483
5071992323,0cyclictest0-21swapper/300:02:523
5071992321,2cyclictest917-21rm21:11:233
5071992320,2cyclictest4832-21ssh00:35:173
507199230,2cyclictest32530-21ssh00:31:223
507199230,23cyclictest0-21swapper/323:36:533
507199230,23cyclictest0-21swapper/323:30:143
507199230,23cyclictest0-21swapper/321:42:443
507199230,23cyclictest0-21swapper/300:26:203
507199230,23cyclictest0-21swapper/300:07:433
507199230,22cyclictest31971-21diskmemload21:27:583
507199230,22cyclictest27244-21ssh21:34:213
507199230,22cyclictest26223-21ssh22:31:253
507199230,22cyclictest24693-21ssh22:29:413
507199230,1cyclictest0-21swapper/322:12:333
507199230,0cyclictest31971-21diskmemload22:37:093
507199230,0cyclictest31971-21diskmemload22:06:393
507199230,0cyclictest0-21swapper/323:59:203
507199230,0cyclictest0-21swapper/300:14:583
5067992323,0cyclictest0-21swapper/223:31:212
5067992323,0cyclictest0-21swapper/223:27:432
5067992323,0cyclictest0-21swapper/222:49:482
5067992323,0cyclictest0-21swapper/200:01:082
5067992322,0cyclictest0-21swapper/222:32:282
5067992321,1cyclictest0-21swapper/200:27:462
5067992320,2cyclictest5806-21ssh21:15:142
506799230,2cyclictest30138-21cstates21:37:332
506799230,2cyclictest12301-21latency_hist19:25:012
506799230,22cyclictest0-21swapper/222:59:462
506799230,22cyclictest0-21swapper/222:52:332
506799230,22cyclictest0-21swapper/222:16:152
506799230,22cyclictest0-21swapper/221:30:242
506799230,22cyclictest0-21swapper/221:28:152
506799230,1cyclictest17974-21ssh23:20:032
506799230,0cyclictest31971-21diskmemload21:10:402
506799230,0cyclictest31971-21diskmemload00:10:142
506799230,0cyclictest0-21swapper/221:50:022
506799230,0cyclictest0-21swapper/200:22:482
506799230,0cyclictest0-21swapper/200:15:592
5065992323,0cyclictest0-21swapper/123:35:121
5065992323,0cyclictest0-21swapper/123:15:221
5065992323,0cyclictest0-21swapper/122:25:171
5065992323,0cyclictest0-21swapper/121:25:191
5065992323,0cyclictest0-21swapper/100:33:231
5065992323,0cyclictest0-21swapper/100:21:241
5065992323,0cyclictest0-21swapper/100:17:101
5065992321,1cyclictest16813-21sendmail-msp20:40:001
5065992321,1cyclictest14934-21munin-run22:50:001
5065992321,1cyclictest0-21swapper/123:23:151
5065992321,1cyclictest0-21swapper/121:52:371
5065992320,2cyclictest7832-21sh23:12:101
5065992320,2cyclictest24347-21sh22:01:211
506599231,1cyclictest0-21swapper/123:04:471
506599230,2cyclictest16709-21rm22:51:461
506599230,23cyclictest0-21swapper/100:37:241
506599230,23cyclictest0-21swapper/100:08:061
506599230,22cyclictest9916-21sendmail-msp19:20:011
506599230,22cyclictest25748-21ssh00:25:291
506599230,22cyclictest14888-21sh23:47:031
506599230,22cyclictest0-21swapper/123:27:341
506599230,1cyclictest965-21ssh22:08:341
506599230,0cyclictest31971-21diskmemload21:15:391
5060992323,0cyclictest31971-21diskmemload00:31:590
5060992323,0cyclictest0-21swapper/023:51:020
5060992323,0cyclictest0-21swapper/023:48:000
5060992323,0cyclictest0-21swapper/023:21:380
5060992323,0cyclictest0-21swapper/023:05:100
5060992323,0cyclictest0-21swapper/022:55:510
5060992323,0cyclictest0-21swapper/022:20:520
5060992321,2cyclictest0-21swapper/022:15:460
5060992321,1cyclictest0-21swapper/023:31:530
5060992320,2cyclictest31971-21diskmemload00:08:240
506099230,4cyclictest606-21dbus-daemon19:30:010
506099230,23cyclictest0-21swapper/022:46:160
506099230,22cyclictest29040-21ssh23:59:080
506099230,22cyclictest2781-21ssh22:38:430
506099230,22cyclictest27517-21rm23:28:090
506099230,22cyclictest26331-21ssh22:31:350
506099230,22cyclictest22858-21ssh21:30:320
506099230,22cyclictest15601-21ssh22:50:050
506099230,1cyclictest31768-21ssh23:04:050
506099230,0cyclictest0-21swapper/021:25:450
506099230,0cyclictest0-21swapper/021:10:440
506099230,0cyclictest0-21swapper/000:25:260
506099230,0cyclictest0-21swapper/000:02:130
5071992222,0cyclictest0-21swapper/322:40:203
5071992221,1cyclictest14635-21ssh22:21:003
5071992220,1cyclictest7603-21apt-get20:22:313
5071992220,1cyclictest0-21swapper/321:56:513
5071992219,2cyclictest16311-21/usr/sbin/munin23:47:393
507199220,2cyclictest22389-21ssh22:56:583
507199220,22cyclictest0-21swapper/323:05:083
507199220,21cyclictest7560-21ssh21:46:163
507199220,21cyclictest609-21rs:main3
507199220,21cyclictest31971-21diskmemload23:20:073
507199220,21cyclictest30046-21apt-get21:07:323
507199220,21cyclictest19976-21sh23:51:313
507199220,21cyclictest10609-21ssh22:46:323
507199220,21cyclictest0-21swapper/320:27:313
507199220,1cyclictest25677-21cat22:02:323
507199220,1cyclictest2349-21munin-run20:10:013
507199220,1cyclictest14916-21ssh23:17:363
507199220,1cyclictest0-21swapper/321:35:503
5067992222,0cyclictest0-21swapper/223:45:222
5067992222,0cyclictest0-21swapper/222:10:092
5067992222,0cyclictest0-21swapper/222:06:182
5067992220,1cyclictest0-21swapper/222:40:052
5067992220,1cyclictest0-21swapper/222:35:062
5067992220,1cyclictest0-21swapper/221:55:412
5067992220,1cyclictest0-21swapper/200:30:372
506799220,21cyclictest606-21dbus-daemon20:10:012
506799220,21cyclictest12309-21ssh23:15:022
506799220,21cyclictest12001-21dump-pmu-power20:30:002
506799220,21cyclictest0-21swapper/223:50:102
506799220,21cyclictest0-21swapper/223:00:432
506799220,21cyclictest0-21swapper/221:45:062
506799220,21cyclictest0-21swapper/221:20:532
506799220,21cyclictest0-21swapper/220:57:312
506799220,21cyclictest0-21swapper/219:39:342
506799220,1cyclictest0-21swapper/200:35:302
506799220,0cyclictest31971-21diskmemload23:12:152
506799220,0cyclictest31971-21diskmemload00:05:452
5065992222,0cyclictest31971-21diskmemload21:55:391
5065992222,0cyclictest0-21swapper/122:58:481
5065992222,0cyclictest0-21swapper/121:10:211
5065992221,1cyclictest17938-21apt-get19:37:301
5065992220,1cyclictest4741-21wc20:15:011
5065992220,1cyclictest32359-21perf20:05:011
5065992220,1cyclictest32359-21perf20:05:011
5065992220,1cyclictest0-21swapper/122:20:151
5065992220,1cyclictest0-21swapper/120:10:011
506599220,22cyclictest0-21swapper/122:12:521
506599220,22cyclictest0-21swapper/121:30:121
506599220,21cyclictest8183-21ssh22:15:301
506599220,21cyclictest25588-21apt-get19:52:311
506599220,21cyclictest0-21swapper/122:31:581
506599220,21cyclictest0-21swapper/121:45:161
5060992222,0cyclictest0-21swapper/021:57:400
5060992222,0cyclictest0-21swapper/000:36:550
5060992221,1cyclictest62550irq/127-eno119:12:310
5060992221,1cyclictest12485-21ssh21:50:150
5060992220,2cyclictest0-21swapper/021:20:070
5060992220,1cyclictest32321-21cron20:05:010
5060992220,1cyclictest32321-21cron20:05:010
5060992219,2cyclictest4729-21turbostat.cron20:15:010
506099220,22cyclictest0-21swapper/021:17:140
506099220,21cyclictest6748-21ssh21:45:060
506099220,21cyclictest31971-21diskmemload23:10:120
506099220,21cyclictest24981-21apt22:30:010
506099220,21cyclictest1565-21seq22:09:270
506099220,21cyclictest0-21swapper/023:17:220
506099220,21cyclictest0-21swapper/020:52:320
506099220,21cyclictest0-21swapper/019:52:310
506099220,21cyclictest0-21swapper/019:47:320
506099220,1cyclictest1712-21ssh21:40:520
507199210,0cyclictest27984-21apt-get19:57:313
507199210,0cyclictest0-21swapper/319:42:303
5067992119,1cyclictest23978-21apt-get20:55:012
5067992119,1cyclictest15102-21perf19:30:012
506799210,20cyclictest0-21swapper/219:47:322
5065992119,1cyclictest9547-21awk20:25:001
506599210,20cyclictest15546-21apt-get19:32:311
506599210,0cyclictest0-21swapper/120:17:291
5060992121,0cyclictest0-21swapper/020:32:310
506099210,20cyclictest0-21swapper/020:42:320
5071992020,0cyclictest5186-21apt-get20:17:303
5071992020,0cyclictest0-21swapper/320:47:303
5071992020,0cyclictest0-21swapper/320:37:323
5071992020,0cyclictest0-21swapper/319:32:313
5071992018,1cyclictest24739-21apt-get19:50:003
507199200,0cyclictest0-21swapper/319:39:343
507199200,0cyclictest0-21swapper/319:17:323
5067992020,0cyclictest0-21swapper/219:57:312
5067992019,1cyclictest27252-21apt-get21:02:322
5067992019,1cyclictest19649-21apt-get20:47:302
5067992019,1cyclictest0-21swapper/220:25:002
506799200,19cyclictest19191-21cron20:45:002
506799200,0cyclictest0-21swapper/219:32:312
5065992020,0cyclictest0-21swapper/121:10:001
5065992020,0cyclictest0-21swapper/121:02:311
5065992020,0cyclictest0-21swapper/120:27:311
5065992020,0cyclictest0-21swapper/119:47:321
5065992020,0cyclictest0-21swapper/119:22:311
5060992020,0cyclictest0-21swapper/020:47:300
506099200,0cyclictest0-21swapper/020:57:310
5071991919,0cyclictest0-21swapper/320:32:313
5071991918,1cyclictest2783-21apt-get20:12:333
5071991917,1cyclictest30404-21apt-get20:02:313
5071991917,1cyclictest30404-21apt-get20:02:313
5067991918,1cyclictest0-21swapper/219:42:302
5060991917,1cyclictest2336-21apt20:10:010
5065991817,1cyclictest0-21swapper/120:55:021
5060991818,0cyclictest0-21swapper/019:42:300
5060991816,1cyclictest29202-21dump-pmu-power21:05:010
507199174,12cyclictest24601-21packagekitd20:58:573
5071991717,0cyclictest0-21swapper/321:02:323
5071991716,0cyclictest0-21swapper/319:22:313
5067991717,0cyclictest0-21swapper/220:37:322
5065991717,0cyclictest0-21swapper/119:25:021
5065991715,1cyclictest0-21swapper/120:35:001
5060991717,0cyclictest0-21swapper/020:22:310
5060991715,1cyclictest29911-21cron20:00:000
5071991616,0cyclictest0-21swapper/319:50:023
5071991616,0cyclictest0-21swapper/319:12:313
507199160,7cyclictest0-21swapper/320:42:323
5067991616,0cyclictest0-21swapper/220:17:302
5065991616,0cyclictest0-21swapper/119:12:311
5065991615,0cyclictest22045-21apt-get20:52:321
5065991615,0cyclictest0-21swapper/119:57:311
506599160,15cyclictest19218-21perf20:45:001
5060991616,0cyclictest14843-21apt-get20:37:320
5060991616,0cyclictest0-21swapper/020:17:300
5060991616,0cyclictest0-21swapper/019:37:300
5060991614,1cyclictest11683-21plymouth19:22:380
5067991515,0cyclictest0-21swapper/219:12:312
506799150,14cyclictest8934-21ntp_states19:17:382
5065991514,1cyclictest0-21swapper/120:47:381
5060991515,0cyclictest10050-21apt-get20:27:310
507199140,0cyclictest0-21swapper/320:52:453
5067991414,0cyclictest0-21swapper/220:01:132
5067991414,0cyclictest0-21swapper/220:01:132
506799140,14cyclictest0-21swapper/221:06:302
506799140,0cyclictest0-21swapper/220:30:202
506799140,0cyclictest0-21swapper/219:52:462
506599140,14cyclictest0-21swapper/119:40:581
5060991414,0cyclictest0-21swapper/021:05:060
506099140,14cyclictest0-21swapper/019:33:590
506099140,0cyclictest0-21swapper/019:16:480
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional