You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-27 - 11:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5s.osadl.org (updated Mon Apr 27, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3073699260,25cyclictest0-21swapper/122:15:531
3073699260,1cyclictest22519-21cron21:40:011
30736992523,1cyclictest1764-21sh23:56:421
3073299251,0cyclictest62550irq/127-eno121:21:190
3073299250,24cyclictest12627-21ssh22:31:090
3073299250,24cyclictest0-21swapper/022:04:120
30745992423,1cyclictest23984-21diskmemload21:24:303
30745992423,0cyclictest0-21swapper/322:10:033
30745992422,1cyclictest24150-21awk00:20:003
3074599240,23cyclictest23984-21diskmemload23:16:583
3074599240,23cyclictest0-21swapper/323:25:563
3074599240,23cyclictest0-21swapper/322:55:443
3074599240,23cyclictest0-21swapper/321:25:123
3074599240,23cyclictest0-21swapper/300:27:043
3074599240,1cyclictest20318-21ssh22:08:203
30741992422,1cyclictest0-21swapper/222:48:472
3074199240,23cyclictest498-21ssh22:51:112
3074199240,23cyclictest0-21swapper/222:17:002
3074199240,23cyclictest0-21swapper/221:40:582
30736992421,2cyclictest17400-21runrttasks23:09:061
3073699240,24cyclictest0-21swapper/123:46:241
3073699240,23cyclictest5241-21sh21:21:451
3073699240,23cyclictest23381-21sh22:42:111
30732992422,1cyclictest27515-21cron20:10:010
30732992421,2cyclictest0-21swapper/021:18:210
3073299241,21cyclictest0-21swapper/021:43:270
3073299240,24cyclictest0-21swapper/021:45:250
3073299240,1cyclictest405-21sh22:20:300
30745992323,0cyclictest0-21swapper/323:30:413
30745992323,0cyclictest0-21swapper/323:07:373
30745992323,0cyclictest0-21swapper/322:41:143
30745992322,1cyclictest0-21swapper/321:34:493
30745992321,1cyclictest34-21ksoftirqd/323:50:183
3074599230,2cyclictest16160-21df_inode22:35:413
3074599230,23cyclictest0-21swapper/323:12:023
3074599230,22cyclictest7220-21sh00:34:533
3074599230,22cyclictest366-21ssh21:17:523
3074599230,22cyclictest31917-21sh21:48:063
3074599230,22cyclictest23045-21sh21:40:253
3074599230,22cyclictest0-21swapper/323:02:073
3074599230,0cyclictest0-21swapper/323:57:013
3074599230,0cyclictest0-21swapper/320:55:393
30741992323,0cyclictest23984-21diskmemload22:06:272
30741992323,0cyclictest0-21swapper/223:01:502
30741992323,0cyclictest0-21swapper/222:35:062
30741992323,0cyclictest0-21swapper/222:01:132
30741992323,0cyclictest0-21swapper/200:31:442
30741992322,1cyclictest23984-21diskmemload00:38:312
30741992322,0cyclictest23984-21diskmemload23:56:042
30741992321,1cyclictest28757-21apt-get23:20:402
30741992321,1cyclictest0-21swapper/223:32:352
30741992320,2cyclictest5535-21rm21:22:112
3074199230,2cyclictest23984-21diskmemload21:10:452
3074199230,23cyclictest0-21swapper/222:57:012
3074199230,22cyclictest27332-21fschecks_time23:50:412
3074199230,22cyclictest0-21swapper/221:51:092
3074199230,0cyclictest23984-21diskmemload22:40:542
3074199230,0cyclictest0-21swapper/223:37:222
3074199230,0cyclictest0-21swapper/222:30:082
30736992323,0cyclictest23984-21diskmemload00:34:311
30736992323,0cyclictest23984-21diskmemload00:12:531
30736992323,0cyclictest0-21swapper/123:40:521
30736992323,0cyclictest0-21swapper/123:18:211
30736992323,0cyclictest0-21swapper/122:39:321
30736992323,0cyclictest0-21swapper/121:52:421
30736992323,0cyclictest0-21swapper/121:34:531
30736992321,1cyclictest4563-21ntp_states22:55:441
30736992321,1cyclictest25452-21apt-get20:05:391
30736992321,1cyclictest0-21swapper/122:50:401
30736992321,1cyclictest0-21swapper/121:13:431
3073699230,23cyclictest0-21swapper/121:45:511
3073699230,23cyclictest0-21swapper/100:20:561
3073699230,23cyclictest0-21swapper/100:06:001
3073699230,22cyclictest8463-21sh23:31:031
3073699230,22cyclictest8091-21ps21:55:461
3073699230,22cyclictest8078-21sh00:03:401
3073699230,22cyclictest11171-21rm23:35:031
3073699230,1cyclictest15491-21sh22:03:381
3073699230,0cyclictest23984-21diskmemload22:06:581
30732992323,0cyclictest23984-21diskmemload22:10:010
30732992323,0cyclictest23984-21diskmemload21:35:210
30732992323,0cyclictest0-21swapper/022:55:360
30732992323,0cyclictest0-21swapper/000:18:530
30732992321,1cyclictest26920-21tr23:50:400
30732992320,2cyclictest18328-21sh23:10:070
3073299230,2cyclictest32701-21ssh00:26:550
3073299230,2cyclictest23994-21dump-pmu-power21:10:000
3073299230,23cyclictest0-21swapper/023:22:060
3073299230,22cyclictest15563-21ssh21:32:030
3073299230,22cyclictest14550-21sh23:37:370
3073299230,22cyclictest10674-21ssh23:01:080
3073299230,0cyclictest23984-21diskmemload22:06:420
3073299230,0cyclictest0-21swapper/022:16:110
30745992222,0cyclictest0-21swapper/323:35:043
30745992222,0cyclictest0-21swapper/321:55:253
30745992221,1cyclictest25452-21apt-get20:05:393
30745992221,0cyclictest5551-21apt-get22:25:383
30745992220,1cyclictest7887-21apt-get00:35:383
30745992220,1cyclictest25833-21sh00:20:463
30745992220,1cyclictest21908-21apt-get21:05:383
30745992220,1cyclictest19529-21sh23:42:343
30745992220,1cyclictest0-21swapper/322:30:223
3074599220,22cyclictest23984-21diskmemload21:51:353
3074599220,22cyclictest17613-21ssh00:12:483
3074599220,21cyclictest973-21apt-get19:15:393
3074599220,21cyclictest32669-21apt-get20:20:403
3074599220,21cyclictest31938-21apt-get22:20:023
3074599220,21cyclictest24418-21ssh21:10:173
3074599220,21cyclictest21679-21apt-get23:45:393
3074599220,21cyclictest0-21swapper/323:21:023
3074599220,21cyclictest0-21swapper/322:15:293
3074599220,21cyclictest0-21swapper/320:30:373
3074599220,21cyclictest0-21swapper/319:30:003
3074599220,21cyclictest0-21swapper/300:07:473
3074599220,1cyclictest8878-21cron00:05:013
3074599220,1cyclictest20649-21ssh21:36:553
3074599220,1cyclictest16122-21sh22:04:443
3074599220,0cyclictest0-21swapper/322:50:073
30741992222,0cyclictest0-21swapper/200:20:222
30741992220,1cyclictest0-21swapper/223:41:312
30741992220,1cyclictest0-21swapper/200:25:092
30741992220,1cyclictest0-21swapper/200:05:192
3074199220,2cyclictest0-21swapper/200:13:232
3074199220,22cyclictest31809-21ssh21:16:102
3074199220,22cyclictest0-21swapper/223:45:242
3074199220,21cyclictest29949-21perf20:15:012
3074199220,21cyclictest18107-21apt-get21:35:382
3074199220,21cyclictest12644-21rm21:30:092
3074199220,21cyclictest0-21swapper/222:25:442
3074199220,21cyclictest0-21swapper/222:24:022
3074199220,1cyclictest7111-21ssh00:02:032
3074199220,1cyclictest23984-21diskmemload21:45:092
3074199220,1cyclictest21126-21ssh23:11:512
3074199220,1cyclictest14402-21turbostat20:50:012
3074199220,1cyclictest0-21swapper/223:25:122
3074199220,1cyclictest0-21swapper/223:18:272
3074199220,1cyclictest0-21swapper/221:55:412
3074199220,0cyclictest0-21swapper/222:10:082
3074199220,0cyclictest0-21swapper/200:16:232
30736992222,0cyclictest0-21swapper/123:00:391
30736992222,0cyclictest0-21swapper/121:26:371
30736992222,0cyclictest0-21swapper/121:17:201
30736992221,1cyclictest8497-21ssh22:27:411
30736992220,1cyclictest0-21swapper/122:20:211
3073699220,21cyclictest23984-21diskmemload23:20:421
3073699220,21cyclictest23057-21ssh21:40:261
3073699220,21cyclictest10647-21apt-get19:35:401
3073699220,21cyclictest0-21swapper/123:50:061
3073699220,21cyclictest0-21swapper/120:40:001
3073699220,21cyclictest0-21swapper/120:20:391
3073699220,21cyclictest0-21swapper/119:45:001
3073699220,21cyclictest0-21swapper/100:35:251
3073699220,1cyclictest21586-21ssh22:10:011
3073699220,1cyclictest18711-21apt-get23:10:391
3073699220,0cyclictest23984-21diskmemload22:46:411
3073699220,0cyclictest0-21swapper/122:33:141
3073699220,0cyclictest0-21swapper/119:55:381
3073699220,0cyclictest0-21swapper/100:18:451
30732992222,0cyclictest0-21swapper/022:25:360
30732992222,0cyclictest0-21swapper/020:35:380
30732992222,0cyclictest0-21swapper/000:04:050
30732992220,1cyclictest8375-21ssh23:30:550
30732992220,1cyclictest31004-21apt-get19:10:390
30732992220,1cyclictest23949-21ssh23:46:300
30732992220,1cyclictest0-21swapper/000:35:390
3073299221,0cyclictest62550irq/127-eno123:15:320
3073299220,22cyclictest0-21swapper/023:08:290
3073299220,21cyclictest9559-21grep21:25:490
3073299220,21cyclictest25582-21diskmemload22:45:170
3073299220,21cyclictest23984-21diskmemload23:25:250
3073299220,21cyclictest23984-21diskmemload00:30:370
3073299220,21cyclictest23984-21diskmemload00:10:280
3073299220,21cyclictest2340-21turbostat.cron20:25:000
3073299220,21cyclictest0-21swapper/021:55:410
3073299220,21cyclictest0-21swapper/021:11:160
3073299220,21cyclictest0-21swapper/019:50:390
3073299220,1cyclictest16521-21ssh23:40:290
3073299220,1cyclictest1477-21ssh23:56:170
3073299220,1cyclictest11174-21timerandwakeup00:05:470
3073299220,1cyclictest0-21swapper/019:40:000
3073299220,1cyclictest0-21swapper/000:20:420
3073299220,0cyclictest23984-21diskmemload21:51:570
30741992120,1cyclictest0-21swapper/219:10:382
30741992119,1cyclictest9917-21apt-get20:40:382
3074199210,20cyclictest0-21swapper/220:30:372
3074199210,0cyclictest7929-21apt-get21:25:402
30732992121,0cyclictest0-21swapper/020:55:390
3073299210,21cyclictest23984-21diskmemload22:50:400
3073299210,1cyclictest22704-21cron20:00:010
3073299210,0cyclictest0-21swapper/020:40:380
3074599200,20cyclictest0-21swapper/319:45:393
30741992020,0cyclictest0-21swapper/219:55:372
3074199200,20cyclictest0-21swapper/220:05:392
3074199200,20cyclictest0-21swapper/219:20:392
3074199200,0cyclictest0-21swapper/220:50:402
3074199200,0cyclictest0-21swapper/219:35:392
30736992020,0cyclictest0-21swapper/120:30:381
30736992020,0cyclictest0-21swapper/120:00:381
30736992020,0cyclictest0-21swapper/119:45:391
30736992020,0cyclictest0-21swapper/119:30:381
30736992019,1cyclictest16803-21ls20:55:011
3073699200,20cyclictest0-21swapper/120:25:381
3073699200,0cyclictest0-21swapper/119:15:391
30732992020,0cyclictest0-21swapper/020:50:400
30732992018,1cyclictest12312-21apt-get20:45:400
3073299200,0cyclictest30241-21apt-get20:15:390
30745991919,0cyclictest0-21swapper/320:15:403
30745991919,0cyclictest0-21swapper/319:55:383
30745991917,1cyclictest13060-21apt-get19:40:373
3074599190,18cyclictest0-21swapper/319:10:393
30741991919,0cyclictest8195-21apt-get19:30:382
30741991919,0cyclictest0-21swapper/221:05:372
30741991919,0cyclictest0-21swapper/220:35:382
30741991918,1cyclictest2649-21apt-get20:25:382
30741991918,0cyclictest17102-21apt-get20:55:392
30741991917,1cyclictest15456-21apt-get19:45:392
30736991919,0cyclictest0-21swapper/120:55:391
30736991917,1cyclictest17849-21apt-get19:50:391
30732991919,0cyclictest0-21swapper/020:05:010
30745991818,0cyclictest0-21swapper/320:45:403
30745991818,0cyclictest0-21swapper/320:40:383
30745991818,0cyclictest0-21swapper/319:30:383
30745991817,1cyclictest4749-21perf20:30:003
30741991818,0cyclictest0-21swapper/219:50:392
30736991818,0cyclictest0-21swapper/119:20:391
30732991818,0cyclictest5801-21apt-get19:25:390
30732991818,0cyclictest0-21swapper/020:25:380
30732991816,1cyclictest0-21swapper/019:45:000
30736991715,1cyclictest21908-21apt-get21:05:381
30732991717,0cyclictest0-21swapper/019:15:390
30745991616,0cyclictest0-21swapper/320:00:383
30745991614,1cyclictest0-21swapper/320:15:013
30741991616,0cyclictest0-21swapper/220:15:402
30741991616,0cyclictest0-21swapper/219:25:392
30741991614,1cyclictest0-21swapper/220:25:002
30736991616,0cyclictest19515-21apt-get21:00:381
30732991616,0cyclictest3404-21apt-get19:20:390
30732991616,0cyclictest0-21swapper/021:00:380
30732991616,0cyclictest0-21swapper/019:30:380
30745991515,0cyclictest0-21swapper/319:50:393
30741991513,1cyclictest23460-21cstates20:00:392
30736991514,0cyclictest0-21swapper/119:10:381
30732991515,0cyclictest0-21swapper/020:30:370
30745991414,0cyclictest0-21swapper/320:50:233
30745991414,0cyclictest0-21swapper/319:35:173
30745991414,0cyclictest0-21swapper/319:20:123
3074599140,14cyclictest0-21swapper/320:35:213
3074599140,0cyclictest0-21swapper/321:00:173
3074199140,14cyclictest0-21swapper/221:00:562
3074199140,14cyclictest0-21swapper/219:15:042
3074199140,0cyclictest0-21swapper/219:40:542
30736991414,0cyclictest0-21swapper/120:45:021
30736991414,0cyclictest0-21swapper/120:15:111
30736991414,0cyclictest0-21swapper/119:25:341
3073699140,14cyclictest0-21swapper/120:40:101
3073299140,0cyclictest0-21swapper/020:10:030
3073299140,0cyclictest0-21swapper/019:45:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional