You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-03 - 08:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Fri Jul 03, 2026 00:44:20)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
7512992524,1cyclictest0-21swapper/321:10:413
750799250,24cyclictest801-21diskmemload23:17:172
750399250,24cyclictest28406-21ssh21:33:531
750399250,24cyclictest2444-21cron21:40:001
7502992523,1cyclictest0-21swapper/000:02:180
750299252,1cyclictest0-21swapper/000:37:350
750299250,24cyclictest32120-21mandb00:00:000
7512992423,1cyclictest801-21diskmemload22:51:353
7512992420,3cyclictest313-21systemd-journal23:05:013
751299240,2cyclictest24109-21ssh00:21:063
751299240,23cyclictest27106-21sh23:55:333
751299240,23cyclictest0-21swapper/321:40:413
7507992424,0cyclictest0-21swapper/223:12:422
7507992423,1cyclictest4762-21ssh22:38:102
7507992422,1cyclictest0-21swapper/223:25:442
7507992420,3cyclictest0-21swapper/222:33:002
7507992419,2cyclictest0-21swapper/223:55:212
750799240,23cyclictest801-21diskmemload23:41:112
750799240,23cyclictest801-21diskmemload21:20:142
750799240,23cyclictest801-21diskmemload00:20:042
750799240,23cyclictest25764-21ssh21:59:452
750399240,24cyclictest0-21swapper/123:52:201
750399240,24cyclictest0-21swapper/122:08:031
750399240,24cyclictest0-21swapper/121:29:581
750399240,23cyclictest801-21diskmemload23:15:091
750399240,23cyclictest0-21swapper/123:35:051
750399240,23cyclictest0-21swapper/123:31:461
750399240,1cyclictest801-21diskmemload00:06:451
750399240,0cyclictest0-21swapper/121:41:501
7502992423,1cyclictest801-21diskmemload23:14:180
7502992423,1cyclictest0-21swapper/021:43:570
750299240,24cyclictest0-21swapper/022:11:350
750299240,24cyclictest0-21swapper/022:00:200
750299240,23cyclictest8186-21apt-get21:45:020
750299240,23cyclictest25915-21sh22:28:120
750299240,23cyclictest0-21swapper/022:21:250
750299240,22cyclictest801-21diskmemload21:52:540
750299240,1cyclictest75-21kswapd023:50:010
750299240,0cyclictest62550irq/127-eno100:13:460
7512992323,0cyclictest0-21swapper/322:02:363
7512992323,0cyclictest0-21swapper/321:20:033
7512992322,1cyclictest16110-1kworker/u9:121:31:213
7512992321,1cyclictest10428-21cron22:15:013
7512992321,1cyclictest0-21swapper/322:55:513
7512992321,1cyclictest0-21swapper/322:46:143
7512992321,1cyclictest0-21swapper/322:06:143
7512992321,1cyclictest0-21swapper/321:46:303
751299230,23cyclictest801-21diskmemload23:18:063
751299230,23cyclictest0-21swapper/323:31:573
751299230,23cyclictest0-21swapper/322:37:443
751299230,22cyclictest801-21diskmemload00:38:253
751299230,22cyclictest23573-21rm21:56:403
751299230,22cyclictest0-21swapper/323:25:493
751299230,1cyclictest2660-21apt-get00:30:023
751299230,1cyclictest0-21swapper/300:08:063
751299230,0cyclictest0-21swapper/322:40:373
751299230,0cyclictest0-21swapper/321:28:073
7507992323,0cyclictest0-21swapper/200:17:542
7507992322,1cyclictest801-21diskmemload21:50:042
7507992320,2cyclictest6324-21apt20:15:002
7507992320,2cyclictest18863-21/usr/sbin/munin22:51:172
7507992320,2cyclictest12668-21ssh21:47:532
750799230,2cyclictest24474-21ssh21:30:562
750799230,2cyclictest19207-21ssh22:21:382
750799230,2cyclictest14434-21ssh22:17:412
750799230,23cyclictest801-21diskmemload22:01:272
750799230,23cyclictest0-21swapper/223:30:162
750799230,23cyclictest0-21swapper/222:57:192
750799230,23cyclictest0-21swapper/200:05:022
750799230,22cyclictest2036-21awk00:30:012
750799230,22cyclictest15371-21ssh23:45:182
750799230,22cyclictest11249-21sh20:25:012
750799230,22cyclictest0-21swapper/221:10:202
750799230,1cyclictest0-21swapper/223:23:092
750799230,0cyclictest801-21diskmemload22:45:272
750799230,0cyclictest801-21diskmemload21:16:512
750799230,0cyclictest0-21swapper/221:37:422
750799230,0cyclictest0-21swapper/200:30:312
7503992323,0cyclictest0-21swapper/123:25:271
7503992323,0cyclictest0-21swapper/123:22:181
7503992323,0cyclictest0-21swapper/123:13:011
7503992323,0cyclictest0-21swapper/100:13:271
7503992323,0cyclictest0-21swapper/100:04:151
7503992321,1cyclictest1913-21ssh21:10:341
7503992321,1cyclictest0-21swapper/123:06:141
7503992321,1cyclictest0-21swapper/121:58:591
750399230,23cyclictest0-21swapper/123:45:051
750399230,23cyclictest0-21swapper/122:14:301
750399230,22cyclictest3311-21grep22:36:221
750399230,22cyclictest24156-21ssh22:55:441
750399230,22cyclictest24102-21sh00:21:061
750399230,22cyclictest23163-21ssh22:54:381
750399230,22cyclictest13167-21rm21:48:301
750399230,22cyclictest12352-21grep19:20:001
750399230,22cyclictest0-21swapper/121:50:571
750399230,1cyclictest29690-21ssh00:25:551
750399230,0cyclictest0-21swapper/122:25:241
7502992323,0cyclictest801-21diskmemload21:16:300
7502992323,0cyclictest0-21swapper/022:46:550
7502992323,0cyclictest0-21swapper/022:43:180
7502992323,0cyclictest0-21swapper/022:37:240
7502992321,1cyclictest0-21swapper/023:25:360
7502992321,1cyclictest0-21swapper/023:06:330
7502992320,2cyclictest1163-21rm21:38:140
750299230,2cyclictest6790-21rm23:36:440
750299230,23cyclictest0-21swapper/023:01:370
750299230,23cyclictest0-21swapper/021:56:450
750299230,22cyclictest819-21apt-get21:10:000
750299230,22cyclictest801-21diskmemload23:20:500
750299230,22cyclictest26740-21turbostat.cron19:50:010
750299230,22cyclictest21835-21ssh21:27:400
750299230,22cyclictest18298-21sh00:15:550
750299230,22cyclictest18205-21ssh22:50:140
750299230,22cyclictest14611-21sh23:16:140
750299230,22cyclictest11308-21ssh22:15:470
750299230,1cyclictest9618-21sh00:07:300
750299230,0cyclictest801-21diskmemload21:32:570
750299230,0cyclictest0-21swapper/023:51:030
750299230,0cyclictest0-21swapper/023:42:020
750299230,0cyclictest0-21swapper/022:05:540
7512992222,0cyclictest0-21swapper/323:51:223
7512992222,0cyclictest0-21swapper/323:40:293
7512992222,0cyclictest0-21swapper/323:06:483
7512992220,1cyclictest2442-21rm00:01:183
7512992220,1cyclictest0-21swapper/323:24:493
751299220,22cyclictest801-21diskmemload22:26:283
751299220,22cyclictest0-21swapper/323:11:123
751299220,22cyclictest0-21swapper/322:22:213
751299220,21cyclictest801-21diskmemload21:35:423
751299220,21cyclictest801-21diskmemload00:10:053
751299220,21cyclictest7836-21apt-get19:11:133
751299220,21cyclictest622-21gdbus21:10:003
751299220,21cyclictest0-21swapper/323:45:033
751299220,21cyclictest0-21swapper/323:35:123
751299220,21cyclictest0-21swapper/321:17:113
751299220,21cyclictest0-21swapper/300:25:133
751299220,21cyclictest0-21swapper/300:15:213
751299220,1cyclictest24356-21apt19:45:013
751299220,1cyclictest19377-21sh21:54:173
751299220,1cyclictest0-21swapper/322:31:353
7507992220,1cyclictest0-21swapper/223:50:362
7507992220,1cyclictest0-21swapper/222:11:162
7507992220,1cyclictest0-21swapper/200:10:262
7507992219,1cyclictest10213-21ssh22:42:502
750799220,22cyclictest0-21swapper/223:00:332
750799220,21cyclictest801-21diskmemload00:35:152
750799220,21cyclictest3787-21ssh23:35:012
750799220,21cyclictest3513-21ssh21:41:012
750799220,21cyclictest31904-21apt-get20:01:122
750799220,21cyclictest20483-21awk21:26:202
750799220,21cyclictest0-21swapper/222:05:542
750799220,21cyclictest0-21swapper/200:01:132
750799220,1cyclictest0-21swapper/223:05:212
7503992222,0cyclictest801-21diskmemload00:33:381
7503992222,0cyclictest0-21swapper/122:16:281
7503992220,1cyclictest19559-21munin-run19:35:001
7503992220,1cyclictest11598-21apt-get20:26:101
750399220,22cyclictest801-21diskmemload22:40:141
750399220,22cyclictest19046-21ssh22:21:251
750399220,21cyclictest29411-21sh23:00:131
750399220,21cyclictest13009-21sh21:20:281
750399220,21cyclictest0-21swapper/120:10:001
750399220,21cyclictest0-21swapper/119:51:131
750399220,1cyclictest9481-21ssh23:40:031
750399220,1cyclictest29208-21ssh22:31:161
750399220,1cyclictest10433-21sh21:17:141
7502992222,0cyclictest801-21diskmemload00:25:320
7502992221,0cyclictest0-21swapper/022:30:230
7502992220,1cyclictest26039-21turbostat.cron20:55:000
7502992219,2cyclictest15617-21rm21:21:420
750299220,2cyclictest31802-21expr23:31:130
750299220,21cyclictest0-21swapper/022:56:390
750299220,21cyclictest0-21swapper/000:30:280
750299220,1cyclictest24912-21ssh00:21:160
750299220,0cyclictest0-21swapper/021:13:210
7512992121,0cyclictest0-21swapper/319:31:113
7507992120,0cyclictest15094-21apt-get19:26:112
750799210,1cyclictest21602-21apt-get20:46:122
750799210,1cyclictest14760-21perf19:25:002
7503992121,0cyclictest0-21swapper/120:51:121
7503992119,1cyclictest0-21swapper/120:05:001
750399210,20cyclictest21270-21awk20:45:001
750399210,20cyclictest0-21swapper/120:56:111
750399210,20cyclictest0-21swapper/119:21:131
750399210,0cyclictest0-21swapper/119:36:121
7502992119,1cyclictest19541-21cron19:35:000
750299210,21cyclictest0-21swapper/020:11:110
750299210,20cyclictest0-21swapper/020:31:130
7512992020,0cyclictest0-21swapper/319:16:123
7512992019,1cyclictest1889-21apt-get20:06:123
7512992019,0cyclictest12702-21apt-get19:21:133
7512992018,1cyclictest0-21swapper/320:40:013
751299200,20cyclictest0-21swapper/320:56:123
750799200,0cyclictest26757-21perf19:50:012
7503992020,0cyclictest0-21swapper/121:06:131
7502992020,0cyclictest0-21swapper/019:56:110
7502992019,0cyclictest10282-21apt-get19:16:120
7512991919,0cyclictest0-21swapper/321:01:133
7512991919,0cyclictest0-21swapper/320:30:023
7512991919,0cyclictest0-21swapper/320:26:103
7512991919,0cyclictest0-21swapper/319:56:113
7512991918,1cyclictest8800-21perf20:20:003
7512991918,1cyclictest0-21swapper/320:11:113
7507991918,1cyclictest0-21swapper/220:36:122
7507991917,1cyclictest6674-21apt-get20:16:102
7507991917,1cyclictest0-21swapper/220:45:002
7507991917,1cyclictest0-21swapper/220:35:012
7503991919,0cyclictest0-21swapper/121:01:131
7503991919,0cyclictest0-21swapper/119:46:121
7503991919,0cyclictest0-21swapper/119:11:131
7503991917,1cyclictest0-21swapper/119:41:111
7502991918,0cyclictest0-21swapper/020:06:120
7512991816,1cyclictest21969-21grep19:40:013
7507991818,0cyclictest29156-21perf19:55:012
7507991818,0cyclictest0-21swapper/220:51:122
7507991818,0cyclictest0-21swapper/220:06:122
7507991818,0cyclictest0-21swapper/219:41:112
7502991818,0cyclictest0-21swapper/020:21:130
7502991818,0cyclictest0-21swapper/019:11:130
7502991817,1cyclictest16791-21apt-get20:36:120
7512991717,0cyclictest0-21swapper/320:51:123
7507991717,0cyclictest0-21swapper/220:26:102
7503991717,0cyclictest0-21swapper/120:36:121
7502991717,0cyclictest0-21swapper/020:41:110
7502991717,0cyclictest0-21swapper/020:26:100
7502991717,0cyclictest0-21swapper/019:51:130
7502991716,1cyclictest0-21swapper/020:46:120
7502991715,1cyclictest8780-21tr20:20:000
750299170,12cyclictest0-21swapper/020:56:120
7512991616,0cyclictest0-21swapper/320:41:113
7512991616,0cyclictest0-21swapper/320:01:123
7507991616,0cyclictest0-21swapper/221:01:132
7507991614,1cyclictest19537-21cron19:35:002
750799160,1cyclictest0-21swapper/219:15:002
7503991616,0cyclictest29487-21apt-get19:56:111
7503991616,0cyclictest0-21swapper/120:31:131
7503991616,0cyclictest0-21swapper/119:26:111
7503991613,2cyclictest6344-21munin-run20:15:001
750399160,2cyclictest10369-21sed20:21:201
750299160,15cyclictest0-21swapper/019:21:130
750799150,5cyclictest0-21swapper/219:16:122
750799150,14cyclictest26392-21apt-get20:56:112
7503991514,0cyclictest0-21swapper/120:46:121
7502991515,0cyclictest0-21swapper/019:26:110
7502991513,1cyclictest23684-21sensors_fan19:41:190
750299150,14cyclictest0-21swapper/020:00:080
7512991414,0cyclictest0-21swapper/319:50:423
751299140,14cyclictest0-21swapper/319:45:053
751299140,0cyclictest0-21swapper/320:45:533
751299140,0cyclictest0-21swapper/320:22:063
751299140,0cyclictest0-21swapper/319:29:493
7507991412,1cyclictest31555-21munin-run20:00:002
750799140,0cyclictest0-21swapper/221:05:562
750799140,0cyclictest0-21swapper/219:39:042
750399140,14cyclictest0-21swapper/120:16:101
7502991414,0cyclictest0-21swapper/021:00:100
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional