You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-15 - 04:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Wed Jul 15, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2419399280,27cyclictest27048-21ssh21:46:513
2419399280,1cyclictest17464-21diskmemload21:18:443
2419399280,1cyclictest0-21swapper/300:15:023
2419399280,1cyclictest0-21swapper/300:15:023
2419399270,26cyclictest8166-21awk21:30:013
2419399270,26cyclictest7374-21ssh21:57:183
2419399270,1cyclictest29914-21strings23:42:153
2419399268,17cyclictest10898-21ssh22:29:173
24193992620,5cyclictest30807-21awk21:22:113
24193992610,15cyclictest0-21swapper/321:44:403
2419399260,2cyclictest24170-21ssh00:05:203
2419399260,25cyclictest13421-21/usr/sbin/munin22:02:203
2419399260,1cyclictest16359-21ssh23:31:073
2418999260,1cyclictest0-21swapper/222:14:312
24193992522,3cyclictest0-21swapper/322:11:053
24193992522,3cyclictest0-21swapper/300:11:183
24193992520,4cyclictest0-21swapper/322:09:513
2419399250,4cyclictest0-21swapper/323:06:473
2419399250,24cyclictest0-21swapper/300:25:153
2419399250,21cyclictest26234-21ssh23:39:323
2419399250,1cyclictest12147-21ssh22:57:273
2419399250,0cyclictest17464-21diskmemload21:51:223
2419399250,0cyclictest0-21swapper/323:57:123
2419399250,0cyclictest0-21swapper/323:25:043
2419399250,0cyclictest0-21swapper/322:31:413
24183992523,1cyclictest0-21swapper/122:54:321
2418399250,24cyclictest17464-21diskmemload23:59:021
2418399250,24cyclictest0-21swapper/121:33:021
2417899250,2cyclictest29593-21ssh00:10:030
2417899250,24cyclictest2004-21/usr/sbin/munin21:52:200
24193992421,3cyclictest0-21swapper/322:50:013
2419399240,4cyclictest14505-21ssh23:00:253
2419399240,23cyclictest30579-21apt-get22:47:133
2419399240,23cyclictest17464-21diskmemload21:37:453
2419399240,23cyclictest0-21swapper/323:45:173
2419399240,23cyclictest0-21swapper/321:32:123
2419399240,23cyclictest0-21swapper/300:35:473
2419399240,23cyclictest0-21swapper/300:31:553
2419399240,23cyclictest0-21swapper/300:20:473
2419399240,20cyclictest0-21swapper/321:12:323
2419399240,1cyclictest8544-21diskmemload23:23:263
2419399240,1cyclictest17464-21diskmemload00:00:243
2419399240,0cyclictest0-21swapper/322:37:123
2419399240,0cyclictest0-21swapper/320:57:133
24189992422,1cyclictest0-21swapper/223:32:032
24189992420,3cyclictest0-21swapper/200:37:122
2418999240,23cyclictest17464-21diskmemload23:14:512
2418999240,23cyclictest17464-21diskmemload22:29:022
2418999240,23cyclictest0-21swapper/222:57:322
2418999240,23cyclictest0-21swapper/222:21:572
2418999240,23cyclictest0-21swapper/222:04:032
2418999240,1cyclictest25157-21apt-get21:17:122
2418999240,1cyclictest17464-21diskmemload23:41:162
2418999240,1cyclictest0-21swapper/222:41:152
24183992424,0cyclictest0-21swapper/122:46:261
24183992422,1cyclictest2182-21apt-get21:25:011
2418399241,4cyclictest0-21swapper/121:17:171
2418399240,2cyclictest21736-21ssh00:31:341
2418399240,23cyclictest28670-21ssh22:44:511
2418399240,23cyclictest0-21swapper/122:33:371
2418399240,0cyclictest0-21swapper/122:23:311
24178992424,0cyclictest62550irq/127-eno123:09:190
2417899240,23cyclictest22473-21ssh21:13:550
2417899240,23cyclictest17464-21diskmemload22:31:460
2417899240,23cyclictest17464-21diskmemload21:30:140
2417899240,23cyclictest0-21swapper/023:35:490
2417899240,23cyclictest0-21swapper/023:03:220
2417899240,1cyclictest17464-21diskmemload00:19:050
2417899240,1cyclictest17464-21diskmemload00:19:050
2417899240,1cyclictest0-21swapper/021:57:140
2417899240,0cyclictest17464-21diskmemload23:17:520
24193992323,0cyclictest0-21swapper/322:20:103
2419399230,23cyclictest17464-21diskmemload23:10:293
2419399230,22cyclictest6175-21idleruntime-cro19:40:003
2419399230,1cyclictest325-21/usr/sbin/munin23:17:133
2419399230,0cyclictest0-21swapper/322:40:223
2419399230,0cyclictest0-21swapper/322:15:453
24189992323,0cyclictest0-21swapper/223:38:542
24189992323,0cyclictest0-21swapper/223:25:002
24189992323,0cyclictest0-21swapper/223:10:002
24189992323,0cyclictest0-21swapper/222:08:222
24189992323,0cyclictest0-21swapper/221:23:422
24189992322,1cyclictest32037-21ssh23:16:172
24189992322,1cyclictest21514-21diskmemload00:31:172
24189992322,1cyclictest17464-21diskmemload00:04:262
24189992321,1cyclictest0-21swapper/222:30:032
24189992321,1cyclictest0-21swapper/221:40:022
2418999230,2cyclictest6193-21munin-plugin-st19:40:002
2418999230,23cyclictest17464-21diskmemload22:45:202
2418999230,23cyclictest0-21swapper/222:15:292
2418999230,23cyclictest0-21swapper/221:51:222
2418999230,22cyclictest9095-21sh21:30:542
2418999230,22cyclictest5496-21perf20:45:012
2418999230,22cyclictest17914-21awk00:00:002
2418999230,22cyclictest0-21swapper/222:35:152
2418999230,22cyclictest0-21swapper/221:11:272
2418999230,0cyclictest0-21swapper/223:27:332
2418999230,0cyclictest0-21swapper/223:04:562
2418999230,0cyclictest0-21swapper/200:22:502
2418999230,0cyclictest0-21swapper/200:18:342
2418999230,0cyclictest0-21swapper/200:18:342
24183992323,0cyclictest0-21swapper/123:01:141
24183992323,0cyclictest0-21swapper/122:13:341
24183992323,0cyclictest0-21swapper/122:00:211
24183992323,0cyclictest0-21swapper/121:41:461
24183992322,1cyclictest0-21swapper/100:15:261
24183992322,1cyclictest0-21swapper/100:15:261
24183992321,1cyclictest6912-21rm23:50:021
24183992321,1cyclictest28812-21ssh23:12:241
24183992321,1cyclictest18658-21apt-get20:07:101
24183992321,1cyclictest0-21swapper/123:05:541
24183992321,1cyclictest0-21swapper/121:54:221
24183992321,1cyclictest0-21swapper/121:12:281
24183992320,2cyclictest26251-21ssh21:45:481
2418399230,2cyclictest9592-21ssh00:20:301
2418399230,23cyclictest0-21swapper/123:26:361
2418399230,23cyclictest0-21swapper/122:35:081
2418399230,23cyclictest0-21swapper/121:55:101
2418399230,22cyclictest9564-21rm23:24:501
2418399230,22cyclictest720-21rm00:12:381
2418399230,22cyclictest31539-21ssh23:15:391
2418399230,22cyclictest26362-21sh23:39:481
2418399230,22cyclictest19421-21ssh22:07:321
2418399230,22cyclictest18749-21ssh00:27:521
2418399230,22cyclictest0-21swapper/123:30:521
2418399230,22cyclictest0-21swapper/122:58:381
2418399230,22cyclictest0-21swapper/122:25:141
2418399230,22cyclictest0-21swapper/122:15:111
2418399230,22cyclictest0-21swapper/100:00:441
2418399230,0cyclictest17464-21diskmemload21:22:041
2418399230,0cyclictest17464-21diskmemload00:05:041
24178992323,0cyclictest17464-21diskmemload21:25:470
24178992323,0cyclictest0-21swapper/023:28:360
24178992323,0cyclictest0-21swapper/022:47:130
24178992323,0cyclictest0-21swapper/022:10:490
24178992323,0cyclictest0-21swapper/021:43:590
24178992323,0cyclictest0-21swapper/000:37:470
24178992323,0cyclictest0-21swapper/000:28:450
24178992321,2cyclictest0-21swapper/021:47:340
2417899230,2cyclictest9569-21ssh22:56:260
2417899230,23cyclictest0-21swapper/023:23:510
2417899230,23cyclictest0-21swapper/022:39:440
2417899230,23cyclictest0-21swapper/022:08:180
2417899230,22cyclictest7072-21ssh22:26:310
2417899230,22cyclictest30095-21ssh23:13:590
2417899230,22cyclictest2401-21rm22:50:010
2417899230,22cyclictest21690-21sed00:02:240
2417899230,22cyclictest17952-21munin-run00:00:000
2417899230,22cyclictest0-21swapper/021:18:030
2417899230,1cyclictest0-21swapper/022:16:220
2417899230,0cyclictest17464-21diskmemload23:42:080
2417899230,0cyclictest17464-21diskmemload00:32:340
2417899230,0cyclictest0-21swapper/023:46:020
2417899230,0cyclictest0-21swapper/023:32:370
2419399220,1cyclictest28966-21latency_hist19:20:003
24189992222,0cyclictest0-21swapper/221:25:262
24189992222,0cyclictest0-21swapper/200:25:372
24189992221,1cyclictest271rcuc/223:50:022
24189992220,1cyclictest24521-21ssh00:05:562
24189992220,1cyclictest17464-21diskmemload00:11:042
24189992220,1cyclictest15083-21cron21:05:002
24189992220,1cyclictest1090-21apt-get20:37:132
24189992220,1cyclictest0-21swapper/221:46:362
2418999220,21cyclictest26953-21apt-get19:17:112
2418999220,21cyclictest14869-21rm21:36:112
2418999220,21cyclictest0-21swapper/223:45:052
2418999220,21cyclictest0-21swapper/222:53:272
2418999220,21cyclictest0-21swapper/219:12:112
2418999220,1cyclictest5391-21ssh21:55:582
24183992222,0cyclictest0-21swapper/100:37:281
24183992220,1cyclictest3771-21latency_hist19:35:001
2418399220,22cyclictest1980-21sh23:46:351
2418399220,21cyclictest17505-21awk21:10:001
2418399220,21cyclictest0-21swapper/123:42:011
2418399220,21cyclictest0-21swapper/121:37:181
2418399220,21cyclictest0-21swapper/119:20:001
24178992220,1cyclictest8605-21apt-get00:20:020
24178992220,1cyclictest29971-21ssh21:20:590
2417899220,22cyclictest23895-21ssh22:40:500
2417899220,21cyclictest17464-21diskmemload23:50:050
2417899220,21cyclictest0-21swapper/020:12:120
2417899220,1cyclictest0-21swapper/022:00:360
2417899220,0cyclictest0-21swapper/021:36:040
2417899220,0cyclictest0-21swapper/000:06:330
24193992121,0cyclictest0-21swapper/319:27:113
24193992119,1cyclictest13373-21idleruntime-cro19:55:013
2419399210,20cyclictest8310-21apt-get20:52:133
2419399210,20cyclictest0-21swapper/319:12:123
2419399210,1cyclictest30916-21apt-get20:30:023
2419399210,0cyclictest0-21swapper/320:47:113
2419399210,0cyclictest0-21swapper/320:37:133
2419399210,0cyclictest0-21swapper/320:12:123
24189992119,1cyclictest13802-21apt-get19:57:132
2418999210,0cyclictest0-21swapper/220:17:122
24183992120,1cyclictest0-21swapper/121:02:131
24183992119,1cyclictest0-21swapper/120:35:011
2418399210,20cyclictest0-21swapper/119:37:111
24178992121,0cyclictest0-21swapper/019:32:100
24178992119,1cyclictest18189-21dump-pmu-power20:05:010
2417899210,0cyclictest4200-21apt-get19:37:110
2417899210,0cyclictest0-21swapper/020:47:110
2417899210,0cyclictest0-21swapper/020:07:100
24193992020,0cyclictest0-21swapper/319:57:133
24193992016,3cyclictest0-21swapper/320:02:113
2419399200,19cyclictest25876-21apt-get20:22:123
24189992020,0cyclictest0-21swapper/220:32:122
2418999200,0cyclictest0-21swapper/220:52:122
24183992020,0cyclictest0-21swapper/120:47:111
24183992020,0cyclictest0-21swapper/120:22:121
2418399200,19cyclictest11406-21apt-get19:52:121
24178992020,0cyclictest0-21swapper/019:47:120
24178992020,0cyclictest0-21swapper/019:27:110
2417899200,0cyclictest0-21swapper/021:02:130
24193991919,0cyclictest0-21swapper/320:17:123
2419399190,13cyclictest0-21swapper/319:42:133
2419399190,0cyclictest0-21swapper/319:32:103
24189991919,0cyclictest29425-21apt-get19:22:122
24189991917,1cyclictest10704-21apt-get20:57:132
24189991917,1cyclictest0-21swapper/221:10:002
24183991919,0cyclictest0-21swapper/120:42:121
24183991919,0cyclictest0-21swapper/119:42:101
24183991917,1cyclictest15808-21awk20:00:011
2418399190,1cyclictest0-21swapper/119:27:111
24178991919,0cyclictest0-21swapper/020:42:120
24178991916,2cyclictest28981-21latency_hist19:20:000
2419399180,0cyclictest13864-21modprobe21:02:163
24189991818,0cyclictest0-21swapper/220:27:122
24189991818,0cyclictest0-21swapper/219:52:122
24183991818,0cyclictest0-21swapper/119:22:121
24178991818,0cyclictest0-21swapper/021:07:110
24178991818,0cyclictest0-21swapper/020:37:130
24178991818,0cyclictest0-21swapper/020:27:120
24178991816,1cyclictest0-21swapper/019:42:100
24193991717,0cyclictest0-21swapper/321:07:113
24193991715,1cyclictest10997-21munin-run19:50:013
24189991716,0cyclictest9012-21apt-get19:47:122
24183991717,0cyclictest23450-21apt-get20:17:121
24183991717,0cyclictest0-21swapper/120:27:121
24178991715,1cyclictest606-21dbus-daemon20:35:010
24193991615,0cyclictest0-21swapper/320:42:123
2419399160,2cyclictest29334-21awk20:27:173
24189991616,0cyclictest6618-21apt-get19:42:102
24189991616,0cyclictest0-21swapper/219:32:102
24189991615,1cyclictest16217-21apt-get20:02:102
24183991616,0cyclictest0-21swapper/120:02:111
24183991614,1cyclictest25191-21sed19:12:141
24183991614,1cyclictest23037-21perf20:15:001
24183991614,1cyclictest0-21swapper/120:57:151
2418399160,0cyclictest0-21swapper/120:52:121
2417899166,10cyclictest18593-21munin-node20:24:550
24178991614,1cyclictest0-21swapper/020:20:000
2417899160,15cyclictest0-21swapper/020:57:140
2417899160,15cyclictest0-21swapper/019:52:140
2419399150,15cyclictest0-21swapper/319:22:583
24189991515,0cyclictest0-21swapper/220:22:122
24189991515,0cyclictest0-21swapper/219:27:112
24183991515,0cyclictest0-21swapper/119:47:121
2418999140,14cyclictest0-21swapper/220:10:472
2418999140,14cyclictest0-21swapper/220:06:502
2418999140,0cyclictest0-21swapper/220:47:072
2418399140,14cyclictest0-21swapper/120:35:461
24178991414,0cyclictest0-21swapper/019:20:110
2417899140,14cyclictest0-21swapper/019:59:060
2417899140,14cyclictest0-21swapper/019:10:110
24178991313,0cyclictest0-21swapper/020:53:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional