You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-03 - 10:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot5s.osadl.org (updated Sun May 03, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4049992722,4cyclictest3001-21ssh21:42:162
4049992720,6cyclictest31605-21ssh00:30:052
405099260,25cyclictest32665-21ssh22:08:183
404999260,25cyclictest6113-21ssh00:07:072
404999260,25cyclictest14427-21rm00:15:222
404999260,21cyclictest0-21swapper/223:56:092
404999260,1cyclictest30081-21diskmemload00:02:102
404999260,1cyclictest0-21swapper/222:36:532
404999260,0cyclictest0-21swapper/222:00:422
4049992521,3cyclictest0-21swapper/221:55:472
4049992520,4cyclictest9505-21ssh23:41:312
4049992520,4cyclictest0-21swapper/223:27:152
4049992520,2cyclictest0-21swapper/222:27:302
4049992520,1cyclictest20666-21ssh22:55:262
404999250,24cyclictest16892-21ssh23:20:512
404999250,24cyclictest0-21swapper/223:51:302
404999250,21cyclictest26644-21sh23:00:532
404999250,21cyclictest18981-21ssh22:53:302
404599250,25cyclictest0-21swapper/123:11:321
404599250,24cyclictest30081-21diskmemload23:37:321
4043992525,0cyclictest62550irq/127-eno122:01:000
404399250,24cyclictest0-21swapper/022:33:510
404399250,24cyclictest0-21swapper/021:42:180
404399250,24cyclictest0-21swapper/000:19:000
404399250,1cyclictest0-21swapper/023:03:400
405099240,24cyclictest0-21swapper/323:30:533
405099240,23cyclictest13105-21sh22:48:143
405099240,1cyclictest0-21swapper/323:22:093
4049992421,3cyclictest0-21swapper/222:40:312
4049992421,0cyclictest0-21swapper/222:49:122
4049992420,4cyclictest0-21swapper/219:11:092
4049992420,3cyclictest6445-21apt-get20:21:062
4049992419,4cyclictest30081-21diskmemload22:31:282
404999240,23cyclictest30081-21diskmemload21:17:082
404999240,23cyclictest0-21swapper/223:37:342
404999240,23cyclictest0-21swapper/221:48:222
404999240,23cyclictest0-21swapper/221:35:452
404999240,23cyclictest0-21swapper/221:14:272
404999240,23cyclictest0-21swapper/220:10:012
404999240,19cyclictest4021-21apt-get20:16:072
404999240,0cyclictest30081-21diskmemload23:31:312
404999240,0cyclictest30081-21diskmemload21:25:202
404999240,0cyclictest0-21swapper/222:12:502
4045992424,0cyclictest0-21swapper/122:27:471
404599240,24cyclictest30081-21diskmemload21:40:501
404599240,23cyclictest30081-21diskmemload22:40:131
404599240,23cyclictest14784-21ssh23:18:161
404599240,23cyclictest0-21swapper/123:47:451
404599240,1cyclictest17082-21apt-get23:21:081
404599240,1cyclictest16380-21fschecks_time21:26:101
404599240,1cyclictest0-21swapper/120:15:011
404599240,0cyclictest30081-21diskmemload22:12:491
404599240,0cyclictest0-21swapper/121:57:311
4043992422,1cyclictest0-21swapper/022:17:190
4043992421,2cyclictest0-21swapper/021:27:550
4043992412,11cyclictest30081-21diskmemload22:11:100
404399240,24cyclictest0-21swapper/023:44:580
404399240,24cyclictest0-21swapper/000:11:400
404399240,23cyclictest30081-21diskmemload22:56:510
404399240,0cyclictest62550irq/127-eno122:26:000
404399240,0cyclictest62550irq/127-eno121:16:430
404399240,0cyclictest30081-21diskmemload22:46:410
404399240,0cyclictest30081-21diskmemload21:34:260
4050992323,0cyclictest30081-21diskmemload21:51:133
4050992323,0cyclictest0-21swapper/323:19:253
4050992323,0cyclictest0-21swapper/321:19:063
4050992322,1cyclictest30081-21diskmemload00:05:103
4050992321,1cyclictest0-21swapper/323:36:103
4050992321,1cyclictest0-21swapper/300:30:333
405099230,23cyclictest30081-21diskmemload21:45:273
405099230,23cyclictest30081-21diskmemload00:12:323
405099230,23cyclictest0-21swapper/323:28:093
405099230,23cyclictest0-21swapper/322:11:483
405099230,23cyclictest0-21swapper/321:10:143
405099230,23cyclictest0-21swapper/300:00:593
405099230,22cyclictest6402-21munin-plugin-st19:15:013
405099230,22cyclictest0-21swapper/323:56:093
405099230,22cyclictest0-21swapper/320:46:083
405099230,1cyclictest0-21swapper/323:03:293
405099230,1cyclictest0-21swapper/300:16:133
405099230,0cyclictest30081-21diskmemload22:30:503
405099230,0cyclictest0-21swapper/322:41:503
405099230,0cyclictest0-21swapper/321:36:523
405099230,0cyclictest0-21swapper/321:30:243
4049992323,0cyclictest0-21swapper/200:38:052
4049992321,2cyclictest0-21swapper/223:46:412
4049992321,2cyclictest0-21swapper/221:31:322
4049992320,3cyclictest0-21swapper/222:09:572
4049992320,2cyclictest0-21swapper/200:21:202
4049992318,4cyclictest26382-21apt-get19:56:082
404999230,23cyclictest0-21swapper/223:16:182
404999230,22cyclictest32529-21/usr/sbin/munin23:06:092
404999230,22cyclictest13577-21ssh21:23:202
404999230,22cyclictest0-21swapper/221:53:002
404999230,1cyclictest9335-21ssh00:11:092
404999230,0cyclictest30081-21diskmemload23:14:442
404999230,0cyclictest30081-21diskmemload22:23:372
4045992323,0cyclictest0-21swapper/123:55:551
4045992323,0cyclictest0-21swapper/122:52:351
4045992323,0cyclictest0-21swapper/122:38:441
4045992323,0cyclictest0-21swapper/121:31:311
4045992323,0cyclictest0-21swapper/121:17:021
4045992321,1cyclictest381-21ssh22:08:321
4045992321,1cyclictest0-21swapper/121:35:041
4045992321,1cyclictest0-21swapper/100:33:121
4045992320,2cyclictest30497-21sh23:31:361
404599230,2cyclictest18545-21rm23:51:011
404599230,2cyclictest11947-21rm21:50:511
404599230,23cyclictest0-21swapper/122:45:161
404599230,23cyclictest0-21swapper/122:31:261
404599230,23cyclictest0-21swapper/122:00:511
404599230,23cyclictest0-21swapper/100:17:551
404599230,22cyclictest9424-21sh22:16:161
404599230,22cyclictest26303-21ssh23:28:351
404599230,22cyclictest0-21swapper/123:01:491
404599230,22cyclictest0-21swapper/119:31:091
404599230,1cyclictest1545-21ssh00:03:361
404599230,0cyclictest0-21swapper/122:56:141
404599230,0cyclictest0-21swapper/121:47:231
4043992323,0cyclictest62550irq/127-eno123:21:250
4043992323,0cyclictest0-21swapper/023:46:480
4043992321,2cyclictest30634-21sh00:29:010
4043992321,1cyclictest0-21swapper/023:30:240
4043992321,1cyclictest0-21swapper/021:52:410
4043992321,1cyclictest0-21swapper/020:00:010
404399230,23cyclictest0-21swapper/022:21:370
404399230,23cyclictest0-21swapper/000:05:550
404399230,22cyclictest7108-21rm22:42:490
404399230,22cyclictest5696-21ssh23:11:020
404399230,22cyclictest31316-21df22:36:090
404399230,22cyclictest30081-21diskmemload23:05:190
404399230,22cyclictest30081-21diskmemload21:24:510
404399230,22cyclictest28770-21ssh23:59:180
404399230,22cyclictest28655-21sh22:05:230
404399230,22cyclictest18691-21sh23:51:100
404399230,22cyclictest10757-21rm23:15:110
404399230,22cyclictest0-21swapper/021:45:120
404399230,0cyclictest30081-21diskmemload00:34:170
404399230,0cyclictest0-21swapper/023:26:130
404399230,0cyclictest0-21swapper/021:38:310
404399230,0cyclictest0-21swapper/021:10:550
4050992222,0cyclictest0-21swapper/323:54:133
4050992222,0cyclictest0-21swapper/322:51:053
4050992222,0cyclictest0-21swapper/322:23:143
4050992222,0cyclictest0-21swapper/322:00:253
4050992222,0cyclictest0-21swapper/300:22:183
4050992221,1cyclictest0-21swapper/322:25:193
4050992220,1cyclictest21044-21sh21:58:093
4050992220,1cyclictest11237-21apt-get20:31:093
4050992220,1cyclictest0-21swapper/320:05:013
4050992220,1cyclictest0-21swapper/319:30:013
405099220,22cyclictest0-21swapper/322:55:313
405099220,22cyclictest0-21swapper/322:37:563
405099220,21cyclictest25283-21idleruntime-cro21:00:013
405099220,21cyclictest15992-21perf19:35:003
405099220,21cyclictest0-21swapper/323:45:583
405099220,21cyclictest0-21swapper/323:40:433
405099220,21cyclictest0-21swapper/323:10:073
405099220,21cyclictest0-21swapper/322:16:113
405099220,21cyclictest0-21swapper/300:25:373
405099220,1cyclictest0-21swapper/323:05:563
405099220,1cyclictest0-21swapper/300:35:163
4049992220,1cyclictest30081-21diskmemload22:15:572
4049992220,1cyclictest0-21swapper/220:30:002
404999220,21cyclictest6728-21apt-get19:16:082
404999220,21cyclictest0-21swapper/220:36:072
404999220,1cyclictest30081-21diskmemload00:25:142
4045992222,0cyclictest30081-21diskmemload22:20:021
4045992222,0cyclictest30081-21diskmemload00:26:001
4045992222,0cyclictest0-21swapper/120:56:101
404599221,1cyclictest15708-21turbostat20:40:001
404599220,21cyclictest9915-21ssh21:20:481
404599220,21cyclictest9845-21ssh23:42:051
404599220,21cyclictest31605-21ssh23:05:031
404599220,21cyclictest0-21swapper/120:41:101
404599220,21cyclictest0-21swapper/100:35:301
404599220,1cyclictest0-21swapper/121:10:451
404599220,0cyclictest0-21swapper/100:12:271
4043992222,0cyclictest0-21swapper/023:35:120
4043992222,0cyclictest0-21swapper/022:50:070
4043992222,0cyclictest0-21swapper/019:51:090
4043992221,1cyclictest30081-21diskmemload00:35:090
404399221,0cyclictest0-21swapper/021:55:100
404399220,22cyclictest0-21swapper/019:46:080
404399220,22cyclictest0-21swapper/000:22:190
404399220,21cyclictest30081-21diskmemload00:00:060
4050992120,1cyclictest0-21swapper/321:40:213
405099210,20cyclictest28049-21apt-get21:06:083
405099210,20cyclictest16734-21apt-get19:36:083
4049992121,0cyclictest9147-21apt-get19:21:082
4049992121,0cyclictest0-21swapper/221:01:092
4049992120,1cyclictest3665-21cron20:15:012
4049992119,2cyclictest0-21swapper/221:06:082
4045992120,1cyclictest11541-21apt-get19:26:091
4045992119,1cyclictest6381-21basename19:15:011
4045992119,1cyclictest13286-21cron20:35:001
404599210,20cyclictest0-21swapper/120:05:011
404599210,0cyclictest0-21swapper/100:20:171
4043992120,1cyclictest25659-21apt-get21:01:090
404399210,21cyclictest0-21swapper/020:11:070
404399210,20cyclictest0-21swapper/020:06:080
404399210,1cyclictest18449-21apt-get20:46:080
4050992020,0cyclictest0-21swapper/320:26:093
4050992019,0cyclictest0-21swapper/319:21:083
4049992020,0cyclictest13939-21apt-get19:31:092
404999200,19cyclictest0-21swapper/219:26:092
4045992020,0cyclictest23986-21apt-get19:51:081
4045992020,0cyclictest0-21swapper/120:46:081
4045992020,0cyclictest0-21swapper/119:48:561
4045992018,1cyclictest28452-21dump-pmu-power20:00:011
404599200,0cyclictest0-21swapper/121:06:081
404599200,0cyclictest0-21swapper/121:01:091
404599200,0cyclictest0-21swapper/120:16:071
4043992020,0cyclictest0-21swapper/019:41:100
4043992020,0cyclictest0-21swapper/019:11:090
4043992018,1cyclictest30100-21perf21:10:000
4043992018,1cyclictest13939-21apt-get19:31:090
4050991919,0cyclictest0-21swapper/320:36:073
4050991919,0cyclictest0-21swapper/320:16:073
4050991919,0cyclictest0-21swapper/319:56:083
4050991918,1cyclictest19153-21apt-get19:41:103
4050991917,1cyclictest8812-21munin-plugin-st19:20:013
4049991919,0cyclictest0-21swapper/220:41:102
4045991919,0cyclictest0-21swapper/120:06:081
4045991916,2cyclictest10865-21users19:21:171
4043991919,0cyclictest0-21swapper/020:26:090
4043991919,0cyclictest0-21swapper/020:21:060
404399190,18cyclictest13634-21apt-get20:36:070
4049991818,0cyclictest0-21swapper/220:51:092
404999180,3cyclictest19882-21awk19:41:132
4045991817,1cyclictest15977-21apt-get19:35:021
4050991717,0cyclictest0-21swapper/319:51:083
4050991715,1cyclictest31586-21apt-get20:06:083
4049991717,0cyclictest23241-21apt-get20:56:102
4049991717,0cyclictest0-21swapper/220:31:092
4049991717,0cyclictest0-21swapper/219:46:082
404999170,1cyclictest18800-21latency_hist19:40:002
404999170,0cyclictest0-21swapper/220:50:012
4045991715,1cyclictest10889-21perf20:30:001
4043991717,0cyclictest0-21swapper/020:51:090
4043991717,0cyclictest0-21swapper/020:41:100
4043991717,0cyclictest0-21swapper/019:26:090
4043991716,0cyclictest23241-21apt-get20:56:100
4050991615,0cyclictest1616-21apt-get20:11:073
4050991614,1cyclictest27694-21cron21:05:013
4050991614,1cyclictest20844-21apt-get20:51:093
4050991614,1cyclictest16056-21apt-get20:41:103
4045991615,0cyclictest0-21swapper/119:41:101
4043991616,0cyclictest0-21swapper/019:36:080
4043991613,2cyclictest29323-21perl20:01:110
404399160,15cyclictest0-21swapper/019:16:070
4049991515,0cyclictest0-21swapper/219:51:082
404999150,0cyclictest0-21swapper/220:02:502
4050991414,0cyclictest0-21swapper/319:45:163
405099140,14cyclictest0-21swapper/320:21:593
4045991414,0cyclictest0-21swapper/119:15:131
404599140,14cyclictest0-21swapper/120:20:221
4043991414,0cyclictest0-21swapper/019:21:050
404399140,14cyclictest0-21swapper/020:15:230
404399140,0cyclictest0-21swapper/020:30:060
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional