You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-19 - 10:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Fri Jun 19, 2026 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28804992820,4cyclictest0-21swapper/323:32:473
2880499270,27cyclictest0-21swapper/321:10:413
28804992621,4cyclictest0-21swapper/323:45:133
28804992619,6cyclictest22159-21ls00:10:053
2880499260,25cyclictest0-21swapper/323:23:283
2880499260,25cyclictest0-21swapper/323:05:273
2880499260,25cyclictest0-21swapper/321:43:043
28798992621,4cyclictest5970-21ssh23:55:062
2878999260,25cyclictest11044-21ssh21:28:270
28804992520,4cyclictest0-21swapper/323:11:303
28804992520,4cyclictest0-21swapper/322:23:033
28804992520,4cyclictest0-21swapper/321:49:293
2880499250,21cyclictest23262-21diskmemload23:50:543
2880499250,21cyclictest0-21swapper/323:18:473
2880499250,1cyclictest20653-21rm00:38:443
2880499250,1cyclictest0-21swapper/321:56:013
2880499250,1cyclictest0-21swapper/321:56:013
2880499250,0cyclictest0-21swapper/322:57:033
2880499250,0cyclictest0-21swapper/322:49:433
28798992523,1cyclictest14287-21ssh00:32:092
2879899250,24cyclictest11125-21ssh21:59:082
2879899250,24cyclictest11125-21ssh21:59:082
2879899250,0cyclictest32320-21ssh23:18:572
2879499250,24cyclictest23262-21diskmemload22:46:291
2879499250,24cyclictest22557-21packagekitd22:40:011
2879499250,24cyclictest22557-21packagekitd22:40:011
28789992523,2cyclictest0-21swapper/022:04:390
28789992523,1cyclictest0-21swapper/021:47:190
2878999250,2cyclictest8048-21tail22:25:130
28804992421,3cyclictest0-21swapper/322:15:173
28804992420,4cyclictest0-21swapper/321:26:323
28804992420,4cyclictest0-21swapper/321:23:093
28804992420,3cyclictest23262-21diskmemload23:26:173
28804992419,4cyclictest0-21swapper/300:07:443
2880499240,24cyclictest0-21swapper/323:00:393
2880499240,23cyclictest0-21swapper/300:18:343
2880499240,21cyclictest23262-21diskmemload21:53:523
28798992421,2cyclictest13776-21sh23:30:452
28798992420,3cyclictest5911-21awk23:25:002
2879899240,24cyclictest23262-21diskmemload22:31:022
2879899240,23cyclictest21520-21cron00:40:002
2879899240,23cyclictest0-21swapper/222:27:462
2879899240,23cyclictest0-21swapper/222:24:432
2879899240,20cyclictest0-21swapper/223:39:492
2879899240,0cyclictest23262-21diskmemload21:27:232
28794992424,0cyclictest23262-21diskmemload23:32:061
28794992423,1cyclictest0-21swapper/122:25:181
28794992422,1cyclictest12857-21munin-run20:50:001
28794992421,2cyclictest6385-21turbostat.cron21:55:001
28794992421,2cyclictest21021-21ssh23:08:451
2879499240,24cyclictest23262-21diskmemload22:24:271
2879499240,23cyclictest23262-21diskmemload23:04:281
2879499240,23cyclictest11146-21sleep19:40:011
2879499240,23cyclictest11146-21sleep19:40:011
2879499240,0cyclictest23262-21diskmemload22:17:011
2879499240,0cyclictest0-21swapper/123:44:141
28789992423,1cyclictest0-21swapper/023:48:010
2878999242,1cyclictest62550irq/127-eno123:59:130
2878999240,24cyclictest0-21swapper/022:21:140
2878999240,24cyclictest0-21swapper/000:03:510
2878999240,23cyclictest15522-21sh22:33:230
2878999240,23cyclictest0-21swapper/023:12:340
2878999240,1cyclictest4454-21sh00:24:010
2878999240,0cyclictest0-21swapper/023:44:460
2878999240,0cyclictest0-21swapper/022:40:120
2878999240,0cyclictest0-21swapper/022:40:120
2878999240,0cyclictest0-21swapper/021:21:090
28804992323,0cyclictest0-21swapper/300:25:353
28804992321,1cyclictest6563-21apt-get19:30:023
28804992321,1cyclictest0-21swapper/322:40:083
28804992321,1cyclictest0-21swapper/322:40:083
28804992320,3cyclictest0-21swapper/300:01:173
28804992319,3cyclictest0-21swapper/300:32:573
28804992318,5cyclictest9621-21ssh23:58:393
28804992318,4cyclictest19359-21sh23:36:073
2880499230,23cyclictest0-21swapper/321:30:223
2880499230,23cyclictest0-21swapper/300:24:183
2880499230,22cyclictest21498-21sh22:08:393
2880499230,22cyclictest21363-21sh22:39:133
2880499230,22cyclictest13534-21ssh22:30:223
2880499230,22cyclictest10226-21ssh22:28:273
2880499230,0cyclictest0-21swapper/323:40:173
2880499230,0cyclictest0-21swapper/322:10:503
28798992323,0cyclictest0-21swapper/223:12:112
28798992321,1cyclictest30142-21ssh22:15:352
28798992320,0cyclictest0-21swapper/221:23:162
2879899231,1cyclictest28-21ksoftirqd/223:54:202
2879899230,2cyclictest16793-21ssh23:05:042
2879899230,23cyclictest0-21swapper/223:47:542
2879899230,23cyclictest0-21swapper/223:40:282
2879899230,23cyclictest0-21swapper/221:50:472
2879899230,23cyclictest0-21swapper/221:45:182
2879899230,23cyclictest0-21swapper/221:10:112
2879899230,23cyclictest0-21swapper/200:18:072
2879899230,22cyclictest5933-21apt-get19:30:022
2879899230,22cyclictest31361-21ssh21:16:052
2879899230,22cyclictest26867-21ssh22:43:522
2879899230,22cyclictest26867-21ssh22:43:522
2879899230,22cyclictest23262-21diskmemload00:07:422
2879899230,22cyclictest20338-21ssh22:37:472
2879899230,22cyclictest0-21swapper/222:09:212
2879899230,1cyclictest12448-21df_inode22:00:042
2879899230,0cyclictest23262-21diskmemload22:59:192
28794992323,0cyclictest0-21swapper/100:38:411
28794992322,1cyclictest5172-21ssh23:23:511
28794992321,1cyclictest17464-21sh21:34:561
28794992320,2cyclictest13478-21ssh22:30:181
2879499230,23cyclictest23262-21diskmemload22:57:241
2879499230,23cyclictest0-21swapper/121:58:151
2879499230,23cyclictest0-21swapper/121:58:151
2879499230,22cyclictest8307-21ssh23:25:371
2879499230,22cyclictest609-21rs:main1
2879499230,22cyclictest4305-21ssh22:52:381
2879499230,22cyclictest30472-21sh23:16:101
2879499230,22cyclictest29215-21rm00:15:261
2879499230,22cyclictest28873-21apt-get21:15:041
2879499230,22cyclictest18834-21ssh22:35:171
2879499230,22cyclictest13127-21rm00:30:221
2879499230,22cyclictest0-21swapper/100:21:061
2879499230,1cyclictest18372-21grep00:05:151
2879499230,1cyclictest10202-21ssh21:27:071
2879499230,1cyclictest0-21swapper/121:12:131
2879499230,0cyclictest0-21swapper/122:12:041
2879499230,0cyclictest0-21swapper/121:40:021
28789992323,0cyclictest6596-21apt-get19:30:030
28789992323,0cyclictest0-21swapper/022:46:330
28789992323,0cyclictest0-21swapper/022:16:140
28789992318,4cyclictest0-21swapper/000:15:050
2878999231,1cyclictest62550irq/127-eno123:33:370
2878999230,2cyclictest26068-21rm00:13:470
2878999230,23cyclictest0-21swapper/023:05:140
2878999230,23cyclictest0-21swapper/022:51:590
2878999230,23cyclictest0-21swapper/021:41:320
2878999230,22cyclictest3743-21sh23:52:430
2878999230,22cyclictest26483-21ssh22:13:100
2878999230,22cyclictest19071-21sh00:06:060
2878999230,22cyclictest17880-21sh22:05:050
2878999230,22cyclictest13590-21ssh23:00:360
2878999230,21cyclictest3641-21sh23:21:340
2878999230,1cyclictest23262-21diskmemload22:35:310
2878999230,1cyclictest1141-21munin-plugin-st19:20:000
2878999230,0cyclictest0-21swapper/021:57:310
2878999230,0cyclictest0-21swapper/021:57:310
2878999230,0cyclictest0-21swapper/021:10:120
28804992221,1cyclictest8995-21apt-get19:35:033
28804992221,1cyclictest8995-21apt-get19:35:033
28804992219,3cyclictest0-21swapper/321:15:253
2880499220,1cyclictest0-21swapper/321:35:253
2880499220,1cyclictest0-21swapper/321:05:003
28798992222,0cyclictest23262-21diskmemload22:10:402
28798992222,0cyclictest0-21swapper/219:15:032
28798992221,1cyclictest20235-21ssh21:36:082
28798992220,1cyclictest5647-21perf20:35:012
28798992220,1cyclictest4247-21ssh00:23:352
28798992220,1cyclictest23048-21ntp_states00:10:102
28798992220,1cyclictest13251-21seq00:00:542
2879899220,21cyclictest11457-21apt-get23:00:032
2879899220,21cyclictest0-21swapper/222:45:152
2879899220,21cyclictest0-21swapper/200:26:252
28794992222,0cyclictest23262-21diskmemload23:11:321
28794992221,1cyclictest2844-21ssh23:51:191
28794992221,1cyclictest19040-21ssh23:35:411
28794992221,1cyclictest0-21swapper/123:45:441
28794992221,1cyclictest0-21swapper/122:00:031
28794992221,0cyclictest21925-21apt-get00:10:041
28794992220,1cyclictest0-21swapper/100:25:071
2879499220,21cyclictest30785-21apt20:20:001
2879499220,21cyclictest19042-21apt-get19:55:021
2879499220,21cyclictest13409-21ssh00:01:071
2879499220,21cyclictest0-21swapper/123:55:291
2879499220,21cyclictest0-21swapper/122:05:031
2879499220,21cyclictest0-21swapper/121:45:281
2879499220,21cyclictest0-21swapper/119:40:031
2879499220,0cyclictest29007-21apt-get19:10:031
28789992222,0cyclictest0-21swapper/023:36:180
28789992222,0cyclictest0-21swapper/023:25:250
28789992222,0cyclictest0-21swapper/023:18:420
28789992222,0cyclictest0-21swapper/000:31:260
2878999220,22cyclictest20291-21ssh21:36:130
2878999220,21cyclictest6673-21ssh00:25:090
2878999220,21cyclictest23262-21diskmemload21:30:580
2878999220,21cyclictest0-21swapper/022:55:050
2878999220,21cyclictest0-21swapper/021:50:100
2878999220,21cyclictest0-21swapper/019:25:030
2878999220,1cyclictest15999-21turbostat19:50:010
28804992119,1cyclictest21183-21perf20:00:003
28804992119,1cyclictest20502-21apt-get21:05:013
2880499210,1cyclictest31139-21apt19:15:003
2880499210,1cyclictest0-21swapper/319:45:013
28798992121,0cyclictest0-21swapper/221:30:352
28798992119,1cyclictest19045-21apt-get19:55:032
2879899210,21cyclictest0-21swapper/223:25:122
28794992121,0cyclictest0-21swapper/120:40:021
2879499210,20cyclictest0-21swapper/121:05:021
28789992121,0cyclictest0-21swapper/021:15:070
28789992120,1cyclictest609-21rs:main0
28789992119,1cyclictest25962-21cron20:10:000
28789992119,1cyclictest18384-21apt-get19:55:020
2878999210,20cyclictest0-21swapper/020:50:040
2878999210,0cyclictest0-21swapper/020:15:020
28804992020,0cyclictest0-21swapper/319:20:023
28804992014,0cyclictest0-21swapper/320:00:023
2880499200,20cyclictest0-21swapper/320:05:043
28798992020,0cyclictest3804-21apt-get19:25:032
28798992018,1cyclictest8312-21apt-get20:40:022
2879899200,0cyclictest0-21swapper/220:25:032
2879499200,0cyclictest0-21swapper/120:55:041
2879499200,0cyclictest0-21swapper/119:30:031
28789992020,0cyclictest0-21swapper/020:30:030
28789992020,0cyclictest0-21swapper/019:35:030
28789992020,0cyclictest0-21swapper/019:35:030
28789992018,1cyclictest31068-21apt-get20:20:020
28804991919,0cyclictest0-21swapper/320:32:023
28804991918,1cyclictest0-21swapper/319:15:033
28798991919,0cyclictest31068-21apt-get20:20:022
28798991919,0cyclictest15554-21apt-get20:55:042
28798991919,0cyclictest0-21swapper/221:05:022
28798991917,1cyclictest26002-21munin-run20:10:002
28804991818,0cyclictest5898-21apt-get20:35:043
28804991816,1cyclictest3181-21apt20:30:013
28804991816,1cyclictest0-21swapper/319:50:013
28798991818,0cyclictest26247-21apt-get20:10:022
28794991818,0cyclictest0-21swapper/120:05:041
28794991818,0cyclictest0-21swapper/119:25:031
28789991818,0cyclictest0-21swapper/021:05:040
28804991717,0cyclictest0-21swapper/320:15:023
28804991715,1cyclictest17679-21dump-pmu-power21:00:003
28798991717,0cyclictest0-21swapper/220:50:002
28798991717,0cyclictest0-21swapper/220:35:042
28798991717,0cyclictest0-21swapper/219:50:022
28798991716,0cyclictest11410-21apt-get19:40:032
28794991716,1cyclictest0-21swapper/120:20:021
28794991715,1cyclictest31401-21apt-get19:15:031
28789991717,0cyclictest0-21swapper/020:25:030
28789991714,3cyclictest0-21swapper/020:10:020
28804991616,0cyclictest0-21swapper/320:45:043
2880499160,15cyclictest26429-21cpuspeed_turbos20:10:033
2879899167,8cyclictest19385-21grep21:00:092
28798991616,0cyclictest0-21swapper/219:35:032
28798991616,0cyclictest0-21swapper/219:35:032
28798991616,0cyclictest0-21swapper/219:20:022
2879899160,0cyclictest0-21swapper/220:00:022
28794991616,0cyclictest0-21swapper/120:50:051
28789991616,0cyclictest1395-21apt-get19:20:020
28789991616,0cyclictest0-21swapper/020:35:040
28789991616,0cyclictest0-21swapper/020:00:020
28789991616,0cyclictest0-21swapper/019:10:020
28798991515,0cyclictest0-21swapper/220:15:022
28794991515,0cyclictest1043-21apt-get20:25:031
28794991514,1cyclictest21457-21apt-get20:00:021
28794991514,0cyclictest3450-21apt-get20:30:031
28789991514,1cyclictest0-21swapper/020:45:100
28789991513,1cyclictest0-21swapper/019:55:010
2880499140,14cyclictest0-21swapper/320:43:003
2880499140,0cyclictest0-21swapper/320:50:083
2880499140,0cyclictest0-21swapper/320:22:253
2880499140,0cyclictest0-21swapper/319:50:023
28798991414,0cyclictest0-21swapper/220:53:262
2879899140,14cyclictest0-21swapper/219:45:042
28794991414,0cyclictest0-21swapper/119:50:111
2879499140,14cyclictest0-21swapper/121:00:231
2879499140,14cyclictest0-21swapper/119:46:171
28789991413,1cyclictest15554-21apt-get20:55:050
28789991413,0cyclictest8312-21apt-get20:40:020
28804991313,0cyclictest0-21swapper/319:26:183
28789991313,0cyclictest0-21swapper/019:40:310
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional