You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-10 - 12:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Fri Jul 10, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
112570323860,2sleep30-21swapper/321:05:253
108874921930,4sleep375-21kworker/3:1-events20:30:143
1005060996660,4cyclictest1136347-21kworker/u8:0+events_unbound22:00:251
1005063996544,18cyclictest1704890-21systemd-journal23:03:532
11838962630,3sleep1281rcuc/122:05:151
1005060996156,4cyclictest1197517-21kworker/u8:0+flush-8:022:20:301
1005060996156,3cyclictest1197517-21kworker/u8:0+events_unbound23:25:091
1005060995953,4cyclictest1070983-21kworker/u8:1+flush-8:020:20:231
1005060995853,4cyclictest1280690-21kworker/u8:3+events_unbound00:30:251
1005060995851,5cyclictest1136347-21kworker/u8:0+flush-8:021:25:201
1005060995651,4cyclictest1091054-21kworker/u8:3+flush-8:021:45:241
1005060995550,4cyclictest3835863-21kworker/u8:4+events_unbound22:10:201
1005060995549,4cyclictest3835863-21kworker/u8:4+flush-8:019:20:241
1005060995549,4cyclictest3835863-21kworker/u8:4+flush-8:019:20:231
1005060995547,6cyclictest1280690-21kworker/u8:3+flush-8:000:15:251
1005060995447,5cyclictest1197517-21kworker/u8:0+events_unbound22:40:231
11747812530,1sleep21174779-21latency21:55:172
11747812530,1sleep21174779-21latency21:55:162
1005060995248,3cyclictest1238000-21kworker/u8:1+events_unbound23:35:221
1005060995248,3cyclictest1238000-21kworker/u8:1+events_unbound23:00:191
1005060995247,4cyclictest1197517-21kworker/u8:0+flush-8:023:40:201
1005060995247,4cyclictest1136347-21kworker/u8:0+flush-8:021:30:251
1005060995247,3cyclictest1280690-21kworker/u8:3+events_unbound00:25:231
1005058995244,6cyclictest1121195-21latency_hist21:05:010
1005060995145,4cyclictest3835863-21kworker/u8:4+flush-8:020:55:201
1005058995144,5cyclictest3835863-21kworker/u8:4+flush-8:019:25:220
1005058995142,7cyclictest1704890-21systemd-journal00:20:000
1005060995044,4cyclictest1280690-21kworker/u8:3+flush-8:023:45:111
1005060994943,4cyclictest1026442-21kworker/u8:0+flush-8:019:40:211
1005060994942,5cyclictest1238000-21kworker/u8:1+events_unbound00:20:211
1005060994941,6cyclictest1091054-21kworker/u8:3+flush-8:021:05:191
1005058994944,3cyclictest1210844-21kworker/u8:2+flush-8:022:55:240
1005060994843,4cyclictest1070983-21kworker/u8:1+flush-8:020:15:241
1005060994843,4cyclictest1026442-21kworker/u8:0+events_unbound20:30:011
1005060994843,3cyclictest3835863-21kworker/u8:4+flush-8:019:35:241
1005060994843,3cyclictest3835863-21kworker/u8:4+events_unbound19:25:201
1005060994840,6cyclictest1051778-21apt-get19:55:031
1005060994839,7cyclictest1060512-21ntpq20:00:161
1005058994844,3cyclictest1091054-21kworker/u8:3+events_unbound21:45:200
1005060994742,4cyclictest3835863-21kworker/u8:4+events_unbound20:35:071
1005060994742,4cyclictest1091054-21kworker/u8:3+events_unbound21:00:181
1005060994742,4cyclictest1026442-21kworker/u8:0+events_unbound20:05:081
1005058994742,4cyclictest3835863-21kworker/u8:4+flush-8:019:50:220
1005060994641,4cyclictest1091054-21kworker/u8:3+events_unbound21:40:231
1005060994640,5cyclictest1197517-21kworker/u8:0+flush-8:023:50:201
1005058994641,4cyclictest1130248-21kworker/u8:1+flush-8:021:15:230
1005058994641,4cyclictest1091054-21kworker/u8:3+flush-8:020:35:210
1005058994641,3cyclictest1280690-21kworker/u8:3+events_unbound23:45:240
1005058994640,4cyclictest1026442-21kworker/u8:0+flush-8:019:40:230
1005058994638,6cyclictest1170957-21latency_hist21:55:010
1005060994541,3cyclictest3835863-21kworker/u8:4+events_unbound19:50:121
1005060994541,3cyclictest1026442-21kworker/u8:0+events_unbound20:10:201
1005060994540,4cyclictest1136347-21kworker/u8:0+flush-8:021:35:211
1005060994539,5cyclictest3835863-21kworker/u8:4+flush-8:021:55:201
1005060994539,5cyclictest3835863-21kworker/u8:4+flush-8:021:55:191
1005060994539,5cyclictest1210844-21kworker/u8:2+flush-8:022:50:211
1005058994540,4cyclictest1197517-21kworker/u8:0+flush-8:022:20:320
1005063994432,10cyclictest1320646-21cat00:25:012
1005060994439,3cyclictest1197517-21kworker/u8:0+flush-8:023:30:211
1005060994438,4cyclictest1238000-21kworker/u8:1+flush-8:023:05:241
1005058994440,3cyclictest1100575-21kworker/u8:0+flush-8:020:50:220
1005058994438,4cyclictest1197517-21kworker/u8:0+events_unbound22:45:010
1005060994338,4cyclictest3835863-21kworker/u8:4+flush-8:020:50:121
1005060994334,7cyclictest1090500-21ntpq20:30:191
1005058994339,3cyclictest3835863-21kworker/u8:4+events_unbound19:15:040
1005058994339,3cyclictest1197517-21kworker/u8:0+events_unbound00:00:120
1005058994335,6cyclictest1181092-21/usr/sbin/munin22:05:190
1005060994236,4cyclictest1210844-21kworker/u8:2+flush-8:022:55:221
100505899422,38cyclictest1-21systemd21:35:010
1005063994117,7cyclictest1704890-21systemd-journal20:50:012
1005060994135,4cyclictest1280690-21kworker/u8:3+flush-8:000:35:191
1005060994135,4cyclictest1280690-21kworker/u8:3+flush-8:000:35:181
1005060994133,6cyclictest1704890-21systemd-journal22:25:031
1005060994133,6cyclictest1221054-21apt-get22:45:041
1005058994135,4cyclictest3835863-21kworker/u8:4+events_unbound19:20:100
1005058994135,4cyclictest3835863-21kworker/u8:4+events_unbound19:20:100
1005060994035,4cyclictest1238000-21kworker/u8:1+flush-8:023:15:241
1005058994036,3cyclictest1070983-21kworker/u8:1+flush-8:020:25:220
1005060993935,3cyclictest1238000-21kworker/u8:1+flush-8:000:00:261
1005060993932,6cyclictest1091054-21kworker/u8:3+events_unbound21:50:191
1005058993932,5cyclictest1704890-21systemd-journal22:17:070
1005058993931,6cyclictest3835863-21kworker/u8:4+flush-8:019:30:180
1005060993834,3cyclictest3835863-21kworker/u8:4+flush-8:020:45:211
1005060993831,5cyclictest3835863-21kworker/u8:4+flush-8:022:15:061
1005060993831,5cyclictest1197517-21kworker/u8:0+flush-8:022:30:201
1005060993829,6cyclictest1704890-21systemd-journal23:15:011
10048782382,7sleep30-21swapper/319:10:003
1005063993722,12cyclictest1191263-21cpuspeed_turbos22:15:052
1005063993713,8cyclictest1704890-21systemd-journal20:10:212
1005060993731,4cyclictest1197517-21kworker/u8:0+flush-8:023:55:251
1005060993730,5cyclictest1238000-21kworker/u8:1+events_unbound23:20:231
1005058993733,3cyclictest1026442-21kworker/u8:0+events_unbound20:05:130
1005058993731,4cyclictest1197517-21kworker/u8:0+flush-8:022:45:200
1005058993731,4cyclictest1076314-21apt-get20:20:000
1005060993631,4cyclictest3835863-21kworker/u8:4+events_unbound19:30:181
1005058993632,3cyclictest1280690-21kworker/u8:3+flush-8:000:30:270
1005058993631,3cyclictest1026442-21kworker/u8:0+flush-8:020:20:110
1005058993630,5cyclictest1091054-21kworker/u8:3+flush-8:021:55:200
1005058993630,5cyclictest1091054-21kworker/u8:3+flush-8:021:55:200
1005058993628,6cyclictest1704890-21systemd-journal22:37:100
1005058993627,7cyclictest1206135-21/usr/sbin/munin22:30:190
10047022364,9sleep10-21swapper/119:07:411
11762202350,2sleep375-21kworker/3:1-events22:00:063
1005063993526,6cyclictest1704890-21systemd-journal21:49:592
1005063993520,12cyclictest1235473-21unixbench_multi22:55:262
1005058993532,2cyclictest3835863-21kworker/u8:4+events_unbound19:45:230
1005058993531,3cyclictest1280690-21kworker/u8:3+flush-8:000:25:100
1005058993530,3cyclictest3835863-21kworker/u8:4+flush-8:020:45:180
1005058993530,3cyclictest1091054-21kworker/u8:3+events_unbound21:10:120
1005058993525,8cyclictest1240899-21awk23:05:000
10281372340,7sleep3451irq_work/319:30:143
1005063993419,12cyclictest1047134-21fschecks_count19:50:082
1005058993432,1cyclictest1197517-21kworker/u8:0+flush-8:023:35:100
1005058993430,3cyclictest1238000-21kworker/u8:1+events_unbound23:05:230
1005058993430,3cyclictest1197517-21kworker/u8:0+flush-8:000:05:090
1005058993429,4cyclictest1197517-21kworker/u8:0+flush-8:023:25:210
1005058993429,4cyclictest1070983-21kworker/u8:1+events_unbound20:30:060
1005058993428,4cyclictest3835863-21kworker/u8:4+events_unbound20:55:210
1005058993428,4cyclictest1197517-21kworker/u8:0+flush-8:023:55:210
1005063993324,7cyclictest1200722-21apt-get22:25:012
100506399332,11cyclictest1300631-21apt-get00:05:072
1005063993320,11cyclictest1061919-21cpuspeed_turbos20:05:072
1005063993318,13cyclictest1056759-21aten2_r5power_c20:00:042
1005063993314,2cyclictest0-21swapper/221:35:142
1005063993311,7cyclictest1290394-21cron23:55:002
1005060993329,3cyclictest1091046-21kworker/u8:2+events_unbound20:40:121
1005060993328,4cyclictest1238000-21kworker/u8:1+flush-8:000:10:151
1005058993329,3cyclictest1197517-21kworker/u8:0+flush-8:022:25:050
1005058993327,4cyclictest1141331-21apt-get21:25:040
1005058993323,8cyclictest1279470-21ntpq23:40:180
1005063993225,5cyclictest1220789-21cron22:45:012
100506399322,12cyclictest1076812-21apt-get20:20:042
1005063993217,13cyclictest1126441-21aten2_r5power_c21:10:072
1005063993214,2cyclictest0-21swapper/222:55:012
100506399320,9cyclictest12651172cat23:25:232
1005060993228,2cyclictest1091054-21kworker/u8:3+flush-8:021:10:151
1005060993227,4cyclictest1197517-21kworker/u8:0+flush-8:022:35:241
1005060993226,4cyclictest1140170-21ntpq21:20:231
1005058993225,5cyclictest3835863-21kworker/u8:4+flush-8:022:10:180
1005058993225,5cyclictest1052505-21irqrtprio19:55:120
1005058993224,6cyclictest1005185-21/usr/sbin/munin19:10:230
1005063993118,11cyclictest1245368-21unixbench_multi23:05:252
1005063993115,2cyclictest0-21swapper/222:10:072
1005060993127,3cyclictest857206-21kworker/u8:3+flush-8:019:15:211
1005058993128,2cyclictest1197517-21kworker/u8:0+events_unbound23:30:210
1005058993126,3cyclictest1091054-21kworker/u8:3+events_unbound21:05:110
1005058993123,6cyclictest1315574-21aten2_r5power_c00:20:050
1005058993121,8cyclictest1229806-21ntpq22:50:190
100506399303,8cyclictest1330613-21apt-get00:35:052
100506399303,8cyclictest1330613-21apt-get00:35:052
1005063993020,7cyclictest1704890-21systemd-journal19:25:222
1005060993025,3cyclictest1197517-21kworker/u8:0+events_unbound00:05:151
1005058993026,3cyclictest1238000-21kworker/u8:1+flush-8:023:15:080
1005058993026,3cyclictest1197517-21kworker/u8:0+events_unbound23:10:260
1005058993025,3cyclictest1290399-21sh23:54:590
1005058993025,3cyclictest1026442-21kworker/u8:0+flush-8:020:10:240
100506399297,2cyclictest10826252irqrtprio20:25:102
100506399292,11cyclictest1290647-21apt-get23:55:062
1005058992925,3cyclictest1280690-21kworker/u8:3+events_unbound00:35:240
1005058992925,3cyclictest1280690-21kworker/u8:3+events_unbound00:35:230
1005058992925,3cyclictest1256185-21cpuspeed_turbos23:20:100
1005063992815,2cyclictest1052000-21cpuspeed_turbos19:55:072
1005060992824,3cyclictest3835863-21kworker/u8:4+flush-8:019:45:101
1005058992822,4cyclictest1704890-21systemd-journal22:05:000
1005058992822,4cyclictest1096774-21aten2_r5power_p20:40:060
1005063992724,2cyclictest1100930-21unixbench_multi20:40:242
1005063992723,2cyclictest1210407-21unixbench_multi22:30:262
1005063992721,4cyclictest1704890-21systemd-journal00:18:582
1005058992721,4cyclictest1306139-21irqcore00:10:140
1005058992721,4cyclictest1136347-21kworker/u8:0+events_unbound21:35:070
1005063992623,2cyclictest1321051-21fschecks_time00:25:102
1005063992619,5cyclictest1704890-21systemd-journal22:40:002
1005060992622,3cyclictest1130248-21kworker/u8:1+events_unbound21:15:051
1005058992620,4cyclictest3835863-21kworker/u8:4+events_unbound19:35:170
1005058992618,6cyclictest1004895-21latency_hist19:10:010
1005063992521,2cyclictest1156509-21cpuspeed_turbos21:40:082
1005063992517,6cyclictest1254687-21grep23:15:152
1005063992516,7cyclictest1704890-21systemd-journal23:40:002
1005060992521,3cyclictest3835863-21kworker/u8:4+events_unbound19:10:171
1005058992519,5cyclictest1136593-21cpuspeed_turbos21:20:110
1005063992420,2cyclictest0-21swapper/221:10:002
1005058992420,3cyclictest3835863-21kworker/u8:4+events_unbound20:00:240
1005058992418,5cyclictest1160573-21unixbench_multi21:40:250
100506399232,14cyclictest1255967-21apt-get23:20:072
100506399222,14cyclictest1005210-21apt-get19:10:062
1005063992218,2cyclictest0-21swapper/221:30:002
1005063992118,2cyclictest1042213-21fschecks_time19:45:092
1005063992117,2cyclictest1270130-21unixbench_singl23:30:252
1005063992116,3cyclictest1115786-21unixbench_multi20:55:252
10000212214,10sleep20-21swapper/219:05:012
100506399203,3cyclictest10927692cut20:35:142
100506399202,13cyclictest1305610-21apt-get00:10:072
1005063992017,2cyclictest1299967-21unixbench_singl00:00:282
1005063992016,2cyclictest0-21swapper/220:20:022
1005063992011,7cyclictest1704890-21systemd-journal20:55:002
100506399200,10cyclictest1151013-21turbostat.cron21:34:592
100506399192,12cyclictest1012112-21apt-get19:15:082
1005063991915,3cyclictest1036675-21sendmail19:40:002
100506399191,12cyclictest1166227-21apt-get21:50:052
10806312180,4sleep3481ktimers/320:20:193
1005063991814,2cyclictest0-21swapper/220:30:182
1005063991814,2cyclictest0-21swapper/219:30:262
1005063991814,2cyclictest0-21swapper/200:30:082
1005063991810,6cyclictest1184103-21tr22:05:152
1005063991714,2cyclictest0-21swapper/222:30:012
1005063991713,2cyclictest0-21swapper/223:10:202
1005063991713,2cyclictest0-21swapper/221:00:242
1005063991712,3cyclictest0-21swapper/221:15:112
1005063991711,4cyclictest1704890-21systemd-journal19:24:592
1005063991711,4cyclictest1704890-21systemd-journal19:24:592
1005063991711,4cyclictest1039697-21tr19:40:162
10378292166,6sleep30-21swapper/319:40:143
1005063991613,2cyclictest1275804-21aten2_r5power_c23:40:062
100506399157,6cyclictest1223557-21tr22:45:152
100506399153,7cyclictest1136376-21apt-get21:20:092
1005063991512,2cyclictest1176378-21cpuspeed_turbos22:00:072
12310622142,7sleep30-21swapper/322:55:023
100506399149,3cyclictest0-21swapper/223:45:162
13096482132,7sleep30-21swapper/300:10:273
12370832133,6sleep30-21swapper/323:00:163
11202002132,7sleep30-21swapper/321:00:163
10964972132,6sleep30-21swapper/320:40:013
10102112133,6sleep30-21swapper/319:15:023
13106952122,6sleep30-21swapper/300:15:083
13003962122,5sleep30-21swapper/300:05:013
12883002122,6sleep30-21swapper/323:50:173
12848122122,6sleep30-21swapper/323:45:273
12797582122,6sleep30-21swapper/323:40:243
12743532122,6sleep30-21swapper/323:35:163
12656302122,6sleep30-21swapper/323:30:023
12564382122,6sleep30-21swapper/323:20:153
12465902122,6sleep30-21swapper/323:10:143
12409072122,5sleep30-21swapper/323:05:013
12264732122,6sleep30-21swapper/322:50:123
12204202123,5sleep30-21swapper/322:40:263
12114242122,6sleep30-21swapper/322:35:113
12059322122,6sleep30-21swapper/322:30:023
12029142122,6sleep30-21swapper/322:25:173
12000572123,5sleep30-21swapper/322:20:303
11953042122,6sleep30-21swapper/322:15:243
11848512122,6sleep30-21swapper/322:05:223
11715532122,6sleep30-21swapper/321:55:113
11715532122,6sleep30-21swapper/321:55:113
11616492122,6sleep30-21swapper/321:45:123
11568142122,6sleep30-21swapper/321:40:143
11486382122,6sleep30-21swapper/321:30:183
11311412122,5sleep30-21swapper/321:15:013
11267852122,6sleep30-21swapper/321:10:123
10719842122,6sleep30-21swapper/320:15:103
10620622122,6sleep30-21swapper/320:05:103
10465802122,5sleep30-21swapper/319:50:023
10418722122,6sleep30-21swapper/319:45:043
10258762122,6sleep30-21swapper/319:25:223
10170392122,6sleep30-21swapper/319:20:043
10170392122,6sleep30-21swapper/319:20:033
10088552122,6sleep30-21swapper/319:10:163
13309922112,5sleep30-21swapper/300:35:113
13309922112,5sleep30-21swapper/300:35:103
13254642112,5sleep30-21swapper/300:30:013
13207412112,6sleep30-21swapper/300:25:083
13155152112,5sleep30-21swapper/300:20:023
12965442112,5sleep30-21swapper/300:00:153
12906092112,5sleep30-21swapper/323:55:013
12608732112,5sleep30-21swapper/323:25:033
12552182112,5sleep30-21swapper/323:15:253
12210582112,5sleep30-21swapper/322:45:073
11887922112,5sleep30-21swapper/322:10:163
11664712112,5sleep30-21swapper/321:50:083
11512412112,6sleep30-21swapper/321:35:033
11418002112,5sleep30-21swapper/321:25:133
11364202111,6sleep30-21swapper/321:20:113
11115882112,5sleep30-21swapper/320:55:073
11063612112,5sleep30-21swapper/320:50:013
11016202112,5sleep30-21swapper/320:45:033
10916412112,5sleep30-21swapper/320:35:053
10828542112,5sleep30-21swapper/320:25:123
10704862113,5sleep30-21swapper/320:10:193
10606422112,5sleep30-21swapper/320:00:213
10545102112,5sleep30-21swapper/319:55:143
10319252112,5sleep30-21swapper/319:35:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional