You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-12 - 02:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Sun Jul 12, 2026 00:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
63423521620,3sleep3451irq_work/319:15:193
7852262770,5sleep00-21swapper/021:45:240
8144692680,3chrt281rcuc/122:15:111
623209996057,2cyclictest693487-21kworker/u8:2+events_unbound21:50:261
623209995045,4cyclictest627723-21kworker/u8:1+events_unbound19:15:261
623214994941,6cyclictest1704890-21systemd-journal23:55:012
623209994736,8cyclictest680665-21apt-get20:05:011
623207994735,4cyclictest627723-21kworker/u8:1+flush-8:020:30:210
623209994541,3cyclictest749960-21kworker/u8:1+flush-8:022:55:231
623209994540,4cyclictest881323-21kworker/u8:3+flush-8:000:25:221
623209994439,4cyclictest881323-21kworker/u8:3+events_unbound23:25:201
623207994438,4cyclictest679571-21kworker/u8:0+events_unbound20:10:070
623207994430,12cyclictest710577-21kworker/u8:3+flush-8:020:55:190
623209994340,2cyclictest693487-21kworker/u8:2+flush-8:020:40:171
623209994338,4cyclictest820948-21kworker/u8:3+events_unbound22:30:231
623207994337,4cyclictest608777-21kworker/u8:2+flush-8:019:10:210
623209994238,3cyclictest693487-21kworker/u8:2+flush-8:020:45:211
623209994238,3cyclictest693487-21kworker/u8:2+flush-8:020:45:201
623209994238,3cyclictest3975468-21kworker/u8:3+flush-8:020:05:091
623209994237,4cyclictest649927-21kworker/u8:0+events_unbound19:35:371
623209994234,6cyclictest1704890-21systemd-journal20:14:591
623209994233,7cyclictest665188-21apt-get19:46:251
623207994236,4cyclictest881323-21kworker/u8:3+flush-8:000:05:270
623207994236,4cyclictest791411-21kworker/u8:0+flush-8:022:10:110
62130224211,2sleep10-21swapper/119:05:131
623214994135,4cyclictest945215-21kworker/u8:0+flush-8:000:30:132
623209994137,3cyclictest815580-21kworker/u8:2+flush-8:022:50:101
623207994135,5cyclictest881323-21kworker/u8:3+flush-8:000:25:180
623207994135,5cyclictest749960-21kworker/u8:1+events_unbound22:45:210
623207994129,10cyclictest915582-21kworker/u8:2+flush-8:000:15:160
623209994036,3cyclictest945215-21kworker/u8:0+flush-8:000:35:061
623209994036,3cyclictest856721-21kworker/u8:0+flush-8:023:20:241
623209994036,3cyclictest749960-21kworker/u8:1+events_unbound21:20:081
623209994036,3cyclictest749960-21kworker/u8:1+events_unbound21:15:211
623209994036,3cyclictest627723-21kworker/u8:1+events_unbound19:55:171
623207994036,3cyclictest693487-21kworker/u8:2+flush-8:021:30:170
623207994034,4cyclictest945215-21kworker/u8:0+flush-8:000:35:070
623207994034,4cyclictest815580-21kworker/u8:2+flush-8:022:35:220
623207994030,8cyclictest884824-21ntpq23:25:150
623214993933,4cyclictest693487-21kworker/u8:2+flush-8:021:35:172
623209993936,2cyclictest749960-21kworker/u8:1+events_unbound22:25:251
623209993935,3cyclictest881323-21kworker/u8:3+events_unbound00:08:281
623209993935,3cyclictest749960-21kworker/u8:1+flush-8:021:55:111
623209993935,3cyclictest749960-21kworker/u8:1+flush-8:021:55:101
623209993935,3cyclictest710577-21kworker/u8:3+events_unbound21:10:251
623209993935,3cyclictest710577-21kworker/u8:3+events_unbound20:50:161
623209993935,3cyclictest693487-21kworker/u8:2+flush-8:021:37:341
623209993935,3cyclictest627723-21kworker/u8:1+flush-8:020:25:071
623209993927,9cyclictest1704890-21systemd-journal22:45:011
623207993935,3cyclictest815580-21kworker/u8:2+flush-8:022:20:070
623207993934,3cyclictest749960-21kworker/u8:1+flush-8:021:55:180
623207993934,3cyclictest749960-21kworker/u8:1+flush-8:021:55:170
623207993934,3cyclictest679571-21kworker/u8:0+flush-8:020:25:200
623207993929,8cyclictest749593-21ntpq21:10:170
623209993835,2cyclictest749960-21kworker/u8:1+events_unbound22:45:041
623209993834,3cyclictest649927-21kworker/u8:0+events_unbound19:40:221
623209993834,2cyclictest749960-21kworker/u8:1+events_unbound21:43:261
623209993833,4cyclictest730496-21kworker/u8:0+flush-8:020:55:081
623209993831,5cyclictest1704890-21systemd-journal19:50:241
623209993824,11cyclictest1704890-21systemd-journal23:08:231
623207993829,7cyclictest894756-21ntpq23:35:140
623209993733,3cyclictest870515-21kworker/u8:2+events_unbound23:40:231
623209993723,9cyclictest835853-21apt-get22:40:011
623207993733,3cyclictest627723-21kworker/u8:1+flush-8:019:45:120
623207993732,3cyclictest750196-21kworker/u8:4+events_unbound22:15:140
623207993728,7cyclictest1704890-21systemd-journal23:05:000
623214993626,8cyclictest1704890-21systemd-journal22:25:012
623209993633,2cyclictest911552-21irqrtprio23:55:101
623209993632,3cyclictest915582-21kworker/u8:2+events_unbound00:00:091
623209993628,6cyclictest805123-21ntpq22:05:171
623209993628,5cyclictest694503-21cut20:15:111
623207993631,3cyclictest3975468-21kworker/u8:3+flush-8:020:05:200
623209993531,3cyclictest881323-21kworker/u8:3+events_unbound00:14:381
623209993531,3cyclictest791411-21kworker/u8:0+events_unbound22:01:231
623209993531,3cyclictest749960-21kworker/u8:1+events_unbound21:25:251
623207993531,3cyclictest693487-21kworker/u8:2+events_unbound21:35:220
623207993529,4cyclictest919770-21kworker/u8:4+flush-8:000:00:160
623209993430,3cyclictest910012-21kworker/u8:1+events_unbound00:30:071
623209993430,3cyclictest881323-21kworker/u8:3+events_unbound23:30:101
623209993430,3cyclictest710577-21kworker/u8:3+events_unbound21:01:261
623209993430,3cyclictest710577-21kworker/u8:3+events_unbound20:35:171
623209993428,4cyclictest930995-21apt-get00:15:031
623209993421,10cyclictest1704890-21systemd-journal19:24:591
623207993429,4cyclictest791411-21kworker/u8:0+flush-8:022:05:200
623207993428,4cyclictest710577-21kworker/u8:3+flush-8:021:00:070
623207993426,6cyclictest714689-21ntpq20:35:170
623214993328,3cyclictest815580-21kworker/u8:2+flush-8:022:40:062
623214993324,7cyclictest1704890-21systemd-journal19:55:002
623209993330,2cyclictest856721-21kworker/u8:0+events_unbound23:00:121
623209993327,4cyclictest806608-21fschecks_count22:10:061
623209993319,11cyclictest1704890-21systemd-journal19:31:251
623207993328,4cyclictest693487-21kworker/u8:2+events_unbound21:05:250
623207993328,3cyclictest749960-21kworker/u8:1+events_unbound22:50:210
623207993327,4cyclictest856721-21kworker/u8:0+flush-8:023:20:240
623207993327,4cyclictest856721-21kworker/u8:0+events_unbound23:15:170
623207993327,4cyclictest660247-21gpgv19:45:000
623207993324,7cyclictest866172-21/usr/sbin/munin23:10:170
8175392320,5sleep3451irq_work/322:20:103
623214993228,3cyclictest693487-21kworker/u8:2+flush-8:021:40:072
623209993228,3cyclictest749960-21kworker/u8:1+events_unbound23:10:181
623209993228,3cyclictest679571-21kworker/u8:0+events_unbound20:32:241
623209993228,3cyclictest608777-21kworker/u8:2+events_unbound19:10:331
623209993227,4cyclictest627723-21kworker/u8:1+events_unbound20:20:221
623207993228,3cyclictest881323-21kworker/u8:3+flush-8:023:40:310
623207993228,3cyclictest654253-21needreboot19:35:160
623207993226,4cyclictest881323-21kworker/u8:3+events_unbound23:50:090
623214993127,3cyclictest881323-21kworker/u8:3+flush-8:000:20:122
623214993127,2cyclictest0-21swapper/221:10:002
623214993125,4cyclictest1704890-21systemd-journal23:57:232
623214993122,7cyclictest765600-21apt-get21:30:012
623209993127,3cyclictest881323-21kworker/u8:3+events_unbound00:21:281
623209993127,3cyclictest750196-21kworker/u8:4+events_unbound21:31:251
623209993127,3cyclictest749960-21kworker/u8:1+flush-8:021:45:101
623209993127,3cyclictest608777-21kworker/u8:2+events_unbound19:25:241
623209993126,4cyclictest870515-21kworker/u8:2+events_unbound23:17:031
623207993127,3cyclictest915582-21kworker/u8:2+flush-8:000:10:280
623207993126,3cyclictest710577-21kworker/u8:3+events_unbound20:45:170
623207993126,3cyclictest710577-21kworker/u8:3+events_unbound20:45:170
623207993126,3cyclictest696228-21tr20:20:040
623207993125,4cyclictest815580-21kworker/u8:2+events_unbound22:55:080
623207993125,4cyclictest693487-21kworker/u8:2+flush-8:020:50:070
623207993122,7cyclictest886006-21/usr/sbin/munin23:30:150
623207993122,7cyclictest608777-21kworker/u8:2+flush-8:019:25:060
623214993021,7cyclictest735440-21cron21:00:002
623209993027,2cyclictest749960-21kworker/u8:1+events_unbound22:20:201
623209993026,3cyclictest856721-21kworker/u8:0+events_unbound23:50:381
623207993026,3cyclictest749960-21kworker/u8:1+flush-8:022:30:100
623207993025,3cyclictest3975468-21kworker/u8:3+events_unbound19:55:240
623207993024,4cyclictest749960-21kworker/u8:1+flush-8:021:40:210
623207993018,4cyclictest881323-21kworker/u8:3+flush-8:000:20:210
623214992923,4cyclictest865947-21cat23:10:002
623214992922,5cyclictest806910-21tr22:10:102
623209992925,3cyclictest870515-21kworker/u8:2+flush-8:023:36:341
623209992925,3cyclictest730496-21kworker/u8:0+events_unbound21:07:191
623209992924,4cyclictest870515-21kworker/u8:2+events_unbound23:45:251
623207992925,3cyclictest627723-21kworker/u8:1+flush-8:020:15:210
623207992925,3cyclictest3975468-21kworker/u8:3+events_unbound19:30:250
623207992923,4cyclictest749960-21kworker/u8:1+flush-8:022:25:150
623207992923,4cyclictest693487-21kworker/u8:2+flush-8:020:40:040
623207992919,8cyclictest666010-21diskstats19:50:060
623207992918,9cyclictest0-21swapper/000:00:010
8895982280,6sleep3451irq_work/323:30:143
623214992823,4cyclictest881323-21kworker/u8:3+events_unbound00:00:172
623207992824,3cyclictest801159-21systemd-run22:05:000
623207992822,4cyclictest749960-21kworker/u8:1+events_unbound22:40:190
62320799280,26cyclictest680192-21grep20:00:240
623214992719,6cyclictest870470-21unixbench_singl23:10:252
623207992722,3cyclictest761169-21fschecks_time21:25:070
623207992722,3cyclictest693487-21kworker/u8:2+events_unbound21:15:080
623207992721,4cyclictest905637-21systemd-run23:50:010
623207992720,5cyclictest608777-21kworker/u8:2+flush-8:019:20:040
623214992622,2cyclictest921304-21fschecks_count00:05:082
623214992622,2cyclictest0-21swapper/221:15:012
623214992621,3cyclictest749960-21kworker/u8:1+events_unbound22:45:182
623214992620,4cyclictest846592-21fschecks_count22:50:092
623207992621,3cyclictest693487-21kworker/u8:2+events_unbound21:50:130
6228342262,6sleep00-21swapper/019:07:370
623214992522,2cyclictest931310-21fschecks_time00:15:082
623214992522,2cyclictest901168-21cpuspeed_turbos23:45:062
623214992522,2cyclictest770543-21cron21:35:002
623214992521,2cyclictest856501-21fschecks_count23:00:092
623214992521,2cyclictest851290-21aten2_r5power_c22:55:052
623214992520,4cyclictest725112-21unixbench_singl20:45:242
623214992520,4cyclictest725112-21unixbench_singl20:45:232
623214992519,4cyclictest630724-21cpuspeed_turbos19:15:092
623214992518,5cyclictest881323-21kworker/u8:3+flush-8:000:10:222
623214992517,7cyclictest785319-21unixbench_singl21:45:242
623214992517,6cyclictest679658-21needreboot20:00:162
623214992516,7cyclictest644887-21unixbench_multi19:25:252
623207992520,3cyclictest749960-21kworker/u8:1+events_unbound21:20:230
623207992520,3cyclictest1-21systemd00:35:010
623207992520,3cyclictest0-21swapper/019:20:000
623214992418,1cyclictest161rcu_preempt22:35:202
623214992414,8cyclictest635815-21fschecks_time19:20:082
623207992420,3cyclictest749960-21kworker/u8:1+events_unbound23:06:260
623214992320,2cyclictest796462-21aten2_r5power_c22:00:072
623214992319,2cyclictest821437-21fschecks_count22:25:072
623214992318,3cyclictest756189-21fschecks_time21:20:112
623214992318,3cyclictest696344-21fschecks_time20:20:072
623214992318,3cyclictest0-21swapper/200:40:002
623214992315,6cyclictest627615-21unixbench_multi19:10:232
62321499231,17cyclictest738391-21grep21:00:142
623214992219,2cyclictest750922-21aten2_r5power_v21:15:052
623214992218,2cyclictest880419-21grep23:20:252
623214992217,4cyclictest693487-21kworker/u8:2+flush-8:021:50:202
623214992214,6cyclictest881424-21fschecks_time23:25:062
623214992214,6cyclictest871448-21fschecks_time23:15:072
623214992213,7cyclictest706221-21fschecks_count20:30:082
62321499219,3cyclictest8262992grep22:30:062
623214992117,3cyclictest881323-21kworker/u8:3+flush-8:000:25:072
623214992117,3cyclictest881323-21kworker/u8:3+events_unbound23:30:062
623214992116,4cyclictest650761-21cpuspeed_turbos19:35:082
623214992116,3cyclictest675006-21unixbench_multi19:55:232
623214992116,3cyclictest0-21swapper/219:45:032
623214992115,1cyclictest161rcu_preempt19:35:012
623214992114,5cyclictest401-21dbus-daemon19:45:002
623214992113,6cyclictest900231-21unixbench_multi23:40:232
623214992112,6cyclictest690795-21latency_hist20:15:002
623214992015,4cyclictest728184-21kthreadcore20:50:132
623214992014,4cyclictest891248-21cpuspeed_turbos23:35:052
623214992014,4cyclictest701195-21cpuspeed_turbos20:25:062
623214992013,6cyclictest694697-21needreboot20:15:112
623214991914,4cyclictest815467-21unixbench_multi22:15:202
623214991914,3cyclictest716205-21fschecks_count20:40:082
623214991914,3cyclictest0-21swapper/222:05:242
623214991914,3cyclictest0-21swapper/221:55:022
623214991914,3cyclictest0-21swapper/221:55:022
623214991913,4cyclictest711139-21cpuspeed_turbos20:35:062
623214991911,6cyclictest684662-21tr20:05:152
6221932193,9sleep30-21swapper/319:05:203
6186452193,9sleep20-21swapper/219:05:062
7396132156,5sleep30-21swapper/321:00:213
9021482142,8sleep30-21swapper/323:45:113
8552912142,8sleep30-21swapper/322:55:233
7966172140,5sleep3481ktimers/322:00:083
8630892132,6sleep30-21swapper/323:05:103
7858512132,5sleep30-21swapper/321:50:013
7729122132,7sleep30-21swapper/321:35:133
7697422130,8sleep30-21swapper/321:30:203
6744772132,7sleep30-21swapper/319:55:173
6663702132,7sleep30-21swapper/319:50:113
6271412132,8sleep30-21swapper/319:10:173
9406452122,5sleep30-21swapper/300:25:013
9371842122,6sleep30-21swapper/300:20:123
9308042122,6sleep30-21swapper/300:15:013
9263822122,6sleep30-21swapper/300:10:083
9209842122,5sleep30-21swapper/300:05:033
9144212122,6sleep30-21swapper/323:55:143
9102002122,6sleep30-21swapper/323:50:263
8983992122,6sleep30-21swapper/323:40:143
8910462122,6sleep30-21swapper/323:35:053
8808082122,5sleep30-21swapper/323:25:013
8709492122,5sleep30-21swapper/323:15:023
8702062122,6sleep30-21swapper/323:10:243
8460732122,6sleep30-21swapper/322:50:013
8452062122,6sleep30-21swapper/322:45:213
8366372122,6sleep30-21swapper/322:40:113
8335722122,6sleep30-21swapper/322:35:123
8111522122,5sleep30-21swapper/322:15:033
7914052122,7sleep30-21swapper/321:55:043
7914052122,7sleep30-21swapper/321:55:043
7766892122,6sleep30-21swapper/321:40:113
7605912122,6sleep30-21swapper/321:25:023
7558432122,6sleep30-21swapper/321:20:083
7498692123,5sleep30-21swapper/321:10:253
7413152122,6sleep30-21swapper/321:05:123
7314502122,6sleep30-21swapper/320:55:123
7293082122,6sleep30-21swapper/320:50:153
7109222122,6sleep30-21swapper/320:35:053
7059282122,6sleep30-21swapper/320:30:033
6955862122,6sleep30-21swapper/320:18:233
6858982122,5sleep30-21swapper/320:10:023
6847472122,6sleep30-21swapper/320:05:163
6759462122,5sleep30-21swapper/320:00:013
6590682122,6sleep30-21swapper/319:40:153
6504722122,5sleep30-21swapper/319:35:023
6445182122,6sleep30-21swapper/319:25:223
6401502123,6sleep30-21swapper/319:24:273
9496172112,6sleep30-21swapper/300:30:183
9169602112,5sleep30-21swapper/300:00:123
8765962112,5sleep30-21swapper/323:20:123
8571222112,5sleep30-21swapper/323:00:133
8262952110,2sleep3481ktimers/322:30:073
8209262112,5sleep30-21swapper/322:25:023
8063222112,5sleep30-21swapper/322:10:053
8046772112,5sleep30-21swapper/322:05:143
7815242112,6sleep30-21swapper/321:45:133
7555452113,5sleep30-21swapper/321:19:563
7208772112,6sleep30-21swapper/320:45:043
7208772112,6sleep30-21swapper/320:45:043
7194352112,5sleep30-21swapper/320:40:163
7039422112,6sleep30-21swapper/320:25:153
6981572112,5sleep30-21swapper/320:20:133
6646142112,5sleep30-21swapper/319:45:213
6457202111,6sleep30-21swapper/319:30:093
9507822102,5sleep30-21swapper/300:35:053
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional