You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-21 - 02:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Tue Apr 21, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
103970724100,5sleep3451irq_work/300:16:273
103970724100,5sleep3451irq_work/300:16:273
85014921640,2sleep3481ktimers/321:06:183
9205102790,8sleep375-21kworker/3:1+mm_percpu_wq22:16:233
8540322760,0sleep1281rcuc/121:11:181
8301702730,2sleep1281rcuc/120:46:181
10057442720,3sleep375-21kworker/3:1-events23:45:013
730840995847,8cyclictest861674-21apt-get21:20:001
730834995447,5cyclictest971255-21/usr/sbin/munin23:11:250
730834995246,4cyclictest812448-21kworker/u8:0+flush-8:023:36:260
730840995145,5cyclictest926459-21kworker/u8:3+flush-8:022:31:151
730840994944,4cyclictest926459-21kworker/u8:3+flush-8:023:06:131
730834994944,4cyclictest995528-21kworker/u8:1+flush-8:023:41:120
730840994742,4cyclictest896783-21kworker/u8:2+flush-8:022:21:131
730840994742,4cyclictest812448-21kworker/u8:0+flush-8:023:36:141
730840994742,4cyclictest725696-21kworker/u8:2+flush-8:020:06:141
730840994737,7cyclictest966012-21latency_hist23:05:011
730840994641,4cyclictest852003-21kworker/u8:3+flush-8:021:26:261
730840994640,5cyclictest725696-21kworker/u8:2+flush-8:019:16:241
730834994639,5cyclictest280-21systemd-journal19:50:000
730834994638,5cyclictest896783-21kworker/u8:2+flush-8:022:26:130
730840994535,8cyclictest280-21systemd-journal21:41:111
730840994535,8cyclictest280-21systemd-journal00:26:121
730840994439,4cyclictest725696-21kworker/u8:2+flush-8:019:56:151
730840994439,4cyclictest725696-21kworker/u8:2+flush-8:019:56:151
730840994339,3cyclictest1020614-21kworker/u8:4+events_unbound00:31:141
730840994338,4cyclictest995528-21kworker/u8:1+flush-8:023:56:261
730840994338,4cyclictest995528-21kworker/u8:1+flush-8:023:51:121
730840994337,4cyclictest715905-21kworker/u8:1+flush-8:019:26:281
730840994337,4cyclictest1020614-21kworker/u8:4+flush-8:000:16:261
730840994337,4cyclictest1020614-21kworker/u8:4+flush-8:000:16:261
730840994332,8cyclictest280-21systemd-journal23:11:121
730834994337,4cyclictest735944-21kworker/u8:3+flush-8:019:16:140
730834994336,4cyclictest715905-21kworker/u8:1+flush-8:019:21:120
10242742430,5sleep30-21swapper/300:01:183
730840994237,4cyclictest725696-21kworker/u8:2+flush-8:021:06:131
730834994237,4cyclictest812448-21kworker/u8:0+flush-8:021:01:130
730834994236,4cyclictest812448-21kworker/u8:0+flush-8:021:56:170
730840994137,3cyclictest812448-21kworker/u8:0+flush-8:022:36:131
730840994134,5cyclictest807564-21apt-get20:26:091
730840994133,6cyclictest280-21systemd-journal19:35:001
730834994134,6cyclictest812448-21kworker/u8:0+flush-8:023:16:130
730840994036,3cyclictest876518-21kworker/u8:1+flush-8:022:11:271
730840994036,3cyclictest862152-21kworker/u8:1+flush-8:021:21:271
730834994033,5cyclictest735944-21kworker/u8:3+flush-8:020:31:250
730840993935,3cyclictest852003-21kworker/u8:3+flush-8:021:31:261
730840993929,8cyclictest280-21systemd-journal23:49:591
7768102380,3sleep375-21kworker/3:1+events19:51:263
730840993834,3cyclictest995528-21kworker/u8:1+flush-8:000:36:261
730840993833,4cyclictest725696-21kworker/u8:2+flush-8:020:51:131
730840993832,5cyclictest812448-21kworker/u8:0+flush-8:021:51:251
730840993832,4cyclictest1020614-21kworker/u8:4+flush-8:000:01:271
730840993832,4cyclictest1000907-21apt-get23:41:081
730840993828,7cyclictest280-21systemd-journal22:18:121
730834993831,4cyclictest995528-21kworker/u8:1+flush-8:023:56:140
730840993732,4cyclictest812448-21kworker/u8:0+flush-8:020:41:271
730840993729,6cyclictest715905-21kworker/u8:1+flush-8:019:11:241
730844993630,4cyclictest1060201-21gpgv00:40:012
730840993631,4cyclictest752898-21kworker/u8:0+flush-8:019:36:221
730840993630,5cyclictest735944-21kworker/u8:3+flush-8:020:31:231
730840993630,4cyclictest812448-21kworker/u8:0+flush-8:022:56:251
730840993630,4cyclictest812448-21kworker/u8:0+flush-8:022:46:271
730840993630,4cyclictest812448-21kworker/u8:0+flush-8:000:11:231
730840993630,4cyclictest812448-21kworker/u8:0+flush-8:000:11:231
730834993630,4cyclictest812448-21kworker/u8:0+flush-8:022:56:130
730834993629,5cyclictest280-21systemd-journal23:28:500
730834993629,5cyclictest280-21systemd-journal19:10:030
730834993627,7cyclictest280-21systemd-journal22:55:010
730840993523,9cyclictest280-21systemd-journal23:26:121
730840993429,4cyclictest725696-21kworker/u8:2+flush-8:020:11:261
730834993430,2cyclictest851774-21idleruntime-cro21:09:590
730834993428,4cyclictest926459-21kworker/u8:3+events_unbound22:31:100
730834993427,6cyclictest862152-21kworker/u8:1+flush-8:021:21:290
730834993427,5cyclictest812448-21kworker/u8:0+flush-8:023:21:280
730834993424,8cyclictest1020970-21diskstats00:01:110
730840993328,4cyclictest725696-21kworker/u8:2+flush-8:019:41:131
730840993326,5cyclictest772064-21grep19:46:301
730840993326,5cyclictest725696-21kworker/u8:2+flush-8:020:56:211
730840993322,7cyclictest280-21systemd-journal20:01:121
730840993320,10cyclictest280-21systemd-journal22:29:591
730844993227,3cyclictest862577-21fschecks_time21:21:142
730844993222,8cyclictest1055208-21awk00:35:012
730840993227,3cyclictest981681-21irqcore23:21:161
730834993228,2cyclictest951174-21idleruntime-cro22:50:000
730834993227,4cyclictest812448-21kworker/u8:0+events_unbound21:11:110
7304672323,4sleep00-21swapper/019:09:060
730840993127,3cyclictest1020614-21kworker/u8:4+flush-8:000:06:131
730840993127,3cyclictest1020614-21kworker/u8:4+flush-8:000:06:131
730840993126,4cyclictest876518-21kworker/u8:1+flush-8:021:46:141
730840993124,3cyclictest0-21swapper/122:41:171
730840993120,8cyclictest821260-21ntpq20:36:231
730834993127,2cyclictest837682-21/usr/sbin/munin20:56:120
730834993127,2cyclictest1025933-21tr00:06:110
730834993127,2cyclictest1025933-21tr00:06:110
730834993125,4cyclictest725696-21kworker/u8:2+flush-8:020:16:250
730834993122,7cyclictest1060160-21apt-get00:40:010
730834993119,10cyclictest763112-21diskstats19:41:120
730844993020,7cyclictest802874-21fschecks_count20:21:132
730840993025,3cyclictest902596-21irqrtprio22:01:161
730840993025,3cyclictest902596-21irqrtprio22:01:161
730834993026,3cyclictest725696-21kworker/u8:2+flush-8:020:06:170
730834993025,3cyclictest961452-21aten2_r5power_e23:01:100
73083499302,23cyclictest861743-21munin-run21:20:000
730844992925,2cyclictest822540-21aten2_r5power_e20:41:112
730844992922,6cyclictest743341-21fschecks_count19:21:122
730840992924,3cyclictest980467-21sed23:16:291
730840992924,3cyclictest812448-21kworker/u8:0+events_unbound21:36:111
730840992923,5cyclictest725696-21kworker/u8:2+events_unbound20:21:211
730840992923,4cyclictest896783-21kworker/u8:2+events_unbound22:51:091
730840992923,4cyclictest797416-21apt-get20:16:081
730834992925,2cyclictest1055194-21cron00:35:010
730834992921,6cyclictest827477-21aten2_r5power_p20:46:100
730834992921,6cyclictest752926-21/usr/sbin/munin19:31:210
730834992920,7cyclictest936097-21apt-get22:35:010
730844992822,4cyclictest970954-21idleruntime-cro23:10:002
730844992822,4cyclictest1009490-21missed_timers23:46:202
730840992823,4cyclictest812448-21kworker/u8:0+flush-8:021:56:261
730834992824,3cyclictest725696-21kworker/u8:2+flush-8:019:26:130
730834992822,4cyclictest812448-21kworker/u8:0+flush-8:021:41:130
730834992822,4cyclictest752898-21kworker/u8:0+flush-8:020:10:430
730834992822,4cyclictest1049910-21unixbench_multi00:26:290
730844992722,3cyclictest857358-21fschecks_count21:16:122
730844992722,3cyclictest847544-21fschecks_time21:06:122
730844992721,4cyclictest907092-21fschecks_count22:06:132
730844992720,5cyclictest872176-21apt-get21:31:092
730840992720,5cyclictest876518-21kworker/u8:1+flush-8:022:06:211
730834992722,4cyclictest945940-21unixbench_singl22:41:320
730834992722,4cyclictest876518-21kworker/u8:1+flush-8:022:11:130
730834992722,3cyclictest876153-21mailstats21:31:270
730834992722,3cyclictest0-21swapper/022:10:000
730834992721,4cyclictest786838-21unixbench_multi20:01:270
730834992720,5cyclictest280-21systemd-journal21:53:300
730834992719,6cyclictest280-21systemd-journal20:40:110
730844992622,2cyclictest985418-21unixbench_singl23:21:292
730844992622,2cyclictest941863-21cpuspeed_turbos22:41:142
730844992622,2cyclictest921709-21aten2_r5power_p22:21:112
730844992622,2cyclictest897181-21fschecks_count21:56:132
730844992622,2cyclictest817545-21aten2_r5power_e20:36:132
730844992621,3cyclictest877401-21fschecks_count21:36:132
730844992616,8cyclictest772727-21apt-get19:51:072
730840992622,2cyclictest0-21swapper/121:01:151
730840992621,4cyclictest1020614-21kworker/u8:4+flush-8:000:21:121
730834992622,3cyclictest876518-21kworker/u8:1+flush-8:021:46:180
730834992619,5cyclictest896783-21kworker/u8:2+events_unbound23:31:140
730834992619,5cyclictest1000801-21kworker/u8:2+flush-8:023:51:210
7267412260,3sleep20-21swapper/219:06:132
730844992521,2cyclictest971632-21fschecks_time23:11:132
730844992521,2cyclictest817143-21cron20:35:002
730844992520,3cyclictest991334-21fschecks_time23:31:142
730840992519,4cyclictest725696-21kworker/u8:2+flush-8:019:21:161
730840992519,3cyclictest0-21swapper/123:31:211
730834992520,4cyclictest725696-21kworker/u8:2+flush-8:021:26:140
730834992519,3cyclictest0-21swapper/020:26:100
10325272250,2sleep3471rcuc/300:11:173
10325272250,2sleep3471rcuc/300:11:173
730844992421,2cyclictest767849-21aten2_r5power_c19:46:112
730844992420,3cyclictest1034834-21unixbench_multi00:11:282
730844992420,3cyclictest1034834-21unixbench_multi00:11:272
730844992420,2cyclictest951792-21fschecks_count22:51:102
730844992419,3cyclictest0-21swapper/219:35:002
730840992420,2cyclictest772953-21tr19:51:101
73083499242,21cyclictest0-21swapper/000:21:250
730834992420,3cyclictest876518-21kworker/u8:1+flush-8:022:01:160
730834992420,3cyclictest876518-21kworker/u8:1+flush-8:022:01:160
730834992419,4cyclictest896783-21kworker/u8:2+flush-8:022:16:170
730834992419,3cyclictest832698-21fschecks_time20:51:130
730834992419,3cyclictest777358-21/usr/sbin/munin19:55:000
73083499240,10cyclictest821301-21/usr/sbin/munin20:36:250
730844992313,8cyclictest1020365-21awk00:00:002
73083499238,3cyclictest0-21swapper/019:35:490
730834992318,3cyclictest0-21swapper/023:46:200
730834992318,3cyclictest0-21swapper/020:00:000
730834992318,3cyclictest0-21swapper/020:00:000
730834992318,3cyclictest0-21swapper/000:15:000
730834992318,3cyclictest0-21swapper/000:14:590
730834992316,5cyclictest877386-21diskstats21:36:130
73084499223,11cyclictest0-21swapper/200:21:162
73084499222,10cyclictest10382352cut00:16:192
73084499222,10cyclictest10382352cut00:16:192
730844992218,2cyclictest1020985-21fschecks_count00:01:112
730844992212,7cyclictest1027895-21tr00:06:202
730844992212,7cyclictest1027895-21tr00:06:202
730834992218,2cyclictest0-21swapper/022:25:010
730834992217,4cyclictest995528-21kworker/u8:1+flush-8:000:16:320
730834992217,4cyclictest995528-21kworker/u8:1+flush-8:000:16:320
730834992216,4cyclictest725696-21kworker/u8:2+flush-8:020:21:260
7259052223,12sleep10-21swapper/119:05:061
730844992117,2cyclictest0-21swapper/223:00:002
730844992112,8cyclictest742338-21unixbench_multi19:16:302
73084499204,3cyclictest0-21swapper/222:16:272
730844992017,2cyclictest902094-21cpuspeed_turbos22:01:112
730844992017,2cyclictest902094-21cpuspeed_turbos22:01:102
730844992017,2cyclictest882198-21aten2_r5power_v21:41:102
730844992017,2cyclictest802014-21cron20:20:012
730844992016,2cyclictest0-21swapper/219:11:112
730844992012,6cyclictest280-21systemd-journal22:33:372
730844992012,6cyclictest0-21swapper/221:51:162
730844992011,7cyclictest778513-21sed19:56:182
730844992011,7cyclictest778513-21sed19:56:172
730844992010,7cyclictest1005718-21sed23:45:012
73083499202,13cyclictest589-21runrttasks23:06:090
730844991916,2cyclictest911968-21cpuspeed_turbos22:11:122
730844991916,2cyclictest782881-21fschecks_count20:01:132
730844991915,2cyclictest0-21swapper/221:50:002
730844991910,7cyclictest844340-21tr21:01:172
730844991910,7cyclictest788432-21sed20:06:162
73084499189,7cyclictest999324-21tr23:36:202
73084499189,7cyclictest946676-21cut22:46:122
73084499189,7cyclictest834351-21cut20:51:172
730844991814,2cyclictest1045756-21aten2_r5power_p00:26:112
730844991814,2cyclictest0-21swapper/223:51:072
730844991814,2cyclictest0-21swapper/220:11:292
730844991813,3cyclictest827659-21fschecks_count20:46:122
730844991813,3cyclictest0-21swapper/220:26:142
730844991810,6cyclictest930664-21cat22:26:282
730844991810,6cyclictest838062-21sed20:56:142
730844991810,6cyclictest751025-21cut19:26:192
730844991810,6cyclictest0-21swapper/222:36:282
7259292183,8sleep30-21swapper/319:05:243
73084499179,6cyclictest978894-21cut23:16:172
73084499179,6cyclictest763127-21fschecks_count19:41:132
73084499179,6cyclictest759307-21cut19:36:162
730844991710,5cyclictest852831-21sed21:11:152
73084499168,6cyclictest867974-21sed21:26:162
730844991613,2cyclictest0-21swapper/223:25:322
730844991613,2cyclictest0-21swapper/223:04:352
9581962132,7sleep30-21swapper/322:56:183
9311822132,6sleep30-21swapper/322:30:013
8760912132,6sleep30-21swapper/321:31:263
8568662132,6sleep30-21swapper/321:15:023
8282802132,7sleep30-21swapper/320:46:173
8178652132,7sleep30-21swapper/320:36:173
10552202132,6sleep30-21swapper/300:35:023
9906672122,5sleep30-21swapper/323:30:013
9808872122,6sleep30-21swapper/323:20:023
9618742122,6sleep30-21swapper/323:01:163
9404802122,6sleep30-21swapper/322:36:243
8993962123,5sleep30-21swapper/321:56:193
8916342122,6sleep30-21swapper/321:50:013
8874032123,6sleep30-21swapper/321:46:163
8819472122,6sleep30-21swapper/321:40:023
8708952122,6sleep30-21swapper/321:26:213
8626372122,6sleep30-21swapper/321:21:163
8461012122,6sleep30-21swapper/321:01:253
8320382122,6sleep30-21swapper/320:50:023
8124942122,6sleep30-21swapper/320:31:083
8072542122,5sleep30-21swapper/320:25:013
7912572122,6sleep30-21swapper/320:06:243
7829862122,6sleep30-21swapper/320:01:143
7675012122,5sleep30-21swapper/319:45:013
7427152122,5sleep30-21swapper/319:20:013
7381032122,6sleep30-21swapper/319:16:123
7355352122,6sleep30-21swapper/319:11:303
10261442122,6sleep30-21swapper/300:06:173
10261442122,6sleep30-21swapper/300:06:173
10110642123,6sleep30-21swapper/323:51:123
10057442122,6sleep30-21swapper/323:45:023
9958412112,5sleep30-21swapper/323:35:023
9909912112,5sleep30-21swapper/323:31:093
9761872112,5sleep30-21swapper/323:16:093
9717222112,5sleep30-21swapper/323:11:153
9705462112,5sleep30-21swapper/323:06:293
9514012112,6sleep30-21swapper/322:50:083
9464632112,5sleep30-21swapper/322:45:023
9420272112,5sleep30-21swapper/322:41:173
9264602113,5sleep30-21swapper/322:25:123
9216292112,5sleep30-21swapper/322:21:113
9117062112,6sleep30-21swapper/322:11:083
9067262112,6sleep30-21swapper/322:05:303
9017792112,6sleep30-21swapper/322:00:203
9017792112,6sleep30-21swapper/322:00:203
8772862112,5sleep30-21swapper/321:36:133
8561442112,5sleep30-21swapper/321:11:293
8375422112,6sleep30-21swapper/320:56:123
8224852112,5sleep30-21swapper/320:41:103
8024962112,5sleep30-21swapper/320:20:043
7974202112,6sleep30-21swapper/320:16:113
7930602110,6sleep30-21swapper/320:11:173
7775752112,6sleep30-21swapper/319:55:043
7775752112,6sleep30-21swapper/319:55:043
7668932112,5sleep30-21swapper/319:41:273
7578162112,5sleep30-21swapper/319:35:023
7534412112,5sleep30-21swapper/319:31:173
7497682112,6sleep30-21swapper/319:26:193
10505982112,5sleep30-21swapper/300:31:083
10460452112,5sleep30-21swapper/300:26:143
10451352112,6sleep30-21swapper/300:22:383
10154352112,5sleep30-21swapper/323:55:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional