You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-15 - 22:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Wed Apr 15, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
416963623060,3sleep3471rcuc/311:46:153
41247882970,2chrt75-21kworker/3:1+events11:00:013
40267742870,4sleep375-21kworker/3:1-events09:21:213
3893874996154,5cyclictest3900788-21kworker/u8:1+flush-8:007:21:301
3893874995945,4cyclictest3945177-21kworker/u8:1+flush-8:008:01:331
3893874995850,6cyclictest3900788-21kworker/u8:1+flush-8:007:31:301
95282570,3chrt75-21kworker/3:1+events12:16:293
3893874995647,7cyclictest280-21systemd-journal12:00:001
3893874995445,6cyclictest3945450-21latency_hist08:00:011
3893870995343,8cyclictest4089615-21apt-get10:25:000
3893870995343,7cyclictest4194220-21latency_hist12:10:010
3893870995241,9cyclictest4009309-21ntpq09:01:250
3893874995045,4cyclictest4049984-21kworker/u8:0+flush-8:011:06:321
3893874995045,4cyclictest3879059-21kworker/u8:0+events_unbound07:51:301
3893874995043,5cyclictest4049984-21kworker/u8:0+flush-8:011:26:161
3893874995043,5cyclictest3879059-21kworker/u8:0+events_unbound08:56:281
3893874994944,3cyclictest4049984-21kworker/u8:0+flush-8:011:21:311
3893874994942,6cyclictest3975787-21kworker/u8:3+flush-8:008:41:301
3893874994940,7cyclictest4089615-21apt-get10:25:011
39567032480,1chrt3956615-21kthreadcore08:11:211
3893874994844,3cyclictest3054410-21kworker/u8:3+events_unbound07:15:031
3893874994841,5cyclictest3945177-21kworker/u8:1+flush-8:009:11:311
3893874994742,3cyclictest465-21kworker/u8:0+flush-8:012:21:311
3893874994742,3cyclictest4074975-21kworker/u8:3+events_unbound10:11:291
3893874994741,5cyclictest4144763-21kworker/u8:3+flush-8:011:31:261
3893874994741,4cyclictest4049984-21kworker/u8:0+flush-8:010:33:371
3893874994741,4cyclictest4045023-21kworker/u8:1+flush-8:010:06:311
3893874994641,3cyclictest465-21kworker/u8:0+events_unbound12:35:011
3893874994637,6cyclictest4063699-21ntpq09:56:241
3893874994634,10cyclictest280-21systemd-journal09:40:001
3893874994541,3cyclictest3916199-21kworker/u8:3+events_unbound08:06:211
3893874994540,4cyclictest4084864-21kworker/u8:1+flush-8:010:46:321
3893874994539,4cyclictest3879059-21kworker/u8:0+events_unbound09:31:291
3893874994539,4cyclictest3879059-21kworker/u8:0+events_unbound09:31:291
3893874994538,6cyclictest4049984-21kworker/u8:0+flush-8:009:51:261
3893870994529,6cyclictest280-21systemd-journal11:24:120
3893874994439,4cyclictest4115072-21kworker/u8:2+flush-8:011:01:161
3893874994438,5cyclictest4045023-21kworker/u8:1+flush-8:010:01:281
3893874994437,6cyclictest3924868-21kworker/u8:2+flush-8:007:41:251
3893874994339,3cyclictest4184347-21kworker/u8:1+events_unbound12:20:001
3893874994336,5cyclictest3879059-21kworker/u8:0+flush-8:009:21:311
3893874994333,6cyclictest4144763-21kworker/u8:3+flush-8:011:36:251
3893874994237,3cyclictest4176269-21kworker/u8:0+events_unbound11:55:011
3893874994237,3cyclictest3879059-21kworker/u8:0+flush-8:009:06:311
38943962410,2sleep375-21kworker/3:1+events07:11:163
3893876994124,3cyclictest4069973-21aten2_r5power_e10:06:132
3893874994136,4cyclictest465-21kworker/u8:0+events_unbound12:36:231
3893874994135,5cyclictest4084864-21kworker/u8:1+flush-8:010:56:271
3893874994133,6cyclictest3054410-21kworker/u8:3+flush-8:007:11:261
3893874994128,10cyclictest280-21systemd-journal10:45:001
3893870994135,3cyclictest280-21systemd-journal08:52:100
3893874994036,3cyclictest4184347-21kworker/u8:1+flush-8:012:11:301
3893874994030,7cyclictest4034013-21ntpq09:26:221
3893870994034,4cyclictest3900788-21kworker/u8:1+flush-8:007:16:170
389387099400,38cyclictest3960284-21true08:15:010
3893874993935,3cyclictest3879059-21kworker/u8:0+flush-8:008:21:211
3893874993934,4cyclictest3900788-21kworker/u8:1+flush-8:007:26:161
3893874993934,4cyclictest3900788-21kworker/u8:1+flush-8:007:26:161
3893874993934,3cyclictest4144763-21kworker/u8:3+flush-8:011:46:221
3893874993932,5cyclictest3879059-21kworker/u8:0+flush-8:008:31:261
3893874993930,6cyclictest280-21systemd-journal11:43:121
3893874993930,6cyclictest280-21systemd-journal11:43:121
3893870993935,3cyclictest4115072-21kworker/u8:2+flush-8:011:01:260
3893870993930,7cyclictest280-21systemd-journal08:30:000
3893874993833,3cyclictest4049984-21kworker/u8:0+flush-8:009:46:211
3893874993827,4cyclictest4099581-21kworker/u8:3+flush-8:010:36:171
3893870993833,4cyclictest3879059-21kworker/u8:0+flush-8:008:36:170
3893874993732,4cyclictest3879059-21kworker/u8:0+events_unbound08:36:251
3893874993732,3cyclictest3900788-21kworker/u8:1+events_unbound07:36:241
3893874993731,4cyclictest3970754-21apt-get08:26:121
3893874993729,6cyclictest4144763-21kworker/u8:3+events_unbound12:06:161
3893870993726,9cyclictest280-21systemd-journal10:30:000
3893876993625,8cyclictest4139578-21awk11:15:002
3893876993622,2cyclictest4139993-21aten2_r5power_p11:16:152
3893874993631,3cyclictest4049984-21kworker/u8:0+events_unbound10:16:281
3893874993630,4cyclictest4049984-21kworker/u8:0+flush-8:011:11:321
3893874993630,4cyclictest3975787-21kworker/u8:3+events_unbound08:46:211
3893874993629,5cyclictest3879059-21kworker/u8:0+flush-8:009:01:161
3893874993629,5cyclictest10176-21kworker/u8:2+flush-8:012:26:271
3893870993629,6cyclictest3916199-21kworker/u8:3+flush-8:007:31:280
3893870993625,9cyclictest4063725-21ntpq09:56:250
3893874993529,4cyclictest4020085-21kworker/u8:2+flush-8:009:41:311
3893874993528,5cyclictest3879059-21kworker/u8:0+events_unbound08:51:281
3893874993524,9cyclictest280-21systemd-journal10:25:011
3893870993525,8cyclictest4098925-21ntpq10:31:260
3893874993428,4cyclictest3916199-21kworker/u8:3+events_unbound08:16:231
3893870993424,7cyclictest280-21systemd-journal12:30:010
3893870993422,10cyclictest280-21systemd-journal10:40:000
41091892330,5sleep2371rcuc/210:41:302
39889872330,2sleep0161rcu_preempt08:41:210
3893876993323,8cyclictest280-21systemd-journal09:55:002
3893874993327,4cyclictest4084864-21kworker/u8:1+flush-8:010:51:231
3893874993326,4cyclictest4144763-21kworker/u8:3+flush-8:012:01:201
3893874993225,5cyclictest3879059-21kworker/u8:0+flush-8:009:16:271
3893870993227,4cyclictest4099581-21kworker/u8:3+events_unbound10:41:320
3893870993226,4cyclictest3945177-21kworker/u8:1+flush-8:009:11:170
3893874993124,5cyclictest3916199-21kworker/u8:3+flush-8:007:46:271
3893870993124,5cyclictest280-21systemd-journal08:20:000
38934412313,9sleep20-21swapper/207:07:062
3893870993025,3cyclictest4049984-21kworker/u8:0+events_unbound11:06:170
3893876992925,2cyclictest4024689-21unixbench_singl09:16:322
3893876992923,4cyclictest3965507-21gpgv08:20:012
3893876992917,9cyclictest4104969-21awk10:40:002
3893874992923,4cyclictest4084864-21kworker/u8:1+flush-8:011:16:251
3893870992926,2cyclictest4159376-21systemd-run11:35:000
3893870992924,4cyclictest3965684-21kworker/u8:2+flush-8:008:21:420
389387099292,26cyclictest0-21swapper/007:41:300
3893870992823,4cyclictest3916199-21kworker/u8:3+flush-8:008:06:300
3893870992823,3cyclictest3915494-21munin-plugin-st07:30:000
3893870992823,3cyclictest3915494-21munin-plugin-st07:30:000
389387099282,25cyclictest0-21swapper/010:51:320
3893870992822,4cyclictest4173786-21unixbench_multi11:46:330
3893870992822,4cyclictest4144763-21kworker/u8:3+flush-8:011:50:430
3893870992822,4cyclictest25019-21turbostat.cron12:35:000
3893870992821,5cyclictest280-21systemd-journal10:59:180
3893876992723,3cyclictest4089234-21unixbench_multi10:21:302
3893876992723,2cyclictest3985096-21unixbench_multi08:36:322
3893876992722,3cyclictest4158973-21unixbench_multi11:31:322
3893870992724,2cyclictest4183404-21needreboot11:56:230
3893870992723,2cyclictest0-21swapper/009:50:010
3893870992722,4cyclictest3916199-21kworker/u8:3+flush-8:007:48:410
3893870992722,3cyclictest3900788-21kworker/u8:1+events_unbound07:21:180
3893870992721,5cyclictest3879059-21kworker/u8:0+flush-8:009:36:270
3893870992721,4cyclictest4114509-21unixbench_singl10:46:320
3893870992720,6cyclictest465-21kworker/u8:0+flush-8:012:36:250
3893870992719,6cyclictest4075032-21/usr/sbin/munin10:11:220
3893876992622,2cyclictest4005244-21idleruntime-cro08:59:592
3893870992622,3cyclictest3879059-21kworker/u8:0+flush-8:007:57:420
3893870992622,3cyclictest3879059-21kworker/u8:0+events_unbound09:16:220
3893870992622,2cyclictest4025785-21seq09:21:180
3893870992621,4cyclictest3879059-21kworker/u8:0+events_unbound09:31:330
3893870992621,4cyclictest3879059-21kworker/u8:0+events_unbound09:31:330
3893870992621,4cyclictest15100-21systemd-run12:25:010
3893870992621,3cyclictest4184347-21kworker/u8:1+events_unbound12:16:130
3893870992619,5cyclictest4084864-21kworker/u8:1+flush-8:011:16:220
3893876992522,2cyclictest4019732-21unixbench_singl09:11:322
3893876992522,2cyclictest19693-21unixbench_multi12:26:322
3893876992517,5cyclictest4029952-21turbostat.cron09:25:002
3893870992522,2cyclictest3924732-21grep07:36:220
3893870992521,3cyclictest3975787-21kworker/u8:3+flush-8:008:46:220
3893870992520,4cyclictest4014053-21latency09:06:220
3893870992520,4cyclictest3946043-21cpuspeed_turbos08:01:160
3893870992520,3cyclictest4164277-21cron11:40:000
3893870992519,4cyclictest3879059-21kworker/u8:0+flush-8:009:26:290
3893870992518,5cyclictest4045023-21kworker/u8:1+flush-8:010:01:260
38891002252,5sleep00-21swapper/007:05:560
3893876992421,2cyclictest3926223-21cpuspeed_turbos07:41:142
3893876992419,3cyclictest4154012-21unixbench_multi11:26:312
3893876992419,3cyclictest3915107-21unixbench_multi07:26:312
3893876992419,3cyclictest3915107-21unixbench_multi07:26:312
3893870992421,1cyclictest4184347-21kworker/u8:1+events_unbound12:11:240
3893870992418,4cyclictest4045023-21kworker/u8:1+flush-8:009:41:210
38927432242,14sleep13892815-21ntpq07:06:251
3893876992320,2cyclictest4125207-21aten2_r5power_v11:01:142
3893876992311,4cyclictest0-21swapper/209:56:282
3893870992318,4cyclictest3879059-21kworker/u8:0+flush-8:007:51:420
3893870992318,3cyclictest0-21swapper/008:56:200
3893870992317,4cyclictest4049984-21kworker/u8:0+events_unbound09:51:110
3893870992315,6cyclictest4154397-21latency_hist11:30:010
3893876992219,2cyclictest4080304-21fschecks_count10:16:162
3893876992219,2cyclictest3945840-21aten2_r5power_c08:01:162
3893876992219,2cyclictest3921084-21aten2_r5power_e07:36:132
3893876992218,2cyclictest3970091-21unixbench_singl08:21:332
3893876992211,2cyclictest161rcu_preempt08:00:002
3893876992210,10cyclictest4047505-21tr09:41:212
3893870992218,3cyclictest4188918-21unixbench_multi12:01:320
3893870992217,3cyclictest0-21swapper/008:31:190
3893876992118,2cyclictest4095461-21fschecks_time10:31:172
3893876992117,2cyclictest3951079-21fschecks_time08:06:182
3893876992116,4cyclictest4119448-21unixbench_multi10:51:342
3893876992114,5cyclictest3980545-21cat08:35:002
3893870992116,3cyclictest0-21swapper/010:16:290
3893870992112,7cyclictest4073625-21ntpq10:06:240
389387699202,12cyclictest585-21apt-get12:11:132
3893876992017,2cyclictest3959888-21unixbench_multi08:11:322
3893876992016,2cyclictest3936211-21fschecks_time07:51:182
3893876992016,2cyclictest0-21swapper/211:55:012
3893876992016,2cyclictest0-21swapper/209:06:232
3893876992015,3cyclictest4123808-21grep10:56:242
3893876992015,3cyclictest4009282-21needreboot09:01:242
3893876992012,6cyclictest4093446-21tr10:26:202
3893876992011,2cyclictest0-21swapper/211:46:152
389387099202,2cyclictest0-21swapper/011:11:130
3893870992017,2cyclictest3898784-21latency_hist07:15:000
3893870992013,3cyclictest589-21runrttasks11:41:140
3893870992013,3cyclictest589-21runrttasks11:41:140
38890312203,8sleep30-21swapper/307:05:013
389387699199,7cyclictest3908877-21tr07:21:202
389387699197,8cyclictest10491-21apt-get12:21:132
3893876991916,2cyclictest4184888-21cpuspeed_turbos12:01:152
3893876991916,2cyclictest4164762-21aten2_r5power_v11:41:152
3893876991916,2cyclictest4164762-21aten2_r5power_v11:41:152
3893876991916,2cyclictest3970972-21cpuspeed_turbos08:26:152
3893876991911,6cyclictest23276-21tr12:31:232
39442512180,2sleep3481ktimers/307:56:223
39345472187,6sleep30-21swapper/307:46:243
3893876991814,3cyclictest0-21swapper/211:36:312
3893876991814,2cyclictest3985865-21aten2_r5power_c08:41:132
3893876991814,2cyclictest0-21swapper/212:36:132
3893876991814,2cyclictest0-21swapper/210:01:322
3893876991814,2cyclictest0-21swapper/207:46:162
3893876991812,4cyclictest0-21swapper/207:31:212
3893876991714,2cyclictest5749-21cpuspeed_turbos12:16:142
3893876991714,2cyclictest0-21swapper/209:36:202
3893876991713,2cyclictest0-21swapper/211:56:322
3893876991713,2cyclictest0-21swapper/210:46:292
3893876991713,2cyclictest0-21swapper/208:46:152
389387699169,5cyclictest4148113-21tr11:21:212
389387699163,8cyclictest4034057-21ntpq09:26:242
389387699162,13cyclictest0-21swapper/211:06:092
389387699162,13cyclictest0-21swapper/207:15:442
389387699162,13cyclictest0-21swapper/207:10:062
3893876991613,2cyclictest0-21swapper/209:46:122
3893876991612,2cyclictest4193888-21unixbench_singl12:06:322
3893876991612,2cyclictest0-21swapper/210:11:132
3893876991612,2cyclictest0-21swapper/208:51:192
3893876991611,3cyclictest0-21swapper/209:31:192
3893876991611,3cyclictest0-21swapper/209:31:192
40910812142,8sleep30-21swapper/310:26:193
222052142,7sleep30-21swapper/312:31:233
41582832132,7sleep30-21swapper/311:31:243
40960002130,4chrt481ktimers/310:31:193
40489992134,5sleep30-21swapper/309:41:293
39394892132,7sleep30-21swapper/307:51:253
41900742122,6sleep30-21swapper/312:06:193
41831462122,6sleep30-21swapper/311:56:243
41600382122,6sleep30-21swapper/311:36:173
41498032122,6sleep30-21swapper/311:26:143
41397912122,6sleep30-21swapper/311:15:023
41304282122,6sleep30-21swapper/311:06:203
41007312122,6sleep30-21swapper/310:36:183
40849782122,6sleep30-21swapper/310:21:133
40745322122,5sleep30-21swapper/310:10:023
40709302122,7sleep30-21swapper/310:06:203
40675712122,6sleep30-21swapper/310:01:233
40602392123,6sleep30-21swapper/309:56:173
40406242122,6sleep30-21swapper/309:36:193
40352252122,6sleep30-21swapper/309:31:133
40352252122,6sleep30-21swapper/309:31:133
40192312122,6sleep30-21swapper/309:11:273
40142352122,6sleep30-21swapper/309:06:253
39809682122,6sleep30-21swapper/308:36:163
39771722122,6sleep30-21swapper/308:31:223
39709992122,6sleep30-21swapper/308:26:163
39609522122,6sleep30-21swapper/308:16:173
39504482122,6sleep30-21swapper/308:05:023
39204232122,6sleep30-21swapper/307:35:003
39102082122,6sleep30-21swapper/307:21:323
38989442122,6sleep30-21swapper/307:15:023
270702122,6sleep30-21swapper/312:36:203
156852122,6sleep30-21swapper/312:26:173
4662113,5sleep30-21swapper/312:10:083
41849552112,5sleep30-21swapper/312:01:173
41744442112,6sleep30-21swapper/311:50:583
41645562112,6sleep30-21swapper/311:40:223
41645562112,6sleep30-21swapper/311:40:223
41448432112,5sleep30-21swapper/311:21:123
41356842112,5sleep30-21swapper/311:11:213
41255352112,5sleep30-21swapper/311:01:183
41154422112,5sleep30-21swapper/310:51:193
41111552111,6sleep30-21swapper/310:46:213
41053212112,5sleep30-21swapper/310:41:163
40800102110,7sleep30-21swapper/310:16:113
40550182112,5sleep30-21swapper/309:51:123
40497692112,5sleep30-21swapper/309:45:023
40302292112,6sleep30-21swapper/309:25:483
40212832112,5sleep30-21swapper/309:16:203
40060682112,6sleep30-21swapper/309:01:203
40003942112,5sleep30-21swapper/308:55:023
39956492112,6sleep30-21swapper/308:50:523
39911672112,5sleep30-21swapper/308:46:193
39858392112,5sleep30-21swapper/308:41:133
39658032112,5sleep30-21swapper/308:21:153
39561692112,6sleep30-21swapper/308:11:203
39477132112,5sleep30-21swapper/308:01:253
39260092112,5sleep30-21swapper/307:41:143
39209152112,6sleep30-21swapper/307:35:153
39108972112,5sleep30-21swapper/307:26:133
39108972112,5sleep30-21swapper/307:26:133
136442112,5sleep30-21swapper/312:21:243
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional