You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-22 - 00:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Tue Apr 21, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28789582850,3sleep20-21swapper/209:46:152
28163332650,2chrt451irq_work/308:41:193
2721688996454,8cyclictest3042110-21cp12:30:002
2721680996257,3cyclictest2788507-21kworker/u8:2+events_unbound08:20:010
2721680996255,5cyclictest2778440-21kworker/u8:1+events_unbound09:11:240
2721680996155,4cyclictest2837950-21kworker/u8:0+events_unbound09:21:240
2721680996055,3cyclictest2721400-21kworker/u8:3+events_unbound07:15:060
2721680995750,5cyclictest2932558-21kworker/u8:3+events_unbound11:11:270
2721680995750,5cyclictest2778440-21kworker/u8:1+flush-8:009:26:250
2721680995649,5cyclictest3017342-21kworker/u8:1+events_unbound12:26:240
2721682995543,9cyclictest280-21systemd-journal07:36:111
2721680995450,3cyclictest2778440-21kworker/u8:1+flush-8:008:46:260
2721680995449,3cyclictest2932558-21kworker/u8:3+events_unbound10:41:300
2721680995448,4cyclictest2978024-21kworker/u8:2+flush-8:011:26:270
2721680995444,4cyclictest2669179-21kworker/u8:0+events_unbound08:11:240
2721680995344,7cyclictest3047068-21latency_hist12:35:010
2721680995248,3cyclictest3027255-21kworker/u8:3+events_unbound12:20:010
2721680995246,4cyclictest2778440-21kworker/u8:1+events_unbound08:56:100
2721680995241,8cyclictest2747535-21ntpq07:31:200
2721680995147,3cyclictest2837950-21kworker/u8:0+flush-8:010:31:270
2721680995146,4cyclictest2837950-21kworker/u8:0+events_unbound10:01:120
2721680995146,4cyclictest2669179-21kworker/u8:0+flush-8:007:26:250
2721680995146,3cyclictest2987146-21kworker/u8:0+events_unbound11:56:120
2721680995146,3cyclictest2778440-21kworker/u8:1+events_unbound09:56:200
2721680995145,4cyclictest2902872-21kworker/u8:2+events_unbound10:46:160
2721680995135,11cyclictest2778440-21kworker/u8:1+flush-8:009:46:070
2721682995038,9cyclictest280-21systemd-journal08:41:111
2721680995046,3cyclictest2778440-21kworker/u8:1+flush-8:011:46:110
2721680995046,3cyclictest2778440-21kworker/u8:1+flush-8:011:46:110
2721680995046,3cyclictest2748433-21kworker/u8:1+flush-8:007:46:280
2721680995045,4cyclictest2721400-21kworker/u8:3+flush-8:007:11:280
2721680995044,5cyclictest2669179-21kworker/u8:0+events_unbound07:36:200
2721680995043,5cyclictest2748433-21kworker/u8:1+events_unbound07:51:240
2721688994940,7cyclictest2962098-21cp11:10:002
2721680994945,3cyclictest2758418-21kworker/u8:3+flush-8:009:01:280
2721680994944,3cyclictest2778440-21kworker/u8:1+events_unbound08:41:130
2721680994943,4cyclictest2778440-21kworker/u8:1+events_unbound09:06:230
2721680994844,3cyclictest2778440-21kworker/u8:1+flush-8:009:36:250
2721680994842,4cyclictest2778440-21kworker/u8:1+flush-8:010:21:210
2721680994743,2cyclictest2837950-21kworker/u8:0+events_unbound09:51:240
2721680994740,5cyclictest2837950-21kworker/u8:0+events_unbound10:06:210
2721682994638,6cyclictest2669179-21kworker/u8:0+flush-8:007:26:261
2721680994642,3cyclictest2778440-21kworker/u8:1+events_unbound09:16:110
2721680994642,3cyclictest2758418-21kworker/u8:3+events_unbound08:06:250
2721680994640,3cyclictest2669179-21kworker/u8:0+events_unbound07:41:260
2721680994639,5cyclictest2788507-21kworker/u8:2+events_unbound08:21:120
2721680994541,3cyclictest2778440-21kworker/u8:1+flush-8:011:16:280
2721680994539,4cyclictest2917796-21apt-get10:26:080
2721680994440,3cyclictest3027255-21kworker/u8:3+events_unbound12:36:250
2721680994440,3cyclictest2778440-21kworker/u8:1+flush-8:009:41:130
272113924428,10sleep10-21swapper/107:07:161
2721682994338,4cyclictest2932558-21kworker/u8:3+flush-8:010:41:171
2721680994339,3cyclictest2758418-21kworker/u8:3+flush-8:008:31:240
2721680994339,3cyclictest2758418-21kworker/u8:3+flush-8:008:01:260
2721680994337,4cyclictest2932558-21kworker/u8:3+events_unbound11:21:210
2721682994233,6cyclictest2977100-21latency_hist11:25:011
2721680994238,3cyclictest3017342-21kworker/u8:1+events_unbound12:06:240
2721680994238,3cyclictest2902872-21kworker/u8:2+flush-8:010:56:130
2721680994237,3cyclictest2778440-21kworker/u8:1+events_unbound09:31:170
2721680994237,3cyclictest2758418-21kworker/u8:3+events_unbound08:36:280
2721680994137,3cyclictest2758418-21kworker/u8:3+events_unbound08:26:120
2721680994135,4cyclictest2932558-21kworker/u8:3+events_unbound12:01:190
2721680994135,4cyclictest2932558-21kworker/u8:3+events_unbound11:41:230
2721680994135,4cyclictest2932558-21kworker/u8:3+events_unbound11:41:230
2721680994135,4cyclictest2669179-21kworker/u8:0+events_unbound07:21:220
2721680994036,3cyclictest2902872-21kworker/u8:2+events_unbound10:36:130
2721680994035,4cyclictest2902872-21kworker/u8:2+events_unbound11:01:270
2721680994033,5cyclictest2837950-21kworker/u8:0+events_unbound10:11:080
2721682993929,8cyclictest2866725-21ntpq09:31:201
2721682993928,8cyclictest2927354-21latency_hist10:35:011
2721680993935,3cyclictest3006997-21kworker/u8:2+flush-8:012:11:260
2721680993935,3cyclictest2778440-21kworker/u8:1+flush-8:011:51:230
2721680993935,3cyclictest2758418-21kworker/u8:3+events_unbound08:51:210
2721680993935,3cyclictest2758418-21kworker/u8:3+events_unbound08:51:210
2721680993933,4cyclictest2837950-21kworker/u8:0+events_unbound10:16:090
2721680993929,7cyclictest2961151-21ntpq11:06:210
27167672393,6sleep00-21swapper/007:05:420
2721680993834,3cyclictest2902872-21kworker/u8:2+events_unbound10:51:160
2721682993729,6cyclictest3006977-21latency_hist11:54:591
2721680993732,3cyclictest2758418-21kworker/u8:3+events_unbound07:56:150
2721680993730,5cyclictest3027255-21kworker/u8:3+events_unbound12:21:080
2721680993632,3cyclictest2778440-21kworker/u8:1+flush-8:011:36:120
2721682993526,7cyclictest2982612-21/usr/sbin/munin11:31:211
2721682993429,3cyclictest2728848-21kworker/u8:2+flush-8:007:20:011
2721682993426,6cyclictest2793595-21apt-get08:21:081
2721682993426,5cyclictest280-21systemd-journal10:48:111
2721680993430,2cyclictest2978024-21kworker/u8:2+events_unbound11:31:170
2721688993327,4cyclictest2977377-21gpgv11:25:012
2721682993328,3cyclictest2917464-21idleruntime-cro10:25:001
2721682993327,4cyclictest2967529-21apt-get11:16:081
2721682993327,4cyclictest280-21systemd-journal09:53:111
2721682993327,4cyclictest280-21systemd-journal09:24:121
2721682993326,5cyclictest280-21systemd-journal08:04:101
2721688993226,4cyclictest2936957-21unixbench_singl10:41:312
2721682993225,5cyclictest280-21systemd-journal12:16:111
2721682993223,6cyclictest280-21systemd-journal07:10:031
2721688993121,8cyclictest280-21systemd-journal08:35:002
2721688993021,6cyclictest2942334-21latency_hist10:50:012
2721682993026,3cyclictest2748433-21kworker/u8:1+flush-8:007:51:131
2721682993026,2cyclictest2902872-21kworker/u8:2+events_unbound10:26:171
2721682993026,2cyclictest2803677-21cpuspeed_turbos08:31:121
2721682993025,3cyclictest2872163-21unixbench_multi09:36:261
272168899299,11cyclictest0-21swapper/209:31:142
2721682992922,5cyclictest2848150-21apt-get09:16:071
2721682992921,6cyclictest280-21systemd-journal12:00:011
2721682992919,7cyclictest2738521-21latency_hist07:25:011
2721688992823,4cyclictest2852761-21idleruntime-cro09:20:012
2721688992823,3cyclictest2738185-21unixbench_singl07:21:292
2721688992822,4cyclictest2768288-21gpgv07:55:002
2721682992824,3cyclictest2813040-21systemd-run08:40:001
2721682992824,2cyclictest2843572-21irqcore09:11:151
2721682992824,2cyclictest0-21swapper/112:25:001
2721682992823,3cyclictest2991282-21needreboot11:36:191
2721682992823,3cyclictest2762955-21unixbench_multi07:46:301
2721682992822,4cyclictest2838044-21apt-get09:06:081
2721682992818,8cyclictest280-21systemd-journal11:26:111
29358742270,6sleep3451irq_work/310:41:213
2721688992723,2cyclictest2908220-21fschecks_time10:16:122
2721688992723,2cyclictest2793252-21idleruntime-cro08:20:002
2721688992722,3cyclictest3047519-21aten2_r5power_v12:36:112
2721688992720,5cyclictest280-21systemd-journal11:57:112
2721682992723,2cyclictest0-21swapper/112:40:001
272168899268,3cyclictest161rcu_preempt07:56:162
272168899263,4cyclictest0-21swapper/207:30:572
2721688992622,2cyclictest2912914-21aten2_r5power_c10:21:092
2721688992622,2cyclictest2843013-21aten2_r5power_c09:11:102
2721688992621,3cyclictest3022436-21aten2_r5power_c12:11:102
2721682992623,2cyclictest2877761-21systemd-run09:45:011
2721682992623,2cyclictest2783361-21cron08:10:001
2721682992622,3cyclictest2758418-21kworker/u8:3+flush-8:009:01:161
2721682992622,2cyclictest2947170-21cron10:55:001
2721682992622,2cyclictest2908139-21cpuspeed_turbos10:16:111
2721682992622,2cyclictest0-21swapper/112:05:011
2721682992622,2cyclictest0-21swapper/111:41:271
2721682992622,2cyclictest0-21swapper/111:41:271
2721682992620,4cyclictest2892439-21unixbench_singl09:56:281
272168899254,2cyclictest421rcuog/210:10:452
2721688992521,2cyclictest2928044-21fschecks_time10:36:132
2721688992521,2cyclictest2726346-21unixbench_singl07:11:292
2721688992520,3cyclictest2978024-21kworker/u8:2+flush-8:011:31:282
2721688992520,3cyclictest2917881-21aten2_r5power_p10:26:092
2721688992520,3cyclictest2853398-21fschecks_count09:21:132
272168899250,6cyclictest2867905-21apt-get09:36:082
2721682992520,4cyclictest2961640-21unixbench_multi11:06:281
2721682992519,4cyclictest2828154-21apt-get08:56:071
2721682992518,5cyclictest2748084-21grep07:31:281
272168899242,5cyclictest0-21swapper/209:56:172
2721688992421,2cyclictest3042564-21aten2_r5power_v12:31:122
2721688992420,3cyclictest3017798-21fschecks_time12:06:112
2721688992419,4cyclictest2946846-21unixbench_singl10:51:282
2721688992414,8cyclictest280-21systemd-journal08:10:002
2721682992420,3cyclictest2773548-21cat08:00:011
2721682992418,5cyclictest3017342-21kworker/u8:1+flush-8:012:06:211
2721682992418,5cyclictest2669179-21kworker/u8:0+flush-8:008:11:121
2721682992414,8cyclictest280-21systemd-journal08:16:121
29006652230,6sleep20-21swapper/210:06:172
2721688992320,2cyclictest371rcuc/211:40:202
2721688992320,2cyclictest371rcuc/211:40:202
2721688992320,2cyclictest2758396-21cron07:45:002
2721688992319,2cyclictest2922839-21aten2_r5power_p10:31:112
2721688992319,2cyclictest0-21swapper/209:55:002
2721682992319,2cyclictest0-21swapper/108:51:261
2721682992319,2cyclictest0-21swapper/108:51:261
2721682992319,2cyclictest0-21swapper/108:26:261
2721682992318,3cyclictest0-21swapper/112:30:011
27210692234,12sleep20-21swapper/207:06:282
28289352220,5sleep20-21swapper/208:56:152
272168899223,4cyclictest0-21swapper/208:11:132
272168899222,4cyclictest0-21swapper/208:21:262
2721688992219,2cyclictest2858388-21fschecks_time09:26:122
2721688992218,2cyclictest3012388-21aten2_r5power_p12:01:172
2721688992218,2cyclictest0-21swapper/207:15:022
2721688992217,3cyclictest3027310-21sshd12:16:052
2721688992216,4cyclictest2972137-21munin-run11:20:002
2721688992210,4cyclictest161rcu_preempt12:21:152
272168299229,4cyclictest0-21swapper/110:35:521
2721682992219,2cyclictest2903167-21cpuspeed_turbos10:11:101
2721682992218,2cyclictest0-21swapper/111:46:081
2721682992218,2cyclictest0-21swapper/111:46:081
2721682992218,2cyclictest0-21swapper/110:01:271
2721682992218,2cyclictest0-21swapper/108:46:171
2721682992217,3cyclictest2948240-21irqrtprio10:56:151
272168899217,3cyclictest161rcu_preempt08:26:082
272168899216,3cyclictest161rcu_preempt10:58:352
272168899212,9cyclictest0-21swapper/211:50:232
272168899212,4cyclictest0-21swapper/209:06:152
272168899211,5cyclictest39-21ksoftirqd/208:36:192
272168299218,5cyclictest0-21swapper/107:40:521
2721682992117,2cyclictest0-21swapper/112:31:211
2721682992117,2cyclictest0-21swapper/112:11:171
2721682992117,2cyclictest0-21swapper/110:06:171
2721682992115,4cyclictest2778440-21kworker/u8:1+events_unbound09:46:191
2721682992115,4cyclictest0-21swapper/109:26:251
2721682992111,8cyclictest2956278-21ntpq11:01:241
271672722110,6sleep30-21swapper/307:05:133
272168899205,2cyclictest161rcu_preempt07:46:292
272168899204,5cyclictest0-21swapper/211:26:282
272168899204,5cyclictest0-21swapper/210:01:262
272168899202,4cyclictest0-21swapper/211:15:002
2721688992017,2cyclictest371rcuc/209:00:012
2721688992017,2cyclictest371rcuc/208:04:512
2721688992017,2cyclictest371rcuc/207:25:512
2721688992011,4cyclictest2987594-21apt-get11:36:082
272168899200,5cyclictest2749494-21cut07:36:152
2721682992016,2cyclictest0-21swapper/111:11:121
272168899195,3cyclictest161rcu_preempt11:05:002
272168899192,12cyclictest2997481-21apt-get11:46:082
272168899192,12cyclictest2997481-21apt-get11:46:082
272168899192,12cyclictest2873117-21apt-get09:41:082
272168899192,12cyclictest2823219-21apt-get08:51:082
272168899192,12cyclictest2823219-21apt-get08:51:082
272168899192,12cyclictest2813356-21apt-get08:41:092
2721688991916,2cyclictest371rcuc/208:45:082
29025962165,7sleep30-21swapper/310:10:003
27951872167,5sleep30-21swapper/308:21:183
30160082143,7sleep30-21swapper/312:01:283
28867392144,6sleep30-21swapper/309:51:223
30320092132,6sleep30-21swapper/312:20:023
30261802132,7sleep30-21swapper/312:11:233
30073202132,7sleep30-21swapper/311:56:093
30020542132,7sleep30-21swapper/311:50:003
30020542132,7sleep30-21swapper/311:49:593
28577252133,6sleep30-21swapper/309:25:023
28508902130,3sleep375-21kworker/3:1+events09:16:183
27585272132,6sleep30-21swapper/307:45:023
27336092132,6sleep30-21swapper/307:20:023
30406332122,6sleep30-21swapper/312:26:203
29875552122,6sleep30-21swapper/311:36:003
29830102122,6sleep30-21swapper/311:31:143
29659932122,6sleep30-21swapper/311:11:203
29613302123,5sleep30-21swapper/311:06:263
29513102123,5sleep30-21swapper/310:56:233
29227592122,6sleep30-21swapper/310:31:113
29221242122,6sleep30-21swapper/310:26:303
29131222122,6sleep30-21swapper/310:21:123
29076702122,6sleep30-21swapper/310:15:023
29028452122,6sleep30-21swapper/310:10:113
28880482122,6sleep30-21swapper/309:55:123
28706722122,6sleep30-21swapper/309:36:183
28639122122,6sleep30-21swapper/309:31:163
28571492122,6sleep30-21swapper/309:21:293
28467292122,6sleep30-21swapper/309:11:223
28381682122,6sleep30-21swapper/309:06:113
28331132122,6sleep30-21swapper/309:01:103
28238792122,6sleep30-21swapper/308:51:153
28238792122,6sleep30-21swapper/308:51:153
28225402122,6sleep30-21swapper/308:46:303
28092642122,6sleep30-21swapper/308:36:183
28029492122,6sleep30-21swapper/308:28:123
27742992122,6sleep30-21swapper/308:01:153
27699842122,6sleep30-21swapper/307:56:183
27522822123,5sleep30-21swapper/307:36:193
30474122112,5sleep30-21swapper/312:36:113
30426902112,5sleep30-21swapper/312:31:133
30275952112,5sleep30-21swapper/312:16:133
30175112112,5sleep30-21swapper/312:06:093
30023502112,5sleep30-21swapper/311:50:493
29934342112,6sleep30-21swapper/311:41:173
29934342112,6sleep30-21swapper/311:41:173
29724922112,5sleep30-21swapper/311:21:113
29672102112,5sleep30-21swapper/311:15:013
29422382112,5sleep30-21swapper/310:50:013
29380192112,5sleep30-21swapper/310:46:163
29279342112,5sleep30-21swapper/310:36:133
28933782112,5sleep30-21swapper/310:01:143
28784172112,5sleep30-21swapper/309:46:133
28732032112,5sleep30-21swapper/309:41:113
28280542112,5sleep30-21swapper/308:55:123
28034152112,5sleep30-21swapper/308:31:093
27888632112,5sleep30-21swapper/308:16:123
27835892112,5sleep30-21swapper/308:10:023
27786662112,5sleep30-21swapper/308:05:243
27670642112,5sleep30-21swapper/307:51:203
27536672112,6sleep30-21swapper/307:40:213
27441672112,5sleep30-21swapper/307:31:143
27388142112,5sleep30-21swapper/307:25:563
27288352112,5sleep30-21swapper/307:15:083
27220422111,6sleep30-21swapper/307:11:113
29775662102,5sleep30-21swapper/311:25:043
29523832102,5sleep30-21swapper/311:00:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional