You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-16 - 05:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Mon Mar 16, 2026 00:44:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3124645995448,4cyclictest3160813-21kworker/u8:3+events_unbound21:16:040
3124645995418,8cyclictest131rcu_preempt22:15:110
3124654995142,5cyclictest3232545-21apt-config00:20:002
3124654995142,5cyclictest3232545-21apt-config00:20:002
3124645994938,7cyclictest3197192-21grep22:35:230
3124650994741,4cyclictest3209446-21kworker/u8:3+events_unbound23:26:311
3124659994637,5cyclictest3236052-21cut00:30:003
3124654994638,5cyclictest3135409-21munin-plugin-st19:40:012
3124654994532,9cyclictest3207483-21grep23:05:262
3124650994535,6cyclictest3168398-21fschecks_count21:15:151
3124645994437,5cyclictest3230675-21kworker/u8:2+events_unbound00:23:420
3124645994436,6cyclictest3143942-21kworker/u8:1+events_unbound21:00:590
3124645994436,5cyclictest3211525-21sendmail23:20:000
3124645994436,5cyclictest3211525-21sendmail23:20:000
3124645994429,11cyclictest121ktimers/023:10:120
3124654994221,8cyclictest131rcu_preempt19:45:012
3124659994133,4cyclictest0-21swapper/320:35:013
3124650994030,6cyclictest0-21swapper/122:45:001
3124645994034,4cyclictest3171260-21kworker/u8:3+events_unbound21:36:140
3124645994031,6cyclictest3133241-21unixbench_multi19:30:250
3124645994029,5cyclictest3160813-21kworker/u8:3+events_unbound20:55:590
3124645994019,11cyclictest131rcu_preempt23:55:230
3124645994014,13cyclictest131rcu_preempt23:20:050
3124645993933,4cyclictest3200743-21kworker/u8:0+events_unbound23:41:350
3124645993929,4cyclictest3179665-21kworker/u8:0+events_unbound22:26:230
3124654993827,8cyclictest3174854-21auditctl21:35:002
3124650993827,6cyclictest0-21swapper/123:20:001
3124650993827,6cyclictest0-21swapper/123:19:591
3124645993832,4cyclictest3225299-21kworker/u8:3+events_unbound00:12:420
3124645993832,4cyclictest3225299-21kworker/u8:3+events_unbound00:12:420
3124645993828,6cyclictest0-21swapper/000:40:000
3124645993826,7cyclictest0-21swapper/019:10:260
3124645993822,5cyclictest131rcu_preempt21:30:250
312465499378,7cyclictest32-21ksoftirqd/223:35:252
3124654993727,7cyclictest3138373-21grep19:45:242
3124645993731,4cyclictest3133455-21kworker/u8:0+events_unbound19:40:440
3124645993724,4cyclictest131rcu_preempt00:15:170
3124645993724,4cyclictest131rcu_preempt00:15:170
3124645993712,12cyclictest0-21swapper/022:34:520
3124654993626,6cyclictest0-21swapper/220:00:272
3124654993620,6cyclictest131rcu_preempt21:02:532
3124650993629,3cyclictest0-21swapper/100:20:001
3124650993629,3cyclictest0-21swapper/100:20:001
3124650993626,6cyclictest0-21swapper/122:35:231
3124650993626,6cyclictest0-21swapper/120:55:241
3124650993623,8cyclictest0-21swapper/119:15:011
3124645993630,4cyclictest3213208-21kworker/u8:1+events_unbound23:31:340
3124645993630,4cyclictest3122472-21kworker/u8:3+events_unbound19:25:410
3124645993629,4cyclictest3183683-21latency_hist22:00:010
3124645993625,7cyclictest0-21swapper/019:25:010
3124654993527,4cyclictest0-21swapper/222:30:162
3124654993527,4cyclictest0-21swapper/220:40:242
3124654993525,6cyclictest3167616-21grep21:10:252
3124650993525,6cyclictest0-21swapper/123:00:251
312464599357,4cyclictest131rcu_preempt20:29:410
3124645993529,4cyclictest3156006-21kworker/u8:2+events_unbound20:44:410
3124645993525,6cyclictest0-21swapper/021:20:240
3124645993523,7cyclictest0-21swapper/022:05:240
3124645993519,4cyclictest131rcu_preempt20:23:440
3124645993515,11cyclictest131rcu_preempt20:50:370
3124659993426,4cyclictest0-21swapper/300:20:253
3124659993425,5cyclictest0-21swapper/323:40:163
3124659993423,6cyclictest3138386-21head19:45:253
3124654993426,4cyclictest0-21swapper/222:00:162
3124654993424,6cyclictest0-21swapper/220:10:002
3124654993410,6cyclictest301rcuc/222:55:252
3124650993420,6cyclictest3154282-21kworker/u8:0+events_unbound20:49:101
3124650993418,4cyclictest131rcu_preempt23:42:231
3124645993425,6cyclictest0-21swapper/019:45:250
3124645993419,5cyclictest131rcu_preempt21:45:160
3124645993417,4cyclictest131rcu_preempt23:28:580
3124645993416,5cyclictest131rcu_preempt23:00:180
3124645993415,4cyclictest0-21swapper/019:50:400
3124645993415,10cyclictest131rcu_preempt21:08:040
3124645993414,10cyclictest0-21swapper/023:35:180
3124645993413,5cyclictest131rcu_preempt00:00:260
3124645993412,4cyclictest131rcu_preempt20:00:220
3124659993325,4cyclictest0-21swapper/300:20:003
3124659993325,4cyclictest0-21swapper/300:19:593
312465499338,6cyclictest0-21swapper/223:10:122
3124654993325,4cyclictest0-21swapper/219:55:012
3124654993324,6cyclictest3141988-21unixbench_multi19:55:252
3124654993323,7cyclictest3126419-21latency_hist19:15:012
3124654993323,6cyclictest0-21swapper/220:55:232
3124654993322,8cyclictest3183389-21idleruntime-cro22:00:002
3124654993315,5cyclictest3149512-21apt-get20:20:122
3124650993325,4cyclictest0-21swapper/123:05:261
3124650993325,4cyclictest0-21swapper/120:35:521
3124650993325,4cyclictest0-21swapper/119:25:391
3124650993323,6cyclictest0-21swapper/119:35:261
3124650993323,6cyclictest0-21swapper/100:25:241
3124650993320,9cyclictest3154029-21sshd20:30:521
3124650993311,10cyclictest24-21ksoftirqd/119:50:161
3124645993327,3cyclictest0-21swapper/023:10:000
3124645993325,6cyclictest3195256-21kworker/u8:2+events_unbound22:41:250
3124645993315,9cyclictest131rcu_preempt20:35:170
3124645993313,4cyclictest0-21swapper/020:46:520
3124659993224,4cyclictest0-21swapper/322:46:253
3124659993221,7cyclictest3188917-21cron22:15:013
3124659993221,7cyclictest3172704-21grep21:25:253
312465499328,5cyclictest32-21ksoftirqd/221:05:242
312465499324,7cyclictest32-21ksoftirqd/219:30:012
3124650993225,4cyclictest3142451-21sendmail20:00:001
3124650993220,7cyclictest0-21swapper/122:20:261
3124650993220,7cyclictest0-21swapper/121:25:251
3124645993221,5cyclictest131rcu_preempt22:05:010
3124645993220,8cyclictest121ktimers/023:45:160
3124645993220,8cyclictest121ktimers/020:15:170
3124645993216,12cyclictest0-21swapper/021:40:130
3124645993215,11cyclictest11-21ksoftirqd/021:50:450
3124645993213,11cyclictest131rcu_preempt22:50:010
3124645993212,3cyclictest131rcu_preempt19:15:200
3124659993123,4cyclictest0-21swapper/320:10:003
3124659993123,4cyclictest0-21swapper/300:35:263
312465499319,7cyclictest3211588-21dpkg23:20:002
312465499319,7cyclictest3211588-21dpkg23:20:002
312465499317,4cyclictest32-21ksoftirqd/219:20:232
3124654993123,3cyclictest0-21swapper/222:05:262
3124654993121,4cyclictest131rcu_preempt20:16:432
3124654993116,4cyclictest131rcu_preempt21:40:182
3124654993114,10cyclictest131rcu_preempt21:20:142
3124650993125,4cyclictest3185741-21kworker/u8:3+events_unbound22:46:261
3124650993124,4cyclictest0-21swapper/121:50:261
3124650993122,6cyclictest0-21swapper/123:45:261
3124650993121,6cyclictest0-21swapper/123:50:251
3124650993121,6cyclictest0-21swapper/120:45:011
312464599318,6cyclictest131rcu_preempt21:25:170
3124645993117,7cyclictest131rcu_preempt22:20:190
3124645993110,9cyclictest131rcu_preempt22:51:440
3124659993023,4cyclictest3150977-21cron20:24:593
3124659993022,4cyclictest0-21swapper/323:15:253
3124659993022,4cyclictest0-21swapper/323:15:253
312465499309,5cyclictest32-21ksoftirqd/222:35:182
312465499308,4cyclictest301rcuc/222:40:152
312465499306,6cyclictest32-21ksoftirqd/221:15:232
312465499306,5cyclictest32-21ksoftirqd/220:45:192
312465499306,5cyclictest32-21ksoftirqd/220:30:012
312465499306,5cyclictest301rcuc/223:55:192
312465499306,4cyclictest32-21ksoftirqd/221:45:262
312465499305,6cyclictest32-21ksoftirqd/222:25:012
312465499305,6cyclictest32-21ksoftirqd/200:10:212
312465499305,6cyclictest32-21ksoftirqd/200:10:212
3124654993023,4cyclictest0-21swapper/220:50:162
3124654993020,7cyclictest3147090-21grep20:10:262
3124654993020,7cyclictest3147090-21grep20:10:262
3124654993020,7cyclictest0-21swapper/200:35:272
312465499300,10cyclictest3193580-21cat22:25:242
3124650993022,5cyclictest0-21swapper/122:35:011
3124650993022,5cyclictest0-21swapper/120:10:261
3124650993022,5cyclictest0-21swapper/120:10:261
3124650993022,5cyclictest0-21swapper/120:05:001
3124650993022,4cyclictest0-21swapper/121:10:011
3124650993020,6cyclictest0-21swapper/122:30:001
3124650993019,5cyclictest3200743-21kworker/u8:0+events_unbound23:35:011
3124650993014,5cyclictest3173104-21kworker/u8:0+events_unbound21:31:301
312464599309,12cyclictest11-21ksoftirqd/022:55:250
3124645993019,6cyclictest0-21swapper/022:10:250
3124645993018,5cyclictest131rcu_preempt23:55:010
3124645993017,5cyclictest131rcu_preempt20:30:520
3124645993015,4cyclictest0-21swapper/000:09:300
3124645993014,3cyclictest131rcu_preempt00:32:410
3124645993013,4cyclictest131rcu_preempt00:25:130
3124645993011,4cyclictest131rcu_preempt19:37:380
3124659992922,3cyclictest0-21swapper/320:55:243
3124659992921,4cyclictest0-21swapper/323:50:203
312465499297,8cyclictest3154855-21basename20:35:172
312465499297,6cyclictest32-21ksoftirqd/222:45:162
312465499296,7cyclictest0-21swapper/223:25:242
312465499296,6cyclictest32-21ksoftirqd/200:30:002
312465499295,6cyclictest32-21ksoftirqd/222:10:162
312465499295,5cyclictest32-21ksoftirqd/223:40:232
312465499294,7cyclictest32-21ksoftirqd/221:35:132
312465499293,7cyclictest32-21ksoftirqd/200:20:252
3124654992920,4cyclictest0-21swapper/220:30:522
3124650992923,4cyclictest3167695-21kworker/u8:1+events_unbound22:16:221
3124650992922,3cyclictest3183380-21kthreadd22:00:001
3124650992921,4cyclictest0-21swapper/123:40:011
3124650992918,7cyclictest0-21swapper/120:50:261
3124650992917,5cyclictest3140955-21kworker/u8:0+events_unbound20:16:351
3124650992915,5cyclictest3228888-21kworker/u8:0+events_unbound00:09:351
312464599299,12cyclictest11-21ksoftirqd/021:15:010
3124645992913,4cyclictest131rcu_preempt20:05:170
3124645992911,10cyclictest131rcu_preempt20:10:220
3124645992911,10cyclictest131rcu_preempt20:10:220
3124659992822,3cyclictest40-21ksoftirqd/323:10:123
3124659992820,4cyclictest3166327-21audit_send_reply21:10:013
3124659992820,4cyclictest0-21swapper/321:20:243
3124659992820,4cyclictest0-21swapper/319:15:023
3124659992820,4cyclictest0-21swapper/300:30:283
312465499286,6cyclictest32-21ksoftirqd/222:50:202
312465499284,6cyclictest32-21ksoftirqd/200:05:172
312465499283,6cyclictest32-21ksoftirqd/221:30:012
3124654992819,6cyclictest0-21swapper/223:30:262
3124654992818,5cyclictest3190630-21munin-plugin-st22:20:002
3124654992818,5cyclictest0-21swapper/223:20:252
312465099286,6cyclictest3230675-21kworker/u8:2+events_unbound00:15:001
312465099282,4cyclictest131rcu_preempt23:20:121
3124650992822,4cyclictest3223532-21kworker/u8:1+events_unbound00:20:321
3124650992822,3cyclictest0-21swapper/123:15:001
3124650992821,4cyclictest0-21swapper/120:25:261
3124650992820,5cyclictest0-21swapper/122:05:261
3124650992820,5cyclictest0-21swapper/100:00:171
3124650992817,7cyclictest0-21swapper/121:40:251
3124650992816,6cyclictest3169415-21kworker/u8:0+events_unbound21:20:241
3124650992814,7cyclictest131rcu_preempt23:55:201
3124645992812,3cyclictest131rcu_preempt19:55:160
3124659992721,3cyclictest0-21swapper/323:59:593
3124659992720,4cyclictest0-21swapper/321:00:233
3124659992719,4cyclictest0-21swapper/322:50:263
3124659992719,4cyclictest0-21swapper/322:30:293
3124659992719,4cyclictest0-21swapper/322:20:263
3124659992718,6cyclictest0-21swapper/320:20:003
3124659992715,8cyclictest0-21swapper/319:40:163
312465499274,4cyclictest3126872-21open_files19:15:032
312465499273,6cyclictest32-21ksoftirqd/200:00:282
312465099279,9cyclictest131rcu_preempt21:35:161
312465099278,3cyclictest131rcu_preempt22:10:231
312465099276,3cyclictest131rcu_preempt21:45:241
3124650992720,5cyclictest3223532-21kworker/u8:1+events_unbound00:38:151
3124650992718,6cyclictest3185342-21latency_hist22:05:011
3124650992717,7cyclictest0-21swapper/120:05:251
3124650992717,4cyclictest3185741-21kworker/u8:3+events_unbound22:56:271
3124650992714,5cyclictest3113072-21kworker/u8:1+events_unbound19:43:541
3124659992620,4cyclictest3135176-21kworker/u8:2+events_unbound19:50:453
3124659992620,4cyclictest3122472-21kworker/u8:3+events_unbound19:15:403
3124659992618,4cyclictest0-21swapper/320:00:013
3124659992617,6cyclictest3183394-21tr22:00:003
312465499264,7cyclictest32-21ksoftirqd/223:00:132
312465499264,7cyclictest32-21ksoftirqd/200:35:002
312465499264,5cyclictest32-21ksoftirqd/223:45:212
312465099268,11cyclictest24-21ksoftirqd/120:20:241
3124659992519,3cyclictest0-21swapper/319:40:013
3124659992519,3cyclictest0-21swapper/319:20:243
3124659992518,3cyclictest0-21swapper/322:35:133
3124659992517,5cyclictest0-21swapper/320:50:263
312465499259,8cyclictest131rcu_preempt23:50:022
312465499253,5cyclictest32-21ksoftirqd/221:50:142
3124650992517,4cyclictest0-21swapper/119:20:241
3124650992511,8cyclictest131rcu_preempt21:10:241
3124650992510,9cyclictest131rcu_preempt00:10:211
312465099250,17cyclictest3138421-21unixbench_singl19:45:251
3124659992418,3cyclictest0-21swapper/322:00:173
3124659992417,4cyclictest3169742-21idleruntime-cro21:20:003
3124659992417,4cyclictest0-21swapper/319:25:263
3124659992417,3cyclictest0-21swapper/319:30:413
3124659992415,6cyclictest3213861-21tune2fs23:25:143
3124659992415,6cyclictest0-21swapper/320:30:013
3124659992414,7cyclictest3228104-21ntp_states00:05:213
3124650992410,4cyclictest131rcu_preempt19:15:031
3124650992410,11cyclictest0-21swapper/100:30:121
3124659992317,3cyclictest0-21swapper/323:35:133
3124659992316,4cyclictest438-21cron00:15:003
3124659992316,4cyclictest438-21cron00:15:003
3124659992315,5cyclictest0-21swapper/320:10:273
3124659992315,5cyclictest0-21swapper/320:10:273
3124659992314,6cyclictest0-21swapper/321:10:183
312465099239,8cyclictest131rcu_preempt19:30:151
3124659992217,2cyclictest0-21swapper/322:55:163
3124659992215,4cyclictest0-21swapper/323:20:153
3124659992215,4cyclictest0-21swapper/320:40:123
3124659992214,6cyclictest0-21swapper/300:05:003
3124659992115,3cyclictest0-21swapper/323:05:223
3124659992115,3cyclictest0-21swapper/320:00:193
3124659992114,3cyclictest0-21swapper/321:40:153
3124659992113,5cyclictest0-21swapper/322:20:013
3124659992111,6cyclictest3156086-21cron20:40:013
3124659992015,3cyclictest0-21swapper/322:25:183
3124659992014,3cyclictest0-21swapper/322:45:013
3124659992014,3cyclictest0-21swapper/322:05:253
3124659992014,3cyclictest0-21swapper/321:45:103
3124659992011,6cyclictest3215979-21/usr/sbin/munin23:30:223
312465999190,4cyclictest3180355-21fschecks_count21:50:163
3124659991811,5cyclictest391ktimers/323:45:143
3124659991811,5cyclictest391ktimers/321:30:113
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional