You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-09 - 09:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Tue Jun 09, 2026 00:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2907133995441,9cyclictest2921508-21grep19:45:262
2907124995445,5cyclictest53-21kcompactd020:45:260
2907129994839,5cyclictest2925312-21cron20:00:001
2907133994741,4cyclictest2940538-21kworker/u8:0+events_unbound20:47:262
2907133994736,5cyclictest2945798-21kworker/u8:1+events_unbound21:02:292
2907129994738,7cyclictest231ktimers/100:10:111
2907124994537,5cyclictest2973521-21auditctl22:20:010
2907133994431,9cyclictest2989094-21grep23:00:262
2907129994438,4cyclictest2996303-21kworker/u8:1+events_unbound23:23:061
2907129994432,8cyclictest2966239-21unixbench_multi21:55:231
2907133994328,11cyclictest311ktimers/222:05:112
2907129994334,6cyclictest2971352-21grep22:10:251
2907137994237,3cyclictest3015533-21latency_hist00:20:003
2907133994229,5cyclictest2910886-21kworker/u8:1+events_unbound19:37:122
2907133994229,5cyclictest2910886-21kworker/u8:1+events_unbound19:37:122
2907133994228,9cyclictest3016760-21grep00:20:242
2907129994217,6cyclictest131rcu_preempt21:40:121
2907137994134,4cyclictest2999969-21munin-plugin-st23:35:003
2907137994126,11cyclictest391ktimers/320:55:113
2907133994133,5cyclictest2927045-21idleruntime-cro20:05:012
2907129994133,4cyclictest2959875-21latency_hist21:40:011
2907133994029,7cyclictest3015099-21grep00:15:262
2907129994025,11cyclictest231ktimers/119:30:131
2907133993926,10cyclictest2909033-21munin-node19:15:012
2907133993921,5cyclictest131rcu_preempt22:05:022
2907129993931,5cyclictest2976903-21kworker/u8:3+events_unbound22:42:591
2907124993931,4cyclictest2933857-21cron20:25:010
2907137993831,4cyclictest2911669-21sshd19:20:153
2907137993828,6cyclictest0-21swapper/321:25:023
2907133993832,4cyclictest2959834-21kworker/u8:2+events_unbound21:42:382
2907133993827,7cyclictest2990772-21grep23:05:262
2907137993729,4cyclictest0-21swapper/321:07:293
2907133993730,5cyclictest2959834-21kworker/u8:2+events_unbound21:57:432
2907133993721,5cyclictest131rcu_preempt22:35:142
2907133993718,5cyclictest645-21runrttasks00:14:092
2907133993717,11cyclictest131rcu_preempt21:30:242
2907124993729,4cyclictest0-21swapper/019:40:010
2907124993729,4cyclictest0-21swapper/019:40:000
2907137993630,3cyclictest0-21swapper/323:05:003
2907137993626,7cyclictest391ktimers/322:10:113
2907137993625,6cyclictest0-21swapper/319:10:273
2907133993625,7cyclictest0-21swapper/220:15:252
2907133993616,12cyclictest131rcu_preempt19:56:272
2907129993629,4cyclictest2953050-21latency_hist21:20:001
2907124993629,4cyclictest0-21swapper/023:10:000
2907124993628,4cyclictest0-21swapper/021:05:000
2907133993527,4cyclictest0-21swapper/222:20:162
2907133993523,9cyclictest2907117-21cyclictest23:15:092
2907133993523,7cyclictest3008220-21grep23:55:252
2907133993523,7cyclictest3008220-21grep23:55:252
2907133993523,7cyclictest0-21swapper/222:30:252
2907133993520,4cyclictest131rcu_preempt22:49:352
2907129993525,5cyclictest0-21swapper/100:15:271
2907137993425,6cyclictest0-21swapper/321:55:023
2907137993424,6cyclictest0-21swapper/319:35:003
2907137993423,7cyclictest391ktimers/300:30:113
2907137993423,7cyclictest391ktimers/300:30:113
2907133993425,5cyclictest0-21swapper/223:30:012
2907133993425,4cyclictest0-21swapper/221:30:022
2907133993423,5cyclictest0-21swapper/223:50:252
2907133993422,7cyclictest0-21swapper/220:55:262
2907133993422,3cyclictest131rcu_preempt20:14:552
2907133993420,3cyclictest131rcu_preempt22:54:152
2907133993418,5cyclictest131rcu_preempt00:07:372
2907133993417,5cyclictest131rcu_preempt23:40:112
2907133993414,3cyclictest0-21swapper/223:49:102
2907129993427,4cyclictest0-21swapper/100:30:151
2907129993427,4cyclictest0-21swapper/100:30:151
2907129993425,6cyclictest2979435-21fschecks_count22:35:151
2907137993326,5cyclictest2968167-21kworker/u8:0+events_unbound22:16:413
2907137993326,4cyclictest0-21swapper/321:30:163
290713399339,11cyclictest32-21ksoftirqd/223:15:012
2907133993327,4cyclictest2910886-21kworker/u8:1+events_unbound19:42:152
2907133993326,5cyclictest2935239-21kworker/u8:3+events_unbound20:42:252
2907133993325,4cyclictest0-21swapper/221:10:152
2907133993322,7cyclictest2986865-21ntpq22:55:212
2907133993322,4cyclictest2976706-21kworker/u8:0+events_unbound22:27:572
2907133993320,5cyclictest131rcu_preempt22:20:012
2907133993317,4cyclictest0-21swapper/223:24:002
2907133993313,9cyclictest131rcu_preempt20:32:362
2907133993313,3cyclictest131rcu_preempt19:54:102
2907129993326,5cyclictest2998028-21kworker/u8:0+events_unbound23:34:421
2907129993325,4cyclictest0-21swapper/119:50:161
2907124993325,5cyclictest2994408-21unixbench_singl23:15:230
2907137993226,3cyclictest0-21swapper/322:20:273
2907137993225,4cyclictest0-21swapper/322:45:163
2907137993225,4cyclictest0-21swapper/320:50:263
2907137993224,4cyclictest0-21swapper/321:25:243
2907137993221,7cyclictest0-21swapper/323:23:053
2907133993226,4cyclictest2944093-21kworker/u8:3+events_unbound21:07:292
2907133993225,5cyclictest2953002-21kworker/u8:1+events_unbound21:24:402
2907133993225,4cyclictest0-21swapper/221:15:152
2907133993223,4cyclictest0-21swapper/219:15:272
2907133993220,5cyclictest131rcu_preempt20:35:462
2907133993219,5cyclictest131rcu_preempt22:40:142
2907133993215,4cyclictest131rcu_preempt20:53:292
2907129993224,4cyclictest0-21swapper/120:35:261
2907129993222,6cyclictest0-21swapper/120:27:211
2907129993222,6cyclictest0-21swapper/120:00:241
2907129993218,10cyclictest231ktimers/100:20:121
2907129993217,6cyclictest2996303-21kworker/u8:1+events_unbound23:25:161
2907137993123,5cyclictest2998265-21cut23:30:003
2907137993121,6cyclictest0-21swapper/320:35:253
290713799311,16cyclictest0-21swapper/321:40:123
290713399319,10cyclictest32-21ksoftirqd/200:00:152
2907133993119,3cyclictest131rcu_preempt20:07:462
290713399311,16cyclictest32-21ksoftirqd/219:25:132
2907133993111,12cyclictest131rcu_preempt19:20:242
2907129993123,5cyclictest3008228-21unixbench_multi23:55:261
2907129993123,5cyclictest3008228-21unixbench_multi23:55:261
2907124993121,6cyclictest0-21swapper/022:37:570
2907137993024,3cyclictest0-21swapper/300:20:243
2907137993017,9cyclictest391ktimers/320:05:143
2907133993022,4cyclictest0-21swapper/219:30:162
2907133993017,3cyclictest131rcu_preempt00:27:262
2907133993015,4cyclictest131rcu_preempt20:26:332
2907133993011,3cyclictest131rcu_preempt00:30:312
2907133993011,3cyclictest131rcu_preempt00:30:312
2907133993011,11cyclictest131rcu_preempt21:53:162
2907133993010,13cyclictest32-21ksoftirqd/223:35:132
2907129993022,4cyclictest0-21swapper/123:00:151
2907129993022,4cyclictest0-21swapper/120:20:141
2907129993022,4cyclictest0-21swapper/120:20:011
2907129993022,4cyclictest0-21swapper/119:45:271
2907129993022,4cyclictest0-21swapper/119:40:001
2907129993022,4cyclictest0-21swapper/119:40:001
2907129993021,6cyclictest0-21swapper/119:20:011
2907129993019,8cyclictest2930437-21sh20:15:011
2907124993024,4cyclictest2965752-21ntp_kernel_err21:55:180
2907124993023,4cyclictest0-21swapper/023:45:250
2907124993023,4cyclictest0-21swapper/023:40:260
2907124993021,4cyclictest0-21swapper/019:32:120
2907124993017,8cyclictest7077-21packagekitd20:35:030
290712499300,27cyclictest0-21swapper/023:20:110
290713799299,10cyclictest40-21ksoftirqd/322:40:243
290713799297,3cyclictest0-21swapper/320:25:123
2907137992923,3cyclictest0-21swapper/300:00:253
2907137992921,5cyclictest0-21swapper/319:55:293
2907137992921,5cyclictest0-21swapper/319:45:013
2907137992920,6cyclictest0-21swapper/323:50:143
290713399299,10cyclictest32-21ksoftirqd/222:15:012
290713399299,10cyclictest0-21swapper/220:21:312
2907133992917,4cyclictest131rcu_preempt00:35:122
290713399290,16cyclictest0-21swapper/221:35:112
2907129992920,6cyclictest2947570-21kworker/u8:0+events_unbound21:05:011
2907129992920,4cyclictest0-21swapper/122:05:141
2907124992918,8cyclictest204-21dbus-daemon23:13:040
2907137992821,4cyclictest0-21swapper/321:35:253
2907137992821,4cyclictest0-21swapper/321:15:243
2907137992820,4cyclictest0-21swapper/320:45:263
2907133992822,4cyclictest2959834-21kworker/u8:2+events_unbound21:46:422
2907129992822,4cyclictest2986075-21kworker/u8:1+events_unbound22:58:021
2907129992821,5cyclictest2944093-21kworker/u8:3+events_unbound21:06:411
2907129992821,4cyclictest3022364-21sendmail00:39:591
2907129992819,6cyclictest0-21swapper/122:50:001
2907129992814,8cyclictest24-21ksoftirqd/119:20:161
2907129992811,11cyclictest24-21ksoftirqd/120:50:251
2907124992821,3cyclictest0-21swapper/020:30:000
2907124992821,3cyclictest0-21swapper/020:10:170
2907124992820,5cyclictest2964587-21head21:50:270
290712499281,3cyclictest0-21swapper/019:10:130
2907124992811,14cyclictest2918565-21cpu19:40:140
290713799272,3cyclictest131rcu_preempt23:45:123
2907137992721,4cyclictest3003371-21kworker/u8:0+events_unbound23:43:113
2907137992719,5cyclictest0-21swapper/321:00:243
2907137992718,7cyclictest2909338-21ntp_offset19:15:023
2907137992718,6cyclictest0-21swapper/300:35:133
2907137992717,6cyclictest0-21swapper/322:50:243
2907137992716,8cyclictest2965791-21seq21:55:203
2907137992713,11cyclictest40-21ksoftirqd/322:40:003
290712999275,12cyclictest131rcu_preempt21:32:351
2907129992722,3cyclictest2941066-21latency_hist20:45:021
2907129992719,3cyclictest0-21swapper/120:30:211
2907129992717,6cyclictest0-21swapper/122:05:001
2907129992717,6cyclictest0-21swapper/119:10:261
2907129992717,6cyclictest0-21swapper/100:25:161
2907137992620,3cyclictest0-21swapper/321:45:163
2907137992620,3cyclictest0-21swapper/320:10:263
2907137992616,7cyclictest2994848-21run-parts23:20:013
2907129992620,4cyclictest2944093-21kworker/u8:3+events_unbound21:12:091
2907129992618,4cyclictest0-21swapper/123:50:141
2907129992617,7cyclictest2996303-21kworker/u8:1+events_unbound23:35:331
2907129992617,5cyclictest0-21swapper/122:35:001
2907129992616,6cyclictest208-21systemd-logind23:48:111
2907129992616,6cyclictest0-21swapper/119:45:001
2907129992615,7cyclictest0-21swapper/119:25:271
2907129992614,5cyclictest2973224-21kworker/u8:2+events_unbound22:20:241
290712499266,4cyclictest3012779-21cat00:10:170
2907124992619,4cyclictest13850irq/36-mmc122:50:010
2907124992619,3cyclictest0-21swapper/019:20:250
2907124992614,6cyclictest0-21swapper/019:45:260
2907137992519,4cyclictest3013647-21kworker/u8:0+events_unbound00:27:343
2907137992518,5cyclictest2973224-21kworker/u8:2+events_unbound22:58:413
2907137992518,3cyclictest0-21swapper/322:00:253
2907137992517,5cyclictest0-21swapper/320:20:003
2907137992516,5cyclictest0-21swapper/323:40:003
2907129992518,5cyclictest3003371-21kworker/u8:0+events_unbound00:05:141
2907129992518,4cyclictest0-21swapper/123:10:251
2907129992517,5cyclictest2996303-21kworker/u8:1+events_unbound23:44:201
2907129992517,4cyclictest0-21swapper/122:15:231
2907129992512,10cyclictest24-21ksoftirqd/121:21:141
2907124992519,3cyclictest2959891-21sendmail21:40:000
2907124992518,4cyclictest0-21swapper/021:10:290
2907124992517,5cyclictest2963452-21latency_hist21:50:020
2907124992515,7cyclictest0-21swapper/022:05:000
2907124992514,6cyclictest0-21swapper/022:50:230
2907124992513,9cyclictest3007447-21cut23:55:150
2907124992513,9cyclictest3007447-21cut23:55:150
2907137992418,3cyclictest0-21swapper/322:25:213
2907137992418,3cyclictest0-21swapper/319:45:263
2907137992418,3cyclictest0-21swapper/319:25:163
2907137992417,5cyclictest3011909-21kworker/u8:1+events_unbound00:08:173
2907137992417,4cyclictest0-21swapper/323:05:263
2907137992416,5cyclictest438-21cron20:25:003
2907137992413,9cyclictest2907117-21cyclictest22:05:103
2907137992411,10cyclictest391ktimers/323:10:113
2907129992417,4cyclictest2965175-21latency_hist21:55:011
2907129992416,5cyclictest0-21swapper/120:57:271
2907129992414,6cyclictest0-21swapper/123:05:271
2907124992418,3cyclictest0-21swapper/023:50:190
2907124992417,5cyclictest3022202-21kworker/u8:1+events_unbound00:38:260
2907124992417,5cyclictest0-21swapper/023:01:250
2907124992417,3cyclictest0-21swapper/023:37:480
2907124992415,6cyclictest0-21swapper/020:55:250
2907124992415,6cyclictest0-21swapper/019:25:190
290712499241,4cyclictest3015537-21munin-run00:20:000
290712499241,19cyclictest0-21swapper/021:44:180
290712499241,19cyclictest0-21swapper/021:07:560
290712499241,19cyclictest0-21swapper/020:54:310
290712499241,19cyclictest0-21swapper/019:56:290
290712499241,19cyclictest0-21swapper/000:30:530
290712499241,19cyclictest0-21swapper/000:30:530
290712499241,19cyclictest0-21swapper/000:04:500
290713799235,8cyclictest131rcu_preempt19:35:273
290713799235,8cyclictest131rcu_preempt19:35:273
2907137992317,4cyclictest3010060-21kworker/u8:3+events_unbound00:12:193
2907137992317,3cyclictest0-21swapper/320:40:233
2907137992315,5cyclictest0-21swapper/320:35:003
2907129992316,5cyclictest2993916-21ntpq23:15:171
2907129992316,3cyclictest0-21swapper/121:25:141
2907129992313,7cyclictest24-21ksoftirqd/100:00:241
2907124992318,3cyclictest0-21swapper/000:20:110
2907124992316,5cyclictest145-21jbd2/mmcblk1p2-821:20:210
2907124992316,3cyclictest0-21swapper/022:44:330
2907124992316,3cyclictest0-21swapper/021:30:160
2907124992316,3cyclictest0-21swapper/019:51:280
2907124992314,6cyclictest0-21swapper/023:30:190
290712499231,3cyclictest0-21swapper/023:26:070
2907124992312,6cyclictest0-21swapper/022:30:240
290712499231,18cyclictest0-21swapper/020:33:330
290712499230,19cyclictest0-21swapper/022:13:370
290712499230,19cyclictest0-21swapper/021:16:570
290712499230,19cyclictest0-21swapper/020:18:240
290712499230,19cyclictest0-21swapper/019:19:160
290712499230,19cyclictest0-21swapper/000:27:570
2907137992216,3cyclictest0-21swapper/319:50:203
2907137992214,5cyclictest0-21swapper/323:55:253
2907137992214,5cyclictest0-21swapper/323:55:253
2907137992213,7cyclictest2950469-21sed21:10:283
2907129992216,4cyclictest2974971-21kworker/u8:1+events_unbound22:25:291
2907129992216,3cyclictest0-21swapper/122:50:201
2907129992216,3cyclictest0-21swapper/120:05:231
2907129992210,6cyclictest24-21ksoftirqd/120:46:291
2907124992217,3cyclictest2955997-21unixbench_multi21:25:240
2907124992214,5cyclictest121ktimers/022:55:200
2907124992213,6cyclictest0-21swapper/022:30:000
290712499220,20cyclictest0-21swapper/020:00:250
290713799211,12cyclictest2977586-21fschecks_time22:30:153
2907124992115,3cyclictest0-21swapper/020:40:210
2907124992114,5cyclictest0-21swapper/000:08:460
2907124992114,3cyclictest0-21swapper/020:05:410
290712499211,17cyclictest629-21snmpd22:20:140
2907137992012,5cyclictest0-21swapper/320:00:193
2907124992010,7cyclictest2968856-21cut22:05:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional