You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-30 - 12:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot5s.osadl.org (updated Sun Aug 30, 2026 00:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3172209995245,4cyclictest3269130-21munin-plugin-st23:49:590
3172212994718,9cyclictest3231537-21/usr/sbin/munin22:00:141
3172221994639,4cyclictest3222645-21munin-plugin-st21:35:013
3172221994639,4cyclictest3222645-21munin-plugin-st21:35:013
3172217994639,3cyclictest0-21swapper/222:30:012
3172212994631,11cyclictest231ktimers/123:45:141
3172212994533,8cyclictest231ktimers/123:20:131
3172221994432,9cyclictest391ktimers/321:05:153
3172217994335,4cyclictest0-21swapper/220:55:012
3172217994335,4cyclictest0-21swapper/220:55:012
3172212994332,8cyclictest3272780-21apt-get00:00:121
3172212994332,8cyclictest3272780-21apt-get00:00:121
3172221994234,5cyclictest0-21swapper/320:10:003
3172212994230,7cyclictest0-21swapper/122:22:421
3172212994227,11cyclictest3194695-21grep20:10:251
3172212994129,8cyclictest0-21swapper/121:35:011
3172212994129,8cyclictest0-21swapper/121:35:001
3172212994124,11cyclictest3205603-21apt-get20:45:121
3172209994133,5cyclictest3207063-21sh20:50:000
3172212994033,4cyclictest3265489-21latency_hist23:39:591
3172209993929,7cyclictest3272544-21sendmail00:00:000
3172217993831,3cyclictest0-21swapper/223:45:002
3172212993825,7cyclictest0-21swapper/121:57:411
3172221993726,8cyclictest3267454-21latency_hist23:45:013
3172217993730,4cyclictest0-21swapper/219:30:012
3172217993727,7cyclictest3265502-21sendmail23:40:002
3172212993729,4cyclictest0-21swapper/100:10:141
3172212993727,7cyclictest3177987-21cron19:24:001
3172209993727,6cyclictest0-21swapper/020:25:400
3172221993626,7cyclictest3217107-21grep21:15:253
3172217993628,4cyclictest0-21swapper/221:50:002
3172212993622,10cyclictest3250692-21/usr/sbin/munin22:55:221
3172212993618,13cyclictest3260625-21runrttasks23:25:131
3172209993630,3cyclictest0-21swapper/022:40:000
3172209993628,5cyclictest0-21swapper/019:20:160
3172221993529,4cyclictest3246316-21kworker/u8:0+events_unbound23:02:493
3172221993528,4cyclictest0-21swapper/322:20:003
3172221993526,5cyclictest0-21swapper/322:15:003
3172221993526,4cyclictest0-21swapper/323:30:153
3172221993525,6cyclictest0-21swapper/322:55:263
3172221993525,6cyclictest0-21swapper/319:50:263
3172221993524,6cyclictest0-21swapper/322:44:593
3172217993527,3cyclictest0-21swapper/221:00:162
3172212993524,7cyclictest3263301-21grep23:30:231
3172212993524,7cyclictest3184453-21grep19:40:261
3172212993521,10cyclictest3212410-21apt-key21:05:011
3172221993426,4cyclictest0-21swapper/323:49:593
3172221993425,6cyclictest0-21swapper/321:50:283
317222199342,4cyclictest131rcu_preempt20:30:123
3172221993424,6cyclictest0-21swapper/319:35:243
3172217993427,4cyclictest0-21swapper/200:40:012
3172217993426,4cyclictest0-21swapper/222:55:172
3172217993414,5cyclictest3246316-21kworker/u8:0+events_unbound23:51:402
3172212993428,3cyclictest3269348-21apt-get23:50:111
3172212993426,5cyclictest0-21swapper/120:25:001
3172212993425,5cyclictest0-21swapper/121:00:011
3172212993422,7cyclictest3277967-21/usr/sbin/munin00:15:151
3172212993420,8cyclictest3275937-21cron00:10:001
3172212993419,12cyclictest3186301-21sendmail-mta19:46:291
3172212993418,11cyclictest0-21swapper/123:15:121
3172212993415,14cyclictest3254859-21sshd23:07:491
317220999343,4cyclictest131rcu_preempt21:05:140
3172209993427,4cyclictest3217109-21unixbench_singl21:15:240
3172221993326,3cyclictest0-21swapper/300:35:013
3172221993324,5cyclictest0-21swapper/320:00:013
3172217993323,8cyclictest3277638-21cron00:15:002
317221799331,6cyclictest131rcu_preempt22:00:132
317221799331,6cyclictest131rcu_preempt21:30:112
317221799331,6cyclictest131rcu_preempt21:30:112
3172212993326,4cyclictest3227758-21kthreadd21:50:001
3172212993326,3cyclictest3198784-21apt-get20:25:131
3172212993325,4cyclictest0-21swapper/123:40:151
3172212993325,4cyclictest0-21swapper/122:50:151
3172212993323,6cyclictest3179298-21grep19:25:251
3172212993321,7cyclictest3280052-21meminfo00:20:181
3172212993320,10cyclictest3175977-21cron19:18:011
3172212993320,10cyclictest3175977-21cron19:18:011
3172212993316,13cyclictest3182061-21kernelversion19:35:181
3172209993326,3cyclictest0-21swapper/000:00:240
3172209993326,3cyclictest0-21swapper/000:00:230
317220999332,5cyclictest131rcu_preempt21:00:130
3172221993224,4cyclictest0-21swapper/322:25:013
3172221993224,4cyclictest0-21swapper/319:20:263
3172221993222,6cyclictest0-21swapper/321:25:243
3172217993224,4cyclictest0-21swapper/223:05:152
3172217993224,4cyclictest0-21swapper/222:40:012
3172217993224,4cyclictest0-21swapper/200:00:272
3172217993224,4cyclictest0-21swapper/200:00:272
3172217993223,5cyclictest3275546-21grep00:05:262
3172212993226,3cyclictest3172372-21apt-get19:10:121
3172212993226,3cyclictest3172372-21apt-get19:10:111
3172212993223,6cyclictest3229451-21sh21:55:011
3172212993223,6cyclictest3190540-21/usr/sbin/munin20:00:161
3172212993222,7cyclictest3208676-21cron20:54:011
3172212993222,7cyclictest3208676-21cron20:54:011
3172212993222,7cyclictest3196493-21sshd20:16:061
3172212993221,8cyclictest3256634-21sshd23:11:111
3172212993220,9cyclictest3215008-21/usr/sbin/munin21:10:231
3172212993220,9cyclictest3212962-21/usr/sbin/munin21:05:181
3172212993220,8cyclictest3283455-21/usr/sbin/munin00:30:191
3172212993219,8cyclictest0-21swapper/121:35:121
3172212993216,13cyclictest3252776-21sed23:00:241
3172209993225,3cyclictest0-21swapper/021:35:010
3172209993225,3cyclictest0-21swapper/021:35:010
3172209993223,6cyclictest0-21swapper/023:40:000
317220999321,4cyclictest131rcu_preempt21:40:120
3172221993123,5cyclictest0-21swapper/323:15:013
3172221993123,5cyclictest0-21swapper/300:00:003
3172221993122,6cyclictest0-21swapper/300:30:013
3172221993122,5cyclictest0-21swapper/322:50:003
3172221993122,5cyclictest0-21swapper/322:50:003
3172221993122,5cyclictest0-21swapper/320:59:593
3172221993120,7cyclictest0-21swapper/321:40:253
3172217993125,4cyclictest3246316-21kworker/u8:0+events_unbound00:23:012
3172217993123,4cyclictest0-21swapper/222:40:172
3172217993121,6cyclictest3187826-21grep19:50:262
3172212993124,3cyclictest3284707-21apt-get00:35:141
3172212993122,6cyclictest0-21swapper/123:55:271
3172212993121,7cyclictest3235089-21/usr/sbin/munin22:10:181
3172212993121,7cyclictest3205193-21cron20:43:001
3172212993120,8cyclictest3220926-21sh21:30:011
3172212993118,10cyclictest3242089-21memory22:30:191
3172212993116,11cyclictest3237977-21cron22:20:011
3172212993115,8cyclictest0-21swapper/119:30:141
3172212993113,13cyclictest3217850-21ls21:20:141
3172209993125,4cyclictest3237762-21kworker/u8:1+events_unbound22:17:440
3172221993025,3cyclictest3246316-21kworker/u8:0+events_unbound23:27:523
3172221993022,4cyclictest0-21swapper/319:15:273
3172221993022,4cyclictest0-21swapper/319:15:263
3172217993023,4cyclictest3271745-21sendmail_mailqu23:55:242
3172217993022,4cyclictest0-21swapper/221:50:272
3172212993024,3cyclictest3224589-21apt-get21:40:141
3172212993020,7cyclictest3202451-21/usr/sbin/munin20:35:151
3172212993020,7cyclictest3186942-21df19:50:141
3172212993019,8cyclictest3192068-21/usr/sbin/munin20:05:151
3172212993019,7cyclictest3246870-21df22:45:151
3172212993019,7cyclictest3246870-21df22:45:151
3172212993013,14cyclictest3243444-21df22:35:141
3172209993024,3cyclictest0-21swapper/023:10:000
3172209993020,7cyclictest3277234-21grep00:10:230
3172209993020,7cyclictest3220091-21ps21:25:220
317220999301,5cyclictest131rcu_preempt00:15:140
317220999301,4cyclictest131rcu_preempt19:10:120
317220999301,4cyclictest131rcu_preempt19:10:110
3172221992923,3cyclictest3258667-21kthreadd23:20:013
3172221992922,4cyclictest3203678-21sendmail20:40:013
3172221992922,4cyclictest0-21swapper/321:49:593
3172221992921,5cyclictest0-21swapper/319:35:003
3172217992921,4cyclictest0-21swapper/220:15:272
3172217992920,6cyclictest3247764-21unixbench_multi22:45:272
3172217992920,6cyclictest3247764-21unixbench_multi22:45:262
3172217992920,5cyclictest0-21swapper/222:05:262
3172212992923,3cyclictest3239940-21apt-get22:25:131
3172212992920,7cyclictest3245062-21apt-get22:40:151
3172212992920,6cyclictest53-21kcompactd019:55:051
3172212992919,7cyclictest3282512-21cron00:27:001
317220999296,4cyclictest131rcu_preempt22:30:010
3172209992922,3cyclictest0-21swapper/021:50:280
3172209992922,3cyclictest0-21swapper/019:15:020
3172209992922,3cyclictest0-21swapper/019:15:010
3172209992921,5cyclictest3243115-21munin-plugin-st22:35:000
3172209992921,3cyclictest0-21swapper/019:25:160
3172209992919,7cyclictest3255847-21kernelversion23:10:180
3172221992821,4cyclictest0-21swapper/320:45:273
3172221992820,6cyclictest3181406-21kworker/u8:1+events_unbound19:42:253
3172221992820,4cyclictest0-21swapper/323:35:253
3172221992819,6cyclictest0-21swapper/322:30:263
3172221992814,3cyclictest0-21swapper/320:40:163
3172217992821,5cyclictest3156625-21kworker/u8:2+events_unbound19:22:192
3172217992821,4cyclictest0-21swapper/200:19:592
3172217992818,7cyclictest3282943-21latency_hist00:30:022
317221799281,6cyclictest3201938-21cron20:35:012
3172212992818,7cyclictest3233233-21/usr/sbin/munin22:05:151
3172209992823,3cyclictest3210488-21sendmail21:00:010
3172209992821,3cyclictest0-21swapper/019:50:260
3172209992820,5cyclictest0-21swapper/023:45:000
3172209992820,4cyclictest3281082-21munin-plugin-st00:25:010
3172221992721,4cyclictest3222390-21kworker/u8:2+events_unbound21:37:423
3172221992720,4cyclictest0-21swapper/322:00:013
3172221992720,3cyclictest0-21swapper/300:35:253
3172221992719,6cyclictest145-21jbd2/mmcblk1p2-820:10:163
3172221992718,6cyclictest0-21swapper/320:30:003
3172221992718,5cyclictest0-21swapper/322:55:003
3172217992720,3cyclictest0-21swapper/219:40:162
3172217992719,4cyclictest0-21swapper/220:45:272
317221799271,13cyclictest0-21swapper/223:25:112
317221799270,4cyclictest131rcu_preempt20:25:132
3172209992722,3cyclictest3196832-21kthreadd20:20:010
3172209992721,3cyclictest0-21swapper/020:40:150
3172221992620,4cyclictest3246316-21kworker/u8:0+events_unbound00:08:013
3172221992619,4cyclictest0-21swapper/323:54:593
3172221992619,3cyclictest0-21swapper/320:20:163
3172221992617,6cyclictest3277174-21unixbench_multi00:10:223
3172221992615,8cyclictest3240958-21grep22:25:263
3172217992620,3cyclictest0-21swapper/223:00:232
3172217992619,5cyclictest3246316-21kworker/u8:0+events_unbound23:33:272
3172217992619,4cyclictest3193428-21idleruntime-cro20:10:002
3172217992619,3cyclictest0-21swapper/220:05:022
3172217992618,5cyclictest0-21swapper/219:55:152
3172217992617,6cyclictest3175712-21grep19:15:262
3172217992617,6cyclictest3175712-21grep19:15:262
317221799261,12cyclictest0-21swapper/221:12:012
317221799261,12cyclictest0-21swapper/220:43:002
3172209992620,4cyclictest3203299-21kworker/u8:0+events_unbound20:37:310
317220999261,5cyclictest3263795-21basename23:35:010
3172209992614,7cyclictest3181018-21grep19:30:260
3172221992518,5cyclictest3258639-21kworker/u8:2+events_unbound23:22:513
3172221992517,5cyclictest3234109-21unixbench_multi22:05:253
3172221992517,5cyclictest0-21swapper/322:00:253
3172221992517,5cyclictest0-21swapper/320:20:013
3172221992517,5cyclictest0-21swapper/320:05:003
3172221992516,6cyclictest0-21swapper/300:15:253
3172221992516,5cyclictest0-21swapper/319:45:193
3172221992514,8cyclictest3243450-21df_inode22:35:133
3172217992519,3cyclictest0-21swapper/222:10:262
3172217992517,4cyclictest0-21swapper/221:55:252
317221799251,12cyclictest0-21swapper/223:48:002
317221799251,12cyclictest0-21swapper/219:49:002
3172209992518,3cyclictest0-21swapper/022:20:230
3172209992518,3cyclictest0-21swapper/022:00:160
3172209992517,5cyclictest0-21swapper/019:55:240
3172209992517,4cyclictest0-21swapper/023:20:000
3172209992516,6cyclictest3269581-21tune2fs23:50:140
3172209992516,5cyclictest3182759-21grep19:35:240
317220999251,5cyclictest3192190-21perl20:05:160
3172209992515,7cyclictest3215180-21threads21:10:260
3172209992515,6cyclictest3261664-21grep23:25:270
317220999251,20cyclictest0-21swapper/021:37:380
3172221992415,5cyclictest0-21swapper/300:20:253
3172221992414,6cyclictest0-21swapper/321:25:003
3172217992418,4cyclictest3217445-21kworker/u8:0+events_unbound21:22:382
3172217992417,4cyclictest32832782sleep200:30:182
3172217992417,4cyclictest3258265-21head23:15:272
3172217992417,4cyclictest0-21swapper/221:05:262
317221799240,11cyclictest0-21swapper/221:29:102
317220999248,3cyclictest0-21swapper/022:15:000
3172209992419,3cyclictest13550irq/42-30be0000.ethernet20:00:170
3172209992417,4cyclictest13550irq/42-30be0000.ethernet22:00:010
3172209992417,3cyclictest0-21swapper/023:20:190
3172209992413,8cyclictest3283200-21cut00:30:150
317220999241,19cyclictest0-21swapper/000:28:090
3172221992315,5cyclictest391ktimers/323:05:243
3172221992315,5cyclictest3208759-21cron20:55:003
3172221992315,5cyclictest3208759-21cron20:55:003
3172221992314,6cyclictest0-21swapper/319:10:253
3172221992314,6cyclictest0-21swapper/319:10:243
3172217992317,4cyclictest3223113-21idleruntime21:35:182
3172217992316,3cyclictest0-21swapper/219:40:012
317221799231,5cyclictest3203656-21munin-run20:40:002
3172217992313,7cyclictest3260410-21cat23:25:012
3172209992317,3cyclictest0-21swapper/022:55:210
3172209992317,3cyclictest0-21swapper/022:05:160
3172209992314,6cyclictest3218308-21ntp_kernel_pll_21:20:210
317220999231,3cyclictest131rcu_preempt22:45:000
3172209992313,7cyclictest3226779-21ls21:45:210
317220999231,18cyclictest0-21swapper/023:02:220
317220999230,19cyclictest0-21swapper/022:46:540
317220999230,19cyclictest0-21swapper/022:46:540
317220999230,19cyclictest0-21swapper/020:21:290
317220999230,19cyclictest0-21swapper/019:40:480
317220999230,19cyclictest0-21swapper/000:09:540
3172221992216,3cyclictest0-21swapper/321:10:273
317221799223,3cyclictest0-21swapper/220:25:012
3172217992216,4cyclictest3239039-21switchtime22:20:232
317221799221,5cyclictest3180272-21basename19:30:192
3172217992214,5cyclictest0-21swapper/221:40:262
3172217992214,5cyclictest0-21swapper/219:10:252
3172217992214,5cyclictest0-21swapper/219:10:252
317220999221,19cyclictest0-21swapper/020:10:580
317220999221,19cyclictest0-21swapper/000:38:500
317220999220,20cyclictest0-21swapper/020:31:240
3172221992114,5cyclictest3210841-21diskstats21:00:163
3172221992114,3cyclictest0-21swapper/300:00:273
3172221992114,3cyclictest0-21swapper/300:00:273
3172221992113,5cyclictest0-21swapper/319:25:163
3172217992115,4cyclictest3237762-21kworker/u8:1+events_unbound22:30:412
3172217992114,4cyclictest645-21runrttasks20:55:182
3172217992114,4cyclictest438-21cron22:20:002
3172217992113,5cyclictest0-21swapper/223:10:242
3172209992112,7cyclictest3249382-21cat22:50:240
317220999210,17cyclictest0-21swapper/020:50:040
317220999210,17cyclictest0-21swapper/020:50:040
3172217991910,5cyclictest3249473-21unixbench_multi22:50:262
3172217991813,3cyclictest3193654-21/usr/sbin/munin20:10:102
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional