You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-28 - 23:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot5s.osadl.org (updated Fri Aug 28, 2026 12:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3385698995749,5cyclictest3468392-21kworker/u8:0+events_unbound11:39:243
3385693995440,10cyclictest311ktimers/209:35:102
3385684995037,10cyclictest121ktimers/010:15:150
3385698994934,11cyclictest391ktimers/309:00:133
3385693994940,6cyclictest3414936-21grep08:30:252
3385698994837,8cyclictest3413715-21auditctl08:30:013
3385693994834,11cyclictest311ktimers/212:10:112
3385698994740,4cyclictest3403481-21munin-plugin-st08:00:003
3385698994740,4cyclictest3403481-21munin-plugin-st08:00:003
3385693994638,4cyclictest0-21swapper/207:15:012
3385698994532,10cyclictest391ktimers/310:20:143
3385684994535,5cyclictest0-21swapper/007:15:020
3385684994532,10cyclictest3389837-21cat07:20:010
3385684994515,10cyclictest3472141-21munin-run11:19:590
3385684994515,10cyclictest3472141-21munin-run11:19:590
3385698994435,4cyclictest0-21swapper/307:15:023
3385693994432,8cyclictest311ktimers/207:25:132
3385689994437,4cyclictest3473864-21munin-plugin-st11:25:001
338568499439,11cyclictest3468839-21cat11:10:010
3385684994314,10cyclictest3429577-21cat09:15:170
3385689994231,8cyclictest231ktimers/107:35:131
3385684994215,9cyclictest3407923-21switchtime08:10:230
3385698994135,4cyclictest3451500-21kworker/u8:2+events_unbound10:34:093
3385689994134,4cyclictest3389827-21cron07:20:001
3385684994113,12cyclictest3434414-21idleruntime-cro09:30:010
3385684994112,11cyclictest3484167-21cat11:55:000
3385684994111,13cyclictest3454122-21cat10:25:200
3385698994030,7cyclictest3393255-21idleruntime-cro07:30:003
3385689994031,6cyclictest3411539-21unixbench_multi08:20:241
3385689994028,8cyclictest3493276-21fschecks_time12:20:151
3385689994028,8cyclictest3493276-21fschecks_time12:20:151
3385698993927,8cyclictest391ktimers/312:00:123
3385693993929,6cyclictest0-21swapper/210:40:002
338568499399,12cyclictest3419788-21mailstats08:45:230
338568499399,10cyclictest3400639-21irqstats07:50:170
338568499395,10cyclictest34574142cat10:35:180
3385684993925,9cyclictest3465561-21apt-get11:00:110
3385684993915,9cyclictest3489197-21latency_hist12:10:000
3385684993913,9cyclictest3435171-21ntpq09:30:180
3385684993910,10cyclictest3413136-21cat08:25:260
3385684993910,10cyclictest3391618-21grep07:25:010
3385698993832,4cyclictest3444876-21kworker/u8:3+events_unbound10:02:403
3385698993827,8cyclictest391ktimers/308:20:123
3385693993831,4cyclictest3451670-21latency_hist10:20:002
3385693993830,4cyclictest0-21swapper/207:40:152
3385693993824,9cyclictest3472066-21sshd11:19:182
3385693993824,9cyclictest3472066-21sshd11:19:182
3385684993830,4cyclictest3414989-21unixbench_singl08:30:250
3385684993827,8cyclictest3482116-21cron11:47:000
3385684993818,17cyclictest3475170-21sshd11:25:290
3385698993720,6cyclictest3451500-21kworker/u8:2+events_unbound10:19:413
3385693993726,6cyclictest0-21swapper/212:00:002
3385689993730,4cyclictest3496235-21idleruntime-cro12:29:591
3385689993728,6cyclictest3492342-21unixbench_multi12:15:261
3385689993728,6cyclictest3492342-21unixbench_multi12:15:261
3385689993715,5cyclictest0-21swapper/108:36:491
3385684993731,3cyclictest3420770-21apt-get08:50:130
3385684993713,4cyclictest3496568-21df12:30:130
3385698993626,6cyclictest0-21swapper/309:15:003
3385693993624,7cyclictest0-21swapper/209:40:252
3385693993623,7cyclictest0-21swapper/210:05:252
3385689993628,4cyclictest0-21swapper/112:00:011
3385689993624,4cyclictest131rcu_preempt11:25:211
3385689993617,11cyclictest3485445-21kworker/u8:2+events_unbound12:09:571
3385689993617,10cyclictest131rcu_preempt08:10:141
3385689993612,8cyclictest3439096-21sed09:40:251
3385684993629,4cyclictest3385679-21cyclictest08:40:250
3385684993627,4cyclictest0-21swapper/010:20:250
3385684993623,10cyclictest3489875-21/usr/sbin/munin12:10:180
3385684993612,10cyclictest3426193-21cat09:05:160
3385698993527,4cyclictest0-21swapper/308:55:163
3385698993525,5cyclictest0-21swapper/312:40:003
338568999358,14cyclictest24-21ksoftirqd/112:00:191
3385689993529,4cyclictest3425519-21kworker/u8:1+events_unbound09:08:531
3385689993527,4cyclictest0-21swapper/112:40:011
3385689993525,6cyclictest0-21swapper/110:55:001
3385689993525,6cyclictest0-21swapper/107:55:251
3385689993525,6cyclictest0-21swapper/107:55:251
3385689993524,7cyclictest3428646-21grep09:10:261
3385689993524,4cyclictest131rcu_preempt07:40:131
338568499357,17cyclictest0-21swapper/007:30:180
3385684993523,8cyclictest3472593-21/usr/sbin/munin11:20:150
3385684993522,10cyclictest3459861-21cron10:41:010
3385684993521,8cyclictest3409872-21grep08:15:260
3385684993521,11cyclictest3486361-21/usr/sbin/munin12:00:180
3385684993520,3cyclictest3455435-21diskstats10:30:130
3385684993519,3cyclictest3424527-21irqstats09:00:190
3385684993515,4cyclictest3403479-21munin-run08:00:010
3385684993515,4cyclictest3403479-21munin-run08:00:000
3385684993513,17cyclictest3427649-21egrep09:10:130
338569899341,4cyclictest3430773-21apt-get09:20:003
3385693993427,4cyclictest3464849-21unixbench_multi10:55:242
3385693993427,4cyclictest0-21swapper/207:50:252
3385693993424,6cyclictest0-21swapper/210:00:242
3385693993424,4cyclictest0-21swapper/209:20:012
3385689993424,7cyclictest0-21swapper/109:55:261
3385689993424,7cyclictest0-21swapper/109:55:251
3385689993423,7cyclictest0-21swapper/108:50:271
3385689993423,5cyclictest131rcu_preempt10:45:131
3385689993422,4cyclictest131rcu_preempt07:50:221
3385689993420,8cyclictest131rcu_preempt09:35:131
3385689993410,6cyclictest24-21ksoftirqd/107:15:021
3385684993423,8cyclictest3411962-21sshd08:24:290
3385684993421,10cyclictest3436611-21/usr/sbin/munin09:35:130
3385684993421,10cyclictest3392861-21/usr/sbin/munin07:25:250
3385684993419,10cyclictest0-21swapper/010:45:120
3385684993414,7cyclictest3468962-21apt-get11:10:130
3385684993414,7cyclictest3468962-21apt-get11:10:130
3385684993413,4cyclictest3448057-21munin-run10:10:000
3385698993327,4cyclictest3483727-21kworker/u8:0+events_unbound11:54:253
3385698993325,4cyclictest0-21swapper/309:10:013
3385693993326,4cyclictest0-21swapper/210:25:262
3385693993325,4cyclictest0-21swapper/212:30:252
3385693993323,6cyclictest0-21swapper/209:45:162
3385689993323,6cyclictest3441622-21fschecks_count09:50:151
3385689993323,6cyclictest3441622-21fschecks_count09:50:151
3385689993323,6cyclictest3414974-21grep08:30:241
3385689993321,5cyclictest131rcu_preempt11:10:161
3385689993321,5cyclictest131rcu_preempt11:10:161
3385689993321,3cyclictest131rcu_preempt11:40:211
3385689993319,4cyclictest131rcu_preempt09:33:581
3385689993318,5cyclictest131rcu_preempt11:05:291
3385689993317,9cyclictest131rcu_preempt11:19:091
3385689993317,9cyclictest131rcu_preempt11:19:081
3385684993327,3cyclictest3494762-21apt-get12:25:120
3385684993326,4cyclictest3462141-21apt-get10:50:120
3385684993326,4cyclictest3444160-21unixbench_multi09:55:240
3385684993326,4cyclictest3444160-21unixbench_multi09:55:240
3385684993325,4cyclictest0-21swapper/010:00:240
3385684993323,7cyclictest3493655-21/usr/sbin/munin12:20:220
3385684993323,7cyclictest3493655-21/usr/sbin/munin12:20:220
3385684993321,9cyclictest3422469-21/usr/sbin/munin08:55:110
3385684993321,8cyclictest3397165-21/usr/sbin/munin07:40:160
3385684993319,11cyclictest3404421-21/usr/sbin/munin08:00:240
3385684993319,11cyclictest3404421-21/usr/sbin/munin08:00:240
3385684993319,11cyclictest3399213-21/usr/sbin/munin07:45:220
3385684993319,10cyclictest3439878-21diskstats09:45:150
3385684993314,16cyclictest0-21swapper/008:05:210
3385684993314,16cyclictest0-21swapper/008:05:200
3385684993310,7cyclictest3417122-21munin-run08:40:000
338569899329,13cyclictest3406415-21unixbench_multi08:05:263
338569899329,13cyclictest3406415-21unixbench_multi08:05:253
3385698993225,5cyclictest3441236-21munin-plugin-st09:50:003
3385698993223,6cyclictest0-21swapper/312:10:233
3385693993224,5cyclictest0-21swapper/211:50:012
3385689993220,5cyclictest131rcu_preempt10:35:151
3385689993220,5cyclictest131rcu_preempt08:25:151
3385689993220,5cyclictest131rcu_preempt07:48:171
3385689993215,9cyclictest131rcu_preempt08:45:241
3385689993215,10cyclictest131rcu_preempt08:00:211
3385689993215,10cyclictest131rcu_preempt08:00:211
3385689993214,9cyclictest131rcu_preempt10:55:201
3385689993211,10cyclictest131rcu_preempt11:00:151
3385684993223,6cyclictest3498276-21diskstats12:35:140
3385684993222,7cyclictest3491450-21/usr/sbin/munin12:15:160
3385684993222,7cyclictest3491450-21/usr/sbin/munin12:15:150
3385684993222,7cyclictest3479928-21/usr/sbin/munin11:40:220
3385684993222,7cyclictest3396564-21cron07:39:010
3385684993220,9cyclictest3441721-21/usr/sbin/munin09:50:160
3385684993220,9cyclictest3441721-21/usr/sbin/munin09:50:160
3385684993220,8cyclictest3438057-21apt-get09:40:100
3385684993219,10cyclictest3431504-21/usr/sbin/munin09:20:160
3385684993217,11cyclictest3448373-21cat10:10:030
3385684993213,16cyclictest3476502-21cut11:30:230
3385698993123,4cyclictest0-21swapper/310:45:253
3385693993124,4cyclictest0-21swapper/209:50:192
3385693993124,4cyclictest0-21swapper/209:50:192
3385693993124,3cyclictest0-21swapper/212:00:152
338568999317,7cyclictest24-21ksoftirqd/108:20:011
338568999314,16cyclictest24-21ksoftirqd/108:55:231
3385689993125,3cyclictest0-21swapper/112:15:001
3385689993121,6cyclictest0-21swapper/107:25:261
3385689993120,5cyclictest131rcu_preempt10:25:161
3385689993120,4cyclictest131rcu_preempt07:20:151
3385689993120,3cyclictest131rcu_preempt10:00:221
3385689993116,4cyclictest131rcu_preempt10:16:261
3385689993114,4cyclictest0-21swapper/108:40:141
3385689993114,10cyclictest131rcu_preempt10:10:131
3385689993113,5cyclictest131rcu_preempt07:31:181
3385689993111,4cyclictest0-21swapper/112:30:211
338568999311,14cyclictest0-21swapper/109:00:211
3385684993121,7cyclictest3484426-21diskstats11:55:160
3385684993121,7cyclictest3477605-21diskstats11:35:160
338569899307,13cyclictest131rcu_preempt09:35:223
3385698993023,4cyclictest0-21swapper/310:40:263
3385698993022,4cyclictest0-21swapper/310:55:233
3385698993022,4cyclictest0-21swapper/307:50:243
3385693993023,3cyclictest0-21swapper/212:35:232
3385693993023,3cyclictest0-21swapper/208:40:262
3385693993019,8cyclictest0-21swapper/210:10:202
3385689993020,7cyclictest3482812-21tune2fs11:50:191
3385689993020,4cyclictest131rcu_preempt10:20:131
3385689993019,4cyclictest131rcu_preempt10:07:291
3385689993018,4cyclictest131rcu_preempt09:45:201
3385689993018,3cyclictest131rcu_preempt10:40:181
3385689993016,4cyclictest131rcu_preempt11:35:221
3385689993013,9cyclictest131rcu_preempt08:05:171
3385689993013,9cyclictest131rcu_preempt08:05:171
3385689993013,4cyclictest0-21swapper/111:30:131
3385689993012,5cyclictest131rcu_preempt10:30:181
3385689993012,5cyclictest131rcu_preempt09:20:161
3385689993011,5cyclictest131rcu_preempt09:30:001
3385684993020,7cyclictest3464239-21sed10:55:160
3385698992922,5cyclictest3394579-21kworker/u8:2+events_unbound07:33:413
3385698992920,6cyclictest3478847-21kworker/u8:2+events_unbound11:40:253
3385698992920,6cyclictest0-21swapper/311:24:593
3385693992922,4cyclictest3473853-21kthreadd11:24:592
3385693992920,4cyclictest0-21swapper/212:15:162
3385693992920,4cyclictest0-21swapper/212:15:162
3385689992912,4cyclictest0-21swapper/111:45:141
3385689992911,11cyclictest131rcu_preempt09:15:161
338569899289,12cyclictest131rcu_preempt12:30:003
338569899288,11cyclictest40-21ksoftirqd/310:00:013
338569899288,11cyclictest40-21ksoftirqd/310:00:003
3385698992822,4cyclictest3480614-21kworker/u8:1+events_unbound11:56:293
3385698992821,4cyclictest3437739-21kworker/u8:1+events_unbound10:09:023
3385698992820,5cyclictest3398387-21idleruntime-cro07:45:013
3385698992819,7cyclictest3388541-21fschecks_count07:15:183
338569899281,6cyclictest0-21swapper/308:10:123
3385698992816,8cyclictest204-21dbus-daemon08:38:523
3385698992815,8cyclictest204-21dbus-daemon11:29:193
338569899281,4cyclictest0-21swapper/309:25:123
3385698992814,5cyclictest3468392-21kworker/u8:0+events_unbound11:09:483
3385698992814,4cyclictest3451500-21kworker/u8:2+events_unbound10:25:413
3385693992821,4cyclictest0-21swapper/212:20:252
3385693992821,4cyclictest0-21swapper/212:20:242
338569899275,4cyclictest131rcu_preempt11:10:233
338569899275,4cyclictest131rcu_preempt11:10:233
3385698992721,4cyclictest3485445-21kworker/u8:2+events_unbound12:19:083
3385698992721,4cyclictest3485445-21kworker/u8:2+events_unbound12:19:083
3385698992720,4cyclictest3494118-21grep12:20:263
3385698992720,4cyclictest3494118-21grep12:20:263
3385698992720,4cyclictest3410301-21munin-plugin-st08:20:003
3385698992720,4cyclictest0-21swapper/310:40:003
3385698992719,4cyclictest0-21swapper/307:35:173
338569899271,6cyclictest3442478-21grep09:50:253
338569899271,6cyclictest3442478-21grep09:50:253
3385698992714,3cyclictest131rcu_preempt10:51:563
3385693992718,6cyclictest0-21swapper/208:15:152
3385693992717,7cyclictest3398808-21grep07:45:172
3385698992620,4cyclictest3481990-21kworker/u8:3+events_unbound11:49:253
3385698992620,4cyclictest3398034-21kworker/u8:0+events_unbound07:45:293
3385698992619,4cyclictest0-21swapper/308:00:163
3385698992619,4cyclictest0-21swapper/308:00:163
3385698992618,4cyclictest0-21swapper/309:40:243
3385693992619,3cyclictest0-21swapper/208:35:192
3385693992619,3cyclictest0-21swapper/208:00:242
3385693992619,3cyclictest0-21swapper/208:00:242
3385698992519,4cyclictest3416767-21kworker/u8:2+events_unbound08:41:503
3385698992517,6cyclictest3420285-21kworker/u8:0+events_unbound08:50:253
3385698992517,6cyclictest3416767-21kworker/u8:2+events_unbound08:45:153
3385698992517,5cyclictest0-21swapper/311:15:173
3385698992517,5cyclictest0-21swapper/311:15:163
3385698992515,4cyclictest3389782-21kworker/u8:2+events_unbound07:21:493
3385698992514,5cyclictest3432489-21kworker/u8:0+events_unbound09:24:003
338569899251,12cyclictest0-21swapper/309:30:113
3385693992519,4cyclictest311ktimers/209:10:172
3385693992517,4cyclictest0-21swapper/212:05:262
3385693992517,4cyclictest0-21swapper/209:55:162
3385693992517,4cyclictest0-21swapper/209:55:162
3385693992515,8cyclictest311ktimers/209:30:122
3385693992515,7cyclictest3433397-21sort09:25:192
3385693992515,6cyclictest3456782-21sh10:35:012
3385693992514,7cyclictest3425188-21grep09:00:262
338569899247,8cyclictest131rcu_preempt11:00:243
3385698992411,5cyclictest131rcu_preempt12:05:183
338569899240,6cyclictest0-21swapper/311:30:123
3385693992417,3cyclictest0-21swapper/212:30:012
3385693992416,5cyclictest0-21swapper/208:05:262
3385693992416,5cyclictest0-21swapper/208:05:262
3385693992416,4cyclictest0-21swapper/207:20:212
3385693992413,6cyclictest0-21swapper/207:55:252
3385693992413,6cyclictest0-21swapper/207:55:242
3385698992317,4cyclictest3485445-21kworker/u8:2+events_unbound12:31:333
3385698992317,4cyclictest3437739-21kworker/u8:1+events_unbound10:10:083
3385693992316,4cyclictest3482820-21fschecks_time11:50:182
3385693992315,5cyclictest0-21swapper/208:20:242
3385693992314,6cyclictest3388593-21tune2fs07:15:172
3385693992314,5cyclictest3413289-21unixbench_singl08:25:262
338569899221,11cyclictest0-21swapper/308:34:293
3385693992216,3cyclictest0-21swapper/210:40:192
3385693992216,3cyclictest0-21swapper/208:10:172
3385693992216,3cyclictest0-21swapper/207:30:232
3385693992215,4cyclictest0-21swapper/211:05:272
3385693992214,5cyclictest0-21swapper/211:10:262
3385693992214,5cyclictest0-21swapper/211:10:252
3385693992213,5cyclictest0-21swapper/210:20:262
338569399213,13cyclictest3423945-21munin-run09:00:002
3385693992115,3cyclictest0-21swapper/211:00:132
3385693992114,4cyclictest3475567-21idleruntime-cro11:29:592
3385693992114,4cyclictest3396685-21idleruntime-cro07:40:002
3385693992113,5cyclictest0-21swapper/209:20:232
3385693992112,6cyclictest3419308-21sort08:45:172
3385693992014,4cyclictest487-21sendmail-mta09:06:302
3385693992014,3cyclictest0-21swapper/211:30:182
3385693992014,3cyclictest0-21swapper/210:46:282
3385693992012,5cyclictest0-21swapper/211:40:252
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional