You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-19 - 05:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot5s.osadl.org (updated Wed Aug 19, 2026 00:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
329191999472,12cyclictest32-21ksoftirqd/223:30:122
3291918994741,4cyclictest3394833-21kworker/u8:3+events_unbound00:21:551
3291920994639,5cyclictest3302557-21kworker/u8:2+events_unbound19:46:063
3291919994537,4cyclictest3341101-21idleruntime-cro21:30:002
3291919994536,6cyclictest3318707-21fschecks_time20:25:162
3291918994436,5cyclictest3342326-21unixbench_multi21:30:261
3291918994428,12cyclictest231ktimers/123:30:131
3291917994433,7cyclictest3328295-21grep20:50:270
3291919994234,6cyclictest3394833-21kworker/u8:3+events_unbound00:11:552
3291919994231,7cyclictest3309540-21cat20:00:012
3291920994131,7cyclictest3307836-21munin-run19:55:013
3291919994130,9cyclictest311ktimers/200:05:172
3291918994134,4cyclictest0-21swapper/121:20:011
3291918994131,6cyclictest208-21systemd-logind21:36:231
3291918994127,10cyclictest231ktimers/120:00:131
3291920994033,4cyclictest3330646-21idleruntime-cro21:00:013
3291918994032,4cyclictest3406575-21munin-plugin-st00:40:001
3291920993933,4cyclictest3365133-21kworker/u8:1+events_unbound22:41:323
3291920993932,5cyclictest3401049-21kworker/u8:2+events_unbound00:26:563
3291920993928,7cyclictest0-21swapper/323:55:263
3291919993928,8cyclictest311ktimers/223:00:132
3291917993933,3cyclictest3311250-21sh20:05:000
3291920993826,6cyclictest0-21swapper/300:30:253
3291919993832,4cyclictest3388902-21kworker/u8:1+events_unbound23:46:462
3291919993830,6cyclictest3345844-21kworker/u8:0+events_unbound22:06:272
3291919993827,4cyclictest131rcu_preempt22:10:432
3291918993831,4cyclictest3302724-21sendmail19:40:011
3291920993729,4cyclictest0-21swapper/320:05:003
3291920993726,7cyclictest0-21swapper/323:05:263
3291919993731,4cyclictest3289585-21kworker/u8:1+events_unbound19:20:562
3291919993730,4cyclictest3330663-21idleruntime-cro21:00:002
3291918993730,5cyclictest145-21jbd2/mmcblk1p2-819:51:051
3291917993729,4cyclictest0-21swapper/023:25:000
3291917993727,6cyclictest0-21swapper/023:55:010
3291920993626,6cyclictest0-21swapper/321:15:253
3291920993626,5cyclictest0-21swapper/323:10:233
3291920993625,7cyclictest0-21swapper/319:55:283
3291919993630,4cyclictest3371905-21kworker/u8:2+events_unbound22:56:342
3291919993630,4cyclictest3371905-21kworker/u8:2+events_unbound22:56:342
3291919993629,5cyclictest3335625-21kworker/u8:1+events_unbound21:56:252
3291919993618,5cyclictest131rcu_preempt20:20:122
3291919993611,12cyclictest32-21ksoftirqd/219:25:242
3291918993626,6cyclictest3301011-21munin-run19:35:001
3291917993625,7cyclictest0-21swapper/019:25:130
3291920993525,6cyclictest0-21swapper/320:20:013
3291920993525,6cyclictest0-21swapper/320:20:003
3291920993522,5cyclictest3345844-21kworker/u8:0+events_unbound22:27:403
3291920993518,14cyclictest391ktimers/319:30:133
329191999356,9cyclictest32-21ksoftirqd/222:00:262
3291919993526,7cyclictest3388902-21kworker/u8:1+events_unbound00:01:532
3291919993518,5cyclictest131rcu_preempt21:45:262
3291919993518,5cyclictest131rcu_preempt21:45:262
3291917993529,4cyclictest0-21swapper/022:50:140
3291920993416,5cyclictest3312783-21kworker/u8:3+events_unbound20:10:043
3291920993416,5cyclictest3312783-21kworker/u8:3+events_unbound20:10:033
3291919993414,10cyclictest131rcu_preempt19:45:252
3291918993427,4cyclictest0-21swapper/120:40:001
3291918993427,4cyclictest0-21swapper/120:20:001
3291918993427,4cyclictest0-21swapper/120:20:001
3291918993427,4cyclictest0-21swapper/100:10:181
3291918993426,4cyclictest0-21swapper/119:50:001
3291918993425,6cyclictest3318660-21fschecks_count20:25:171
3291918993425,5cyclictest0-21swapper/123:40:001
3291918993424,6cyclictest0-21swapper/100:30:241
3291917993427,3cyclictest0-21swapper/021:05:010
329191799341,30cyclictest0-21swapper/020:35:140
3291920993325,4cyclictest0-21swapper/321:40:253
3291920993323,6cyclictest0-21swapper/323:20:233
3291920993322,6cyclictest0-21swapper/321:35:273
3291919993327,4cyclictest3323167-21kworker/u8:0+events_unbound21:31:232
3291919993326,4cyclictest3385854-21munin-plugin-st23:40:012
3291919993323,7cyclictest3323481-21cat20:40:012
3291919993321,4cyclictest131rcu_preempt19:35:162
3291919993315,12cyclictest301rcuc/200:25:122
3291919993311,12cyclictest32-21ksoftirqd/222:15:222
3291918993326,4cyclictest3372222-21sendmail23:00:001
3291918993326,4cyclictest3372222-21sendmail23:00:001
3291918993323,7cyclictest3295478-21unixbench_singl19:15:271
3291918993323,7cyclictest0-21swapper/119:15:021
3291918993323,6cyclictest0-21swapper/122:25:001
3291918993322,7cyclictest0-21swapper/123:50:251
3291917993326,4cyclictest0-21swapper/019:15:050
3291917993325,4cyclictest0-21swapper/019:40:190
3291917993324,6cyclictest121ktimers/021:30:120
3291917993324,5cyclictest0-21swapper/023:00:000
3291917993324,5cyclictest0-21swapper/022:59:590
3291917993322,7cyclictest3321682-21apt20:35:010
3291920993225,5cyclictest3335625-21kworker/u8:1+events_unbound22:02:403
3291920993223,5cyclictest0-21swapper/322:20:013
3291920993219,9cyclictest0-21swapper/320:40:013
3291920993211,4cyclictest131rcu_preempt22:30:123
329192099320,4cyclictest131rcu_preempt00:10:133
3291919993226,4cyclictest3315992-21kworker/u8:1+events_unbound20:31:112
3291919993225,4cyclictest3406575-21cut00:40:012
3291919993224,6cyclictest3302404-21kworker/u8:0+events_unbound20:02:412
3291919993222,6cyclictest0-21swapper/221:50:262
3291919993222,6cyclictest0-21swapper/221:50:252
3291918993222,5cyclictest0-21swapper/122:25:171
3291918993221,7cyclictest0-21swapper/120:45:261
3291917993226,3cyclictest0-21swapper/019:50:010
3291917993225,4cyclictest0-21swapper/020:10:280
3291917993225,4cyclictest0-21swapper/020:10:270
3291917993225,4cyclictest0-21swapper/000:20:000
3291917993223,6cyclictest3357911-21grep22:15:260
3291920993125,4cyclictest3394833-21kworker/u8:3+events_unbound00:16:553
3291920993124,4cyclictest3321259-21grep20:30:263
3291920993124,3cyclictest0-21swapper/300:35:243
3291920993122,6cyclictest3335961-21sh21:15:003
3291920993122,5cyclictest0-21swapper/319:15:273
3291920993119,8cyclictest3364917-21grep22:35:273
329192099311,4cyclictest131rcu_preempt22:50:133
329191999317,13cyclictest131rcu_preempt20:45:012
329191999317,13cyclictest131rcu_preempt20:45:012
329191999317,11cyclictest32-21ksoftirqd/219:40:282
329191999315,10cyclictest32-21ksoftirqd/219:15:122
3291919993125,4cyclictest3335625-21kworker/u8:1+events_unbound21:11:202
3291919993125,4cyclictest3334265-21munin-plugin-st21:10:012
3291919993124,4cyclictest3331233-21fschecks_count21:00:172
3291919993122,4cyclictest0-21swapper/220:06:082
3291919993116,3cyclictest131rcu_preempt23:52:562
3291919993110,11cyclictest32-21ksoftirqd/221:35:152
329191899312,5cyclictest131rcu_preempt20:10:151
329191899312,5cyclictest131rcu_preempt20:10:141
3291917993124,3cyclictest0-21swapper/022:25:000
3291917993123,5cyclictest3344093-21grep21:35:270
3291920993024,4cyclictest3356481-21kworker/u8:1+events_unbound22:21:283
3291920993022,5cyclictest0-21swapper/320:50:003
3291920993022,4cyclictest0-21swapper/321:30:273
3291920993022,4cyclictest0-21swapper/320:55:003
3291920993019,7cyclictest0-21swapper/323:55:003
329191999308,11cyclictest32-21ksoftirqd/223:05:252
329191999307,4cyclictest131rcu_preempt22:30:012
329191999306,15cyclictest32-21ksoftirqd/219:10:182
329191999303,5cyclictest311ktimers/220:45:272
329191999302,6cyclictest32-21ksoftirqd/223:20:012
3291919993022,4cyclictest0-21swapper/200:20:142
3291919993017,5cyclictest131rcu_preempt20:55:002
3291919993015,6cyclictest3302557-21kworker/u8:2+events_unbound19:51:152
3291919993011,3cyclictest0-21swapper/220:12:482
3291919993011,3cyclictest0-21swapper/220:12:482
3291919993010,11cyclictest131rcu_preempt23:40:132
3291918993024,4cyclictest3307557-21kworker/u8:1+events_unbound19:56:071
3291918993022,5cyclictest3332929-21fschecks_count21:05:161
3291918993021,4cyclictest0-21swapper/121:40:151
3291917993021,4cyclictest0-21swapper/000:36:560
3291920992923,4cyclictest3311089-21kworker/u8:1+events_unbound20:06:083
3291920992923,4cyclictest3293202-21kworker/u8:2+events_unbound19:12:423
3291920992921,6cyclictest391ktimers/321:25:133
3291920992920,6cyclictest0-21swapper/319:25:243
3291920992915,8cyclictest131rcu_preempt23:34:473
3291920992914,6cyclictest3394833-21kworker/u8:3+events_unbound00:23:193
3291920992913,9cyclictest131rcu_preempt21:05:233
3291920992913,10cyclictest131rcu_preempt22:55:183
3291920992913,10cyclictest131rcu_preempt22:55:183
329192099291,14cyclictest0-21swapper/320:24:303
329191999298,12cyclictest32-21ksoftirqd/219:31:372
329191999297,5cyclictest131rcu_preempt21:20:202
329191999297,11cyclictest32-21ksoftirqd/222:40:252
329191999296,13cyclictest32-21ksoftirqd/220:17:332
329191999296,13cyclictest32-21ksoftirqd/220:17:332
3291919992921,4cyclictest0-21swapper/223:10:262
3291919992915,5cyclictest131rcu_preempt00:15:222
3291919992910,3cyclictest131rcu_preempt22:40:002
329191799297,3cyclictest131rcu_preempt21:25:140
3291917992922,4cyclictest0-21swapper/022:05:260
3291917992921,4cyclictest3325312-21sh20:45:010
3291917992921,4cyclictest3325312-21sh20:45:000
3291920992822,4cyclictest3371905-21kworker/u8:2+events_unbound23:00:423
3291920992811,6cyclictest3394833-21kworker/u8:3+events_unbound00:07:453
329192099281,13cyclictest0-21swapper/321:20:163
329191999286,7cyclictest32-21ksoftirqd/222:50:272
3291919992815,5cyclictest131rcu_preempt22:32:292
3291919992815,3cyclictest131rcu_preempt23:27:332
3291919992810,11cyclictest32-21ksoftirqd/200:00:002
3291918992822,4cyclictest0-21swapper/100:15:131
3291918992821,4cyclictest0-21swapper/123:55:261
3291918992821,4cyclictest0-21swapper/122:30:261
3291918992820,5cyclictest0-21swapper/122:00:171
3291918992818,7cyclictest3328318-21unixbench_singl20:50:271
3291918992818,7cyclictest0-21swapper/123:20:011
3291917992821,3cyclictest0-21swapper/023:30:220
3291917992820,4cyclictest0-21swapper/020:05:300
3291917992819,6cyclictest0-21swapper/021:00:010
3291917992819,6cyclictest0-21swapper/019:50:280
3291917992816,8cyclictest3368392-21grep22:45:250
329191799281,11cyclictest3385838-21cron23:40:000
329192099275,6cyclictest3302963-21apt-get19:40:143
3291920992720,5cyclictest3378883-21kworker/u8:2+events_unbound23:18:423
3291920992719,5cyclictest0-21swapper/320:30:003
3291920992719,4cyclictest0-21swapper/321:00:273
3291920992717,7cyclictest3354480-21grep22:05:263
329191999277,4cyclictest131rcu_preempt21:15:182
3291919992720,3cyclictest0-21swapper/222:45:172
329191999271,12cyclictest0-21swapper/222:23:012
3291918992716,7cyclictest0-21swapper/121:15:011
3291920992619,5cyclictest3335625-21kworker/u8:1+events_unbound21:49:573
3291920992619,5cyclictest3335625-21kworker/u8:1+events_unbound21:49:563
3291920992614,5cyclictest3350116-21sort21:55:143
3291920992612,8cyclictest131rcu_preempt21:55:013
3291920992612,8cyclictest131rcu_preempt21:55:013
3291919992620,4cyclictest3378883-21kworker/u8:2+events_unbound23:20:402
329191999261,6cyclictest32-21ksoftirqd/221:40:142
3291918992619,4cyclictest3318280-21sh20:25:011
3291918992619,4cyclictest0-21swapper/123:10:161
3291918992619,4cyclictest0-21swapper/119:20:261
3291918992618,5cyclictest0-21swapper/123:05:251
3291917992620,3cyclictest0-21swapper/021:45:000
3291917992619,4cyclictest3293583-21kthreadd19:15:000
3291920992519,4cyclictest3299159-21kworker/u8:1+events_unbound19:38:463
3291920992518,4cyclictest3383842-21kworker/u8:0+events_unbound23:43:413
3291920992517,5cyclictest0-21swapper/320:40:283
3291920992517,5cyclictest0-21swapper/320:40:273
3291920992516,5cyclictest0-21swapper/322:45:193
329191899256,9cyclictest131rcu_preempt21:45:291
329191899256,9cyclictest131rcu_preempt21:45:291
329191899253,4cyclictest131rcu_preempt21:00:121
3291918992519,4cyclictest3373470-21unixbench_multi23:00:281
329191899251,8cyclictest33203832fschecks_count20:30:171
3291918992518,4cyclictest0-21swapper/100:00:161
3291918992518,3cyclictest0-21swapper/122:15:001
3291918992516,5cyclictest0-21swapper/122:20:001
3291918992515,7cyclictest3368797-21sh22:50:001
3291918992515,7cyclictest3353642-21uniq22:05:171
3291917992517,4cyclictest0-21swapper/021:15:250
3291917992516,7cyclictest121ktimers/020:20:120
3291917992516,6cyclictest0-21swapper/021:55:170
329191799251,20cyclictest0-21swapper/020:27:310
329192099244,11cyclictest40-21ksoftirqd/322:10:273
3291920992414,5cyclictest0-21swapper/319:20:273
329192099241,12cyclictest0-21swapper/323:28:233
3291918992418,3cyclictest0-21swapper/121:55:001
3291918992418,3cyclictest0-21swapper/121:55:001
3291918992416,5cyclictest0-21swapper/120:55:201
3291918992414,6cyclictest0-21swapper/122:40:251
3291917992417,4cyclictest3366700-21grep22:40:260
3291917992417,4cyclictest3291785-1kworker/0:1H+mmc_complete19:40:000
3291917992417,3cyclictest0-21swapper/021:53:030
3291917992417,3cyclictest0-21swapper/021:53:020
3291917992416,4cyclictest438-21cron00:35:010
3291917992415,6cyclictest13550irq/42-30be0000.ethernet23:15:130
329191799241,3cyclictest3361768-21apt-get22:30:040
329191799241,20cyclictest645-21runrttasks22:04:400
329191799241,19cyclictest0-21swapper/022:10:430
329191799241,19cyclictest0-21swapper/021:05:350
329191799241,19cyclictest0-21swapper/019:55:530
329191799241,19cyclictest0-21swapper/000:21:410
329192099239,8cyclictest131rcu_preempt23:45:253
329191899236,4cyclictest131rcu_preempt00:05:151
3291918992312,7cyclictest0-21swapper/123:20:241
3291918992310,10cyclictest3325310-21sh20:45:011
3291918992310,10cyclictest3325310-21sh20:45:001
329191799234,14cyclictest13550irq/42-30be0000.ethernet21:45:150
329191799234,14cyclictest13550irq/42-30be0000.ethernet21:45:150
3291917992316,4cyclictest0-21swapper/023:10:250
3291917992316,3cyclictest0-21swapper/022:29:090
329191799231,18cyclictest0-21swapper/023:02:280
329191799231,18cyclictest0-21swapper/021:21:180
329191799231,10cyclictest3316502-21wc20:20:010
329191799231,10cyclictest3316502-21wc20:20:000
329191799230,19cyclictest0-21swapper/000:29:540
329191899225,8cyclictest131rcu_preempt22:50:241
3291918992216,3cyclictest0-21swapper/121:55:281
3291918992216,3cyclictest0-21swapper/120:05:241
3291918992216,3cyclictest0-21swapper/119:40:281
3291918992214,5cyclictest0-21swapper/100:30:001
3291918992212,7cyclictest3338306-21cat21:20:231
3291917992216,2cyclictest0-21swapper/000:10:060
3291917992216,2cyclictest0-21swapper/000:04:230
3291917992215,3cyclictest3375614-21cron23:10:000
3291917992214,6cyclictest121ktimers/022:35:150
3291917992213,5cyclictest3395847-21unixbench_multi00:05:290
329191799221,19cyclictest0-21swapper/019:22:570
329191799221,18cyclictest3335985-21basename21:15:000
329191799220,20cyclictest0-21swapper/023:41:060
3291918992111,6cyclictest0-21swapper/123:25:251
329191799215,3cyclictest3391975-21ntp_states23:55:230
3291917992114,5cyclictest121ktimers/019:30:220
3291917992113,5cyclictest121ktimers/023:25:290
329191899209,8cyclictest3364005-21awk22:35:151
3291918992014,4cyclictest145-21jbd2/mmcblk1p2-823:40:211
3291918992013,4cyclictest645-21runrttasks21:30:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional