You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-03 - 06:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Mon Aug 03, 2026 00:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2686237995324,4cyclictest2709580-21fschecks_time20:15:163
2686233994942,5cyclictest2789401-21kworker/u8:2+events_unbound00:38:372
2686233994820,7cyclictest131rcu_preempt19:55:142
2686223994835,9cyclictest121ktimers/000:35:150
2686237994719,4cyclictest0-21swapper/322:25:153
2686223994738,6cyclictest2698231-21grep19:40:230
2686233994537,4cyclictest0-21swapper/219:50:002
2686223994334,6cyclictest208-21systemd-logind21:56:120
2686223994329,10cyclictest2690176-21sendmail19:20:000
2686237994230,8cyclictest2699991-21grep19:45:263
2686233994230,9cyclictest311ktimers/222:00:132
2686237994134,4cyclictest2744743-21unixbench_singl21:55:263
2686237994128,8cyclictest2758836-21sendmail22:40:013
2686233994129,9cyclictest311ktimers/220:45:132
2686237994029,7cyclictest0-21swapper/321:50:253
2686233994033,5cyclictest2717526-21kworker/u8:0+events_unbound20:40:562
2686237993929,5cyclictest0-21swapper/321:40:163
2686228993928,8cyclictest231ktimers/119:20:131
2686223993929,7cyclictest2721090-21munin-run20:50:010
2686237993830,5cyclictest2705534-21munin-plugin-st20:05:013
2686233993829,4cyclictest0-21swapper/220:25:172
2686228993826,6cyclictest0-21swapper/119:45:271
2686223993832,3cyclictest645-21runrttasks20:00:140
2686223993828,6cyclictest2743473-21cron21:55:000
2686237993625,7cyclictest0-21swapper/321:20:253
2686237993624,8cyclictest2696559-21grep19:35:243
2686223993627,5cyclictest0-21swapper/021:30:000
2686237993526,6cyclictest2713825-21grep20:25:273
2686237993524,8cyclictest2785853-21tail23:55:253
2686237993523,8cyclictest2761809-21grep22:45:243
2686228993526,6cyclictest0-21swapper/100:15:001
2686228993526,5cyclictest0-21swapper/100:19:591
2686228993525,6cyclictest0-21swapper/120:20:241
2686228993525,6cyclictest0-21swapper/120:20:241
2686228993523,9cyclictest231ktimers/100:20:111
2686223993529,3cyclictest2707439-21idleruntime-cro20:10:000
2686237993427,4cyclictest0-21swapper/321:10:173
2686237993423,8cyclictest391ktimers/323:00:123
2686233993417,10cyclictest2789401-21kworker/u8:2+events_unbound00:33:462
2686228993426,4cyclictest0-21swapper/122:05:001
2686228993413,7cyclictest131rcu_preempt20:30:141
2686223993427,5cyclictest13550irq/42-30be0000.ethernet00:25:220
2686223993427,5cyclictest13550irq/42-30be0000.ethernet00:25:210
2686223993416,3cyclictest2703910-21latency_hist20:00:020
2686237993325,5cyclictest2702096-21sh19:55:013
2686237993325,4cyclictest0-21swapper/323:20:253
2686237993324,6cyclictest0-21swapper/322:05:173
2686237993322,5cyclictest0-21swapper/300:10:013
2686233993325,4cyclictest0-21swapper/222:20:252
2686233993321,9cyclictest311ktimers/220:30:142
2686228993326,5cyclictest2767058-21kworker/u8:4+events_unbound23:18:401
2686228993326,5cyclictest2767058-21kworker/u8:4+events_unbound23:18:401
2686228993326,4cyclictest2698928-21kworker/u8:2+events_unbound20:00:411
2686228993325,4cyclictest0-21swapper/120:10:261
268622399339,4cyclictest11-21ksoftirqd/022:00:210
268622399336,8cyclictest2740113-21cat21:45:010
2686223993324,6cyclictest0-21swapper/000:00:000
2686223993322,8cyclictest2687386-21grep19:10:260
2686223993322,8cyclictest2687386-21grep19:10:260
2686223993322,7cyclictest2726205-21debian-sa121:05:000
2686237993225,4cyclictest2760530-21cron22:45:003
2686233993226,4cyclictest2745089-21kworker/u8:0+events_unbound22:06:162
2686233993225,3cyclictest0-21swapper/223:45:262
2686233993224,4cyclictest0-21swapper/220:00:492
2686228993226,4cyclictest2727919-21munin-plugin-st21:10:011
2686228993226,4cyclictest2709588-21kworker/u8:1+events_unbound20:45:571
2686228993223,4cyclictest0-21swapper/120:50:161
268622899322,12cyclictest24-21ksoftirqd/121:35:121
2686228993215,5cyclictest2685718-21kworker/u8:1+events_unbound19:16:251
2686237993124,4cyclictest0-21swapper/319:55:183
2686237993123,4cyclictest0-21swapper/323:05:253
2686237993123,4cyclictest0-21swapper/319:40:133
2686237993117,11cyclictest391ktimers/323:35:123
2686233993125,4cyclictest2691573-21kworker/u8:2+events_unbound19:25:402
2686233993121,7cyclictest2772457-21sh23:20:002
2686233993121,7cyclictest2772457-21sh23:19:592
2686233993120,7cyclictest2752020-21sendmail22:20:012
2686233993116,5cyclictest2765408-21kworker/u8:0+events_unbound23:00:412
2686233993111,5cyclictest131rcu_preempt00:20:182
268622899318,4cyclictest2728601-21cat21:10:191
2686228993125,4cyclictest2727626-21kworker/u8:1+events_unbound21:21:061
2686228993121,6cyclictest0-21swapper/121:49:591
2686223993122,6cyclictest2789748-21auditctl00:10:010
2686223993122,5cyclictest0-21swapper/021:35:010
2686237993023,3cyclictest0-21swapper/321:45:253
2686237993020,7cyclictest0-21swapper/300:15:013
2686233993023,4cyclictest0-21swapper/220:55:282
2686233993022,6cyclictest2736511-21latency_hist21:35:002
2686233993022,4cyclictest0-21swapper/222:10:262
2686233993022,4cyclictest0-21swapper/219:20:152
2686233993022,4cyclictest0-21swapper/219:15:042
2686233993013,4cyclictest2725920-21kworker/u8:2+events_unbound21:06:102
268623399301,15cyclictest0-21swapper/221:45:132
2686228993021,5cyclictest0-21swapper/123:50:181
2686228993021,5cyclictest0-21swapper/122:40:001
268622399305,7cyclictest11-21ksoftirqd/023:30:160
2686223993024,4cyclictest0-21swapper/019:55:010
2686223993019,3cyclictest131rcu_preempt00:16:440
2686237992919,7cyclictest2798855-21fschecks_count00:35:183
2686233992922,5cyclictest2707376-21kworker/u8:0+events_unbound20:09:422
2686233992922,4cyclictest2729373-21kworker/u8:2+events_unbound21:22:422
2686233992921,5cyclictest2757486-21fschecks_count22:35:152
2686233992918,7cyclictest0-21swapper/222:30:152
268623399290,17cyclictest0-21swapper/223:40:112
2686228992923,4cyclictest2727626-21kworker/u8:1+events_unbound21:26:071
2686228992923,3cyclictest0-21swapper/100:00:011
2686228992921,5cyclictest208-21systemd-logind00:39:381
2686228992921,4cyclictest0-21swapper/120:00:001
2686228992918,7cyclictest0-21swapper/120:10:011
268622399299,7cyclictest11-21ksoftirqd/022:05:210
268622399294,9cyclictest0-21swapper/000:11:430
2686223992922,4cyclictest0-21swapper/023:35:250
2686223992922,3cyclictest0-21swapper/022:16:150
2686223992920,6cyclictest0-21swapper/023:49:590
268622399290,5cyclictest2712793-21apt-get20:25:120
2686237992821,3cyclictest0-21swapper/323:45:013
2686237992818,6cyclictest0-21swapper/322:00:263
268623399287,3cyclictest131rcu_preempt00:05:272
2686233992821,5cyclictest2687525-21kworker/u8:0+events_unbound19:12:412
2686233992821,5cyclictest2687525-21kworker/u8:0+events_unbound19:12:412
2686233992818,6cyclictest2743019-21grep21:50:252
2686228992821,4cyclictest0-21swapper/122:55:171
2686228992821,4cyclictest0-21swapper/122:55:171
2686228992818,6cyclictest0-21swapper/119:30:001
268622399289,6cyclictest11-21ksoftirqd/019:39:450
268622399289,5cyclictest11-21ksoftirqd/023:00:150
268622399289,14cyclictest0-21swapper/020:30:130
268622399284,19cyclictest2776041-21latency_hist23:30:000
268622399283,22cyclictest0-21swapper/022:37:440
2686223992821,4cyclictest0-21swapper/022:25:280
2686223992819,5cyclictest0-21swapper/022:10:250
2686223992814,11cyclictest2757241-21cut22:35:010
2686223992811,13cyclictest0-21swapper/000:30:130
2686223992811,10cyclictest11-21ksoftirqd/020:15:200
2686237992716,7cyclictest2727920-21diskmemload21:10:003
2686233992721,4cyclictest2786332-21cat00:00:002
2686233992721,4cyclictest2729373-21kworker/u8:2+events_unbound21:15:432
2686233992720,5cyclictest2761908-21kworker/u8:2+events_unbound22:55:282
2686233992720,5cyclictest2761908-21kworker/u8:2+events_unbound22:55:272
2686233992720,4cyclictest311ktimers/219:50:122
2686233992718,5cyclictest0-21swapper/223:10:262
268623399271,13cyclictest0-21swapper/200:04:502
268622899276,4cyclictest2739193-21awk21:40:211
2686228992722,3cyclictest0-21swapper/100:00:231
2686228992720,5cyclictest2729373-21kworker/u8:2+events_unbound21:16:041
2686228992720,4cyclictest2712181-21kworker/u8:2+events_unbound20:25:551
2686228992719,4cyclictest0-21swapper/120:20:011
2686228992718,6cyclictest0-21swapper/123:20:181
268622399278,6cyclictest0-21swapper/021:10:210
268622399275,4cyclictest2788254-21cat00:05:020
268622399274,5cyclictest2738139-21apt-get21:40:020
2686223992716,5cyclictest131rcu_preempt22:49:330
2686223992716,4cyclictest131rcu_preempt22:40:200
2686237992618,5cyclictest0-21swapper/323:15:173
2686237992618,5cyclictest0-21swapper/323:15:173
2686237992618,4cyclictest0-21swapper/322:17:003
2686237992618,4cyclictest0-21swapper/320:35:263
2686237992615,7cyclictest2786756-21grep00:00:153
2686237992615,7cyclictest0-21swapper/319:20:253
268623799261,10cyclictest2797387-21cut00:30:223
268623399266,6cyclictest2725723-21unixbench_multi21:00:262
2686233992619,5cyclictest2796392-21kworker/u8:0+events_unbound00:26:162
2686233992619,5cyclictest2796392-21kworker/u8:0+events_unbound00:26:162
2686233992618,6cyclictest2707376-21kworker/u8:0+events_unbound20:20:312
2686233992618,6cyclictest2707376-21kworker/u8:0+events_unbound20:20:302
2686233992618,4cyclictest0-21swapper/221:25:302
2686233992617,5cyclictest0-21swapper/223:05:252
2686233992617,5cyclictest0-21swapper/222:26:172
2686233992617,4cyclictest0-21swapper/223:20:262
2686228992620,4cyclictest2758506-21kworker/u8:2+events_unbound22:40:141
2686228992620,3cyclictest0-21swapper/122:05:241
2686228992618,5cyclictest2724068-21unixbench_singl20:55:281
2686228992618,4cyclictest0-21swapper/119:55:011
2686228992618,4cyclictest0-21swapper/119:10:181
2686228992618,4cyclictest0-21swapper/119:10:171
2686228992617,6cyclictest0-21swapper/119:40:011
2686228992617,5cyclictest0-21swapper/120:40:011
268622899261,4cyclictest131rcu_preempt19:30:131
268622899261,14cyclictest0-21swapper/123:00:251
268622399264,7cyclictest2712367-21chrt20:22:490
268622399264,7cyclictest2712367-21chrt20:22:480
2686223992621,3cyclictest13850irq/36-mmc123:15:010
2686223992619,5cyclictest2722115-21switchtime20:50:250
2686223992619,4cyclictest0-21swapper/023:20:010
2686223992619,4cyclictest0-21swapper/023:20:000
2686223992613,6cyclictest131rcu_preempt20:43:080
268622399260,24cyclictest0-21swapper/022:50:180
268622399260,24cyclictest0-21swapper/022:50:170
268622399260,21cyclictest2692015-21latency_hist19:25:010
2686237992519,3cyclictest0-21swapper/321:35:183
2686237992518,5cyclictest391ktimers/320:40:133
2686237992518,3cyclictest0-21swapper/319:15:043
2686237992517,5cyclictest0-21swapper/321:25:293
2686237992517,4cyclictest0-21swapper/323:10:263
2686237992517,4cyclictest0-21swapper/320:45:183
2686233992517,5cyclictest2705444-21kworker/u8:3+events_unbound20:11:502
2686233992517,4cyclictest0-21swapper/220:15:242
268623399251,6cyclictest0-21swapper/200:10:112
268623399251,12cyclictest0-21swapper/220:50:142
2686228992519,4cyclictest2717526-21kworker/u8:0+events_unbound20:40:131
2686228992519,3cyclictest0-21swapper/122:20:191
2686228992517,4cyclictest0-21swapper/100:25:161
2686228992517,4cyclictest0-21swapper/100:25:151
268622899251,12cyclictest0-21swapper/123:45:031
268622399259,13cyclictest2767592-21apt-get23:05:110
268622399254,18cyclictest2693634-21sed19:30:010
268622399253,12cyclictest11-21ksoftirqd/021:15:230
2686223992519,3cyclictest0-21swapper/021:45:120
2686223992513,10cyclictest2765463-21cron22:58:000
2686223992513,10cyclictest2765463-21cron22:57:590
2686223992512,4cyclictest131rcu_preempt21:21:240
268622399251,20cyclictest0-21swapper/020:36:570
268622399251,20cyclictest0-21swapper/019:49:050
2686223992511,7cyclictest131rcu_preempt22:20:190
2686223992511,11cyclictest2709145-21basename20:15:000
2686237992416,4cyclictest0-21swapper/321:30:263
2686233992416,6cyclictest2780805-21kworker/u8:1+events_unbound23:50:202
268623399241,4cyclictest2684028-21kworker/2:2+mm_percpu_wq19:31:392
2686233992410,6cyclictest32-21ksoftirqd/221:55:202
268622899244,14cyclictest0-21swapper/123:35:171
2686228992418,4cyclictest2770404-21kworker/u8:1+events_unbound23:11:321
2686228992418,4cyclictest2687525-21kworker/u8:0+events_unbound19:40:451
2686228992417,5cyclictest2780805-21kworker/u8:1+events_unbound23:43:501
2686228992416,5cyclictest0-21swapper/121:55:271
2686228992416,5cyclictest0-21swapper/121:30:181
268622399242,20cyclictest2779873-21irqstats23:40:160
2686223992418,3cyclictest2784202-21grep23:50:260
2686223992418,2cyclictest0-21swapper/020:55:210
2686223992411,9cyclictest2726441-21apt-get21:05:130
2686223992411,10cyclictest2773741-21/usr/sbin/munin23:20:250
2686237992317,3cyclictest2750295-21idleruntime-cro22:15:003
2686237992316,4cyclictest0-21swapper/322:20:253
2686237992315,5cyclictest391ktimers/321:15:123
2686237992315,5cyclictest0-21swapper/320:55:263
2686237992315,5cyclictest0-21swapper/320:20:153
2686237992315,5cyclictest0-21swapper/320:20:153
2686237992315,5cyclictest0-21swapper/300:20:233
2686237992314,6cyclictest2792047-21cut00:15:163
2686237992314,6cyclictest2716030-21sort20:35:003
2686233992316,5cyclictest2755066-21kworker/u8:1+events_unbound22:45:552
2686233992316,5cyclictest2738250-21dpkg21:40:002
2686233992316,5cyclictest2734963-21kworker/u8:2+events_unbound21:44:272
2686233992316,3cyclictest0-21swapper/223:35:252
2686233992315,6cyclictest2717526-21kworker/u8:0+events_unbound21:11:002
2686233992314,7cyclictest2687525-21kworker/u8:0+events_unbound19:39:142
2686233992314,6cyclictest2793373-21ls00:20:012
2686233992313,7cyclictest0-21swapper/223:25:202
2686233992313,6cyclictest0-21swapper/220:40:002
2686228992318,2cyclictest0-21swapper/100:05:221
2686228992317,3cyclictest0-21swapper/122:45:211
2686228992317,3cyclictest0-21swapper/100:30:151
2686228992316,5cyclictest2745089-21kworker/u8:0+events_unbound22:10:211
2686228992315,4cyclictest0-21swapper/123:30:211
2686228992315,3cyclictest131rcu_preempt21:01:001
2686228992313,7cyclictest164-21systemd-journal22:30:401
268622399233,10cyclictest11-21ksoftirqd/000:20:190
2686223992317,2cyclictest0-21swapper/019:30:220
2686237992217,2cyclictest0-21swapper/320:10:213
2686237992216,3cyclictest0-21swapper/323:30:263
2686237992216,3cyclictest0-21swapper/320:05:233
2686237992214,4cyclictest2725793-21grep21:00:263
2686233992215,5cyclictest2767058-21kworker/u8:4+events_unbound23:30:012
268623399221,4cyclictest131rcu_preempt19:40:102
2686228992214,6cyclictest2767058-21kworker/u8:4+events_unbound23:25:201
2686228992214,5cyclictest231ktimers/121:50:131
2686228992214,5cyclictest0-21swapper/122:25:231
268622899221,3cyclictest24-21ksoftirqd/123:05:131
2686237992114,5cyclictest2693477-21kworker/u8:1+events_unbound19:30:423
2686237992112,6cyclictest0-21swapper/322:55:213
2686237992112,6cyclictest0-21swapper/322:55:213
268623799211,14cyclictest2782492-21unixbench_singl23:45:253
268623799210,4cyclictest0-21swapper/322:31:323
2686228992115,4cyclictest0-21swapper/122:17:011
2686228992114,5cyclictest231ktimers/122:50:141
2686228992114,5cyclictest231ktimers/122:50:141
268623799206,9cyclictest2722440-21sshd20:50:583
268623799203,12cyclictest2687477-21sshd19:10:353
268623799203,12cyclictest2687477-21sshd19:10:353
2686237992014,3cyclictest0-21swapper/323:50:163
2686237992013,5cyclictest391ktimers/300:28:423
2686237992013,5cyclictest391ktimers/300:28:413
268623399201,3cyclictest2759066-21apt-get22:40:132
2686237991813,3cyclictest2762472-21cpu22:50:143
2686237991813,3cyclictest2762472-21cpu22:50:133
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional