You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-05 - 00:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot5s.osadl.org (updated Sat Jul 04, 2026 12:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3744018996357,4cyclictest3743738-21kworker/u8:2+events_unbound07:15:030
3744018996357,4cyclictest3743738-21kworker/u8:2+events_unbound07:15:020
3744022995343,6cyclictest3831104-21ls11:20:001
3744027995137,11cyclictest311ktimers/207:20:122
3744027995137,11cyclictest311ktimers/207:20:122
3744031994839,5cyclictest3811924-21cron10:25:003
3744018994740,5cyclictest3791320-21kworker/u8:2+events_unbound09:30:360
3744027994618,25cyclictest3842241-21sort11:50:192
3744027994617,25cyclictest0-21swapper/209:20:012
3744027994610,6cyclictest3783952-21unixbench_multi09:00:262
3744027994610,6cyclictest3783952-21unixbench_multi09:00:262
3744031994537,5cyclictest3775670-21cron08:40:013
3744027994534,7cyclictest3851309-21grep12:15:252
3744027994519,23cyclictest0-21swapper/209:45:232
3744022994538,5cyclictest3806670-21kworker/u8:1+events_unbound10:10:411
3744018994538,5cyclictest3804905-21kworker/u8:3+events_unbound10:05:400
3744027994416,24cyclictest3834042-21grep11:25:262
374402799441,16cyclictest3769588-21ls08:20:232
374402799441,16cyclictest3769588-21ls08:20:222
3744018994432,9cyclictest121ktimers/008:20:150
3744018994432,9cyclictest121ktimers/008:20:140
3744031994337,4cyclictest3754942-21kworker/u8:1+events_unbound07:55:113
374402799432,16cyclictest3775255-21head08:35:242
3744018994337,4cyclictest3849974-21kworker/u8:1+events_unbound12:16:040
3744031994231,4cyclictest3784165-21kworker/u8:0+events_unbound09:10:363
3744031994221,4cyclictest131rcu_preempt11:18:513
3744031994220,5cyclictest131rcu_preempt08:55:003
3744027994234,5cyclictest3844959-21ls12:00:002
3744027994234,5cyclictest3844959-21ls11:59:592
3744018994235,5cyclictest3758368-21kworker/u8:0+events_unbound08:25:250
3744018994231,7cyclictest3817046-21sendmail10:40:000
3744031994134,5cyclictest3743738-21kworker/u8:2+events_unbound07:10:013
3744031994130,6cyclictest3806331-21grep10:05:253
374402799413,6cyclictest3761798-21cron08:00:022
374402799412,7cyclictest3764815-21head08:05:252
3744027994116,21cyclictest3753636-21df07:35:142
374402799411,14cyclictest3854359-21grep12:25:242
3744018994134,5cyclictest3797911-21kworker/u8:1+events_unbound09:45:370
3744031994029,7cyclictest0-21swapper/310:00:003
3744031994029,7cyclictest0-21swapper/310:00:003
3744031994028,5cyclictest3843022-21kworker/u8:0+events_unbound12:01:033
3744031994016,11cyclictest0-21swapper/312:34:403
374402799408,5cyclictest3771956-21seq08:26:222
374402799402,9cyclictest3745638-21sh07:15:012
3744027994029,8cyclictest3805094-21apt10:05:002
3744027994029,8cyclictest3805094-21apt10:05:002
3744027994029,7cyclictest3821948-21grep10:50:242
374402799402,10cyclictest164-21systemd-journal08:50:322
374402799401,6cyclictest3747942-21cron07:20:002
374402799401,6cyclictest3747942-21cron07:20:002
3744027994014,3cyclictest3846902-21/usr/sbin/munin12:05:142
3744027994014,22cyclictest0-21swapper/210:40:022
374402799401,12cyclictest3809302-21ntp_states10:15:222
374402799401,11cyclictest3848764-21fschecks_count12:10:152
374402799401,10cyclictest3824095-21seq11:00:002
3744022994034,4cyclictest3822002-21kworker/u8:0+events_unbound11:00:511
3744031993932,4cyclictest3754973-21cron07:40:003
3744031993921,5cyclictest3744011-21cyclictest09:35:253
3744031993915,12cyclictest131rcu_preempt09:05:263
374402799392,9cyclictest438-21cron11:05:002
374402799392,11cyclictest3830743-21sshd11:15:552
374402799391,9cyclictest3802090-21fschecks_count09:55:162
374402799391,9cyclictest3802090-21fschecks_count09:55:162
3744027993914,22cyclictest0-21swapper/207:50:242
3744027993912,24cyclictest0-21swapper/208:15:182
374402799391,11cyclictest3756320-21users07:40:262
3744018993924,9cyclictest131rcu_preempt11:40:210
3744018993912,7cyclictest131rcu_preempt08:35:120
3744031993831,5cyclictest3736945-21kworker/u8:1+events_unbound07:25:033
3744031993827,8cyclictest3820451-21munin-plugin-st10:50:003
374402799383,6cyclictest3772679-21cut08:30:152
374402799382,10cyclictest3856891-21cron12:35:002
374402799382,10cyclictest3839634-21apt-get11:45:042
374402799381,8cyclictest3835803-21grep11:30:262
374402799381,8cyclictest3814845-21grep10:30:262
374402799381,6cyclictest3858594-21cron12:40:002
3744027993812,3cyclictest3793385-21/usr/sbin/munin09:30:202
3744027993812,23cyclictest3796679-21latency_hist09:40:002
374402799381,10cyclictest3838351-21grep11:40:162
374402799381,10cyclictest3820460-21awk10:50:002
3744027993810,4cyclictest3828229-21if_eth111:10:172
3744022993831,5cyclictest145-21jbd2/mmcblk1p2-807:45:061
3744022993830,4cyclictest3754975-21cron07:40:011
3744018993821,13cyclictest0-21swapper/011:55:000
3744031993731,4cyclictest3777883-21kworker/u8:1+events_unbound09:00:323
3744031993731,4cyclictest3777883-21kworker/u8:1+events_unbound09:00:323
3744031993728,6cyclictest0-21swapper/309:20:003
3744031993728,5cyclictest0-21swapper/308:30:253
3744031993720,5cyclictest131rcu_preempt10:30:213
3744031993718,5cyclictest131rcu_preempt10:10:243
3744031993714,12cyclictest0-21swapper/310:40:043
374402799374,5cyclictest3818268-21grep10:40:262
3744027993727,7cyclictest3801667-21cron09:55:012
374402799372,6cyclictest3836444-21/usr/sbin/munin11:35:252
3744027993712,3cyclictest3758457-21latency_hist07:50:012
374402799371,10cyclictest3787371-21tail09:10:252
3744027993710,3cyclictest3807110-21cpuspeed10:10:142
3744027993710,3cyclictest3789982-21/usr/sbin/munin09:20:182
3744018993721,10cyclictest131rcu_preempt12:05:160
3744031993629,5cyclictest3837678-21kworker/u8:2+events_unbound11:51:033
3744031993621,5cyclictest131rcu_preempt11:45:183
3744031993619,5cyclictest131rcu_preempt11:30:233
3744031993619,3cyclictest131rcu_preempt11:43:523
3744031993618,4cyclictest131rcu_preempt07:49:143
374402799368,4cyclictest0-21swapper/208:00:172
3744027993628,5cyclictest3766937-21munin-plugin-st08:15:002
374402799362,10cyclictest164-21systemd-journal08:40:292
3744027993611,5cyclictest311ktimers/207:25:162
3744022993626,7cyclictest3844941-21cron12:00:001
3744022993626,7cyclictest3844941-21cron11:59:591
3744018993623,7cyclictest3791320-21kworker/u8:2+events_unbound09:35:120
3744031993528,5cyclictest3822002-21kworker/u8:0+events_unbound10:55:513
3744031993519,5cyclictest131rcu_preempt07:20:213
3744031993519,5cyclictest131rcu_preempt07:20:213
374403199351,19cyclictest0-21swapper/312:25:123
374402799352,8cyclictest3853501-21cron12:25:012
374402799351,7cyclictest3813214-21head10:25:282
3744027993511,4cyclictest3798434-21latency_hist09:45:022
374402799351,10cyclictest3781459-21fschecks_time08:55:172
374402799351,10cyclictest3752198-21wc07:30:192
3744027993510,3cyclictest3806927-21latency_hist10:10:012
3744022993527,5cyclictest3801670-21cron09:55:001
3744022993527,4cyclictest0-21swapper/111:35:011
3744018993529,4cyclictest3773631-21kworker/u8:2+events_unbound08:40:310
3744018993528,4cyclictest0-21swapper/012:30:250
3744018993524,7cyclictest3837910-21sh11:40:000
3744018993516,10cyclictest3744011-21cyclictest07:55:140
374401899350,9cyclictest11-21ksoftirqd/012:25:130
3744031993426,4cyclictest0-21swapper/311:55:263
3744031993426,4cyclictest0-21swapper/311:55:263
3744031993424,6cyclictest0-21swapper/311:40:003
3744031993419,5cyclictest131rcu_preempt08:15:213
3744031993418,5cyclictest131rcu_preempt07:15:263
3744031993418,5cyclictest131rcu_preempt07:15:263
3744031993416,5cyclictest131rcu_preempt09:30:013
3744031993416,5cyclictest131rcu_preempt08:45:233
3744031993415,5cyclictest131rcu_preempt09:20:113
3744027993414,17cyclictest311ktimers/208:45:252
3744022993425,7cyclictest3767724-21ntp_offset08:15:211
3744022993425,5cyclictest3813629-21munin-plugin-st10:30:001
3744022993422,5cyclictest3799680-21kworker/u8:0+events_unbound10:05:151
3744018993427,4cyclictest0-21swapper/011:15:270
3744018993426,4cyclictest0-21swapper/009:25:160
374401899341,10cyclictest11-21ksoftirqd/007:30:110
3744031993327,4cyclictest3822002-21kworker/u8:0+events_unbound11:10:563
3744031993326,4cyclictest3794861-21cron09:35:003
3744031993324,6cyclictest0-21swapper/312:40:013
3744031993320,5cyclictest131rcu_preempt12:05:163
3744031993318,4cyclictest131rcu_preempt09:49:563
3744031993318,12cyclictest3851787-21munin-plugin-st12:20:003
3744031993317,3cyclictest131rcu_preempt10:54:313
3744031993317,3cyclictest131rcu_preempt07:32:583
3744031993314,5cyclictest131rcu_preempt10:15:173
3744031993314,4cyclictest131rcu_preempt08:07:173
374402799332,6cyclictest1-21systemd12:01:012
374402799332,11cyclictest3810839-21sed10:20:182
374402799331,9cyclictest3831829-21cat11:20:212
3744022993327,4cyclictest3813561-21kworker/u8:1+events_unbound10:32:401
3744022993324,6cyclictest0-21swapper/108:40:021
3744018993327,4cyclictest3817597-21kworker/u8:2+events_unbound10:45:480
3744018993327,3cyclictest0-21swapper/010:20:000
3744018993322,8cyclictest3751101-21grep07:25:260
3744018993321,4cyclictest131rcu_preempt07:35:200
3744018993315,5cyclictest131rcu_preempt11:05:120
3744031993220,3cyclictest131rcu_preempt07:43:313
3744031993217,5cyclictest131rcu_preempt08:25:133
3744031993216,5cyclictest131rcu_preempt11:00:213
3744031993216,3cyclictest131rcu_preempt08:11:413
3744031993215,5cyclictest131rcu_preempt08:55:223
374403199321,14cyclictest0-21swapper/308:00:193
374402799321,11cyclictest3826326-21df11:05:152
3744022993225,4cyclictest3772265-21kthreadd08:30:001
3744022993225,4cyclictest0-21swapper/109:40:241
3744018993223,5cyclictest0-21swapper/010:25:010
374401899321,9cyclictest11-21ksoftirqd/008:10:120
3744018993217,9cyclictest131rcu_preempt12:36:360
3744018993216,5cyclictest131rcu_preempt11:25:020
3744018993213,10cyclictest3745508-21kworker/u8:0-events_freezable_power_07:14:590
3744018993211,11cyclictest0-21swapper/010:13:060
3744031993125,4cyclictest3758368-21kworker/u8:0+events_unbound08:24:413
3744031993125,4cyclictest3758368-21kworker/u8:0+events_unbound08:24:413
3744031993117,3cyclictest131rcu_preempt12:10:263
3744031993116,5cyclictest3754942-21kworker/u8:1+events_unbound07:51:103
3744031993116,4cyclictest131rcu_preempt10:35:223
3744031993115,3cyclictest131rcu_preempt08:41:493
3744031993110,13cyclictest131rcu_preempt11:09:413
3744022993125,4cyclictest438-21cron08:10:011
3744022993123,4cyclictest0-21swapper/110:35:171
3744022993122,6cyclictest3848743-21fschecks_count12:10:151
3744018993125,4cyclictest3787602-21kworker/u8:1+events_unbound09:15:350
3744018993123,5cyclictest0-21swapper/010:40:260
3744018993121,6cyclictest0-21swapper/008:15:170
3744018993120,4cyclictest131rcu_preempt11:25:190
3744018993116,9cyclictest131rcu_preempt11:14:370
3744018993116,5cyclictest131rcu_preempt08:55:180
374401899310,19cyclictest0-21swapper/007:45:130
374403199308,12cyclictest40-21ksoftirqd/309:50:143
374403199304,4cyclictest0-21swapper/311:25:123
3744031993021,6cyclictest0-21swapper/310:25:293
3744031993011,12cyclictest0-21swapper/312:22:353
3744027993010,3cyclictest645-21runrttasks09:09:312
374402299305,4cyclictest131rcu_preempt09:45:121
374402299301,5cyclictest131rcu_preempt11:40:131
3744018993024,4cyclictest3784165-21kworker/u8:0+events_unbound09:02:400
3744018993024,4cyclictest3784165-21kworker/u8:0+events_unbound09:02:400
3744018993023,5cyclictest3764901-21kworker/u8:1+events_unbound08:08:430
3744018993023,3cyclictest0-21swapper/011:30:250
3744018993020,6cyclictest0-21swapper/008:50:010
3744018993018,4cyclictest131rcu_preempt09:05:180
3744018993013,11cyclictest131rcu_preempt10:25:210
3744018993012,5cyclictest3843022-21kworker/u8:0-events_power_efficient11:59:480
3744018993012,5cyclictest3843022-21kworker/u8:0-events_power_efficient11:59:480
3744018993012,12cyclictest3804905-21kworker/u8:3+events_unbound10:53:050
3744031992914,3cyclictest131rcu_preempt11:22:423
3744031992913,3cyclictest131rcu_preempt09:41:093
3744031992912,4cyclictest131rcu_preempt10:03:533
3744031992912,4cyclictest131rcu_preempt10:03:533
3744022992922,3cyclictest0-21swapper/109:55:231
3744022992922,3cyclictest0-21swapper/109:55:231
3744022992919,6cyclictest0-21swapper/109:15:251
3744022992919,5cyclictest0-21swapper/110:40:271
3744018992925,2cyclictest0-21swapper/011:00:160
3744018992920,7cyclictest13550irq/42-30be0000.ethernet12:05:000
3744018992918,4cyclictest131rcu_preempt09:44:420
3744018992917,8cyclictest3800760-21ntpq09:50:190
3744018992916,4cyclictest131rcu_preempt12:20:160
3744018992915,4cyclictest131rcu_preempt08:51:000
3744018992913,10cyclictest131rcu_preempt09:55:200
3744018992913,10cyclictest131rcu_preempt09:55:200
3744018992911,5cyclictest131rcu_preempt11:45:130
3744022992821,3cyclictest0-21swapper/108:30:261
3744022992817,8cyclictest3841280-21seq11:46:481
3744022992810,4cyclictest3749877-21sh07:25:001
3744022992810,4cyclictest3749877-21sh07:25:001
374401899289,13cyclictest0-21swapper/008:30:200
374401899286,3cyclictest131rcu_preempt10:00:120
374401899286,3cyclictest131rcu_preempt10:00:110
374401899285,11cyclictest11-21ksoftirqd/009:20:130
3744018992822,3cyclictest3787410-21unixbench_singl09:10:250
3744018992821,4cyclictest0-21swapper/007:20:130
3744018992821,4cyclictest0-21swapper/007:20:120
3744018992821,3cyclictest0-21swapper/007:40:160
3744018992817,3cyclictest131rcu_preempt11:00:000
3744018992814,8cyclictest131rcu_preempt10:30:120
3744022992720,4cyclictest3848369-21sh12:09:591
3744022992720,3cyclictest0-21swapper/110:05:001
3744022992720,3cyclictest0-21swapper/110:05:001
3744022992719,4cyclictest0-21swapper/108:55:161
3744022992717,6cyclictest0-21swapper/110:20:021
3744022992717,6cyclictest0-21swapper/109:20:251
374402299267,4cyclictest131rcu_preempt09:10:121
3744022992620,4cyclictest3758368-21kworker/u8:0+events_unbound08:21:431
3744022992620,4cyclictest3758368-21kworker/u8:0+events_unbound08:21:431
3744022992619,5cyclictest3835914-21kworker/u8:0+events_unbound11:36:021
3744022992619,3cyclictest0-21swapper/112:35:151
3744022992618,5cyclictest3748099-21latency_hist07:20:021
3744022992618,5cyclictest3748099-21latency_hist07:20:011
3744022992616,6cyclictest0-21swapper/112:05:001
374402299261,22cyclictest3831349-21chrt11:20:141
3744022992611,7cyclictest3822281-21kworker/u8:1+events_unbound10:59:151
3744018992612,8cyclictest131rcu_preempt07:52:550
374402299252,4cyclictest131rcu_preempt12:30:251
3744022992519,4cyclictest3777883-21kworker/u8:1+events_unbound08:52:351
3744022992519,3cyclictest0-21swapper/111:55:001
3744022992517,5cyclictest3759641-21unixbench_multi07:50:241
3744022992517,5cyclictest0-21swapper/108:40:261
3744022992516,5cyclictest231ktimers/107:55:261
374401899257,6cyclictest11-21ksoftirqd/012:10:160
3744018992511,4cyclictest131rcu_preempt08:00:210
3744022992418,4cyclictest3849974-21kworker/u8:1+events_unbound12:20:471
3744022992418,4cyclictest3754942-21kworker/u8:1+events_unbound07:40:151
3744022992417,5cyclictest3787602-21kworker/u8:1+events_unbound09:25:351
3744022992417,4cyclictest0-21swapper/109:40:001
3744022992416,5cyclictest0-21swapper/111:05:171
3744022992416,4cyclictest0-21swapper/107:25:161
3744022992414,6cyclictest0-21swapper/109:05:261
374402299241,3cyclictest3850307-21apt-get12:15:121
3744022992412,8cyclictest1-21systemd08:00:141
374402299240,6cyclictest3794849-21cron09:35:001
374402299234,10cyclictest131rcu_preempt10:20:181
3744022992317,3cyclictest0-21swapper/111:10:171
3744022992316,4cyclictest3827912-21kworker/u8:2+events_unbound11:25:251
3744022992312,7cyclictest3752006-21uniq07:30:161
374402299226,8cyclictest0-21swapper/108:45:241
3744022992215,5cyclictest231ktimers/110:50:331
3744022992215,4cyclictest1-21systemd08:10:201
3744022992215,4cyclictest0-21swapper/107:15:011
3744022992212,3cyclictest24-21ksoftirqd/110:45:261
3744022992115,3cyclictest0-21swapper/109:00:251
3744022992115,3cyclictest0-21swapper/109:00:251
374402799192,13cyclictest3792252-21ntp_states09:25:212
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional