You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-01 - 14:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Wed Apr 01, 2026 00:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3719488995546,5cyclictest3721123-21munin-plugin-st19:15:011
3719486995347,4cyclictest0-21swapper/000:30:110
3719486995341,9cyclictest121ktimers/021:15:120
371948699511,47cyclictest121ktimers/021:30:130
371948699511,47cyclictest121ktimers/021:30:130
3719486994840,5cyclictest3743890-21sh20:20:010
3719486994631,11cyclictest121ktimers/000:20:110
3719492994536,6cyclictest3797140-21grep22:50:252
3719492994434,7cyclictest3769493-21grep21:30:252
3719492994434,7cyclictest3769493-21grep21:30:252
371949299437,5cyclictest131rcu_preempt21:00:142
3719486994332,8cyclictest3814679-21auditctl23:45:000
3719486994332,8cyclictest3814679-21auditctl23:45:000
3719496994234,5cyclictest3750913-21cron20:40:003
3719492994234,5cyclictest3812968-21grep23:40:002
3719496994133,5cyclictest3756646-21runrttasks20:55:173
3719496994133,5cyclictest3756646-21runrttasks20:55:163
3719486994129,7cyclictest0-21swapper/023:00:000
3719496993829,4cyclictest0-21swapper/321:20:003
3719492993828,7cyclictest3752636-21auditctl20:45:002
371948899383,5cyclictest131rcu_preempt19:40:131
3719488993831,4cyclictest438-21cron19:40:011
3719488993828,7cyclictest3725139-21apt19:25:011
3719486993826,8cyclictest0-21swapper/000:40:000
3719488993728,5cyclictest3797143-21unixbench_multi22:50:241
3719486993729,4cyclictest0-21swapper/021:10:260
3719496993628,5cyclictest3753008-21fschecks_count20:45:163
3719492993628,4cyclictest0-21swapper/221:20:002
3719488993627,4cyclictest0-21swapper/100:30:251
3719488993626,6cyclictest0-21swapper/122:35:161
3719488993625,7cyclictest3810828-21grep23:30:241
3719488993625,7cyclictest3769495-21unixbench_singl21:30:251
3719488993625,7cyclictest3769495-21unixbench_singl21:30:241
3719486993629,3cyclictest0-21swapper/020:15:000
3719496993524,7cyclictest0-21swapper/320:55:013
3719496993524,6cyclictest0-21swapper/320:40:253
3719492993525,7cyclictest438-21cron20:10:002
3719488993526,6cyclictest0-21swapper/121:40:011
371948899351,4cyclictest131rcu_preempt19:30:121
3719486993525,6cyclictest0-21swapper/022:00:260
3719486993522,8cyclictest3723011-21taskset19:15:260
3719492993427,4cyclictest0-21swapper/223:05:162
3719492993426,6cyclictest3741993-21kworker/u8:1+events_unbound20:36:342
3719492993423,8cyclictest311ktimers/220:10:122
3719488993425,5cyclictest0-21swapper/123:15:241
3719488993421,8cyclictest0-21swapper/122:45:011
371948899341,7cyclictest131rcu_preempt21:20:121
3719486993423,7cyclictest0-21swapper/000:15:250
3719486993423,6cyclictest0-21swapper/020:40:250
3719496993326,4cyclictest3733665-21latency_hist19:50:013
3719496993325,4cyclictest0-21swapper/320:00:253
3719496993325,4cyclictest0-21swapper/320:00:253
3719496993323,7cyclictest3794205-21sh22:45:013
371948899333,5cyclictest131rcu_preempt23:40:141
371948899333,5cyclictest131rcu_preempt23:40:131
3719488993323,3cyclictest2802268-21kworker/1:2+events00:05:001
371948899332,28cyclictest3804031-21head23:10:251
3719496993224,4cyclictest0-21swapper/322:50:163
3719496993224,4cyclictest0-21swapper/321:01:373
3719496993224,4cyclictest0-21swapper/300:24:593
3719496993222,7cyclictest3740048-21grep20:05:263
3719496993218,4cyclictest131rcu_preempt00:01:523
3719496993218,3cyclictest131rcu_preempt23:32:383
3719496993213,4cyclictest131rcu_preempt19:13:423
3719492993226,3cyclictest0-21swapper/219:50:152
3719492993226,3cyclictest0-21swapper/219:45:252
3719492993224,4cyclictest0-21swapper/200:40:002
3719492993221,8cyclictest3774780-21grep21:45:252
3719488993224,5cyclictest3794580-21fschecks_count22:45:161
3719488993224,4cyclictest0-21swapper/123:40:001
3719488993223,5cyclictest0-21swapper/122:24:591
3719488993223,4cyclictest0-21swapper/120:10:161
3719488993221,7cyclictest0-21swapper/119:45:251
371948699323,25cyclictest3794628-21fschecks_time22:45:160
3719486993224,4cyclictest0-21swapper/021:25:000
3719486993221,7cyclictest0-21swapper/019:40:210
371949699315,6cyclictest40-21ksoftirqd/323:30:003
371949699314,7cyclictest40-21ksoftirqd/321:55:173
371949699313,8cyclictest40-21ksoftirqd/323:05:253
3719496993123,4cyclictest0-21swapper/321:30:003
3719496993117,10cyclictest391ktimers/300:15:133
3719496993115,4cyclictest131rcu_preempt23:01:293
3719492993125,4cyclictest3766263-21kworker/u8:2+events_unbound21:26:412
3719492993124,3cyclictest0-21swapper/223:30:242
3719492993123,4cyclictest0-21swapper/223:50:152
3719492993121,7cyclictest3722961-21grep19:15:262
3719492993121,6cyclictest0-21swapper/220:50:012
3719488993125,4cyclictest3761150-21kworker/u8:0+events_unbound21:10:191
3719488993125,3cyclictest0-21swapper/122:10:001
3719488993125,3cyclictest0-21swapper/122:10:001
3719488993124,3cyclictest0-21swapper/100:00:011
371948899312,3cyclictest131rcu_preempt19:50:121
3719488993121,6cyclictest3757470-21grep20:55:261
3719488993121,6cyclictest3757470-21grep20:55:261
3719488993120,7cyclictest0-21swapper/120:20:011
3719486993127,2cyclictest13850irq/36-mmc120:35:060
3719486993125,3cyclictest13850irq/36-mmc120:05:000
3719486993125,3cyclictest13850irq/36-mmc120:05:000
3719486993119,8cyclictest3745142-21grep20:20:260
371948699311,26cyclictest3727285-21fschecks_time19:30:170
371949699304,6cyclictest40-21ksoftirqd/323:50:003
371949699303,9cyclictest40-21ksoftirqd/321:40:223
3719496993021,6cyclictest0-21swapper/323:40:273
3719496993021,6cyclictest0-21swapper/323:40:273
3719496993017,5cyclictest131rcu_preempt23:54:133
3719496993011,3cyclictest131rcu_preempt20:34:313
371949299306,3cyclictest3766039-21unixbench_multi21:20:252
3719492993023,4cyclictest0-21swapper/221:10:172
371949299302,25cyclictest3791185-21fschecks_count22:35:162
3719492993022,5cyclictest0-21swapper/222:15:132
3719492993022,4cyclictest0-21swapper/219:25:002
3719492993020,5cyclictest0-21swapper/219:25:262
3719492993017,7cyclictest3739578-21kworker/u8:0+events_unbound20:19:282
371949299301,6cyclictest131rcu_preempt00:30:112
3719488993024,3cyclictest0-21swapper/122:20:001
3719488993021,7cyclictest3743705-21kworker/u8:3-ext4-rsv-conversion20:30:011
3719488993021,4cyclictest0-21swapper/122:00:251
3719488993019,7cyclictest0-21swapper/123:50:241
3719486993023,4cyclictest3794203-21cron22:45:010
3719486993023,4cyclictest0-21swapper/023:05:250
3719486993022,4cyclictest0-21swapper/022:20:250
3719486993022,4cyclictest0-21swapper/021:05:230
3719486993022,4cyclictest0-21swapper/021:00:290
371949699298,12cyclictest40-21ksoftirqd/322:35:133
371949699295,7cyclictest40-21ksoftirqd/323:35:183
371949699295,15cyclictest40-21ksoftirqd/319:55:413
371949699294,8cyclictest40-21ksoftirqd/322:05:203
371949699294,8cyclictest40-21ksoftirqd/322:05:193
371949699293,8cyclictest40-21ksoftirqd/300:25:213
371949699292,7cyclictest40-21ksoftirqd/322:05:013
3719496992921,5cyclictest3723413-21cron19:20:003
3719496992921,4cyclictest0-21swapper/319:35:173
3719496992919,7cyclictest391ktimers/320:15:243
3719496992918,4cyclictest131rcu_preempt22:20:413
371949699291,6cyclictest40-21ksoftirqd/321:45:173
3719496992914,4cyclictest131rcu_preempt00:35:163
371949699290,11cyclictest0-21swapper/323:12:003
371949299298,4cyclictest131rcu_preempt21:40:012
3719492992922,4cyclictest3816385-21idleruntime-cro23:50:002
3719492992922,3cyclictest0-21swapper/221:00:002
3719492992922,3cyclictest0-21swapper/221:00:002
3719488992923,3cyclictest3723421-21kthreadd19:20:011
3719488992923,3cyclictest0-21swapper/119:25:241
3719488992921,5cyclictest0-21swapper/100:10:001
3719488992921,4cyclictest3816383-21kthreadd23:50:001
3719488992919,6cyclictest3771778-21kworker/u8:2+events_unbound21:40:241
3719488992914,9cyclictest3825536-21kworker/u8:1+events_unbound00:28:051
3719486992922,3cyclictest13550irq/42-30be0000.ethernet22:20:000
3719486992922,3cyclictest0-21swapper/021:40:230
3719486992918,7cyclictest0-21swapper/023:00:160
371949699288,5cyclictest391ktimers/322:30:163
371949699287,6cyclictest40-21ksoftirqd/322:45:123
371949699284,7cyclictest40-21ksoftirqd/319:30:013
371949699284,6cyclictest40-21ksoftirqd/321:30:253
371949699284,6cyclictest40-21ksoftirqd/321:30:253
371949699284,6cyclictest40-21ksoftirqd/321:10:253
371949699283,7cyclictest40-21ksoftirqd/319:20:263
371949699282,9cyclictest40-21ksoftirqd/322:15:003
3719496992822,4cyclictest381rcuc/319:52:313
3719496992817,7cyclictest0-21swapper/323:20:273
3719496992815,7cyclictest0-21swapper/323:00:013
3719496992813,2cyclictest131rcu_preempt22:17:113
3719496992812,9cyclictest131rcu_preempt23:15:113
3719496992811,10cyclictest131rcu_preempt19:32:283
371949299287,6cyclictest131rcu_preempt23:05:002
3719492992823,3cyclictest3799327-21sendmail23:00:012
3719492992822,4cyclictest3776706-21kworker/u8:2+events_unbound22:26:522
3719492992821,4cyclictest3813376-21fschecks_count23:40:182
3719492992821,4cyclictest3813376-21fschecks_count23:40:172
3719492992820,5cyclictest0-21swapper/200:00:002
371949299281,6cyclictest3760063-21fschecks_count21:05:142
371949299280,4cyclictest131rcu_preempt19:55:152
3719488992820,4cyclictest0-21swapper/120:00:001
3719488992816,9cyclictest231ktimers/120:00:121
3719488992816,9cyclictest231ktimers/120:00:111
3719488992811,10cyclictest3766263-21kworker/u8:2+events_unbound21:26:261
3719486992821,4cyclictest0-21swapper/023:30:240
3719486992820,5cyclictest0-21swapper/020:50:250
3719486992816,5cyclictest3739578-21kworker/u8:0+events_unbound20:08:420
371949699278,16cyclictest391ktimers/319:40:203
3719496992717,7cyclictest391ktimers/321:06:153
3719496992714,3cyclictest0-21swapper/320:20:243
3719496992710,10cyclictest131rcu_preempt23:55:213
371949699270,9cyclictest40-21ksoftirqd/300:10:163
3719492992721,3cyclictest0-21swapper/222:05:012
3719492992721,3cyclictest0-21swapper/200:25:262
3719492992721,3cyclictest0-21swapper/200:10:162
3719492992718,6cyclictest3827469-21sh00:25:002
3719492992717,7cyclictest1-21systemd22:41:552
3719492992716,7cyclictest0-21swapper/222:20:252
3719492992716,6cyclictest3748541-21grep20:30:252
3719492992713,10cyclictest311ktimers/219:10:132
3719488992720,5cyclictest3759414-21kworker/u8:1+events_unbound21:55:161
3719488992719,5cyclictest0-21swapper/100:15:001
3719488992718,5cyclictest3764776-21cron21:20:001
3719488992714,7cyclictest24-21ksoftirqd/121:00:281
3719488992710,10cyclictest0-21swapper/123:05:381
3719486992715,8cyclictest0-21swapper/022:15:000
371949699269,5cyclictest131rcu_preempt21:35:023
371949699268,4cyclictest131rcu_preempt20:26:573
371949699265,4cyclictest40-21ksoftirqd/321:53:513
371949699264,14cyclictest40-21ksoftirqd/320:10:183
3719496992620,3cyclictest381rcuc/321:21:363
3719496992617,6cyclictest0-21swapper/322:25:243
3719496992616,8cyclictest391ktimers/300:30:133
371949299266,4cyclictest131rcu_preempt00:20:012
3719492992619,5cyclictest0-21swapper/223:10:152
3719492992619,4cyclictest0-21swapper/222:35:012
3719488992618,4cyclictest0-21swapper/122:30:241
3719488992615,7cyclictest3749036-21gpgv20:35:011
3719486992619,4cyclictest3721251-21munin-node19:15:000
3719486992619,4cyclictest0-21swapper/020:30:250
3719486992618,5cyclictest0-21swapper/023:25:000
3719486992617,6cyclictest3821038-21grep00:00:250
371949299255,4cyclictest131rcu_preempt20:55:022
371948899256,7cyclictest131rcu_preempt23:25:251
3719488992515,6cyclictest208-21systemd-logind00:37:161
371948899251,13cyclictest0-21swapper/122:10:171
3719486992515,6cyclictest3822787-21grep00:10:120
3719486992514,9cyclictest3777169-21/usr/sbin/munin21:55:160
371948699251,20cyclictest0-21swapper/022:54:310
3719496992411,5cyclictest131rcu_preempt00:05:593
371949299248,8cyclictest0-21swapper/220:03:292
371949299248,8cyclictest0-21swapper/220:03:292
371949299242,4cyclictest131rcu_preempt22:10:162
3719492992417,5cyclictest3729938-21kworker/u8:2+events_unbound19:37:352
3719492992417,3cyclictest0-21swapper/223:15:152
3719492992411,7cyclictest131rcu_preempt20:20:192
371948899245,3cyclictest131rcu_preempt20:55:021
3719488992417,5cyclictest3788902-21kworker/u8:0+events_unbound22:29:191
3719488992417,3cyclictest0-21swapper/121:50:251
3719488992415,6cyclictest0-21swapper/120:05:271
3719488992412,5cyclictest3743705-21kworker/u8:3+events_unbound20:20:201
3719486992417,4cyclictest13550irq/42-30be0000.ethernet19:35:160
3719486992416,5cyclictest0-21swapper/019:20:180
371948699241,5cyclictest0-21swapper/023:36:500
3719486992414,7cyclictest121ktimers/022:25:140
3719486992414,6cyclictest0-21swapper/023:50:130
3719486992414,6cyclictest0-21swapper/019:55:280
3719492992318,2cyclictest0-21swapper/223:25:192
3719492992317,3cyclictest0-21swapper/221:56:482
371949299230,7cyclictest3775728-21cat21:50:162
3719488992317,4cyclictest3794088-21kworker/u8:2+events_unbound22:57:001
3719488992317,4cyclictest3794088-21kworker/u8:2+events_unbound00:23:131
3719488992317,3cyclictest0-21swapper/121:45:171
3719488992317,3cyclictest0-21swapper/120:45:011
371948899231,4cyclictest3760404-21sed21:05:171
371948899231,12cyclictest0-21swapper/123:00:181
371948899231,12cyclictest0-21swapper/120:37:481
371948699238,13cyclictest121ktimers/020:45:120
3719486992316,3cyclictest0-21swapper/022:05:400
3719486992316,3cyclictest0-21swapper/022:05:390
3719486992316,3cyclictest0-21swapper/021:52:250
3719486992316,3cyclictest0-21swapper/021:37:410
3719486992315,6cyclictest121ktimers/021:25:130
3719486992314,6cyclictest0-21swapper/023:15:130
3719486992314,5cyclictest121ktimers/021:45:210
371948699231,18cyclictest0-21swapper/023:25:070
371948699231,18cyclictest0-21swapper/023:13:470
371948699231,18cyclictest0-21swapper/022:37:200
371948699231,18cyclictest0-21swapper/019:52:400
371948699230,19cyclictest0-21swapper/023:56:580
371948699230,19cyclictest0-21swapper/019:48:430
371948699230,19cyclictest0-21swapper/000:06:560
371949299227,6cyclictest3769554-21kworker/u8:3+events_unbound21:41:142
3719492992216,3cyclictest0-21swapper/223:20:222
3719492992216,3cyclictest0-21swapper/200:10:012
3719492992215,5cyclictest3739578-21kworker/u8:0+events_unbound20:27:462
3719488992216,3cyclictest0-21swapper/120:45:241
3719486992216,4cyclictest0-21swapper/019:25:130
3719486992216,2cyclictest0-21swapper/022:30:180
371948699221,19cyclictest0-21swapper/020:56:060
371948699221,19cyclictest0-21swapper/020:56:050
371948699221,17cyclictest0-21swapper/023:45:080
371949299219,8cyclictest3731542-21grep19:40:262
371949299212,3cyclictest131rcu_preempt22:45:252
3719492992115,3cyclictest0-21swapper/219:30:232
3719492992114,4cyclictest0-21swapper/222:06:052
3719492992114,4cyclictest0-21swapper/222:06:052
371948899218,4cyclictest221rcuc/100:15:141
371949299201,3cyclictest131rcu_preempt00:00:142
371948699201,17cyclictest0-21swapper/020:25:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional