You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-13 - 13:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot5s.osadl.org (updated Thu Aug 13, 2026 00:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4071290995142,5cyclictest4185455-21awk00:40:013
4071287994838,7cyclictest4150490-21grep22:55:252
4071278994740,5cyclictest4101806-21kworker/u8:0+events_unbound20:40:130
4071278994740,5cyclictest4101806-21kworker/u8:0+events_unbound20:40:130
4071278994740,5cyclictest4099757-21kworker/u8:3+events_unbound20:35:120
4071278994735,9cyclictest4178430-21sendmail00:20:000
4071278994735,9cyclictest4178430-21sendmail00:20:000
4071282994538,5cyclictest4078998-21kworker/u8:2+events_unbound20:00:061
4071282994536,5cyclictest4109991-21/usr/sbin/munin21:00:151
4071278994539,4cyclictest4109382-21kworker/u8:1+events_unbound21:50:270
4071278994437,4cyclictest4109382-21kworker/u8:1+events_unbound21:25:240
407128799430,16cyclictest0-21swapper/221:25:142
4071278994337,4cyclictest4137292-21kworker/u8:0+events_unbound22:35:320
4071278994216,6cyclictest131rcu_preempt21:15:120
407129099418,9cyclictest4111542-21latency_hist21:05:013
407129099417,10cyclictest4144651-21mii-tool22:40:173
4071287994134,5cyclictest4075238-21kworker/u8:1+events_unbound19:29:592
4071282994130,7cyclictest0-21swapper/121:30:261
4071278994029,5cyclictest4109382-21kworker/u8:1+events_unbound21:05:180
4071290993929,7cyclictest4073164-21apt-key19:15:013
4071290993929,7cyclictest4073164-21apt-key19:15:013
4071290993925,8cyclictest0-21swapper/320:10:253
4071287993931,5cyclictest0-21swapper/221:20:012
4071287993928,8cyclictest4133853-21idleruntime-cro22:10:002
4071282993931,4cyclictest0-21swapper/119:15:011
4071282993931,4cyclictest0-21swapper/119:15:011
4071282993919,5cyclictest131rcu_preempt23:00:151
4071278993931,4cyclictest0-21swapper/020:20:010
4071278993929,6cyclictest0-21swapper/021:25:000
407127899391,10cyclictest11-21ksoftirqd/000:05:160
407129099384,15cyclictest4101258-21sed20:35:003
4071282993829,6cyclictest0-21swapper/122:25:011
407129099379,9cyclictest4106778-21cut20:50:163
407129099378,11cyclictest4090526-21awk20:00:263
407129099378,10cyclictest4138926-21sshd22:24:293
407129099374,14cyclictest4097828-21latency_hist20:25:013
4071287993726,8cyclictest4109289-21grep20:55:262
4071282993729,6cyclictest4180335-21latency_hist00:25:001
4071282993729,6cyclictest4180335-21latency_hist00:24:591
4071282993728,6cyclictest4102529-21grep20:35:261
4071278993731,4cyclictest4109382-21kworker/u8:1+events_unbound21:10:180
4071290993624,4cyclictest0-21swapper/319:30:013
407129099362,16cyclictest4120598-21fschecks_count21:30:163
4071287993630,4cyclictest4135528-21kworker/u8:3+events_unbound22:20:302
4071287993629,3cyclictest0-21swapper/219:15:012
4071287993629,3cyclictest0-21swapper/219:15:012
4071287993627,6cyclictest7082-21polkitd19:15:022
4071282993627,6cyclictest0-21swapper/100:40:011
4071282993618,4cyclictest0-21swapper/119:45:021
4071282993617,3cyclictest131rcu_preempt21:43:001
407129099359,9cyclictest4175078-21latency_hist00:10:003
407129099358,8cyclictest4181134-21ntp_states00:25:213
4071290993524,8cyclictest4166484-21auditctl23:45:003
4071287993527,4cyclictest0-21swapper/222:10:292
4071282993526,5cyclictest0-21swapper/122:45:161
4071282993526,5cyclictest0-21swapper/120:25:011
4071282993526,4cyclictest0-21swapper/121:05:161
4071282993525,7cyclictest0-21swapper/123:00:001
4071282993520,3cyclictest131rcu_preempt21:15:261
4071278993529,4cyclictest4160894-21kworker/u8:1+events_unbound23:40:480
4071278993528,4cyclictest4130430-21sh22:00:000
4071290993426,4cyclictest0-21swapper/320:45:253
4071290993425,4cyclictest0-21swapper/320:20:013
4071290993424,6cyclictest0-21swapper/320:05:253
4071290993423,7cyclictest0-21swapper/322:30:163
4071287993427,3cyclictest0-21swapper/222:35:242
4071287993427,3cyclictest0-21swapper/220:25:172
4071287993418,6cyclictest4075238-21kworker/u8:1+events_unbound19:41:422
4071287993417,11cyclictest4117284-21kworker/u8:3+events_unbound21:35:522
4071282993423,5cyclictest131rcu_preempt22:10:011
4071282993422,8cyclictest231ktimers/119:45:151
4071282993422,5cyclictest131rcu_preempt22:32:061
4071282993421,4cyclictest131rcu_preempt20:30:281
4071278993427,4cyclictest4140671-21cron22:30:010
407129099339,8cyclictest4084375-21sed19:45:023
4071290993326,4cyclictest4164774-21sh23:40:003
4071290993325,4cyclictest0-21swapper/323:05:163
4071290993324,5cyclictest0-21swapper/321:10:263
4071290993322,7cyclictest4152622-21auditctl23:05:003
4071287993325,4cyclictest0-21swapper/221:30:232
4071287993317,6cyclictest4162836-21kworker/u8:0+events_unbound23:38:032
4071287993316,11cyclictest4135528-21kworker/u8:3+events_unbound22:26:132
4071287993311,13cyclictest4178064-21kworker/u8:0+events_unbound00:24:572
4071287993311,13cyclictest4178064-21kworker/u8:0+events_unbound00:24:572
407128299339,6cyclictest24-21ksoftirqd/100:30:011
4071282993325,4cyclictest0-21swapper/122:25:251
4071282993325,4cyclictest0-21swapper/100:00:161
4071282993323,7cyclictest231ktimers/119:35:021
4071282993323,6cyclictest0-21swapper/121:40:011
407128299332,15cyclictest24-21ksoftirqd/120:25:161
4071282993321,4cyclictest131rcu_preempt21:55:251
4071282993320,5cyclictest131rcu_preempt21:53:251
4071282993320,4cyclictest131rcu_preempt19:55:211
4071282993319,3cyclictest131rcu_preempt23:40:131
4071282993317,3cyclictest131rcu_preempt20:07:211
4071278993327,4cyclictest4090893-21kworker/u8:1+events_unbound20:20:080
4071278993324,7cyclictest4078998-21kworker/u8:2+events_unbound19:40:010
4071278993323,7cyclictest4135552-21auditctl22:15:000
4071278993318,6cyclictest4095014-21kworker/u8:0+events_unbound20:29:410
407129099328,5cyclictest4146597-21ntp_states22:45:223
407129099326,12cyclictest4112554-21timerandwakeup21:05:243
4071290993226,3cyclictest0-21swapper/323:30:163
4071290993224,4cyclictest0-21swapper/323:30:013
4071290993224,4cyclictest0-21swapper/300:10:203
4071287993224,4cyclictest4176304-21grep00:10:242
4071287993216,5cyclictest4137292-21kworker/u8:0+events_unbound22:31:482
4071287993215,10cyclictest4143880-21kworker/u8:3+events_unbound22:48:212
4071287993211,6cyclictest4106062-21kworker/u8:0+events_unbound21:01:512
407128299327,5cyclictest24-21ksoftirqd/119:40:011
4071282993221,7cyclictest0-21swapper/119:15:251
4071282993220,7cyclictest0-21swapper/120:40:241
4071282993220,7cyclictest0-21swapper/120:40:241
407128299321,7cyclictest24-21ksoftirqd/121:15:011
4071282993215,9cyclictest131rcu_preempt22:00:241
4071282993215,9cyclictest131rcu_preempt22:00:241
4071282993214,11cyclictest131rcu_preempt00:05:291
4071282993213,5cyclictest131rcu_preempt23:54:221
4071282993210,4cyclictest0-21swapper/123:55:171
4071282993210,4cyclictest0-21swapper/119:25:231
407127899325,19cyclictest0-21swapper/022:15:230
4071278993226,4cyclictest4109382-21kworker/u8:1+events_unbound21:00:170
4071278993225,4cyclictest4109759-21awk21:00:010
4071278993224,5cyclictest4150492-21unixbench_singl22:55:250
4071278993220,9cyclictest4080753-21sh19:35:010
4071278993219,5cyclictest4072601-21kworker/u8:1+events_unbound19:12:310
4071278993219,5cyclictest4072601-21kworker/u8:1+events_unbound19:12:310
4071278993217,5cyclictest4078998-21kworker/u8:2+events_unbound20:05:080
4071278993215,10cyclictest4160894-21kworker/u8:1+events_unbound23:51:320
4071278993213,11cyclictest4109382-21kworker/u8:1+events_unbound21:47:010
407129099318,5cyclictest4177387-21meminfo00:15:213
407129099318,5cyclictest4177387-21meminfo00:15:213
4071290993123,4cyclictest0-21swapper/300:20:253
4071290993123,4cyclictest0-21swapper/300:20:253
4071290993122,5cyclictest4104652-21grep20:45:003
4071290993122,5cyclictest4104652-21grep20:45:003
4071290993120,5cyclictest0-21swapper/322:00:273
4071290993120,5cyclictest0-21swapper/322:00:273
4071287993125,4cyclictest4128454-21kworker/u8:0+events_unbound22:00:472
4071287993125,4cyclictest4128454-21kworker/u8:0+events_unbound22:00:472
4071287993125,3cyclictest0-21swapper/223:20:002
4071287993125,3cyclictest0-21swapper/222:45:012
4071287993125,3cyclictest0-21swapper/220:40:242
4071287993125,3cyclictest0-21swapper/220:40:242
4071287993124,4cyclictest0-21swapper/221:59:592
4071287993114,5cyclictest4075238-21kworker/u8:1+events_unbound19:30:232
4071287993112,10cyclictest4159101-21kworker/u8:3+events_unbound23:21:532
4071287993112,10cyclictest4159101-21kworker/u8:3+events_unbound23:21:532
4071282993121,7cyclictest231ktimers/121:25:171
4071282993120,8cyclictest231ktimers/123:05:231
4071282993120,7cyclictest231ktimers/122:10:241
4071282993120,5cyclictest4090893-21kworker/u8:1+events_unbound20:14:421
4071282993119,6cyclictest4155911-21kworker/u8:0+events_unbound23:25:561
4071282993115,4cyclictest0-21swapper/123:40:011
4071282993114,9cyclictest131rcu_preempt23:45:231
4071282993113,10cyclictest131rcu_preempt00:14:001
4071282993111,5cyclictest131rcu_preempt22:50:131
407127899316,13cyclictest0-21swapper/000:25:250
4071278993124,3cyclictest0-21swapper/000:20:250
4071278993124,3cyclictest0-21swapper/000:20:250
4071278993111,10cyclictest4166298-21kworker/u8:2+events_unbound23:47:130
407129099308,12cyclictest0-21swapper/321:44:443
407129099305,10cyclictest4149894-21sort22:55:203
407129099304,5cyclictest4126008-21meminfo21:45:183
4071290993023,4cyclictest391ktimers/321:22:273
4071290993016,11cyclictest4134645-21/usr/sbin/munin22:10:203
4071290993014,12cyclictest0-21swapper/323:50:113
407128799307,7cyclictest4175839-21kworker/u8:3+events_unbound00:25:242
407128799307,6cyclictest1-21systemd20:45:132
4071287993013,5cyclictest4171466-21kworker/u8:1+events_unbound23:59:562
4071287993013,10cyclictest131rcu_preempt00:05:152
4071287993012,10cyclictest131rcu_preempt20:25:012
407128299307,20cyclictest231ktimers/122:15:131
407128299303,9cyclictest24-21ksoftirqd/120:55:191
4071282993023,4cyclictest0-21swapper/122:35:241
4071282993021,5cyclictest0-21swapper/123:20:161
4071282993021,5cyclictest0-21swapper/123:20:161
4071282993020,7cyclictest231ktimers/123:30:251
4071282993020,7cyclictest231ktimers/122:40:151
4071282993020,7cyclictest231ktimers/121:50:011
4071282993020,7cyclictest231ktimers/120:45:151
4071282993019,7cyclictest231ktimers/100:30:171
4071282993013,9cyclictest131rcu_preempt23:15:201
4071282993013,9cyclictest131rcu_preempt23:10:231
4071282993010,3cyclictest131rcu_preempt19:53:211
4071278993024,4cyclictest4137292-21kworker/u8:0+events_unbound22:50:130
4071278993023,5cyclictest4104303-21kworker/u8:2+events_unbound20:50:140
4071278993023,4cyclictest0-21swapper/021:40:010
407129099294,8cyclictest0-21swapper/319:30:193
4071290992923,3cyclictest4086114-21apt-get19:50:133
4071290992918,7cyclictest4157730-21sh23:20:003
4071290992917,9cyclictest4077259-21cron19:24:013
4071290992916,10cyclictest4182907-21/usr/sbin/munin00:30:273
4071290992916,10cyclictest4167477-21swap23:45:233
407128799298,12cyclictest131rcu_preempt23:05:182
4071287992923,4cyclictest4178064-21kworker/u8:0+events_unbound00:16:212
4071287992923,4cyclictest4178064-21kworker/u8:0+events_unbound00:16:212
4071287992923,4cyclictest4078998-21kworker/u8:2+events_unbound20:05:062
4071287992922,4cyclictest4166496-21munin-plugin-st23:45:002
4071287992914,9cyclictest4106062-21kworker/u8:0-events_freezable_power_20:53:452
407128799291,14cyclictest164-21systemd-journal19:50:022
407128799291,13cyclictest4126836-21runrttasks21:47:432
407128799290,14cyclictest0-21swapper/223:10:102
407128299299,11cyclictest24-21ksoftirqd/120:55:011
4071282992919,7cyclictest231ktimers/100:20:001
4071282992919,7cyclictest231ktimers/100:20:001
4071282992913,3cyclictest131rcu_preempt19:20:201
4071282992911,11cyclictest131rcu_preempt21:23:161
407127899298,4cyclictest131rcu_preempt21:35:010
407127899298,12cyclictest131rcu_preempt22:09:590
407127899296,15cyclictest131rcu_preempt00:10:190
4071278992920,6cyclictest0-21swapper/000:40:010
4071278992919,7cyclictest380-21ntpd19:40:210
4071278992912,14cyclictest0-21swapper/019:20:130
4071290992820,4cyclictest4171603-21sh00:00:003
4071290992820,4cyclictest4118740-21apt-get21:25:143
4071290992820,4cyclictest0-21swapper/321:50:253
4071290992819,6cyclictest4085168-21/usr/sbin/munin19:45:253
4071290992818,7cyclictest4101591-21/usr/sbin/munin20:35:163
4071290992817,8cyclictest4098062-21munin-node20:25:123
4071290992817,6cyclictest0-21swapper/319:15:043
4071290992815,10cyclictest4143744-21cron22:35:593
4071290992815,10cyclictest4115202-21/usr/sbin/munin21:15:143
4071290992812,11cyclictest4147867-21cut22:50:143
407128799286,8cyclictest131rcu_preempt23:25:262
407128799283,4cyclictest131rcu_preempt19:25:012
4071287992821,5cyclictest4095014-21kworker/u8:0+events_unbound20:15:252
4071287992813,4cyclictest131rcu_preempt22:50:092
407127899287,12cyclictest131rcu_preempt23:55:230
407127899287,12cyclictest131rcu_preempt23:14:000
407127899282,3cyclictest131rcu_preempt20:10:250
4071278992821,4cyclictest0-21swapper/023:30:000
4071278992821,3cyclictest0-21swapper/022:00:180
4071278992821,3cyclictest0-21swapper/022:00:180
407129099279,14cyclictest4087974-21cut19:55:153
407129099275,8cyclictest4173347-21latency_hist00:05:003
4071290992717,7cyclictest4122443-21/usr/sbin/munin21:35:183
4071290992716,8cyclictest4108394-21/usr/sbin/munin20:55:143
4071290992716,6cyclictest4129173-21fschecks_time21:55:173
4071290992715,7cyclictest0-21swapper/323:10:273
407128799277,8cyclictest131rcu_preempt23:00:252
407128799274,7cyclictest131rcu_preempt19:40:012
4071287992719,6cyclictest4160894-21kworker/u8:1+events_unbound23:50:132
4071287992712,8cyclictest32-21ksoftirqd/220:30:102
407128799271,11cyclictest0-21swapper/220:14:322
4071287992711,10cyclictest32-21ksoftirqd/219:50:472
407128799270,12cyclictest0-21swapper/200:30:142
407127899279,9cyclictest131rcu_preempt22:40:240
407127899278,3cyclictest0-21swapper/019:55:150
407127899277,13cyclictest131rcu_preempt23:04:000
407127899277,13cyclictest131rcu_preempt00:00:160
407127899275,14cyclictest131rcu_preempt23:30:240
4071278992721,4cyclictest4157654-21kworker/u8:2+events_unbound23:20:430
4071278992721,4cyclictest4157654-21kworker/u8:2+events_unbound23:20:430
4071278992721,3cyclictest0-21swapper/019:15:030
4071290992620,3cyclictest0-21swapper/322:05:163
4071290992616,7cyclictest4080991-21/usr/sbin/munin19:35:113
407128799267,8cyclictest131rcu_preempt23:30:002
407128799267,8cyclictest131rcu_preempt22:15:172
407128799267,8cyclictest131rcu_preempt19:55:132
407128799264,7cyclictest131rcu_preempt00:40:012
407128799262,20cyclictest629-21snmpd21:05:102
4071287992618,4cyclictest0-21swapper/200:00:332
407127899269,9cyclictest131rcu_preempt23:35:120
407127899269,7cyclictest131rcu_preempt19:50:230
407127899262,7cyclictest4154322-21sh23:10:000
407127899262,20cyclictest4147493-21cron22:50:000
4071278992618,5cyclictest0-21swapper/023:20:000
4071278992617,6cyclictest121ktimers/000:32:370
4071290992519,3cyclictest4135782-21apt-get22:15:113
407128799257,7cyclictest131rcu_preempt23:45:212
407128799257,7cyclictest131rcu_preempt20:35:152
407128799252,4cyclictest4090086-21awk20:00:212
4071287992518,3cyclictest0-21swapper/221:40:152
407128799251,12cyclictest0-21swapper/221:52:572
407127899256,10cyclictest131rcu_preempt20:45:190
407127899255,12cyclictest131rcu_preempt20:30:270
407127899255,11cyclictest131rcu_preempt22:20:090
407127899254,12cyclictest131rcu_preempt21:40:210
4071278992520,3cyclictest4079207-21latency_hist19:30:000
4071278992519,3cyclictest0-21swapper/020:00:260
4071278992518,5cyclictest4135528-21kworker/u8:3+events_unbound22:30:160
407127899246,11cyclictest131rcu_preempt19:45:180
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional