You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-18 - 14:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot5s.osadl.org (updated Tue Aug 18, 2026 00:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
618778995345,4cyclictest709081-21ls23:29:590
618790995141,6cyclictest733223-21sendmail00:40:003
618790995141,6cyclictest733223-21sendmail00:39:593
618783995144,4cyclictest643827-21sendmail20:20:001
618783994738,5cyclictest733202-21munin-run00:40:001
618783994738,5cyclictest733202-21munin-run00:40:001
618783994738,5cyclictest673034-21cron21:45:001
618790994632,10cyclictest652565-21cron20:45:013
618783994332,7cyclictest0-21swapper/119:25:011
618790994235,5cyclictest729654-21kworker/u8:1+events_unbound00:32:423
618790994235,5cyclictest729654-21kworker/u8:1+events_unbound00:32:413
618790994233,5cyclictest698837-21munin-run23:00:013
618778994236,3cyclictest642116-21idleruntime-cro20:14:590
618790994135,4cyclictest618491-21kworker/u8:0+events_unbound19:11:563
618790994129,9cyclictest391ktimers/319:45:113
618790994127,4cyclictest131rcu_preempt21:20:313
618790994126,4cyclictest131rcu_preempt22:34:053
618790994126,4cyclictest131rcu_preempt22:34:053
618787994130,8cyclictest311ktimers/200:20:132
618790994033,5cyclictest674539-21kworker/u8:3+events_unbound22:02:213
618790994026,9cyclictest0-21swapper/320:20:003
618787994028,9cyclictest311ktimers/221:05:122
618783994033,4cyclictest0-21swapper/100:29:591
618783994019,14cyclictest384037-21kworker/u8:2+events_unbound19:15:121
618790993933,4cyclictest629684-21kworker/u8:1+events_unbound19:36:583
618790993930,5cyclictest0-21swapper/323:50:173
618790993930,5cyclictest0-21swapper/323:50:173
618790993928,4cyclictest679758-21kworker/u8:1+events_unbound22:08:423
618790993920,4cyclictest0-21swapper/320:35:153
618790993920,11cyclictest131rcu_preempt22:40:263
618790993918,4cyclictest0-21swapper/323:29:123
618787993929,6cyclictest0-21swapper/223:20:012
618790993832,4cyclictest717514-21kworker/u8:0+events_unbound00:07:393
618790993832,4cyclictest625082-21kworker/u8:3+events_unbound19:41:593
618790993832,4cyclictest625082-21kworker/u8:3+events_unbound19:31:593
618790993832,4cyclictest620273-21kworker/u8:1+events_unbound19:16:573
618790993827,4cyclictest662426-21kworker/u8:1+events_unbound21:17:153
618790993823,4cyclictest131rcu_preempt20:11:283
618790993820,10cyclictest131rcu_preempt21:43:413
618790993817,11cyclictest660720-21kworker/u8:0-rpciod21:06:413
618787993826,9cyclictest311ktimers/221:15:132
61877899385,5cyclictest131rcu_preempt20:00:140
61877899385,4cyclictest131rcu_preempt21:45:130
61877899382,5cyclictest131rcu_preempt22:35:110
618790993724,4cyclictest131rcu_preempt23:24:283
618790993724,10cyclictest391ktimers/322:10:113
618787993727,6cyclictest0-21swapper/221:50:252
618778993726,6cyclictest0-21swapper/021:10:230
61879099367,9cyclictest40-21ksoftirqd/320:35:013
618790993630,4cyclictest676248-21kworker/u8:1+events_unbound21:57:203
618790993630,4cyclictest655660-21kworker/u8:1+events_unbound20:52:143
618790993623,4cyclictest131rcu_preempt21:32:343
618790993623,4cyclictest131rcu_preempt21:32:343
618790993622,4cyclictest131rcu_preempt22:29:213
618790993622,4cyclictest131rcu_preempt22:29:213
618790993619,4cyclictest131rcu_preempt23:47:533
618790993619,4cyclictest131rcu_preempt23:47:523
618790993618,3cyclictest0-21swapper/323:56:423
618790993616,9cyclictest131rcu_preempt23:04:073
618790993616,5cyclictest131rcu_preempt00:00:263
618790993615,6cyclictest695657-21kworker/u8:0-events_freezable_power_23:06:073
618783993628,4cyclictest0-21swapper/100:15:011
618790993527,6cyclictest717514-21kworker/u8:0+events_unbound00:27:423
618790993526,5cyclictest0-21swapper/323:15:143
618790993525,5cyclictest0-21swapper/320:00:013
618790993519,5cyclictest131rcu_preempt21:52:363
618790993519,4cyclictest131rcu_preempt22:50:173
618790993516,5cyclictest660720-21kworker/u8:0-flush-179:9621:13:323
618787993526,6cyclictest0-21swapper/221:10:122
618787993524,7cyclictest0-21swapper/220:20:172
618783993528,5cyclictest717514-21kworker/u8:0+events_unbound00:22:411
618783993527,4cyclictest0-21swapper/123:30:261
618778993526,4cyclictest0-21swapper/021:17:140
618778993525,6cyclictest0-21swapper/019:35:010
618778993523,9cyclictest121ktimers/000:35:130
618778993523,9cyclictest121ktimers/000:35:130
618778993522,8cyclictest0-21swapper/022:10:010
618790993424,7cyclictest0-21swapper/319:25:003
618790993420,4cyclictest131rcu_preempt20:59:443
618790993418,9cyclictest131rcu_preempt23:37:343
618790993418,4cyclictest131rcu_preempt00:12:283
618787993426,5cyclictest0-21swapper/219:40:012
618787993424,6cyclictest0-21swapper/222:55:252
618787993424,6cyclictest0-21swapper/221:30:232
618787993424,6cyclictest0-21swapper/221:30:232
618783993427,4cyclictest681777-21apt-key22:10:001
618783993423,7cyclictest0-21swapper/122:00:271
618783993415,5cyclictest700512-21kworker/u8:1+events_unbound23:15:011
618778993427,4cyclictest731058-21unixbench_singl00:30:240
618778993427,4cyclictest731058-21unixbench_singl00:30:240
61879099336,7cyclictest40-21ksoftirqd/322:50:003
618790993327,4cyclictest633202-21kworker/u8:1+events_unbound19:51:583
618790993322,4cyclictest131rcu_preempt21:29:483
618790993321,4cyclictest131rcu_preempt21:48:063
618790993321,4cyclictest131rcu_preempt00:19:483
618790993320,4cyclictest131rcu_preempt20:04:123
618790993319,9cyclictest391ktimers/322:15:103
618790993316,4cyclictest131rcu_preempt23:10:183
618790993315,10cyclictest131rcu_preempt20:05:063
618790993315,10cyclictest131rcu_preempt20:05:063
618790993312,5cyclictest131rcu_preempt20:25:213
618787993324,6cyclictest0-21swapper/219:20:012
618787993322,7cyclictest0-21swapper/223:10:252
618787993318,11cyclictest311ktimers/219:25:142
618783993325,5cyclictest0-21swapper/123:15:221
618783993325,4cyclictest0-21swapper/120:25:261
618783993324,6cyclictest677668-21seq21:55:291
618778993329,2cyclictest631456-21kworker/u8:0+events_unbound19:46:580
618778993326,4cyclictest0-21swapper/019:25:010
618778993324,6cyclictest657696-21sendmail21:00:000
618790993224,4cyclictest0-21swapper/323:30:163
618790993222,5cyclictest0-21swapper/321:35:283
618790993216,4cyclictest0-21swapper/322:24:543
618790993215,4cyclictest131rcu_preempt22:37:133
618790993214,4cyclictest131rcu_preempt20:46:363
61878799322,4cyclictest131rcu_preempt20:40:132
618787993224,4cyclictest0-21swapper/222:00:162
618787993223,5cyclictest0-21swapper/219:35:002
618787993222,6cyclictest0-21swapper/222:05:162
618787993222,6cyclictest0-21swapper/220:25:272
618787993220,7cyclictest0-21swapper/219:55:262
618783993223,5cyclictest0-21swapper/120:45:011
618778993225,5cyclictest681486-21kworker/u8:0+events_unbound22:28:430
618778993225,5cyclictest681486-21kworker/u8:0+events_unbound22:28:430
61877899321,4cyclictest131rcu_preempt19:50:110
618790993123,6cyclictest717514-21kworker/u8:0+events_unbound00:21:413
618790993117,4cyclictest131rcu_preempt19:26:103
618790993114,9cyclictest131rcu_preempt23:44:473
618787993124,4cyclictest692012-21munin-plugin-st22:40:002
618787993123,4cyclictest624641-21sh19:25:012
618787993123,4cyclictest0-21swapper/222:50:262
618787993122,5cyclictest0-21swapper/200:10:262
618787993121,6cyclictest0-21swapper/219:50:242
618783993124,4cyclictest0-21swapper/120:55:281
618783993124,4cyclictest0-21swapper/120:10:271
618778993123,4cyclictest0-21swapper/000:25:280
618778993120,8cyclictest678146-21sh22:00:010
61877899311,4cyclictest131rcu_preempt22:20:140
618790993012,10cyclictest131rcu_preempt20:20:273
618790993011,4cyclictest131rcu_preempt21:00:133
618787993022,4cyclictest0-21swapper/223:55:172
618787993022,4cyclictest0-21swapper/222:25:272
618787993022,4cyclictest0-21swapper/222:25:262
618787993022,4cyclictest0-21swapper/221:40:172
618787993021,5cyclictest0-21swapper/223:30:252
618783993022,4cyclictest0-21swapper/123:45:161
618783993022,4cyclictest0-21swapper/123:45:161
618783993022,4cyclictest0-21swapper/121:25:281
618783993022,4cyclictest0-21swapper/120:50:011
618783993022,4cyclictest0-21swapper/100:05:291
618783993013,3cyclictest24-21ksoftirqd/120:00:261
61877899305,3cyclictest131rcu_preempt00:20:000
61877899303,4cyclictest131rcu_preempt20:15:140
618778993023,4cyclictest0-21swapper/000:20:180
618778993022,6cyclictest121ktimers/022:40:130
618778993019,7cyclictest679395-21grep22:00:270
61878799296,5cyclictest131rcu_preempt23:00:122
618787992922,4cyclictest311ktimers/222:43:312
618787992921,4cyclictest0-21swapper/220:57:132
618787992921,4cyclictest0-21swapper/200:15:232
618787992920,6cyclictest0-21swapper/219:45:012
618787992920,5cyclictest0-21swapper/223:50:202
618787992920,5cyclictest0-21swapper/223:50:202
618787992919,7cyclictest0-21swapper/221:25:002
618783992923,4cyclictest633202-21kworker/u8:1+events_unbound19:57:001
618783992922,5cyclictest625082-21kworker/u8:3+events_unbound19:40:411
618783992922,3cyclictest0-21swapper/119:45:251
618783992921,5cyclictest1-21systemd23:22:351
618783992921,4cyclictest0-21swapper/120:05:281
618783992921,4cyclictest0-21swapper/120:05:271
618783992921,4cyclictest0-21swapper/100:30:251
618783992921,4cyclictest0-21swapper/100:30:251
618783992920,6cyclictest0-21swapper/122:20:271
618783992920,6cyclictest0-21swapper/119:30:261
618783992919,7cyclictest673485-21grep21:45:171
618783992918,8cyclictest0-21swapper/122:15:161
618783992918,7cyclictest650431-21grep20:35:261
61877899292,8cyclictest711590-21/usr/sbin/munin23:35:220
618778992921,5cyclictest0-21swapper/023:55:000
618778992921,5cyclictest0-21swapper/023:55:000
618778992919,6cyclictest667526-21grep21:25:270
61878799283,4cyclictest0-21swapper/200:30:242
61878799283,4cyclictest0-21swapper/200:30:242
618787992820,4cyclictest0-21swapper/221:00:282
618787992819,5cyclictest0-21swapper/223:50:002
618787992819,5cyclictest0-21swapper/223:50:002
61878799281,13cyclictest650884-21idleruntime-cro20:40:012
618783992820,4cyclictest0-21swapper/123:40:001
618783992819,7cyclictest231ktimers/123:25:141
61878399281,6cyclictest0-21swapper/121:00:161
618778992821,4cyclictest0-21swapper/020:40:000
618778992820,4cyclictest0-21swapper/021:35:280
618778992820,4cyclictest0-21swapper/020:55:010
618787992719,5cyclictest0-21swapper/223:35:252
618787992718,6cyclictest0-21swapper/221:45:272
61878799271,16cyclictest0-21swapper/222:30:182
61878799271,16cyclictest0-21swapper/222:30:182
618783992720,4cyclictest703725-21kworker/u8:2+events_unbound23:40:231
618783992719,4cyclictest0-21swapper/121:15:251
618783992719,4cyclictest0-21swapper/121:10:131
618783992718,6cyclictest231ktimers/122:55:221
618783992717,5cyclictest0-21swapper/121:30:241
618783992717,5cyclictest0-21swapper/121:30:241
618783992711,10cyclictest24-21ksoftirqd/119:35:241
61877899278,7cyclictest131rcu_preempt21:02:130
618778992721,4cyclictest652199-21kworker/u8:2+events_unbound21:07:150
618778992721,3cyclictest0-21swapper/023:00:250
618778992721,3cyclictest0-21swapper/022:10:240
618778992716,7cyclictest648689-21sshd20:32:040
618778992716,6cyclictest0-21swapper/000:00:310
618787992619,3cyclictest0-21swapper/220:15:262
618787992618,5cyclictest728434-21fschecks_count00:25:182
618787992618,5cyclictest0-21swapper/220:10:272
618787992618,5cyclictest0-21swapper/219:10:262
618787992613,4cyclictest131rcu_preempt22:15:112
618783992619,5cyclictest671110-21kworker/u8:0+events_unbound21:50:161
618783992619,4cyclictest681486-21kworker/u8:0+events_unbound22:31:411
618783992619,4cyclictest681486-21kworker/u8:0+events_unbound22:31:401
618783992619,4cyclictest0-21swapper/121:05:281
618783992618,5cyclictest0-21swapper/122:45:271
618783992618,4cyclictest0-21swapper/123:55:001
618783992618,4cyclictest0-21swapper/123:55:001
618783992610,7cyclictest24-21ksoftirqd/100:00:151
618778992619,4cyclictest0-21swapper/019:40:270
618778992618,5cyclictest0-21swapper/023:20:260
618778992618,5cyclictest0-21swapper/000:15:010
618778992617,5cyclictest0-21swapper/020:40:210
61877899260,7cyclictest646819-21unixbench_singl20:25:270
618787992518,3cyclictest0-21swapper/222:00:012
618783992519,4cyclictest645498-21kworker/u8:1+events_unbound20:32:051
618783992519,3cyclictest0-21swapper/121:20:131
618783992518,5cyclictest695657-21kworker/u8:0+events_unbound23:05:071
618783992517,5cyclictest0-21swapper/123:59:591
618783992517,5cyclictest0-21swapper/122:10:151
61878399251,6cyclictest692312-21cpu22:40:151
618783992515,6cyclictest0-21swapper/121:35:181
618783992515,5cyclictest0-21swapper/122:25:171
618783992515,5cyclictest0-21swapper/122:25:161
61877899255,4cyclictest131rcu_preempt22:50:170
61877899252,3cyclictest131rcu_preempt23:10:010
618778992521,2cyclictest13550irq/42-30be0000.ethernet21:40:130
618778992521,2cyclictest13550irq/42-30be0000.ethernet20:20:140
618778992519,4cyclictest715784-21kworker/u8:3+events_unbound23:56:140
618778992519,3cyclictest0-21swapper/022:45:170
618778992519,3cyclictest0-21swapper/019:10:170
61877899251,5cyclictest131rcu_preempt21:50:120
618778992515,7cyclictest705648-21cron23:20:010
618778992515,7cyclictest0-21swapper/022:15:220
618787992418,3cyclictest0-21swapper/220:35:012
618787992416,5cyclictest311ktimers/223:27:392
618787992416,5cyclictest0-21swapper/220:45:162
618787992416,4cyclictest720628-21unixbench_singl00:00:322
618787992415,7cyclictest712875-21cut23:40:152
618783992417,4cyclictest655523-21tail20:50:261
618783992416,5cyclictest692001-21cron22:40:001
61877899245,11cyclictest131rcu_preempt19:25:170
61877899242,20cyclictest0-21swapper/023:34:090
618778992418,4cyclictest695657-21kworker/u8:0+events_unbound22:57:140
618778992417,3cyclictest0-21swapper/021:30:550
618778992417,3cyclictest0-21swapper/021:30:550
61877899241,19cyclictest0-21swapper/023:46:510
61877899241,19cyclictest0-21swapper/023:46:510
61877899241,19cyclictest0-21swapper/019:36:300
618787992317,3cyclictest0-21swapper/200:05:222
618787992315,5cyclictest0-21swapper/221:35:282
618787992315,4cyclictest0-21swapper/220:00:272
61878799231,15cyclictest654959-21/usr/sbin/munin20:50:212
61878799231,13cyclictest707394-21idleruntime-cro23:25:012
61878399238,3cyclictest131rcu_preempt00:15:131
618783992316,5cyclictest384037-21kworker/u8:2+events_unbound19:25:301
618783992315,5cyclictest700079-21grep23:00:261
618783992313,7cyclictest24-21ksoftirqd/122:50:161
618783992312,7cyclictest0-21swapper/119:50:191
61877899232,3cyclictest665779-21grep21:20:260
618778992319,2cyclictest13550irq/42-30be0000.ethernet19:55:140
618778992316,4cyclictest0-21swapper/000:05:280
618778992315,5cyclictest13850irq/36-mmc120:45:220
618778992314,7cyclictest640417-21munin-plugin-st20:10:010
618778992314,7cyclictest640417-21munin-plugin-st20:10:000
618778992313,6cyclictest713177-21runrttasks23:40:180
61877899230,19cyclictest0-21swapper/023:10:030
618787992216,3cyclictest0-21swapper/221:25:232
618787992215,5cyclictest311ktimers/223:05:152
618787992215,4cyclictest0-21swapper/222:10:202
618787992212,6cyclictest640552-21cat20:10:012
618787992212,6cyclictest640552-21cat20:10:012
618787992211,7cyclictest1-21systemd00:37:582
618787992211,7cyclictest1-21systemd00:37:572
61878799221,15cyclictest32-21ksoftirqd/222:20:172
618783992216,3cyclictest0-21swapper/120:20:261
618783992214,5cyclictest619996-21grep19:10:271
618778992212,4cyclictest131rcu_preempt22:33:500
618778992212,4cyclictest131rcu_preempt22:33:490
618787992113,5cyclictest0-21swapper/222:45:162
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional