You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-13 - 03:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s (updated Tue May 13, 2025 00:44:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3441073994733,10cyclictest3483182-21cron21:09:591
3441068994534,6cyclictest3543480-21idleruntime-cro00:05:000
3441068994534,6cyclictest3543480-21idleruntime-cro00:05:000
3441073994431,9cyclictest3523089-21cron23:05:011
3441068994431,8cyclictest3548773-21munin-plugin-st00:20:000
3441073994334,5cyclictest3450284-21cron19:35:011
3441073994332,6cyclictest0-21swapper/120:10:001
3441073994332,6cyclictest0-21swapper/120:10:001
3441084994132,5cyclictest3492946-21unixbench_singl21:35:283
344108499411,16cyclictest0-21swapper/320:00:153
344108499411,16cyclictest0-21swapper/320:00:153
3441078994130,8cyclictest311ktimers/219:40:142
3441078994115,8cyclictest0-21swapper/221:35:282
3441068994131,5cyclictest3443224-21timerwakeupswit19:15:020
3441068994031,4cyclictest0-21swapper/021:40:010
3441084993928,8cyclictest3486601-21sendmail21:20:013
3441084993928,7cyclictest0-21swapper/321:35:013
3441078993930,4cyclictest0-21swapper/223:05:182
3441073993931,4cyclictest3548774-21grep00:19:591
3441068993929,5cyclictest0-21swapper/021:20:280
3441068993929,5cyclictest0-21swapper/019:15:290
3441068993927,8cyclictest3470628-21seq20:30:270
3441068993920,6cyclictest131rcu_preempt20:20:140
3441068993916,11cyclictest0-21swapper/021:41:520
3441084993831,4cyclictest0-21swapper/320:45:193
3441073993829,5cyclictest3469405-21munin-run20:30:001
3441068993830,6cyclictest121ktimers/023:40:130
3441068993819,15cyclictest0-21swapper/000:10:000
3441068993819,15cyclictest0-21swapper/000:09:590
3441084993730,4cyclictest3442963-21cron19:15:013
3441084993729,4cyclictest0-21swapper/321:45:003
3441078993727,6cyclictest0-21swapper/222:00:002
3441078993727,6cyclictest0-21swapper/221:15:002
3441073993724,9cyclictest0-21swapper/122:19:591
3441068993725,8cyclictest3541343-21grep23:55:270
3441068993725,8cyclictest3541343-21grep23:55:270
3441068993724,9cyclictest3528183-21sendmail23:20:010
3441084993628,4cyclictest0-21swapper/321:25:003
3441078993627,6cyclictest0-21swapper/223:00:002
3441073993628,5cyclictest3454146-21fschecks_time19:45:171
3441073993626,6cyclictest0-21swapper/122:30:271
3441073993626,6cyclictest0-21swapper/121:35:011
3441073993625,6cyclictest0-21swapper/123:40:251
3441068993626,5cyclictest0-21swapper/020:50:010
3441068993616,4cyclictest0-21swapper/021:16:050
3441068993614,11cyclictest0-21swapper/019:41:250
3441084993527,5cyclictest440-21cron22:10:003
3441084993527,5cyclictest440-21cron22:09:593
3441084993525,6cyclictest0-21swapper/320:25:293
3441078993527,4cyclictest0-21swapper/221:05:272
3441078993526,4cyclictest0-21swapper/219:50:192
3441078993524,7cyclictest3475735-21tail20:45:292
3441073993525,6cyclictest0-21swapper/123:20:001
3441073993525,6cyclictest0-21swapper/121:55:191
3441073993523,9cyclictest231ktimers/119:40:141
3441073993522,7cyclictest0-21swapper/121:50:251
3441073993522,7cyclictest0-21swapper/120:20:011
344106899356,21cyclictest11-21ksoftirqd/020:15:020
3441068993529,4cyclictest3489856-21kworker/u8:2+events_unbound22:01:430
3441068993525,5cyclictest0-21swapper/023:20:270
3441068993524,6cyclictest3519696-21idleruntime-cro22:55:000
3441068993523,7cyclictest3496365-21grep21:45:270
3441068993517,5cyclictest131rcu_preempt20:15:020
3441068993516,11cyclictest131rcu_preempt00:20:200
3441084993426,5cyclictest3500191-21sendmail22:00:003
3441084993424,7cyclictest3458260-21wc19:55:253
3441084993424,6cyclictest0-21swapper/323:15:203
3441084993424,6cyclictest0-21swapper/300:20:003
3441078993427,3cyclictest0-21swapper/222:55:002
3441078993426,4cyclictest0-21swapper/223:55:162
3441078993426,4cyclictest0-21swapper/223:55:152
3441078993426,4cyclictest0-21swapper/220:10:012
3441078993426,4cyclictest0-21swapper/220:10:012
3441078993422,7cyclictest0-21swapper/223:15:302
3441073993427,3cyclictest0-21swapper/122:05:181
3441073993427,3cyclictest0-21swapper/122:05:181
3441073993424,5cyclictest0-21swapper/123:45:171
3441068993422,4cyclictest131rcu_preempt23:46:390
3441068993421,8cyclictest3456668-21grep19:50:270
344106899341,7cyclictest3552405-21apt-get00:30:140
3441068993416,5cyclictest131rcu_preempt21:57:560
3441068993413,12cyclictest131rcu_preempt21:25:210
3441068993412,11cyclictest131rcu_preempt22:25:010
3441084993325,4cyclictest0-21swapper/323:20:193
3441084993325,4cyclictest0-21swapper/323:00:003
3441084993325,4cyclictest0-21swapper/300:25:283
3441078993325,5cyclictest0-21swapper/222:40:002
3441078993325,4cyclictest0-21swapper/221:45:272
3441078993316,11cyclictest131rcu_preempt22:43:472
3441073993325,4cyclictest0-21swapper/122:25:281
3441073993325,3cyclictest0-21swapper/100:00:281
3441073993325,3cyclictest0-21swapper/100:00:271
3441073993321,7cyclictest0-21swapper/121:00:161
3441073993321,7cyclictest0-21swapper/121:00:151
3441068993325,5cyclictest3468978-21grep20:25:290
3441068993323,5cyclictest0-21swapper/021:50:150
3441068993322,5cyclictest0-21swapper/022:20:000
3441068993313,3cyclictest0-21swapper/000:37:510
3441068993313,11cyclictest131rcu_preempt20:55:020
3441068993313,11cyclictest131rcu_preempt20:55:010
3441084993226,3cyclictest0-21swapper/321:15:003
3441084993218,6cyclictest3489856-21kworker/u8:2+events_unbound21:45:273
3441078993225,3cyclictest0-21swapper/222:00:162
3441078993219,8cyclictest311ktimers/219:30:142
3441078993215,6cyclictest3533244-21kworker/u8:1+events_unbound23:37:272
3441073993223,5cyclictest0-21swapper/100:05:231
3441073993223,5cyclictest0-21swapper/100:05:231
3441073993223,4cyclictest0-21swapper/121:40:271
3441073993222,6cyclictest0-21swapper/122:55:001
3441073993222,6cyclictest0-21swapper/119:50:191
3441073993221,6cyclictest0-21swapper/120:00:001
344106899325,9cyclictest11-21ksoftirqd/022:40:010
3441068993223,7cyclictest121ktimers/022:10:150
3441068993223,7cyclictest121ktimers/022:10:150
3441068993219,5cyclictest131rcu_preempt23:35:010
3441068993218,3cyclictest131rcu_preempt19:55:490
3441084993125,3cyclictest0-21swapper/320:10:003
3441084993125,3cyclictest0-21swapper/320:10:003
3441084993121,6cyclictest3509294-21cron22:25:013
3441084993121,6cyclictest0-21swapper/322:10:213
3441084993121,6cyclictest0-21swapper/322:10:213
3441084993115,10cyclictest40-21ksoftirqd/323:55:173
3441084993115,10cyclictest40-21ksoftirqd/323:55:173
3441078993123,4cyclictest3509302-21cron22:25:012
3441078993123,4cyclictest0-21swapper/222:50:002
3441078993121,6cyclictest0-21swapper/222:10:002
3441078993121,6cyclictest0-21swapper/222:10:002
3441073993124,3cyclictest0-21swapper/119:15:201
3441073993123,4cyclictest0-21swapper/119:40:011
3441073993122,6cyclictest3477947-21latency_hist20:55:001
3441073993121,6cyclictest0-21swapper/122:45:261
3441073993120,6cyclictest0-21swapper/123:20:281
344106899319,6cyclictest11-21ksoftirqd/021:30:260
3441068993125,4cyclictest3489856-21kworker/u8:2+events_unbound22:07:420
3441068993125,4cyclictest3489856-21kworker/u8:2+events_unbound22:07:410
3441068993119,8cyclictest121ktimers/023:25:280
3441068993119,4cyclictest131rcu_preempt21:00:430
3441068993119,4cyclictest131rcu_preempt21:00:430
3441068993118,5cyclictest131rcu_preempt23:55:000
3441068993118,5cyclictest131rcu_preempt22:40:210
3441068993118,5cyclictest131rcu_preempt21:07:160
3441068993118,5cyclictest131rcu_preempt20:41:460
3441068993111,12cyclictest131rcu_preempt00:25:260
3441068993110,8cyclictest11-21ksoftirqd/023:00:300
3441068993110,6cyclictest131rcu_preempt19:20:280
3441084993023,4cyclictest0-21swapper/319:45:263
3441084993023,4cyclictest0-21swapper/300:39:593
3441084993019,6cyclictest0-21swapper/323:25:273
3441078993023,4cyclictest0-21swapper/200:40:002
3441078993019,7cyclictest3464287-21sed20:15:022
3441073993022,4cyclictest0-21swapper/122:35:191
3441073993022,3cyclictest0-21swapper/119:15:021
344107399301,4cyclictest131rcu_preempt21:45:151
344106899309,13cyclictest11-21ksoftirqd/019:49:350
344106899303,15cyclictest3526019-21grep23:10:280
3441068993017,3cyclictest131rcu_preempt22:46:570
3441068993016,3cyclictest131rcu_preempt20:04:310
3441068993016,3cyclictest131rcu_preempt20:04:310
3441068993014,4cyclictest131rcu_preempt22:25:190
3441068993013,4cyclictest131rcu_preempt00:10:290
3441068993012,4cyclictest131rcu_preempt19:32:130
3441068993011,11cyclictest11-21ksoftirqd/020:35:280
3441068993010,12cyclictest11-21ksoftirqd/023:40:010
344108499297,4cyclictest131rcu_preempt23:50:123
3441084992911,5cyclictest3469070-21kworker/u8:3+events_unbound20:53:273
3441078992922,3cyclictest0-21swapper/200:10:012
3441078992922,3cyclictest0-21swapper/200:10:012
3441078992921,4cyclictest0-21swapper/222:30:272
3441078992921,4cyclictest0-21swapper/220:55:262
3441078992921,4cyclictest0-21swapper/220:55:262
3441078992914,4cyclictest3525019-21/usr/sbin/munin23:10:192
344107899291,2cyclictest0-21swapper/200:00:142
344107899291,2cyclictest0-21swapper/200:00:142
344107399299,8cyclictest131rcu_preempt00:00:001
344107399299,8cyclictest131rcu_preempt00:00:001
3441073992921,4cyclictest0-21swapper/120:45:011
3441073992920,4cyclictest0-21swapper/120:15:011
3441073992919,6cyclictest0-21swapper/123:35:281
3441073992919,6cyclictest0-21swapper/121:10:261
3441073992918,6cyclictest0-21swapper/123:05:301
344106899297,12cyclictest131rcu_preempt22:30:180
3441068992917,4cyclictest131rcu_preempt21:11:360
3441068992917,3cyclictest131rcu_preempt19:27:030
3441068992916,5cyclictest131rcu_preempt22:55:160
3441068992914,3cyclictest131rcu_preempt19:39:180
3441068992911,11cyclictest131rcu_preempt20:50:180
3441068992910,5cyclictest131rcu_preempt23:05:290
344108499287,7cyclictest131rcu_preempt22:45:243
3441084992822,3cyclictest0-21swapper/322:20:003
3441084992822,3cyclictest0-21swapper/321:25:253
3441084992821,4cyclictest0-21swapper/319:25:013
3441084992821,3cyclictest0-21swapper/321:05:273
3441084992820,4cyclictest0-21swapper/322:35:013
3441084992820,4cyclictest0-21swapper/321:00:253
3441084992820,4cyclictest0-21swapper/321:00:253
3441084992819,6cyclictest3448829-21/usr/sbin/munin19:30:263
3441084992819,5cyclictest0-21swapper/320:35:013
3441084992814,6cyclictest3533244-21kworker/u8:1+events_unbound23:37:103
344108499281,12cyclictest0-21swapper/322:40:143
344107899289,4cyclictest3486594-21cat21:20:012
3441078992820,4cyclictest0-21swapper/223:40:272
3441078992819,6cyclictest3550870-21grep00:25:182
3441078992819,6cyclictest0-21swapper/221:40:272
344107399288,8cyclictest131rcu_preempt00:25:001
3441073992820,4cyclictest0-21swapper/122:00:241
3441073992819,5cyclictest0-21swapper/120:45:291
3441073992817,6cyclictest0-21swapper/120:55:261
3441073992817,6cyclictest0-21swapper/120:55:261
3441068992810,9cyclictest131rcu_preempt20:05:180
3441068992810,9cyclictest131rcu_preempt20:05:170
344108499278,4cyclictest3461900-21kworker/u8:0+events_unbound20:16:313
3441084992721,4cyclictest3439019-21kworker/u8:2+events_unbound19:25:173
3441084992720,5cyclictest3489856-21kworker/u8:2+events_unbound21:50:093
3441084992720,3cyclictest0-21swapper/322:50:263
3441084992717,5cyclictest0-21swapper/323:40:263
3441084992713,7cyclictest40-21ksoftirqd/319:40:243
3441084992712,13cyclictest40-21ksoftirqd/319:35:193
344107899272,3cyclictest131rcu_preempt20:40:132
3441078992719,4cyclictest0-21swapper/223:45:172
3441078992715,8cyclictest0-21swapper/219:10:172
3441078992714,4cyclictest131rcu_preempt21:04:332
3441078992714,4cyclictest131rcu_preempt21:04:322
3441073992719,5cyclictest0-21swapper/123:35:001
3441073992719,5cyclictest0-21swapper/120:30:281
3441073992719,4cyclictest0-21swapper/122:40:271
3441073992718,5cyclictest0-21swapper/123:25:191
3441073992718,5cyclictest0-21swapper/100:25:181
3441073992718,4cyclictest0-21swapper/122:20:241
3441073992718,4cyclictest0-21swapper/121:15:191
344108499267,3cyclictest131rcu_preempt20:10:143
3441084992620,4cyclictest3489856-21kworker/u8:2+events_unbound22:04:093
3441084992612,7cyclictest40-21ksoftirqd/320:20:273
3441084992611,4cyclictest3540016-21kworker/u8:3+events_unbound00:07:003
3441084992611,4cyclictest3540016-21kworker/u8:3+events_unbound00:06:593
344107899269,7cyclictest131rcu_preempt19:15:222
3441078992619,5cyclictest3553522-21kworker/u8:0+events_unbound00:34:322
3441078992617,4cyclictest0-21swapper/223:50:172
3441078992617,4cyclictest0-21swapper/221:50:232
3441078992615,8cyclictest3466698-21wc20:20:222
344107899261,4cyclictest0-21swapper/219:45:242
3441078992610,7cyclictest131rcu_preempt21:25:132
344107399268,8cyclictest131rcu_preempt00:35:251
3441073992619,3cyclictest0-21swapper/123:50:261
3441073992618,3cyclictest0-21swapper/121:25:011
3441073992616,6cyclictest0-21swapper/120:35:291
3441084992520,3cyclictest3441058-21cyclictest22:35:193
3441084992518,5cyclictest3439019-21kworker/u8:2+events_unbound19:15:153
3441084992518,4cyclictest3541716-21kworker/u8:0+events_unbound00:15:013
3441084992518,3cyclictest0-21swapper/323:05:003
3441078992519,3cyclictest0-21swapper/222:15:252
3441078992518,5cyclictest3548712-21kworker/u8:3+events_unbound00:20:302
3441078992518,3cyclictest0-21swapper/220:20:002
3441078992517,6cyclictest3450679-21fschecks_count19:35:162
3441078992516,6cyclictest0-21swapper/200:14:592
3441078992514,8cyclictest3529990-21wc23:25:012
3441073992518,4cyclictest3489856-21kworker/u8:2+events_unbound21:28:361
3441073992518,4cyclictest0-21swapper/120:20:271
3441073992516,5cyclictest0-21swapper/119:30:011
3441073992515,5cyclictest0-21swapper/100:30:281
344108499249,7cyclictest40-21ksoftirqd/320:40:003
3441084992416,4cyclictest0-21swapper/323:05:303
3441084992416,4cyclictest0-21swapper/300:00:283
3441084992416,4cyclictest0-21swapper/300:00:283
3441084992411,3cyclictest40-21ksoftirqd/320:55:263
3441084992411,3cyclictest40-21ksoftirqd/320:55:263
344107899249,7cyclictest131rcu_preempt20:25:262
344107899248,8cyclictest131rcu_preempt21:20:222
344107899247,7cyclictest131rcu_preempt22:25:142
344107899246,7cyclictest131rcu_preempt20:30:192
344107899245,7cyclictest131rcu_preempt21:30:172
3441078992418,3cyclictest0-21swapper/200:15:212
3441078992417,3cyclictest0-21swapper/220:55:012
3441078992415,4cyclictest0-21swapper/223:30:272
3441078992413,8cyclictest3521742-21df23:00:182
3441073992417,5cyclictest3489856-21kworker/u8:2+events_unbound21:38:021
3441073992416,4cyclictest0-21swapper/123:00:001
3441073992415,5cyclictest0-21swapper/123:10:281
3441084992317,4cyclictest3541716-21kworker/u8:0+events_unbound00:20:153
3441078992317,3cyclictest0-21swapper/222:10:242
3441078992317,3cyclictest0-21swapper/222:10:232
3441078992317,3cyclictest0-21swapper/219:55:262
344108499224,5cyclictest131rcu_preempt23:30:163
3441084992215,4cyclictest0-21swapper/323:10:283
3441084992214,5cyclictest3474131-21kworker/u8:1+events_unbound20:42:373
3441084992212,6cyclictest0-21swapper/300:30:273
3441078992215,3cyclictest0-21swapper/220:00:222
3441078992215,3cyclictest0-21swapper/220:00:212
3441078992214,5cyclictest0-21swapper/220:35:202
3441078992213,6cyclictest3531600-21basename23:30:012
344107399225,8cyclictest131rcu_preempt00:10:281
3441073992215,3cyclictest0-21swapper/122:10:221
3441073992215,3cyclictest0-21swapper/122:10:221
3441078992115,3cyclictest0-21swapper/219:20:202
3441078992114,5cyclictest0-21swapper/219:25:232
3441073992115,3cyclictest0-21swapper/120:00:221
3441073992115,3cyclictest0-21swapper/120:00:221
344107399211,12cyclictest0-21swapper/119:20:241
3441084992014,3cyclictest0-21swapper/323:45:243
344108499191,10cyclictest0-21swapper/319:50:223
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional