You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-02 - 12:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot5s.osadl.org (updated Fri May 02, 2025 00:44:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3495013995023,24cyclictest3574746-21idleruntime-cro23:00:000
3495013994813,31cyclictest0-21swapper/021:40:010
3495025994631,11cyclictest391ktimers/319:55:163
3495017994434,7cyclictest3545005-21grep21:30:301
3495013994421,19cyclictest36052532sleep000:25:260
349501399441,7cyclictest3543765-21idleruntime-cro21:30:000
3495013994414,26cyclictest0-21swapper/021:00:010
3495013994413,28cyclictest0-21swapper/019:45:230
349502599436,6cyclictest131rcu_preempt00:30:133
349501399432,8cyclictest3581553-21sendmail23:20:010
3495013994316,3cyclictest13650irq/42-30be0000.ethernet20:05:230
3495013994316,3cyclictest13650irq/42-30be0000.ethernet20:05:230
3495021994231,8cyclictest311ktimers/223:10:142
349501399429,8cyclictest3528673-21date20:45:020
3495013994212,3cyclictest0-21swapper/019:55:280
349501399411,8cyclictest3583429-21cron23:25:000
349501399401,18cyclictest0-21swapper/021:00:280
3495013994011,5cyclictest121ktimers/022:09:000
349501399401,11cyclictest3511248-21debian-sa119:55:010
3495025993932,4cyclictest3560937-21munin-plugin-st22:20:003
3495025993932,3cyclictest0-21swapper/323:40:003
349501399395,6cyclictest3547461-21cpuspeed21:40:160
3495013993928,8cyclictest3588521-21munin-plugin-st23:40:000
349501399392,5cyclictest0-21swapper/019:40:000
349501399391,8cyclictest3600638-21idleruntime-cro00:15:010
349501399391,8cyclictest3600638-21idleruntime-cro00:15:000
3495025993826,9cyclictest391ktimers/320:15:163
3495021993821,14cyclictest3495006-21cyclictest19:40:212
3495017993825,10cyclictest231ktimers/121:45:151
3495017993825,10cyclictest231ktimers/121:45:141
349501399389,7cyclictest3568991-21ls22:40:240
349501399381,6cyclictest3525262-21latency_hist20:35:010
349501399381,6cyclictest3514932-21latency_hist20:05:010
3495017993728,5cyclictest3605284-21unixbench_multi00:25:271
3495013993729,5cyclictest3598933-21ls00:10:000
3495013993712,5cyclictest121ktimers/022:00:260
3495013993710,6cyclictest3497060-21wc19:15:020
3495013993710,3cyclictest3538647-21latency_hist21:15:010
349501799365,6cyclictest131rcu_preempt22:50:141
3495017993628,4cyclictest0-21swapper/100:00:001
349501399369,5cyclictest121ktimers/019:40:290
349501399368,7cyclictest3558180-21cat22:10:170
3495013993613,3cyclictest3561486-21if_eth122:20:190
3495013993612,3cyclictest0-21swapper/022:15:280
3495013993611,5cyclictest0-21swapper/023:45:230
3495013993610,6cyclictest121ktimers/019:15:010
3495025993527,4cyclictest0-21swapper/320:55:303
3495025993523,7cyclictest0-21swapper/320:10:293
3495021993527,4cyclictest0-21swapper/221:55:272
3495021993526,4cyclictest0-21swapper/221:00:002
3495017993527,4cyclictest0-21swapper/120:05:301
3495017993527,4cyclictest0-21swapper/120:05:291
3495017993526,5cyclictest0-21swapper/119:50:281
3495017993524,7cyclictest0-21swapper/121:50:281
3495013993528,5cyclictest3571263-21kworker/u8:3+events_unbound22:49:430
3495013993527,4cyclictest0-21swapper/021:50:000
3495013993527,4cyclictest0-21swapper/021:50:000
349501399352,11cyclictest3609350-21sendmail-msp00:40:010
3495013993515,3cyclictest13950irq/36-mmc120:25:000
3495013993512,4cyclictest121ktimers/023:40:180
349501399351,11cyclictest3604019-21cron00:24:590
349501399350,14cyclictest0-21swapper/020:50:260
3495025993427,4cyclictest3581607-21latency_hist23:20:013
3495025993426,4cyclictest0-21swapper/323:55:253
3495021993426,4cyclictest0-21swapper/223:15:172
3495021993424,6cyclictest0-21swapper/219:45:302
3495017993424,6cyclictest0-21swapper/120:20:001
3495017993424,5cyclictest0-21swapper/120:45:011
3495017993423,7cyclictest3570879-21grep22:45:261
3495017993423,6cyclictest0-21swapper/123:25:261
3495013993427,4cyclictest3602332-21sendmail00:19:590
349501399342,14cyclictest0-21swapper/021:50:270
3495013993414,5cyclictest0-21swapper/020:14:110
3495013993412,5cyclictest121ktimers/022:25:140
3495013993412,4cyclictest121ktimers/021:05:160
3495013993411,4cyclictest121ktimers/021:15:150
3495013993411,4cyclictest121ktimers/000:30:190
349502599335,6cyclictest131rcu_preempt22:00:143
3495021993323,5cyclictest0-21swapper/223:40:162
3495021993323,4cyclictest0-21swapper/223:30:272
3495017993325,4cyclictest0-21swapper/123:15:271
3495017993324,5cyclictest0-21swapper/122:30:001
3495017993322,5cyclictest0-21swapper/123:10:011
349501399337,8cyclictest3579940-21date23:15:000
3495013993311,3cyclictest0-21swapper/019:20:190
349501399330,3cyclictest0-21swapper/021:34:370
3495025993224,5cyclictest0-21swapper/322:55:013
3495025993224,4cyclictest0-21swapper/321:45:283
3495025993224,4cyclictest0-21swapper/321:45:283
3495025993223,4cyclictest0-21swapper/319:15:173
3495025993222,6cyclictest3510805-21grep19:50:293
3495021993224,4cyclictest0-21swapper/222:40:002
3495021993224,4cyclictest0-21swapper/200:35:262
3495017993224,4cyclictest0-21swapper/119:30:271
3495013993225,4cyclictest3594059-21fschecks_time23:55:160
3495013993213,3cyclictest121ktimers/023:31:030
3495025993124,4cyclictest0-21swapper/320:50:193
3495025993123,4cyclictest0-21swapper/300:15:163
3495025993119,8cyclictest3524588-21grep20:30:263
3495021993123,4cyclictest0-21swapper/219:10:282
3495017993123,4cyclictest0-21swapper/120:30:171
3495013993123,4cyclictest0-21swapper/022:35:000
3495013993122,6cyclictest0-21swapper/020:20:010
349501399310,18cyclictest0-21swapper/023:53:550
3495025993022,4cyclictest0-21swapper/322:45:163
3495017993023,3cyclictest0-21swapper/100:05:011
3495017993022,3cyclictest0-21swapper/119:15:011
3495013993013,5cyclictest0-21swapper/023:01:360
3495013993010,6cyclictest121ktimers/019:30:230
349502599292,4cyclictest131rcu_preempt20:40:193
3495025992923,4cyclictest3553801-21kworker/u8:1+events_unbound22:10:443
3495025992921,4cyclictest0-21swapper/319:35:153
3495025992921,4cyclictest0-21swapper/319:20:263
3495025992918,7cyclictest0-21swapper/322:55:263
3495025992918,7cyclictest0-21swapper/300:40:003
3495025992913,7cyclictest131rcu_preempt20:45:183
3495021992921,5cyclictest0-21swapper/219:55:282
3495021992921,4cyclictest0-21swapper/221:00:302
3495017992922,3cyclictest0-21swapper/122:40:261
3495017992921,4cyclictest0-21swapper/122:15:181
3495017992921,4cyclictest0-21swapper/121:40:281
3495017992921,4cyclictest0-21swapper/100:10:161
3495017992921,4cyclictest0-21swapper/100:10:161
3495017992920,5cyclictest0-21swapper/120:55:001
3495017992919,7cyclictest3542048-21sh21:25:011
3495017992919,6cyclictest0-21swapper/121:30:011
349501799291,4cyclictest131rcu_preempt20:10:161
349501399291,14cyclictest0-21swapper/000:00:510
3495025992821,4cyclictest3604173-21latency_hist00:25:003
3495025992821,4cyclictest0-21swapper/321:55:273
3495025992820,4cyclictest0-21swapper/300:00:263
3495021992820,4cyclictest0-21swapper/223:50:282
3495021992817,7cyclictest0-21swapper/219:40:012
3495017992820,4cyclictest0-21swapper/122:00:271
3495017992818,6cyclictest0-21swapper/121:15:261
3495017992818,6cyclictest0-21swapper/119:50:011
3495013992820,4cyclictest0-21swapper/022:50:290
3495013992820,4cyclictest0-21swapper/021:25:000
3495013992810,3cyclictest0-21swapper/022:38:250
3495025992721,4cyclictest3560878-21kworker/u8:2+events_unbound22:43:023
3495025992721,4cyclictest3543685-21kworker/u8:0+events_unbound21:37:423
3495025992721,4cyclictest3500270-21kworker/u8:1+events_unbound20:00:433
3495025992720,5cyclictest3564178-21kworker/u8:0+events_unbound22:32:013
3495025992720,4cyclictest3605256-21grep00:25:263
3495025992719,4cyclictest0-21swapper/323:45:193
3495025992719,4cyclictest0-21swapper/320:05:203
3495025992719,4cyclictest0-21swapper/320:05:203
3495025992718,5cyclictest3540331-21cron21:20:003
3495025992717,6cyclictest0-21swapper/321:30:303
3495021992720,3cyclictest0-21swapper/200:15:262
3495021992719,5cyclictest0-21swapper/221:35:192
3495021992719,4cyclictest0-21swapper/219:20:242
3495017992720,5cyclictest231ktimers/119:15:021
3495017992718,4cyclictest0-21swapper/122:10:001
3495013992721,3cyclictest0-21swapper/020:45:210
349502599268,4cyclictest131rcu_preempt19:15:013
349502599262,3cyclictest131rcu_preempt22:05:163
3495025992619,5cyclictest3537792-21kworker/u8:3+events_unbound21:13:393
3495025992616,6cyclictest0-21swapper/319:45:303
3495025992616,5cyclictest0-21swapper/321:50:273
3495025992615,6cyclictest0-21swapper/323:20:283
3495021992620,3cyclictest0-21swapper/200:35:002
3495021992619,5cyclictest146-21jbd2/mmcblk1p2-821:05:182
3495021992619,4cyclictest3495006-21cyclictest19:25:262
3495021992619,4cyclictest0-21swapper/222:00:272
3495021992619,3cyclictest0-21swapper/222:40:162
3495021992619,3cyclictest0-21swapper/220:15:292
3495021992618,5cyclictest0-21swapper/222:20:272
3495017992618,5cyclictest3598415-21sort00:05:271
3495017992618,5cyclictest0-21swapper/120:25:281
3495017992618,4cyclictest0-21swapper/119:55:291
3495017992617,6cyclictest0-21swapper/121:40:001
3495017992617,6cyclictest0-21swapper/121:00:011
349501799261,13cyclictest0-21swapper/119:35:241
3495025992519,4cyclictest3581329-21kworker/u8:1+events_unbound23:29:393
3495025992518,5cyclictest3593421-21kworker/u8:2+events_unbound00:12:193
3495025992518,5cyclictest3593421-21kworker/u8:2+events_unbound00:12:193
3495025992517,5cyclictest0-21swapper/323:10:253
3495025992516,6cyclictest391ktimers/319:40:063
3495025992515,6cyclictest3501509-21grep19:25:233
349502599251,4cyclictest0-21swapper/323:50:163
3495021992519,4cyclictest3526776-21idleruntime-cro20:40:012
3495021992519,3cyclictest0-21swapper/223:35:212
3495021992518,3cyclictest0-21swapper/222:10:022
3495021992516,6cyclictest311ktimers/221:15:172
3495021992516,6cyclictest0-21swapper/222:35:012
3495021992513,7cyclictest3551757-21grep21:50:272
349501799253,18cyclictest24-21ksoftirqd/122:30:131
3495017992518,5cyclictest3559170-21kworker/u8:0+events_unbound22:21:181
3495017992517,5cyclictest0-21swapper/123:45:181
3495017992516,6cyclictest0-21swapper/122:00:001
3495017992515,6cyclictest3507193-21grep19:40:331
349502599249,10cyclictest391ktimers/321:20:173
3495025992418,4cyclictest3547382-21kworker/u8:2+events_unbound21:40:243
3495025992418,3cyclictest0-21swapper/323:40:183
3495025992418,3cyclictest0-21swapper/323:05:213
3495025992418,3cyclictest0-21swapper/320:35:183
349502599241,4cyclictest131rcu_preempt23:00:133
349502199246,15cyclictest3495006-21cyclictest19:50:142
3495021992418,3cyclictest0-21swapper/220:50:292
3495021992417,3cyclictest0-21swapper/223:05:012
3495021992416,4cyclictest0-21swapper/223:25:242
3495021992416,4cyclictest0-21swapper/200:10:262
3495021992416,4cyclictest0-21swapper/200:10:262
3495021992415,4cyclictest0-21swapper/220:05:012
3495017992418,3cyclictest3579821-21sh23:15:011
3495017992418,3cyclictest0-21swapper/123:40:151
3495017992418,3cyclictest0-21swapper/123:35:151
3495017992418,3cyclictest0-21swapper/100:35:011
3495017992416,5cyclictest0-21swapper/122:10:161
3495017992415,6cyclictest3575355-21ls23:00:201
3495017992414,7cyclictest3593213-21grep23:50:291
3495017992414,7cyclictest3583455-21basename23:25:001
3495017992413,8cyclictest3585813-21memory23:30:221
349501399241,4cyclictest3522009-21df20:25:170
3495025992317,4cyclictest3533415-21kworker/u8:0+events_unbound21:04:293
3495025992316,4cyclictest3521467-21kworker/u8:1+events_unbound20:25:483
3495025992316,4cyclictest0-21swapper/323:30:283
3495025992316,3cyclictest0-21swapper/322:35:243
3495025992314,5cyclictest3562239-21head22:20:283
3495021992317,3cyclictest3583433-21cron23:25:002
3495021992317,3cyclictest0-21swapper/223:00:012
3495021992317,3cyclictest0-21swapper/222:50:012
3495021992317,3cyclictest0-21swapper/221:40:292
3495021992317,3cyclictest0-21swapper/221:30:212
3495021992316,4cyclictest637-21runrttasks20:10:272
3495021992316,4cyclictest0-21swapper/222:50:272
3495021992316,3cyclictest0-21swapper/222:20:002
3495021992315,4cyclictest3559227-21sh22:15:002
3495021992313,6cyclictest0-21swapper/200:00:012
3495021992312,6cyclictest0-21swapper/200:25:262
3495021992310,11cyclictest3495006-21cyclictest21:45:152
3495021992310,11cyclictest3495006-21cyclictest21:45:142
3495017992317,4cyclictest3537792-21kworker/u8:3+events_unbound21:10:451
3495017992317,3cyclictest0-21swapper/120:45:281
349501799231,4cyclictest3567938-21munin-run22:40:001
349501799231,4cyclictest0-21swapper/119:20:191
3495017992314,5cyclictest0-21swapper/100:20:001
3495017992313,7cyclictest0-21swapper/119:25:211
3495017992313,6cyclictest0-21swapper/121:05:271
349501399230,19cyclictest0-21swapper/023:26:480
3495025992216,4cyclictest35027582sleep319:30:193
3495025992214,5cyclictest3564178-21kworker/u8:0+events_unbound22:28:543
3495025992214,5cyclictest0-21swapper/321:05:183
3495025992212,7cyclictest3543301-21grep21:25:283
3495021992216,3cyclictest0-21swapper/222:25:272
3495021992216,3cyclictest0-21swapper/221:25:282
3495021992215,3cyclictest0-21swapper/200:10:002
3495021992215,3cyclictest0-21swapper/200:00:162
3495021992213,5cyclictest0-21swapper/221:10:302
3495021992213,5cyclictest0-21swapper/220:25:292
3495017992216,4cyclictest231ktimers/121:00:171
3495017992215,3cyclictest0-21swapper/120:35:221
3495017992214,4cyclictest0-21swapper/120:20:291
3495017992213,6cyclictest3608542-21grep00:35:241
3495017992213,5cyclictest0-21swapper/100:24:591
3495013992216,2cyclictest0-21swapper/020:35:140
3495013992215,3cyclictest0-21swapper/023:05:270
349501399220,18cyclictest0-21swapper/019:28:550
3495021992115,3cyclictest3602686-21df_inode00:20:182
3495021992115,3cyclictest0-21swapper/223:45:222
3495021992115,3cyclictest0-21swapper/221:20:262
3495021992115,3cyclictest0-21swapper/220:40:312
3495021992110,8cyclictest3523725-21forks20:30:162
349501799210,19cyclictest231ktimers/120:01:401
3495013992114,3cyclictest0-21swapper/021:57:310
3495021992013,5cyclictest311ktimers/220:20:212
3495021992013,4cyclictest3515302-21fschecks_time20:05:212
3495021992013,4cyclictest3515302-21fschecks_time20:05:202
3495017992013,4cyclictest3573263-21apt-get22:55:121
349502199180,16cyclictest311ktimers/219:30:162
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional