You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-01-31 - 05:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec

ARM Freescale i.MX8M Plus @1600 MHz, Linux 5.17.0-rt15 (Profile)

Latency plot of shadow in rack #b, slot #5
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q done
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot5s (updated Tue Jan 31, 2023 00:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3600539996533,8cyclictest3611398-21munin-plugin-st19:40:010
3600539996047,7cyclictest3652526-21idleruntime-cro21:40:000
3600539996047,7cyclictest3652526-21idleruntime-cro21:40:000
3600549995526,25cyclictest0-21swapper/200:00:362
3600553995429,21cyclictest3701794-21grep00:00:363
3600549995345,5cyclictest3661134-21munin-plugin-st22:05:002
3600553995130,17cyclictest0-21swapper/322:35:003
3600553995039,7cyclictest3616062-21grep19:50:303
3600545995041,5cyclictest3618245-21dpkg20:00:001
3600553994925,20cyclictest0-21swapper/322:50:313
3600539994938,6cyclictest3604568-21sendmail19:20:010
3600553994825,18cyclictest0-21swapper/319:15:303
3600549994822,21cyclictest0-21swapper/219:30:312
3600549994638,4cyclictest3602433-21latency_hist19:15:012
3600549994621,21cyclictest3676627-21latency_hist22:50:012
3600539994636,7cyclictest121ktimers/000:05:170
3600539994631,9cyclictest0-21swapper/021:25:000
3600549994527,14cyclictest0-21swapper/223:00:002
3600539994534,7cyclictest3645675-21sendmail21:20:010
3600553994435,6cyclictest3652078-21grep21:35:313
3600553994435,6cyclictest3652078-21grep21:35:313
3600553994419,21cyclictest0-21swapper/322:25:343
3600549994437,4cyclictest3707339-21munin-plugin-st00:20:012
3600545994434,6cyclictest3650793-21munin-plugin-st21:35:001
3600545994434,6cyclictest3650793-21munin-plugin-st21:35:001
3600545994433,7cyclictest3607581-21unixbench_singl19:25:301
3600549994333,6cyclictest3657281-21unixbench_singl21:50:302
3600545994335,4cyclictest3602523-21latency_hist19:15:011
3600545994334,6cyclictest3623886-21fschecks_time20:15:221
3600539994333,5cyclictest3677854-21unixbench_singl22:50:300
3600539994331,6cyclictest0-21swapper/022:50:000
3600553994229,8cyclictest0-21swapper/320:20:023
3600553994221,17cyclictest0-21swapper/323:50:013
3600553994217,20cyclictest0-21swapper/322:45:273
360055399421,36cyclictest3683655-21/usr/sbin/munin23:10:193
3600549994216,21cyclictest0-21swapper/219:55:302
3600539994232,8cyclictest121ktimers/023:45:180
360054999411,35cyclictest3668418-21cut22:25:232
360055399408,27cyclictest3663707-21proc_pri22:10:333
3600553994030,6cyclictest3657283-21grep21:50:293
3600553994019,17cyclictest3617760-21grep19:55:293
360055399401,34cyclictest3682057-21/usr/sbin/munin23:05:203
360055399401,34cyclictest3620315-21/usr/sbin/munin20:05:183
360054999407,29cyclictest3681155-21date23:00:322
360054999403,34cyclictest3616127-21/usr/sbin/munin19:50:302
360054999401,3cyclictest3621971-21apt-get20:10:212
360054999401,2cyclictest3647618-21apt-get21:25:182
3600545994030,6cyclictest0-21swapper/121:10:341
3600545994029,6cyclictest0-21swapper/123:35:361
3600545994029,6cyclictest0-21swapper/119:40:011
3600539994030,6cyclictest3638391-21grep20:55:310
3600553993930,6cyclictest3605000-21fschecks_time19:20:213
360055399392,32cyclictest3664890-21/usr/sbin/munin22:15:213
3600553993914,22cyclictest3630247-21seq20:34:513
360055399391,35cyclictest3707828-21/usr/sbin/munin00:20:243
360055399391,35cyclictest3639514-21/usr/sbin/munin21:00:243
360055399391,34cyclictest3706313-21/usr/sbin/munin00:15:263
360055399391,33cyclictest3673307-21sed22:40:013
360055399391,33cyclictest3609065-21/usr/sbin/munin19:30:303
360054999396,28cyclictest3671567-21cat22:35:012
360054999392,32cyclictest3694963-21grep23:40:392
360054999392,32cyclictest3604297-21cron19:17:012
3600549993917,18cyclictest0-21swapper/220:25:312
360054999391,31cyclictest3711215-21grep00:30:232
3600545993928,6cyclictest0-21swapper/100:20:011
3600539993926,8cyclictest3674385-21grep22:40:370
360055399388,27cyclictest3637798-21wc20:55:253
360055399382,33cyclictest3610261-21/usr/sbin/munin19:35:223
360055399381,34cyclictest3713045-21/usr/sbin/munin00:35:243
360055399381,34cyclictest3697603-21/usr/sbin/munin23:50:233
360055399381,34cyclictest3692680-21/usr/sbin/munin23:35:283
360055399381,34cyclictest3649565-21/usr/sbin/munin21:30:213
360055399381,34cyclictest3649565-21/usr/sbin/munin21:30:213
360055399381,34cyclictest3646668-21/usr/sbin/munin21:20:343
360055399381,34cyclictest3642465-21seq21:10:063
360055399381,34cyclictest3613723-21/usr/sbin/munin19:45:243
360055399381,32cyclictest3600805-21df19:10:153
360055399381,31cyclictest3656092-21latency_hist21:50:013
3600549993832,4cyclictest3606289-21idleruntime-cro19:25:012
360054999382,30cyclictest3664936-21cut22:15:232
360054999381,4cyclictest0-21swapper/220:40:212
360054999381,34cyclictest3663176-21df22:10:232
360054999381,32cyclictest3619552-21unixbench_multi20:00:312
3600545993830,4cyclictest3686843-21sendmail23:20:001
3600545993829,6cyclictest3616072-21unixbench_multi19:50:301
3600545993827,6cyclictest0-21swapper/123:40:391
3600545993826,7cyclictest0-21swapper/100:09:591
360055399375,29cyclictest3612428-21/usr/sbin/munin19:40:343
3600553993725,8cyclictest3635841-21tune2fs20:50:213
3600553993715,19cyclictest3681421-21seq23:01:393
360055399371,33cyclictest3640777-21/usr/sbin/munin21:05:183
360055399371,31cyclictest3702573-21diskstats00:05:193
360055399371,31cyclictest3694013-21/usr/sbin/munin23:40:223
360055399371,31cyclictest3688834-21/usr/sbin/munin23:25:153
360055399371,31cyclictest3687368-21/usr/sbin/munin23:20:233
360055399371,31cyclictest3678896-21/usr/sbin/munin22:55:253
360055399371,31cyclictest3653157-21/usr/sbin/munin21:40:313
360055399371,31cyclictest3644518-21/usr/sbin/munin21:15:213
360055399371,30cyclictest3690491-21/usr/sbin/munin23:30:173
360055399371,30cyclictest3659659-21/usr/sbin/munin22:00:183
360054999373,29cyclictest3691951-21cron23:35:002
360054999373,29cyclictest3645195-21unixbench_multi21:15:312
360054999372,31cyclictest3674377-21grep22:40:372
360054999371,9cyclictest3688447-21modprobe23:23:552
360054999371,9cyclictest3671944-21/usr/sbin/munin22:35:202
3600549993716,17cyclictest3650966-21cat21:35:022
3600549993716,17cyclictest3650966-21cat21:35:012
3600549993716,17cyclictest0-21swapper/221:00:002
360054999371,5cyclictest3700100-21sed23:55:362
360054999371,5cyclictest3700100-21sed23:55:352
360054999371,3cyclictest0-21swapper/200:10:192
360054999371,32cyclictest3692194-21/usr/sbin/munin23:35:282
360054999371,32cyclictest3666707-21fschecks_time22:20:212
360054999371,30cyclictest3651160-21grep21:35:212
360054999371,30cyclictest3651160-21grep21:35:212
3600545993726,7cyclictest3713803-21unixbench_multi00:35:361
3600539993729,5cyclictest3640072-21unixbench_multi21:00:310
3600539993726,5cyclictest3641770-21grep21:05:310
3600553993619,13cyclictest0-21swapper/321:55:293
360055399361,32cyclictest3666800-21/usr/sbin/munin22:20:223
360055399361,32cyclictest3661703-21/usr/sbin/munin22:05:223
360055399361,32cyclictest3661703-21/usr/sbin/munin22:05:223
360055399361,32cyclictest3647879-21/usr/sbin/munin21:25:233
360055399361,32cyclictest3635216-21taskset20:47:543
360055399361,32cyclictest3635216-21taskset20:47:543
360055399361,31cyclictest3711846-21/usr/sbin/munin00:30:363
360055399361,31cyclictest3621947-21seq20:10:043
360055399361,30cyclictest3709370-21apt-get00:25:163
360055399361,30cyclictest3709370-21apt-get00:25:163
360055399361,30cyclictest3704507-21/usr/sbin/munin00:10:293
360055399361,30cyclictest3685540-21fschecks_time23:15:203
360055399361,30cyclictest3627098-21munin-node20:25:153
360055399361,29cyclictest3630508-21/usr/sbin/munin20:35:163
360055399360,33cyclictest53-21kcompactd020:00:083
360055399360,33cyclictest3673713-21/usr/sbin/munin22:40:303
360055399360,30cyclictest0-21swapper/320:20:163
3600549993623,9cyclictest3614359-21grep19:45:312
360054999362,31cyclictest3696149-21/usr/sbin/munin23:45:322
360054999361,9cyclictest3643556-21sed21:10:342
360054999361,8cyclictest3610989-21unixbench_singl19:35:312
360054999361,7cyclictest3606679-21fschecks_count19:25:202
360054999361,5cyclictest3611699-21/usr/sbin/munin19:40:202
360054999361,3cyclictest3685354-21apt-get23:15:172
360054999361,31cyclictest3707666-21/usr/sbin/munin00:20:302
360054999361,31cyclictest3647254-21sshd21:23:392
360054999361,31cyclictest3637100-21cron20:55:002
360054999361,30cyclictest3690246-21cron23:30:002
360054999361,30cyclictest3631557-21grep20:35:312
360054999361,30cyclictest3630264-21cron20:35:002
360054999361,29cyclictest3683816-21grep23:10:242
360054999361,29cyclictest3640065-21grep21:00:302
360054999361,12cyclictest3634625-21fgrep20:45:292
360054999361,12cyclictest3634625-21fgrep20:45:292
3600545993629,3cyclictest3652528-21kworker/u8:221:40:001
3600545993629,3cyclictest3652528-21kworker/u8:221:40:001
3600545993628,4cyclictest3649093-21idleruntime-cro21:30:001
3600545993625,6cyclictest0-21swapper/121:00:301
3600539993628,5cyclictest3691969-21idleruntime-cro23:35:000
3600539993625,7cyclictest3643519-21grep21:10:340
360055399351,31cyclictest3699139-21df23:55:203
360055399351,31cyclictest3699139-21df23:55:203
360055399351,31cyclictest3632233-21/usr/sbin/munin20:40:263
360055399351,31cyclictest3607726-21cron19:27:013
360054999352,29cyclictest3662400-21grep22:05:312
360054999352,29cyclictest3662400-21grep22:05:312
360054999351,9cyclictest3709707-21/usr/sbin/munin00:25:222
360054999351,9cyclictest3709707-21/usr/sbin/munin00:25:222
360054999351,7cyclictest3642257-21basename21:10:002
360054999351,7cyclictest3624613-21sed20:15:312
360054999351,30cyclictest0-21swapper/221:40:372
360054999351,2cyclictest0-21swapper/223:05:032
360054999351,29cyclictest3703447-21grep00:05:322
360054999351,11cyclictest3626108-21find20:20:452
360054999350,3cyclictest0-21swapper/223:50:162
360054999350,2cyclictest0-21swapper/221:45:172
3600545993527,5cyclictest3688547-21cron23:25:001
3600545993527,4cyclictest0-21swapper/122:15:241
3600545993526,5cyclictest0-21swapper/121:05:221
3600539993525,5cyclictest0-21swapper/020:10:000
3600539993524,7cyclictest3658940-21grep21:55:290
360054999341,6cyclictest3658104-21fschecks_count21:55:192
360054999341,4cyclictest633-21snmpd22:50:202
360054999340,3cyclictest3713085-21/usr/sbin/munin00:35:252
3600545993426,4cyclictest0-21swapper/122:55:001
3600545993423,7cyclictest0-21swapper/122:30:331
3600539993425,5cyclictest3628571-21idleruntime-cro20:30:000
3600539993425,4cyclictest0-21swapper/000:14:590
3600539993422,7cyclictest0-21swapper/000:00:000
3600539993422,7cyclictest0-21swapper/000:00:000
3600539993421,8cyclictest0-21swapper/020:40:350
3600545993325,5cyclictest3710836-21cron00:30:011
3600545993325,5cyclictest3710836-21cron00:30:001
3600545993323,6cyclictest0-21swapper/121:55:201
3600545993322,6cyclictest0-21swapper/123:55:351
3600545993322,6cyclictest0-21swapper/123:55:351
3600539993325,4cyclictest0-21swapper/023:25:310
3600539993324,5cyclictest3618266-21idleruntime-cro20:00:000
3600545993225,3cyclictest0-21swapper/119:15:021
3600545993222,6cyclictest0-21swapper/123:45:401
3600545993220,7cyclictest0-21swapper/119:45:011
360053999323,6cyclictest3697488-21fschecks_count23:50:210
3600539993223,5cyclictest3614823-21latency_hist19:50:000
3600539993223,4cyclictest0-21swapper/020:50:310
3600539993221,7cyclictest3710415-21grep00:25:310
3600539993221,7cyclictest3710415-21grep00:25:310
3600545993123,4cyclictest0-21swapper/120:45:001
3600545993123,4cyclictest0-21swapper/100:20:241
3600545993123,3cyclictest0-21swapper/123:10:001
3600545993122,6cyclictest0-21swapper/122:35:281
3600545993121,6cyclictest0-21swapper/120:35:211
3600545993120,6cyclictest0-21swapper/120:55:311
3600545993120,6cyclictest0-21swapper/120:50:321
3600539993122,4cyclictest0-21swapper/000:15:340
3600539993121,6cyclictest3626865-21apt20:25:000
3600539993121,6cyclictest0-21swapper/019:25:300
3600539993120,7cyclictest3662832-21latency_hist22:10:010
3600539993120,7cyclictest3662832-21latency_hist22:10:000
3600539993118,8cyclictest0-21swapper/019:13:250
3600545993022,4cyclictest0-21swapper/121:55:001
3600545993019,7cyclictest0-21swapper/120:05:301
3600545993019,6cyclictest0-21swapper/122:45:321
3600539993020,5cyclictest3686352-21grep23:15:300
3600539993020,5cyclictest0-21swapper/020:00:310
3600539993019,7cyclictest0-21swapper/023:00:000
3600539993019,7cyclictest0-21swapper/000:20:400
3600539993019,7cyclictest0-21swapper/000:00:240
360053999301,24cyclictest3635583-21latency_hist20:50:010
360053999301,24cyclictest3635583-21latency_hist20:50:010
360053999301,23cyclictest3684662-21unixbench_multi23:10:350
3600545992921,4cyclictest0-21swapper/122:25:231
3600545992921,4cyclictest0-21swapper/121:40:251
3600545992921,4cyclictest0-21swapper/120:25:001
3600545992919,8cyclictest3628803-21apt-get20:30:171
3600545992918,6cyclictest0-21swapper/119:30:301
3600545992916,9cyclictest3614160-21grep19:45:301
3600545992912,13cyclictest3690256-21idleruntime-cro23:30:001
360053999292,20cyclictest3666246-21munin-run22:20:000
3600539992916,10cyclictest121ktimers/023:40:200
3600545992819,6cyclictest0-21swapper/122:10:361
3600545992818,6cyclictest0-21swapper/123:05:001
3600545992818,6cyclictest0-21swapper/120:45:311
3600545992818,6cyclictest0-21swapper/120:45:311
3600545992812,13cyclictest3673919-21ntp_states22:40:351
3600545992812,13cyclictest3605896-21/usr/sbin/munin19:20:311
3600539992823,2cyclictest13650irq/42-30be0000.ethernet21:50:270
3600539992818,5cyclictest0-21swapper/019:20:210
360053999280,3cyclictest0-21swapper/022:30:170
3600545992720,3cyclictest0-21swapper/122:05:311
3600545992720,3cyclictest0-21swapper/122:05:311
3600545992719,5cyclictest0-21swapper/100:30:231
3600545992714,9cyclictest3666494-21/usr/sbin/munin22:20:191
3600545992712,12cyclictest3644758-21/usr/sbin/munin21:15:281
3600545992711,13cyclictest3627556-21wc20:25:241
360053999278,16cyclictest0-21swapper/020:30:200
3600539992721,4cyclictest3631979-21cron20:40:010
3600539992720,4cyclictest3609226-21tail19:30:300
3600539992720,4cyclictest13650irq/42-30be0000.ethernet21:30:300
3600539992720,4cyclictest13650irq/42-30be0000.ethernet21:30:300
3600539992719,5cyclictest3687265-21fschecks_time23:20:210
3600539992717,7cyclictest3669229-21grep22:25:330
3600539992717,6cyclictest0-21swapper/021:45:310
3600539992715,8cyclictest211-21dbus-daemon00:37:270
3600545992618,4cyclictest0-21swapper/122:00:211
3600545992618,4cyclictest0-21swapper/121:23:391
3600545992617,5cyclictest0-21swapper/120:10:241
3600545992616,7cyclictest3705630-21ls00:14:591
3600545992616,7cyclictest3697442-21/usr/sbin/munin23:50:201
3600545992616,6cyclictest0-21swapper/100:00:351
3600545992615,7cyclictest3655986-21cron21:50:001
3600545992612,10cyclictest3618937-21latency20:00:231
3600545992611,12cyclictest3683873-21fschecks_time23:10:251
3600539992619,3cyclictest0-21swapper/019:50:200
3600539992618,4cyclictest3625141-21latency_hist20:20:010
3600539992618,4cyclictest0-21swapper/020:15:020
3600539992617,5cyclictest3711890-21switchtime00:30:370
3600539992617,4cyclictest0-21swapper/022:35:290
3600539992616,7cyclictest211-21dbus-daemon21:28:400
3600539992614,8cyclictest3660669-21grep22:00:310
3600545992510,10cyclictest3690628-21grep23:30:211
360053999253,9cyclictest3682510-21/usr/sbin/munin23:05:270
3600545992413,8cyclictest3679089-21ntp_states22:55:281
3600539992317,4cyclictest3647111-21kworker/u8:3+events_unbound21:40:120
360053999223,13cyclictest3681602-21sshd23:03:500
3600539992214,4cyclictest0-21swapper/019:45:000
3600539992115,3cyclictest0-21swapper/023:35:230
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional