You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-01 - 15:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot5s.osadl.org (updated Mon Dec 01, 2025 12:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3524598994937,8cyclictest121ktimers/008:25:120
3524598994937,8cyclictest121ktimers/008:25:110
3524611994735,8cyclictest3624251-21fschecks_time11:55:143
3524598994636,8cyclictest121ktimers/012:25:140
3524611994435,4cyclictest0-21swapper/307:35:003
3524611994328,11cyclictest391ktimers/308:20:133
3524611994328,11cyclictest391ktimers/308:20:133
3524602994335,5cyclictest299-21systemd-logind08:15:481
3524607994236,4cyclictest3562735-21kworker/u8:1+events_unbound09:05:562
3524611994130,9cyclictest391ktimers/311:30:133
3524602994133,5cyclictest3556039-21cron08:40:001
3524602994130,8cyclictest3559671-21munin-run08:50:011
3524611994028,7cyclictest0-21swapper/307:45:283
3524602994029,7cyclictest0-21swapper/110:40:001
3524598994028,8cyclictest3611480-21sendmail11:20:000
3524611993927,8cyclictest3600790-21tail10:45:273
3524611993831,4cyclictest3576472-21unixbench_multi09:35:253
3524611993818,6cyclictest3638258-21ntpq12:35:203
3524611993727,6cyclictest3599544-21cron10:45:013
3524607993729,4cyclictest0-21swapper/211:15:002
3524607993727,6cyclictest0-21swapper/210:05:302
3524602993729,3cyclictest0-21swapper/107:20:001
3524602993723,5cyclictest3533264-21kworker/u8:0+events_unbound07:55:111
3524611993625,7cyclictest0-21swapper/307:55:273
3524611993610,8cyclictest3603903-21mailstats10:55:253
3524607993628,5cyclictest3535346-21cron07:40:002
3524607993628,5cyclictest3535346-21cron07:40:002
3524602993629,5cyclictest3606028-21kworker/u8:1+events_unbound12:16:221
3524602993629,5cyclictest3606028-21kworker/u8:1+events_unbound12:16:221
3524602993627,5cyclictest0-21swapper/111:55:251
3524602993619,5cyclictest3576854-21kworker/u8:0+events_unbound09:48:371
3524602993614,7cyclictest131rcu_preempt10:40:161
3524598993614,18cyclictest0-21swapper/007:40:010
3524598993614,18cyclictest0-21swapper/007:40:000
3524611993527,4cyclictest0-21swapper/308:50:163
3524611993527,4cyclictest0-21swapper/307:20:263
3524611993526,6cyclictest3545139-21unixbench_multi08:05:333
3524611993525,7cyclictest391ktimers/311:15:123
3524611993524,7cyclictest3555574-21grep08:35:313
3524607993528,4cyclictest3554324-21cron08:35:012
3524607993528,4cyclictest3554324-21cron08:35:002
3524602993529,4cyclictest3606028-21kworker/u8:1+events_unbound11:46:201
3524602993528,5cyclictest3534997-21kworker/u8:2+events_unbound07:40:371
3524602993527,4cyclictest3530249-21sh07:25:001
3524598993527,4cyclictest0-21swapper/012:40:000
3524611993425,5cyclictest3549228-21idleruntime-cro08:20:013
3524611993415,15cyclictest3622158-21apt-get11:50:163
3524611993410,6cyclictest40-21ksoftirqd/311:20:193
3524607993427,4cyclictest3623208-21unixbench_singl11:50:292
3524607993425,5cyclictest0-21swapper/209:30:272
3524602993426,4cyclictest0-21swapper/108:30:251
3524602993426,4cyclictest0-21swapper/108:30:251
3524602993426,4cyclictest0-21swapper/107:35:001
3524602993417,6cyclictest3573095-21kworker/u8:1+events_unbound09:38:371
352461199335,10cyclictest3554337-21latency_hist08:35:013
352461199335,10cyclictest3554337-21latency_hist08:35:013
3524611993326,4cyclictest3566484-21sh09:10:003
3524611993311,4cyclictest40-21ksoftirqd/311:40:243
3524607993326,4cyclictest3545621-21latency_hist08:10:012
3524602993325,4cyclictest0-21swapper/110:05:191
3524602993322,7cyclictest3637013-21grep12:30:251
3524602993316,7cyclictest131rcu_preempt10:45:121
3524602993316,6cyclictest131rcu_preempt10:50:121
3524602993312,12cyclictest3573095-21kworker/u8:1+events_unbound09:30:121
3524598993323,5cyclictest0-21swapper/011:24:590
3524598993322,7cyclictest3567390-21processes09:10:230
3524611993224,5cyclictest3618530-21idleruntime-cro11:40:013
3524611993224,4cyclictest0-21swapper/309:40:263
3524611993223,4cyclictest0-21swapper/307:15:013
3524611993210,6cyclictest40-21ksoftirqd/312:30:223
3524607993225,4cyclictest0-21swapper/211:00:272
3524607993225,4cyclictest0-21swapper/211:00:272
3524602993226,4cyclictest3587226-21kworker/u8:1+events_unbound10:11:021
3524602993226,4cyclictest3587226-21kworker/u8:1+events_unbound10:11:011
3524602993225,4cyclictest3611468-21latency_hist11:20:011
3524602993223,5cyclictest0-21swapper/108:55:531
3524602993222,6cyclictest0-21swapper/112:00:241
352459899326,5cyclictest131rcu_preempt09:35:120
352459899325,4cyclictest131rcu_preempt12:20:120
352461199315,9cyclictest3609971-21latency_hist11:15:003
352461199313,12cyclictest3594201-21cron10:30:003
3524611993122,6cyclictest0-21swapper/312:20:243
3524607993124,3cyclictest0-21swapper/207:45:282
3524607993123,4cyclictest0-21swapper/209:55:272
3524607993123,4cyclictest0-21swapper/207:40:252
3524607993122,6cyclictest3577578-21fschecks_time09:40:162
3524602993123,4cyclictest0-21swapper/111:00:171
3524602993123,4cyclictest0-21swapper/111:00:171
3524602993123,4cyclictest0-21swapper/109:00:151
3524598993124,5cyclictest3576854-21kworker/u8:0+events_unbound09:46:010
3524598993124,5cyclictest3524280-21kworker/u8:1+events_unbound07:15:320
3524598993123,4cyclictest0-21swapper/010:20:250
3524598993123,4cyclictest0-21swapper/009:20:000
3524611993021,5cyclictest0-21swapper/308:40:153
3524611993019,7cyclictest3586972-21grep10:05:303
3524611993018,9cyclictest391ktimers/312:00:123
3524607993023,3cyclictest0-21swapper/207:20:152
3524602993022,4cyclictest0-21swapper/112:05:261
3524602993020,6cyclictest3540007-21grep07:50:251
3524602993016,6cyclictest3613268-21kworker/u8:0+events_unbound11:34:491
352460299301,15cyclictest0-21swapper/112:21:591
352461199299,6cyclictest40-21ksoftirqd/310:30:133
3524611992922,4cyclictest0-21swapper/312:15:263
3524611992922,4cyclictest0-21swapper/312:15:263
3524611992920,6cyclictest3547500-21sh08:15:013
3524611992916,9cyclictest3584214-21/usr/sbin/munin10:00:113
3524611992914,11cyclictest3581241-21/usr/sbin/munin09:50:203
3524611992910,6cyclictest40-21ksoftirqd/309:20:213
3524607992923,4cyclictest3571377-21kworker/u8:2+events_unbound09:24:312
3524607992923,4cyclictest3554084-21kworker/u8:1+events_unbound08:50:162
3524607992923,4cyclictest3526037-21kworker/u8:0+events_unbound07:19:422
3524607992910,6cyclictest3585481-21kworker/u8:0+events_unbound10:34:002
352460299298,13cyclictest131rcu_preempt10:15:181
352460299298,12cyclictest24-21ksoftirqd/109:20:251
352460299297,11cyclictest0-21swapper/111:26:091
3524602992920,6cyclictest3609279-21grep11:10:251
3524602992920,6cyclictest3538356-21grep07:45:281
3524602992912,6cyclictest3606028-21kworker/u8:1+events_unbound11:05:341
3524602992912,5cyclictest3567969-21kworker/u8:1+events_unbound09:18:451
352460299290,5cyclictest0-21swapper/107:10:141
3524598992922,3cyclictest0-21swapper/012:00:010
3524598992922,3cyclictest0-21swapper/009:55:260
3524598992921,4cyclictest0-21swapper/007:10:270
3524598992919,6cyclictest0-21swapper/010:50:250
352461199283,6cyclictest0-21swapper/311:00:173
352461199283,6cyclictest0-21swapper/311:00:173
3524611992815,10cyclictest3590155-21/usr/sbin/munin10:15:253
3524611992814,10cyclictest3527508-21/usr/sbin/munin07:15:203
3524607992820,6cyclictest3558430-21fschecks_time08:45:192
3524607992819,6cyclictest3546173-21fschecks_count08:10:152
3524607992818,6cyclictest3579282-21fschecks_time09:45:172
3524607992815,9cyclictest0-21swapper/209:40:002
352460299289,15cyclictest24-21ksoftirqd/109:10:121
3524602992819,5cyclictest0-21swapper/112:10:151
3524602992818,6cyclictest0-21swapper/111:40:001
3524602992815,5cyclictest3585481-21kworker/u8:0+events_unbound10:04:151
3524602992815,5cyclictest3524592-21cyclictest08:45:021
3524602992813,3cyclictest0-21swapper/107:38:511
3524602992813,3cyclictest0-21swapper/107:38:511
3524598992821,5cyclictest3526037-21kworker/u8:0+events_unbound07:20:320
3524598992821,3cyclictest0-21swapper/011:40:000
3524598992819,6cyclictest0-21swapper/009:50:260
3524598992814,11cyclictest3524592-21cyclictest11:30:130
352461199279,5cyclictest40-21ksoftirqd/307:25:243
352461199278,4cyclictest40-21ksoftirqd/312:25:233
352461199276,6cyclictest0-21swapper/308:00:213
3524611992720,4cyclictest0-21swapper/307:35:243
3524611992720,4cyclictest0-21swapper/307:35:243
3524611992718,6cyclictest391ktimers/309:00:013
3524611992717,7cyclictest3602612-21sshd10:51:093
3524611992717,7cyclictest3591094-21/usr/sbin/munin10:20:133
3524611992716,7cyclictest3628530-21grep12:05:273
3524611992715,8cyclictest3588635-21grep10:10:263
3524611992715,8cyclictest3588635-21grep10:10:253
3524611992714,10cyclictest3558312-21/usr/sbin/munin08:45:173
3524611992712,8cyclictest131rcu_preempt08:25:203
3524611992712,8cyclictest131rcu_preempt08:25:193
3524607992721,4cyclictest3606028-21kworker/u8:1+events_unbound12:01:422
3524607992720,4cyclictest0-21swapper/212:25:252
3524607992719,4cyclictest0-21swapper/211:06:132
3524607992718,6cyclictest0-21swapper/211:40:182
3524607992717,6cyclictest0-21swapper/209:15:302
3524607992716,7cyclictest215-21dbus-daemon12:11:202
3524607992712,7cyclictest32-21ksoftirqd/207:15:012
352460799271,10cyclictest35919062sed10:20:252
352460299278,5cyclictest0-21swapper/111:43:001
352460299277,11cyclictest131rcu_preempt10:55:141
352460299274,13cyclictest24-21ksoftirqd/109:25:491
352460299274,13cyclictest24-21ksoftirqd/109:25:491
3524602992720,5cyclictest3634305-21kworker/u8:1+events_unbound12:25:191
3524602992719,4cyclictest0-21swapper/111:55:011
3524602992719,4cyclictest0-21swapper/110:30:291
3524602992719,4cyclictest0-21swapper/109:40:271
3524602992717,6cyclictest3547036-21grep08:10:241
352460299271,12cyclictest3637122-21kworker/u8:0-events_freezable_power_12:38:171
3524598992720,3cyclictest0-21swapper/011:25:260
3524598992720,3cyclictest0-21swapper/010:45:010
3524598992719,4cyclictest3606028-21kworker/u8:1+events_unbound12:00:260
3524598992719,4cyclictest0-21swapper/009:20:260
3524598992718,5cyclictest0-21swapper/008:05:000
3524598992716,6cyclictest0-21swapper/012:05:270
3524598992715,9cyclictest3573486-21date09:30:010
3524598992715,9cyclictest3573486-21date09:30:000
352461199266,6cyclictest0-21swapper/309:25:153
352461199266,6cyclictest0-21swapper/309:25:153
3524611992614,9cyclictest3621601-21sshd11:46:153
3524611992614,9cyclictest3569558-21cron09:16:003
3524611992612,10cyclictest391ktimers/309:30:113
3524607992620,4cyclictest3585481-21kworker/u8:0+events_unbound10:26:022
3524607992620,3cyclictest0-21swapper/212:20:242
3524607992619,4cyclictest0-21swapper/211:30:002
3524607992619,4cyclictest0-21swapper/210:40:202
3524607992618,5cyclictest0-21swapper/210:50:262
3524607992618,4cyclictest0-21swapper/212:40:012
3524607992618,4cyclictest0-21swapper/210:10:252
3524607992618,4cyclictest0-21swapper/210:10:252
3524607992614,10cyclictest0-21swapper/212:05:122
352460299269,7cyclictest24-21ksoftirqd/111:20:251
3524602992618,4cyclictest0-21swapper/108:00:261
352460299261,14cyclictest0-21swapper/108:20:561
352460299261,14cyclictest0-21swapper/108:20:551
352460299261,13cyclictest0-21swapper/108:25:191
352460299261,13cyclictest0-21swapper/108:25:181
352459899262,4cyclictest3541739-21grep07:55:270
3524598992620,4cyclictest3606028-21kworker/u8:1+events_unbound11:11:140
3524598992620,4cyclictest3605897-21unixbench_multi11:00:270
3524598992620,4cyclictest3605897-21unixbench_multi11:00:270
3524598992620,4cyclictest3533154-21timerwakeupswit07:30:260
3524598992618,4cyclictest3554343-21munin-plugin-st08:35:010
3524598992618,4cyclictest3554343-21munin-plugin-st08:35:000
3524598992617,6cyclictest3544268-21grep08:05:210
3524598992616,7cyclictest3588626-21grep10:10:260
3524598992616,7cyclictest3588626-21grep10:10:260
352461199259,9cyclictest131rcu_preempt10:35:333
3524611992515,7cyclictest3613750-21df_inode11:25:153
3524611992515,7cyclictest3580471-21cron09:49:013
3524611992515,7cyclictest3539004-21/usr/sbin/munin07:50:123
3524611992515,7cyclictest3535942-21/usr/sbin/munin07:40:193
3524611992514,8cyclictest3568084-21sshd09:13:493
3524611992511,11cyclictest3564392-21users09:00:263
3524607992518,4cyclictest0-21swapper/212:30:262
3524607992518,4cyclictest0-21swapper/209:50:252
3524607992517,4cyclictest3616380-21unixbench_singl11:30:262
352460799251,4cyclictest440-21cron09:15:012
3524607992513,8cyclictest1-21systemd10:16:022
3524602992519,4cyclictest3560999-21kworker/u8:2+events_unbound08:51:451
3524602992518,5cyclictest3576854-21kworker/u8:0+events_unbound09:55:141
352460299250,13cyclictest0-21swapper/110:27:221
352459899253,4cyclictest131rcu_preempt07:50:250
3524598992519,4cyclictest3562597-21unixbench_multi08:55:260
3524598992515,7cyclictest3575277-21sed09:35:010
3524598992512,11cyclictest0-21swapper/008:40:000
352459899251,20cyclictest3597600-21cron10:40:010
352459899251,20cyclictest0-21swapper/008:54:210
3524598992510,12cyclictest11-21ksoftirqd/012:30:130
3524607992418,4cyclictest3548860-21kworker/u8:0+events_unbound08:25:512
3524607992418,4cyclictest3548860-21kworker/u8:0+events_unbound08:25:512
3524607992418,4cyclictest3533264-21kworker/u8:0+events_unbound07:50:412
3524607992417,5cyclictest3552329-21kworker/u8:2+events_unbound08:40:532
3524607992417,3cyclictest0-21swapper/209:30:012
3524607992417,3cyclictest0-21swapper/209:30:002
3524607992416,4cyclictest0-21swapper/210:40:002
3524607992416,4cyclictest0-21swapper/208:00:142
352460299241,12cyclictest0-21swapper/108:05:281
352460299240,13cyclictest0-21swapper/109:50:161
352459899242,3cyclictest3599881-21df10:45:150
3524598992418,3cyclictest0-21swapper/008:15:010
3524598992417,3cyclictest0-21swapper/012:15:260
3524598992417,3cyclictest0-21swapper/012:15:260
3524598992417,3cyclictest0-21swapper/011:46:240
3524598992415,6cyclictest3563898-21awk09:00:210
3524598992414,6cyclictest0-21swapper/008:20:220
3524598992414,6cyclictest0-21swapper/008:20:220
352459899241,19cyclictest0-21swapper/011:40:300
352461199233,12cyclictest40-21ksoftirqd/309:55:143
3524607992317,3cyclictest0-21swapper/208:20:012
3524607992316,4cyclictest0-21swapper/208:00:022
3524607992312,7cyclictest0-21swapper/212:15:272
3524607992312,7cyclictest0-21swapper/212:15:262
3524602992317,4cyclictest3530211-21kworker/u8:1+events_unbound07:28:021
352459899238,6cyclictest3552329-21kworker/u8:2+events_unbound08:40:020
3524598992317,3cyclictest0-21swapper/010:05:160
3524598992316,3cyclictest0-21swapper/010:33:130
352459899231,3cyclictest0-21swapper/010:15:120
352459899231,18cyclictest0-21swapper/010:26:510
352460799226,3cyclictest131rcu_preempt09:00:002
3524607992217,3cyclictest3612429-21missed_timers11:20:192
3524607992212,7cyclictest3550943-21basename08:25:012
3524607992212,7cyclictest3550943-21basename08:25:002
3524598992217,3cyclictest3628601-21kworker/u8:2-events_freezable_power_12:10:240
3524598992216,3cyclictest0-21swapper/011:55:000
3524598992216,3cyclictest0-21swapper/010:55:260
3524598992216,3cyclictest0-21swapper/010:00:230
3524598992216,3cyclictest0-21swapper/008:45:300
3524598992215,3cyclictest0-21swapper/009:44:260
352459899221,3cyclictest0-21swapper/008:19:020
3524598992213,7cyclictest3606789-21cut11:05:160
352459899221,19cyclictest0-21swapper/007:48:020
352459899221,19cyclictest0-21swapper/007:25:300
3524607992115,4cyclictest3585878-21latency_hist10:05:012
3524607992113,5cyclictest311ktimers/209:00:162
3524598992115,3cyclictest0-21swapper/009:05:230
352460799209,8cyclictest3624813-21sensors_temp11:55:222
3524607992014,3cyclictest0-21swapper/207:25:222
3524607992011,6cyclictest53-21kcompactd010:45:242
3524607991913,3cyclictest0-21swapper/211:45:212
3524607991911,5cyclictest0-21swapper/211:35:232
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional