You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-20 - 15:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Mon Jul 20, 2026 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
248416995611,29cyclictest355413-21apt-key12:20:010
248418995242,7cyclictest231ktimers/111:45:131
248422995144,5cyclictest274969-21kworker/u8:2+events_unbound08:25:142
248422995144,5cyclictest274969-21kworker/u8:2+events_unbound08:25:142
248422994839,5cyclictest321023-21basename10:40:012
248427994733,11cyclictest391ktimers/312:05:133
248418994635,8cyclictest283276-21idleruntime-cro08:50:001
248416994638,4cyclictest341704-21idleruntime-cro11:40:010
248416994638,4cyclictest315438-21unixbench_multi10:20:260
24841699461,6cyclictest288528-21latency_hist09:05:020
248427994535,6cyclictest296522-21unixbench_singl09:25:253
248416994533,8cyclictest252376-21sendmail07:20:010
24841699452,6cyclictest274366-21users08:20:260
248418994437,4cyclictest321035-21idleruntime-cro10:40:001
248416994434,6cyclictest276031-21grep08:25:260
248416994434,6cyclictest276031-21grep08:25:260
24841699441,5cyclictest314280-21latency_hist10:20:010
248427994335,5cyclictest278122-21kworker/u8:0+events_unbound08:35:153
248422994333,8cyclictest290038-21kworker/u8:0+events_unbound09:10:222
248416994332,8cyclictest121ktimers/012:05:120
248418994234,5cyclictest286681-21latency_hist09:00:011
248418994231,8cyclictest231ktimers/111:15:141
24841699421,9cyclictest288911-21/usr/sbin/munin09:05:180
24841699421,9cyclictest265429-21/usr/sbin/munin07:55:230
24841699421,5cyclictest3389742sleep011:30:200
24841699421,3cyclictest361254-21irqstats12:35:170
24841699421,10cyclictest269921-21/usr/sbin/munin08:10:150
24841699420,5cyclictest281728-21latency_hist08:45:000
24841699412,10cyclictest316283-21fschecks_count10:25:170
24841699411,9cyclictest328981-21/usr/sbin/munin11:00:220
24841699411,9cyclictest252948-21/usr/sbin/munin07:20:180
24841699411,8cyclictest355802-21munin-node12:20:100
24841699411,8cyclictest335742-21/usr/sbin/munin11:20:230
24841699411,8cyclictest321633-21/usr/sbin/munin10:40:170
24841699411,8cyclictest308698-21sshd10:00:270
24841699411,6cyclictest338426-21latency_hist11:30:010
24841699411,3cyclictest285206-21apt-get08:55:120
24841699403,8cyclictest302735-21/usr/sbin/munin09:45:200
24841699402,6cyclictest317838-21apt-get10:30:120
24841699401,8cyclictest346074-21/usr/sbin/munin11:50:230
24841699401,8cyclictest256006-21apt-get07:30:120
24841699401,5cyclictest320105-21ntp_states10:35:210
24841699401,5cyclictest305237-21grep09:50:260
24841699401,5cyclictest248688-21df07:10:140
24841699401,10cyclictest332717-21grep11:10:270
24842299399,5cyclictest131rcu_preempt09:30:112
248418993931,4cyclictest0-21swapper/107:50:001
24841699392,4cyclictest352171-21munin-node12:10:110
24841699391,9cyclictest295981-21/usr/sbin/munin09:25:210
24841699391,9cyclictest271791-21grep08:15:170
24841699391,7cyclictest263574-21/usr/sbin/munin07:50:210
24841699391,6cyclictest300581-21/usr/sbin/munin09:40:120
24841699391,6cyclictest298780-21latency_hist09:35:020
24841699391,6cyclictest283103-21cron08:48:010
24841699391,5cyclictest360245-21head12:30:270
24841699391,5cyclictest349498-21/usr/sbin/munin12:00:260
24841699391,5cyclictest277375-21/usr/sbin/munin08:30:240
24841699391,4cyclictest358586-21/usr/sbin/munin12:25:270
24841699391,4cyclictest306966-21/usr/sbin/munin09:55:270
24841699391,12cyclictest293535-21grep09:20:000
248416993911,24cyclictest330455-21missed_timers11:05:200
248416993911,24cyclictest330455-21missed_timers11:05:200
24841699391,10cyclictest298863-21apt-get09:35:120
24842299382,13cyclictest0-21swapper/208:10:132
248418993830,4cyclictest0-21swapper/111:40:151
24841699382,8cyclictest267914-21cron08:05:000
24841699382,5cyclictest311253-21/usr/sbin/munin10:10:150
24841699382,5cyclictest309890-21ntp_states10:05:220
24841699382,4cyclictest254886-21/usr/sbin/munin07:25:190
24841699381,8cyclictest334436-21sed11:15:280
24841699381,8cyclictest294292-21awk09:20:210
24841699381,8cyclictest294292-21awk09:20:210
24841699381,8cyclictest278510-21/usr/sbin/munin08:35:160
24841699381,7cyclictest259551-21/usr/sbin/munin07:40:160
24841699381,6cyclictest343648-21apt-get11:45:120
24841699381,11cyclictest261908-21ntp_states07:45:230
24842299378,5cyclictest131rcu_preempt07:45:122
248422993731,4cyclictest302070-21idleruntime-cro09:45:012
24841699371,8cyclictest325455-21/usr/sbin/munin10:50:230
24841699371,5cyclictest283967-21/usr/sbin/munin08:50:190
24841699371,4cyclictest347151-21/usr/sbin/munin11:55:150
24841699371,4cyclictest347151-21/usr/sbin/munin11:55:150
24841699371,4cyclictest290471-21forks09:10:150
24841699371,3cyclictest342668-21/usr/sbin/munin11:40:230
24841699371,3cyclictest257818-21/usr/sbin/munin07:35:130
24841699371,11cyclictest323782-21/usr/sbin/munin10:45:230
248427993629,5cyclictest278122-21kworker/u8:0+events_unbound08:55:173
24841699361,5cyclictest327024-21meminfo10:55:190
248427993528,5cyclictest267802-21kworker/u8:0+events_unbound08:10:103
248427993527,4cyclictest0-21swapper/307:20:163
248422993526,3cyclictest0-21swapper/212:25:002
248418993526,5cyclictest0-21swapper/111:14:591
248418993524,7cyclictest0-21swapper/108:05:011
248427993424,6cyclictest0-21swapper/308:20:003
248422993424,6cyclictest0-21swapper/208:15:272
248422993422,8cyclictest296514-21grep09:25:252
248422993410,10cyclictest131rcu_preempt07:30:122
248418993426,4cyclictest0-21swapper/108:30:161
248418993422,9cyclictest348524-21sh12:00:001
248418993422,9cyclictest348524-21sh12:00:001
248427993325,4cyclictest0-21swapper/310:00:013
248422993326,3cyclictest0-21swapper/212:35:252
248422993325,4cyclictest0-21swapper/208:35:142
248422993323,6cyclictest0-21swapper/212:05:262
248422993323,6cyclictest0-21swapper/209:50:002
248418993325,4cyclictest0-21swapper/110:45:171
248422993225,3cyclictest0-21swapper/207:30:012
248422993222,6cyclictest204-21dbus-daemon08:45:162
248422993219,8cyclictest0-21swapper/212:20:022
248422993214,6cyclictest131rcu_preempt11:30:132
248418993224,4cyclictest0-21swapper/110:30:251
248418993223,5cyclictest0-21swapper/112:10:161
248418993223,5cyclictest0-21swapper/109:25:011
248418993223,5cyclictest0-21swapper/109:25:011
248418993222,7cyclictest204-21dbus-daemon09:00:181
248418993221,7cyclictest331058-21grep11:05:271
248418993221,7cyclictest331058-21grep11:05:271
248427993124,4cyclictest0-21swapper/309:35:173
248427993124,3cyclictest0-21swapper/311:35:173
248427993123,4cyclictest0-21swapper/307:55:163
248422993124,5cyclictest258852-21kworker/u8:1+events_unbound07:44:572
248418993124,5cyclictest278397-21sshd08:35:141
248418993123,5cyclictest0-21swapper/107:25:221
248418993121,6cyclictest0-21swapper/108:50:171
248427993025,3cyclictest348390-21kworker/u8:2+events_unbound12:12:413
248427993022,4cyclictest0-21swapper/309:30:263
248427993020,6cyclictest0-21swapper/308:40:273
248422993023,4cyclictest0-21swapper/208:10:002
248422993022,6cyclictest276269-21kworker/u8:3+events_unbound08:40:162
248418993021,6cyclictest359443-21tune2fs12:30:171
248418993021,5cyclictest0-21swapper/107:30:171
248418993019,7cyclictest251906-21grep07:15:281
248418993018,8cyclictest1-21systemd09:30:231
248427992922,5cyclictest338516-21kworker/u8:0+events_unbound11:50:573
248427992922,3cyclictest0-21swapper/308:20:253
248427992921,4cyclictest0-21swapper/310:15:233
248427992921,4cyclictest0-21swapper/310:10:153
24842299299,5cyclictest131rcu_preempt10:25:172
248422992923,4cyclictest351602-21kworker/u8:3+events_unbound12:10:242
248422992923,3cyclictest309084-21sh10:05:012
248422992922,5cyclictest338516-21kworker/u8:0+events_unbound12:02:412
248422992922,3cyclictest0-21swapper/207:35:242
248422992921,6cyclictest338516-21kworker/u8:0+events_unbound11:35:572
248422992921,4cyclictest0-21swapper/208:50:262
248422992920,6cyclictest337872-21grep11:25:262
248422992917,4cyclictest276269-21kworker/u8:3+events_unbound08:32:192
248418992921,6cyclictest231ktimers/112:15:131
248418992921,4cyclictest0-21swapper/107:50:261
248418992920,6cyclictest0-21swapper/107:45:001
248427992819,4cyclictest0-21swapper/311:10:263
248427992819,4cyclictest0-21swapper/309:10:263
24842799281,24cyclictest277255-21ntp_states08:30:213
24842299282,3cyclictest0-21swapper/207:20:122
248422992821,5cyclictest327868-21kworker/u8:2+events_unbound10:59:402
248422992821,4cyclictest288409-21munin-plugin-st09:05:002
248422992820,4cyclictest0-21swapper/211:20:172
248422992820,4cyclictest0-21swapper/210:15:232
24842299281,15cyclictest0-21swapper/210:45:122
248418992821,5cyclictest231ktimers/109:50:211
248418992821,4cyclictest0-21swapper/107:55:261
248418992820,4cyclictest312058-21head10:10:261
248418992818,5cyclictest438-21cron11:40:001
248427992721,4cyclictest334874-21grep11:20:003
248427992720,5cyclictest326150-21kworker/u8:1+events_unbound11:00:513
248427992720,4cyclictest350250-21munin-plugin-st12:05:003
248427992720,4cyclictest338282-21cron11:30:003
248427992720,3cyclictest0-21swapper/312:40:013
248427992719,6cyclictest230741-21kworker/u8:2+events_unbound07:14:523
24842299277,11cyclictest32-21ksoftirqd/209:50:232
24842299273,3cyclictest131rcu_preempt08:55:122
248422992721,4cyclictest326150-21kworker/u8:1+events_unbound11:00:402
248422992720,5cyclictest248000-21kworker/u8:1+events_unbound07:10:152
248422992717,8cyclictest311ktimers/210:30:142
248418992720,4cyclictest0-21swapper/110:50:251
248418992719,4cyclictest0-21swapper/108:20:251
248418992715,8cyclictest290108-21munin-plugin-st09:10:001
248427992617,5cyclictest0-21swapper/310:40:003
248427992616,6cyclictest0-21swapper/309:50:243
24842799261,14cyclictest308331-21grep10:00:233
248422992620,4cyclictest308919-21kworker/u8:0+events_unbound10:06:522
248422992618,5cyclictest0-21swapper/207:50:172
248422992617,6cyclictest0-21swapper/209:10:012
24842299261,12cyclictest0-21swapper/210:51:032
248418992618,5cyclictest303325-21grep09:45:271
248418992618,5cyclictest0-21swapper/108:40:171
248427992519,3cyclictest0-21swapper/309:00:183
248427992517,4cyclictest0-21swapper/309:40:163
24842299258,10cyclictest32-21ksoftirqd/209:35:242
24842299255,3cyclictest131rcu_preempt07:55:212
24842299254,12cyclictest32-21ksoftirqd/208:20:172
248422992519,4cyclictest311ktimers/209:15:142
248422992519,4cyclictest293543-21kworker/u8:0+events_unbound09:20:162
248422992519,4cyclictest293543-21kworker/u8:0+events_unbound09:20:152
248422992513,3cyclictest131rcu_preempt11:55:182
248422992513,3cyclictest131rcu_preempt11:55:182
248418992518,5cyclictest0-21swapper/109:10:251
248418992518,4cyclictest0-21swapper/108:15:261
248418992516,6cyclictest292809-21expr09:15:251
248418992514,7cyclictest308655-21grep10:00:251
248427992418,4cyclictest266026-21kworker/u8:1+events_unbound08:05:083
248427992418,3cyclictest0-21swapper/311:05:183
248427992418,3cyclictest0-21swapper/311:05:183
248427992418,3cyclictest0-21swapper/307:25:133
248427992417,4cyclictest360696-21idleruntime-cro12:35:013
248427992417,4cyclictest0-21swapper/310:55:013
248427992417,4cyclictest0-21swapper/309:20:263
248427992417,4cyclictest0-21swapper/309:20:263
248427992417,3cyclictest0-21swapper/307:15:163
248427992416,4cyclictest0-21swapper/312:15:163
248427992415,5cyclictest284582-21head08:50:253
248427992414,7cyclictest391ktimers/312:20:043
248427992414,6cyclictest0-21swapper/308:25:163
248427992414,6cyclictest0-21swapper/308:25:163
248427992414,6cyclictest0-21swapper/307:40:003
24842299247,9cyclictest32-21ksoftirqd/210:13:172
24842299247,10cyclictest32-21ksoftirqd/211:15:162
24842299247,10cyclictest0-21swapper/207:15:222
24842299241,9cyclictest32-21ksoftirqd/211:50:132
248422992419,3cyclictest268108-21latency_hist08:05:012
248422992418,4cyclictest322615-21kworker/u8:1+events_unbound10:44:042
248422992417,5cyclictest356953-21kworker/u8:0+events_unbound12:30:152
248422992414,3cyclictest0-21swapper/210:00:012
248422992413,8cyclictest330902-21cat11:05:262
248422992413,8cyclictest330902-21cat11:05:252
248418992412,8cyclictest358505-21grep12:25:251
248427992317,3cyclictest0-21swapper/311:40:193
248427992317,3cyclictest0-21swapper/307:35:013
248427992314,5cyclictest0-21swapper/308:00:163
248422992314,7cyclictest312458-21kworker/u8:2+events_unbound10:20:132
24842299230,12cyclictest329417-21kworker/2:2+mm_percpu_wq11:11:522
248418992317,4cyclictest254080-21sh07:25:001
248418992315,4cyclictest307529-21latency_hist10:00:011
248418992314,6cyclictest276442-21cron08:30:011
248418992314,6cyclictest276442-21cron08:30:011
24842799222,4cyclictest131rcu_preempt08:45:133
248427992216,3cyclictest0-21swapper/312:25:253
248427992216,3cyclictest0-21swapper/309:15:273
248427992214,6cyclictest391ktimers/310:35:003
248427992214,4cyclictest0-21swapper/311:30:173
248427992213,6cyclictest321821-21cut10:40:193
24842299224,10cyclictest32-21ksoftirqd/211:45:252
248422992212,7cyclictest358515-21grep12:25:252
248418992216,3cyclictest0-21swapper/111:30:171
248418992216,3cyclictest0-21swapper/110:40:191
248418992216,3cyclictest0-21swapper/109:25:211
248418992216,3cyclictest0-21swapper/107:10:261
248418992215,5cyclictest309890-21ntp_states10:05:231
248418992215,4cyclictest0-21swapper/111:55:001
248418992214,4cyclictest0-21swapper/110:20:001
248418992212,7cyclictest356002-21cut12:20:161
248427992117,2cyclictest0-21swapper/309:50:003
248427992115,4cyclictest260797-21cron07:44:013
248427992114,4cyclictest263178-21fschecks_count07:50:163
248427992112,6cyclictest343999-21/usr/sbin/munin11:45:193
248418992115,3cyclictest0-21swapper/109:35:251
248418992114,5cyclictest231ktimers/110:55:131
248418992114,5cyclictest231ktimers/109:40:121
248418992113,5cyclictest231ktimers/110:20:131
248418992111,7cyclictest0-21swapper/111:25:191
24841899211,13cyclictest0-21swapper/112:38:101
24842799205,3cyclictest309533-21fschecks_time10:05:153
248427992014,4cyclictest391ktimers/310:20:143
248427992014,3cyclictest0-21swapper/311:20:163
248427992014,3cyclictest0-21swapper/309:05:213
248418992014,3cyclictest0-21swapper/110:25:211
248418992013,4cyclictest335282-21fschecks_count11:20:161
248418992013,4cyclictest269641-21idleruntime-cro08:10:001
248418992013,4cyclictest231ktimers/108:10:181
24842799199,7cyclictest261707-21cut07:45:203
248418991912,5cyclictest231ktimers/107:35:211
24842799187,8cyclictest327926-21seq10:58:393
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional