You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-28 - 20:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot5s.osadl.org (updated Tue Jul 28, 2026 12:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
583973995338,10cyclictest231ktimers/110:40:121
58397899521,32cyclictest672232-21cut11:25:012
583978995040,6cyclictest587919-21grep07:20:002
583968994934,11cyclictest121ktimers/007:55:140
583982994838,6cyclictest629075-21grep09:20:003
583978994841,4cyclictest583961-21cyclictest09:55:002
583973994834,11cyclictest231ktimers/111:15:121
583968994831,14cyclictest121ktimers/012:05:120
583978994720,23cyclictest599859-21basename07:55:012
58397899471,27cyclictest588184-21cpu07:20:132
583973994636,5cyclictest0-21swapper/109:15:011
583978994532,10cyclictest311ktimers/212:25:142
583973994539,4cyclictest685570-21kworker/u8:3+events_unbound12:10:071
58397899441,38cyclictest643177-21apt-get10:00:132
58397899441,37cyclictest662585-21memory10:55:192
58397899441,37cyclictest662585-21memory10:55:192
58397899431,36cyclictest680906-21apt-get11:50:112
58397899431,35cyclictest606910-21apt-get08:15:152
58397899430,2cyclictest0-21swapper/211:45:122
58397899428,30cyclictest678507-21grep11:40:252
583978994232,7cyclictest611349-21grep08:25:252
58397899422,37cyclictest627184-21cron09:13:002
58397899422,35cyclictest584579-21memory07:10:202
58397899421,36cyclictest689443-21apt-get12:15:122
58397899421,36cyclictest672474-21cstates11:25:152
58397899421,36cyclictest655524-21/usr/sbin/munin10:35:172
58397899421,36cyclictest605761-21/usr/sbin/munin08:10:212
58397899421,35cyclictest691166-21apt-get12:20:122
58397899421,35cyclictest691166-21apt-get12:20:122
58397899421,33cyclictest3596338-1kworker/2:1H+kblockd11:10:162
58397399422,4cyclictest131rcu_preempt12:05:121
583978994133,5cyclictest642931-21munin-plugin-st10:00:002
58397899413,35cyclictest597806-21cron07:46:002
58397899413,35cyclictest597806-21cron07:46:002
583978994132,6cyclictest311ktimers/208:45:142
58397899411,37cyclictest682925-21/usr/sbin/munin11:55:172
58397899411,37cyclictest648881-21/usr/sbin/munin10:15:232
58397899411,36cyclictest600210-21/usr/sbin/munin07:55:162
58397899411,35cyclictest653953-21/usr/sbin/munin10:30:192
58397899411,35cyclictest603616-21/usr/sbin/munin08:05:142
58397899411,34cyclictest650001-21apt-get10:20:122
58397399411,4cyclictest131rcu_preempt09:35:141
58397399410,15cyclictest0-21swapper/112:20:121
58397399410,15cyclictest0-21swapper/112:20:121
583982994030,7cyclictest690494-21unixbench_singl12:15:253
583982994030,7cyclictest675974-21fschecks_time11:35:173
583982994030,7cyclictest391ktimers/309:05:153
58397899402,35cyclictest695153-21ntp_states12:30:232
58397899402,35cyclictest695153-21ntp_states12:30:222
583978994017,20cyclictest660346-21cat10:50:012
58397899401,36cyclictest669407-21meminfo11:15:192
58397899401,36cyclictest664305-21/usr/sbin/munin11:00:192
58397899401,36cyclictest652393-21/usr/sbin/munin10:25:222
58397899401,36cyclictest627689-21cat09:15:142
58397899401,36cyclictest624706-21/usr/sbin/munin09:05:222
58397899401,36cyclictest596105-21cron07:41:002
58397899401,35cyclictest622487-21apt-get09:00:152
58397899401,34cyclictest646626-21/usr/sbin/munin10:10:152
58397899401,34cyclictest645328-21memory10:05:212
58397899401,34cyclictest589959-21/usr/sbin/munin07:25:152
58397899401,32cyclictest612030-21apt-get08:30:122
58396899408,7cyclictest131rcu_preempt10:55:130
58396899408,7cyclictest131rcu_preempt10:55:130
58396899408,4cyclictest131rcu_preempt07:15:130
583968994033,5cyclictest634119-21kworker/u8:1+events_unbound09:49:290
58396899401,10cyclictest11-21ksoftirqd/008:15:150
58397899392,34cyclictest620269-21cron08:52:012
58397899391,36cyclictest592012-21/usr/sbin/munin07:30:212
58397899391,35cyclictest696614-21/usr/sbin/munin12:35:162
58397899391,35cyclictest633898-21sshd09:31:392
58397899391,34cyclictest660437-21apt-get10:50:132
58397899391,34cyclictest660437-21apt-get10:50:132
58397899391,34cyclictest601936-21/usr/sbin/munin08:00:152
58397899391,33cyclictest687742-21apt-get12:10:132
58397899391,33cyclictest674530-21/usr/sbin/munin11:30:212
58397899391,33cyclictest631018-21apt09:25:122
58397899391,33cyclictest620874-21/usr/sbin/munin08:55:142
583978993912,23cyclictest0-21swapper/209:20:152
583973993933,4cyclictest680350-21kworker/u8:1+events_unbound11:49:561
583973993932,5cyclictest685570-21kworker/u8:3+events_unbound12:35:101
58397399392,3cyclictest131rcu_preempt09:00:141
583968993923,13cyclictest121ktimers/012:20:120
583968993923,13cyclictest121ktimers/012:20:120
58396899390,4cyclictest131rcu_preempt08:05:130
58397899383,32cyclictest614251-21/usr/sbin/munin08:35:202
58397899381,34cyclictest686386-21/usr/sbin/munin12:05:202
58397899381,34cyclictest665675-21/usr/sbin/munin11:05:162
58397899381,34cyclictest637482-21sshd09:43:402
58397899381,34cyclictest616124-21/usr/sbin/munin08:40:242
58397899381,34cyclictest609705-21users08:20:252
58397899381,34cyclictest593604-21/usr/sbin/munin07:35:202
58397899381,32cyclictest53-21kcompactd011:35:082
583973993832,4cyclictest221rcuc/111:20:101
583973993828,5cyclictest0-21swapper/110:35:001
583973993827,8cyclictest231ktimers/110:25:111
58397399381,15cyclictest0-21swapper/111:50:121
583968993831,4cyclictest589621-21cron07:25:000
583968993830,3cyclictest0-21swapper/012:40:000
583968993827,5cyclictest625622-21kworker/u8:3+events_unbound09:29:250
583982993726,6cyclictest0-21swapper/310:30:003
58397899371,33cyclictest657034-21apt-get10:40:142
583973993727,6cyclictest592609-21grep07:30:251
58397399370,5cyclictest131rcu_preempt09:30:111
58396899378,6cyclictest131rcu_preempt08:10:140
58396899376,5cyclictest131rcu_preempt09:37:250
583968993731,4cyclictest692270-21kworker/u8:0+events_unbound12:25:080
583968993728,6cyclictest642921-21sh10:00:000
583982993620,7cyclictest131rcu_preempt09:35:273
583982993518,3cyclictest131rcu_preempt12:20:263
583982993518,3cyclictest131rcu_preempt12:20:253
583973993528,4cyclictest684094-21cron12:00:001
583973993527,4cyclictest0-21swapper/111:40:171
583973993527,4cyclictest0-21swapper/108:00:011
58397399350,3cyclictest131rcu_preempt09:55:111
58396899351,5cyclictest131rcu_preempt11:05:130
583982993424,7cyclictest655074-21cron10:35:013
583982993419,9cyclictest131rcu_preempt07:46:543
583982993419,9cyclictest131rcu_preempt07:46:533
583982993417,14cyclictest391ktimers/309:32:403
583982993411,8cyclictest670648-21sed11:20:013
583973993425,6cyclictest604501-21grep08:05:271
583973993425,5cyclictest0-21swapper/109:10:011
583968993428,4cyclictest644307-21kworker/u8:1+events_unbound10:19:350
583982993321,5cyclictest680350-21kworker/u8:1+events_unbound11:48:423
583973993323,7cyclictest591340-21cut07:30:001
583973993319,5cyclictest585273-21kworker/u8:3+events_unbound07:16:391
583973993314,10cyclictest651232-21kworker/u8:0+events_unbound11:10:181
583968993325,4cyclictest0-21swapper/007:45:000
583968993323,6cyclictest0-21swapper/010:24:370
58398299329,5cyclictest40-21ksoftirqd/311:30:233
58398299325,7cyclictest40-21ksoftirqd/311:00:013
58398299325,7cyclictest40-21ksoftirqd/311:00:003
583982993225,4cyclictest0-21swapper/308:50:253
583982993224,3cyclictest0-21swapper/308:05:273
583982993214,5cyclictest131rcu_preempt11:01:263
58397399324,4cyclictest131rcu_preempt10:45:111
583973993223,6cyclictest0-21swapper/111:25:171
58396899329,3cyclictest131rcu_preempt10:25:190
583968993227,3cyclictest663495-21kworker/u8:1+events_unbound11:04:470
583968993226,3cyclictest0-21swapper/011:15:250
583968993225,4cyclictest0-21swapper/008:50:000
583968993216,8cyclictest685570-21kworker/u8:3+events_unbound12:10:180
58396899321,5cyclictest131rcu_preempt08:55:120
583968993210,10cyclictest0-21swapper/009:05:220
58398299315,7cyclictest40-21ksoftirqd/307:15:203
58398299314,7cyclictest40-21ksoftirqd/308:25:253
58398299314,17cyclictest40-21ksoftirqd/311:15:013
583982993124,4cyclictest0-21swapper/308:15:283
583982993121,7cyclictest391ktimers/312:05:003
583982993120,4cyclictest131rcu_preempt12:25:153
583982993114,5cyclictest131rcu_preempt08:55:243
583982993114,4cyclictest131rcu_preempt10:40:233
583982993113,11cyclictest131rcu_preempt09:56:583
583982993111,17cyclictest391ktimers/310:00:193
583973993117,5cyclictest640631-21kworker/u8:0+events_unbound10:03:161
583968993125,3cyclictest0-21swapper/009:30:250
583968993124,5cyclictest611477-21kworker/u8:2+events_unbound08:30:170
583968993110,11cyclictest0-21swapper/010:00:220
58398299307,6cyclictest40-21ksoftirqd/307:40:173
58398299306,7cyclictest0-21swapper/310:35:043
58398299306,6cyclictest40-21ksoftirqd/312:10:243
58398299305,6cyclictest40-21ksoftirqd/308:00:223
583982993021,6cyclictest608841-21fschecks_time08:20:153
583982993021,6cyclictest606269-21grep08:10:273
583982993020,7cyclictest391ktimers/310:45:133
583982993015,5cyclictest131rcu_preempt08:40:013
583982993011,5cyclictest0-21swapper/311:05:273
583973993024,4cyclictest680350-21kworker/u8:1+events_unbound12:00:051
583973993022,6cyclictest634119-21kworker/u8:1+events_unbound09:48:411
583973993022,5cyclictest0-21swapper/112:20:011
583973993017,5cyclictest685570-21kworker/u8:3+events_unbound12:33:171
583973993017,5cyclictest685570-21kworker/u8:3+events_unbound12:33:171
583973993016,5cyclictest630619-21kworker/u8:0+events_unbound09:42:281
583973993013,9cyclictest598014-21kworker/u8:0+events_unbound07:53:251
58397399301,16cyclictest0-21swapper/108:38:041
583968993024,4cyclictest585273-21kworker/u8:3+events_unbound07:14:000
583968993024,3cyclictest0-21swapper/007:40:000
583968993022,5cyclictest0-21swapper/007:45:160
583968993022,5cyclictest0-21swapper/007:45:150
583968993016,8cyclictest131rcu_preempt10:30:210
583968993012,5cyclictest606283-21kworker/u8:1+events_unbound08:36:580
58398299297,8cyclictest40-21ksoftirqd/308:40:243
58398299297,6cyclictest40-21ksoftirqd/312:10:003
58398299296,7cyclictest40-21ksoftirqd/307:25:203
58398299296,5cyclictest40-21ksoftirqd/309:50:203
58398299295,7cyclictest40-21ksoftirqd/308:50:013
583982992922,4cyclictest0-21swapper/311:55:263
583982992920,6cyclictest0-21swapper/307:30:163
58398299291,9cyclictest40-21ksoftirqd/311:40:253
583982992919,7cyclictest391ktimers/310:12:073
583982992919,7cyclictest391ktimers/309:45:133
583982992918,6cyclictest131rcu_preempt07:51:493
583982992914,5cyclictest131rcu_preempt08:30:213
583982992914,4cyclictest131rcu_preempt10:55:003
583982992914,4cyclictest131rcu_preempt10:55:003
583982992914,3cyclictest131rcu_preempt10:20:173
583982992912,9cyclictest131rcu_preempt10:15:203
583982992910,5cyclictest131rcu_preempt11:50:213
583982992910,5cyclictest131rcu_preempt11:20:213
58397399299,12cyclictest131rcu_preempt08:30:201
583973992921,6cyclictest663495-21kworker/u8:1+events_unbound11:05:051
583973992921,4cyclictest0-21swapper/109:25:271
583973992920,6cyclictest0-21swapper/110:40:001
583973992914,6cyclictest646216-21kworker/u8:2+events_unbound10:15:411
583973992912,9cyclictest0-21swapper/110:55:111
583973992912,9cyclictest0-21swapper/110:55:111
58396899298,13cyclictest131rcu_preempt10:40:210
583968992919,6cyclictest0-21swapper/007:30:000
58396899291,7cyclictest694720-21sort12:30:160
58396899291,7cyclictest694720-21sort12:30:160
583968992910,10cyclictest0-21swapper/011:20:140
583968992910,10cyclictest0-21swapper/010:45:180
58396899290,16cyclictest0-21swapper/009:21:160
58398299286,7cyclictest40-21ksoftirqd/312:40:003
58398299286,7cyclictest40-21ksoftirqd/307:55:263
58398299286,4cyclictest391ktimers/309:25:143
583982992817,3cyclictest131rcu_preempt07:21:043
583982992814,9cyclictest131rcu_preempt07:39:043
583982992814,4cyclictest131rcu_preempt12:30:123
583982992814,4cyclictest131rcu_preempt12:30:123
583982992810,4cyclictest131rcu_preempt09:41:393
583982992810,10cyclictest131rcu_preempt07:10:173
58398299280,3cyclictest623175-21find09:00:263
58397399289,10cyclictest0-21swapper/110:50:231
58397399289,10cyclictest0-21swapper/110:50:231
58397399287,12cyclictest131rcu_preempt08:55:131
58397399287,12cyclictest131rcu_preempt08:50:191
58397399287,11cyclictest131rcu_preempt11:35:001
583973992822,3cyclictest0-21swapper/111:40:001
583973992812,5cyclictest0-21swapper/107:35:281
58397399280,8cyclictest607904-21unixbench_multi08:15:281
58396899288,11cyclictest131rcu_preempt11:45:140
58396899288,11cyclictest131rcu_preempt08:40:160
58396899285,4cyclictest0-21swapper/011:50:120
583968992820,6cyclictest673586-21kworker/u8:2+events_unbound11:30:200
583968992819,6cyclictest592612-21unixbench_singl07:30:250
583968992811,9cyclictest0-21swapper/008:50:150
583968992810,6cyclictest660050-21kworker/u8:2+events_unbound10:50:260
583968992810,6cyclictest660050-21kworker/u8:2+events_unbound10:50:260
583968992810,3cyclictest131rcu_preempt09:10:160
58396899280,16cyclictest0-21swapper/011:40:590
58398299275,6cyclictest40-21ksoftirqd/309:20:223
583982992721,3cyclictest0-21swapper/309:10:273
583982992710,6cyclictest131rcu_preempt11:25:243
58397399278,11cyclictest131rcu_preempt12:25:191
58397399278,10cyclictest0-21swapper/110:20:181
58397399278,10cyclictest0-21swapper/108:40:161
58397399278,10cyclictest0-21swapper/107:45:131
58397399278,10cyclictest0-21swapper/107:45:131
58397399278,10cyclictest0-21swapper/107:20:181
58397399277,12cyclictest131rcu_preempt10:05:231
58397399276,13cyclictest131rcu_preempt08:10:191
583973992721,4cyclictest587870-21kworker/u8:1+events_unbound07:44:411
583973992719,6cyclictest587870-21kworker/u8:1+events_unbound08:03:431
58396899278,12cyclictest131rcu_preempt11:55:150
58396899277,12cyclictest131rcu_preempt10:35:170
58396899277,12cyclictest131rcu_preempt09:43:390
58396899271,15cyclictest0-21swapper/011:25:280
583982992610,9cyclictest131rcu_preempt10:05:133
58397399269,8cyclictest131rcu_preempt07:10:201
58397399268,4cyclictest131rcu_preempt09:50:131
58397399267,4cyclictest131rcu_preempt08:25:271
58397399267,11cyclictest131rcu_preempt08:20:221
583973992619,4cyclictest0-21swapper/108:50:001
58397399261,14cyclictest0-21swapper/110:13:501
58396899268,11cyclictest131rcu_preempt10:05:230
58396899267,7cyclictest131rcu_preempt08:20:200
58396899266,8cyclictest131rcu_preempt10:10:140
58396899266,12cyclictest611477-21kworker/u8:2+events_unbound08:29:130
583968992622,2cyclictest13550irq/42-30be0000.ethernet11:10:230
583968992620,4cyclictest673586-21kworker/u8:2+events_unbound11:35:180
583968992620,3cyclictest0-21swapper/009:20:010
583968992619,5cyclictest685570-21kworker/u8:3+events_unbound12:15:040
583968992619,5cyclictest598014-21kworker/u8:0+events_unbound07:50:200
583968992610,6cyclictest620294-21kworker/u8:1+events_unbound09:00:220
583968992610,3cyclictest131rcu_preempt12:00:240
58397399252,3cyclictest628619-21unixbench_multi09:15:251
58396899255,7cyclictest131rcu_preempt08:00:140
58396899250,14cyclictest0-21swapper/009:50:590
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional