You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-14 - 21:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot5s.osadl.org (updated Sun Jun 14, 2026 12:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
817786995225,22cyclictest0-21swapper/309:25:053
817777995135,12cyclictest231ktimers/107:15:131
817777994942,5cyclictest819231-21kworker/u8:1+events_unbound07:14:551
817777994942,5cyclictest819231-21kworker/u8:1+events_unbound07:14:551
817786994536,6cyclictest0-21swapper/308:00:163
817777994534,8cyclictest231ktimers/111:25:141
817774994535,5cyclictest852850-21idleruntime-cro08:50:000
817781994436,5cyclictest916390-21munin-plugin-st11:55:002
817781994335,4cyclictest847521-21munin-plugin-st08:35:012
817777994333,6cyclictest855834-21unixbench_singl08:55:231
81778199421,9cyclictest894976-21/usr/sbin/munin10:50:212
81778199421,9cyclictest889359-21/usr/sbin/munin10:35:182
817777994236,4cyclictest830148-21kworker/u8:2+events_unbound08:04:581
817786994130,8cyclictest878012-21grep10:00:263
817786994118,20cyclictest0-21swapper/311:45:163
817781994128,9cyclictest311ktimers/211:45:122
81778199411,9cyclictest821085-21/usr/sbin/munin07:15:252
81778199411,8cyclictest875397-21/usr/sbin/munin09:55:172
81778199411,8cyclictest870777-21/usr/sbin/munin09:40:212
81778199411,8cyclictest862680-21/usr/sbin/munin09:15:262
81778199411,8cyclictest850356-21/usr/sbin/munin08:40:222
81778199410,9cyclictest856618-21/usr/sbin/munin09:00:142
817777994135,4cyclictest860995-21kworker/u8:2+events_unbound09:20:051
817777994123,5cyclictest131rcu_preempt07:34:541
817774994132,5cyclictest0-21swapper/008:25:010
817774994132,5cyclictest0-21swapper/008:25:000
81778199403,32cyclictest917064-21memory11:55:192
817781994017,20cyclictest645-21runrttasks10:20:262
81778199401,10cyclictest841796-21/usr/sbin/munin08:15:252
817777994033,5cyclictest871256-21kworker/u8:1+events_unbound09:45:071
817777994028,9cyclictest930613-21latency_hist12:35:011
817786993933,4cyclictest904438-21cron11:20:003
817786993933,4cyclictest904438-21cron11:20:003
817786993932,4cyclictest0-21swapper/309:45:263
81778199393,3cyclictest920901-21meminfo12:05:192
817781993932,4cyclictest840687-21cron08:15:012
817781993931,5cyclictest1-21systemd10:45:152
81778199391,9cyclictest872661-21/usr/sbin/munin09:45:232
81778199391,9cyclictest827824-21/usr/sbin/munin07:35:242
81778199391,9cyclictest824690-21/usr/sbin/munin07:25:262
81778199391,8cyclictest864158-21sed09:20:232
81778199391,5cyclictest887726-21/usr/sbin/munin10:30:172
81778199391,5cyclictest881227-21/usr/sbin/munin10:10:242
81778199391,11cyclictest926032-21memory12:20:192
817777993933,4cyclictest928539-21kworker/u8:0+events_unbound12:35:321
817777993933,4cyclictest894035-21kworker/u8:0+events_unbound10:54:411
817777993931,4cyclictest0-21swapper/108:40:001
817781993831,4cyclictest829160-21fschecks_count07:40:162
81778199382,4cyclictest907087-21/usr/sbin/munin11:25:232
81778199381,8cyclictest912376-21cat11:40:252
81778199381,8cyclictest831769-21/usr/sbin/munin07:45:262
81778199381,7cyclictest896534-21wc10:55:172
81778199381,6cyclictest901380-21/usr/sbin/munin11:10:132
81778199381,6cyclictest901380-21/usr/sbin/munin11:10:132
81778199381,6cyclictest853086-21apt-get08:50:132
81778199381,5cyclictest924453-21/usr/sbin/munin12:15:202
81778199381,4cyclictest903541-21/usr/sbin/munin11:15:212
81778199381,4cyclictest903541-21/usr/sbin/munin11:15:202
81778199381,4cyclictest866788-21/usr/sbin/munin09:30:132
81778199381,11cyclictest898326-21memory11:00:182
81778199381,11cyclictest882199-21df_inode10:15:142
81778199381,11cyclictest879259-21ntp_states10:05:252
81778199381,11cyclictest826530-21chrt07:31:292
81778199381,10cyclictest818630-21/usr/sbin/munin07:10:222
81778199381,10cyclictest818630-21/usr/sbin/munin07:10:222
817781993810,24cyclictest844256-21latency_hist08:25:012
817781993810,24cyclictest844256-21latency_hist08:25:012
81778199380,4cyclictest0-21swapper/207:50:132
817777993829,6cyclictest204-21dbus-daemon10:30:141
817777993825,5cyclictest131rcu_preempt10:35:151
817774993829,6cyclictest931941-21unixbench_singl12:35:260
817786993728,5cyclictest0-21swapper/312:20:003
817786993715,3cyclictest0-21swapper/309:15:243
81778199377,24cyclictest0-21swapper/211:30:182
81778199372,3cyclictest918918-21/usr/sbin/munin12:00:202
81778199371,9cyclictest873558-21/usr/sbin/munin09:50:272
81778199371,9cyclictest854781-21/usr/sbin/munin08:55:142
81778199371,8cyclictest890961-21diskstats10:40:152
81778199371,7cyclictest858541-21/usr/sbin/munin09:05:192
81778199371,7cyclictest821966-21apt-get07:20:152
81778199371,5cyclictest928365-21sshd12:25:272
81778199371,5cyclictest835942-21/usr/sbin/munin08:00:162
81778199371,4cyclictest877092-21/usr/sbin/munin10:00:142
81778199371,4cyclictest866124-21sshd09:25:342
81778199371,4cyclictest852110-21/usr/sbin/munin08:45:232
81778199371,3cyclictest910368-21ntp_states11:35:212
81778199371,3cyclictest905372-21/usr/sbin/munin11:20:222
81778199371,3cyclictest869010-21ntp_states09:35:222
81778199371,3cyclictest848083-21/usr/sbin/munin08:35:162
81778199371,3cyclictest0-21swapper/209:10:122
81778199371,3cyclictest0-21swapper/209:10:122
81778199371,31cyclictest901031-21cron11:10:002
81778199371,2cyclictest0-21swapper/208:05:152
81778199371,11cyclictest931702-21grep12:35:262
81778199371,10cyclictest929317-21irqstats12:30:162
817777993725,8cyclictest841923-21grep08:15:251
817786993628,5cyclictest833412-21unixbench_multi07:50:243
817786993626,5cyclictest0-21swapper/307:20:003
81778199369,22cyclictest0-21swapper/208:25:252
81778199361,9cyclictest922268-21df_inode12:10:142
81778199361,8cyclictest834100-21/usr/sbin/munin07:55:182
81778199361,4cyclictest886106-21/usr/sbin/munin10:25:242
817774993629,4cyclictest828533-21cron07:40:000
817774993628,4cyclictest0-21swapper/008:20:000
817774993627,5cyclictest0-21swapper/012:35:000
817786993528,4cyclictest0-21swapper/307:45:023
817786993526,6cyclictest391ktimers/311:25:123
817777993526,6cyclictest867734-21unixbench_multi09:30:261
817777993519,5cyclictest131rcu_preempt11:45:181
817777993519,4cyclictest131rcu_preempt11:20:451
817777993518,4cyclictest131rcu_preempt11:03:211
817774993524,7cyclictest893738-21grep10:45:260
817786993426,5cyclictest932369-21munin-run12:40:003
817786993424,6cyclictest826831-21sh07:35:013
817777993420,5cyclictest131rcu_preempt11:50:181
817777993419,5cyclictest131rcu_preempt09:18:191
817777993419,5cyclictest131rcu_preempt08:41:021
817777993412,5cyclictest131rcu_preempt12:00:221
817777993411,4cyclictest131rcu_preempt12:29:251
817774993426,4cyclictest0-21swapper/007:20:260
817774993424,7cyclictest863537-21tune2fs09:20:150
817774993424,6cyclictest0-21swapper/010:15:190
817774993422,8cyclictest860912-21grep09:10:260
817774993422,8cyclictest860912-21grep09:10:260
817786993322,7cyclictest886965-21sh10:30:003
81777799336,5cyclictest24-21ksoftirqd/110:50:001
817777993326,5cyclictest902674-21kworker/u8:1+events_unbound11:18:411
817777993326,5cyclictest902674-21kworker/u8:1+events_unbound11:18:411
817777993326,4cyclictest0-21swapper/108:45:161
817777993326,3cyclictest0-21swapper/112:20:001
817777993325,5cyclictest0-21swapper/111:35:241
817777993316,4cyclictest131rcu_preempt09:08:341
817777993314,11cyclictest131rcu_preempt11:10:201
817777993314,11cyclictest131rcu_preempt11:10:201
817777993314,11cyclictest131rcu_preempt08:30:241
817774993325,4cyclictest0-21swapper/012:20:260
817774993325,3cyclictest0-21swapper/008:55:010
817774993324,4cyclictest0-21swapper/010:45:010
817786993224,4cyclictest0-21swapper/308:25:273
817777993224,4cyclictest0-21swapper/110:55:141
817777993224,4cyclictest0-21swapper/110:15:161
817777993223,6cyclictest923624-21sh12:14:591
817777993221,4cyclictest131rcu_preempt08:50:041
817777993218,4cyclictest131rcu_preempt08:23:301
817777993218,4cyclictest131rcu_preempt08:23:291
817777993217,7cyclictest888345-21kworker/u8:0+events_unbound10:41:541
817777993215,9cyclictest131rcu_preempt11:55:131
817777993215,10cyclictest131rcu_preempt09:50:161
817777993214,4cyclictest131rcu_preempt08:06:581
817777993213,5cyclictest131rcu_preempt09:42:571
817777993211,9cyclictest131rcu_preempt09:10:241
817777993211,9cyclictest131rcu_preempt09:10:241
817774993224,5cyclictest0-21swapper/012:09:590
817774993224,4cyclictest0-21swapper/010:40:000
817774993223,6cyclictest818936-21grep07:10:250
817774993223,6cyclictest818936-21grep07:10:240
817774993220,8cyclictest0-21swapper/008:00:280
817786993124,4cyclictest0-21swapper/308:00:003
817786993122,5cyclictest0-21swapper/310:40:003
817786993121,6cyclictest828061-21grep07:35:253
817786993120,7cyclictest855827-21grep08:55:243
817786993118,9cyclictest882223-21grep10:15:163
817777993117,5cyclictest131rcu_preempt09:25:141
817777993114,9cyclictest131rcu_preempt10:00:151
817777993114,4cyclictest131rcu_preempt11:08:231
817777993114,4cyclictest131rcu_preempt09:35:541
817777993113,4cyclictest131rcu_preempt08:10:251
81777799310,3cyclictest845813-21cron08:30:001
817774993124,4cyclictest914676-21cron11:50:000
817786993024,3cyclictest0-21swapper/310:40:243
817786993022,4cyclictest0-21swapper/308:35:253
817786993020,7cyclictest857486-21grep09:00:253
817777993024,4cyclictest878215-21kworker/u8:2+events_unbound10:08:411
817777993023,4cyclictest0-21swapper/110:20:121
817777993019,4cyclictest131rcu_preempt09:00:241
817777993017,7cyclictest904386-21kworker/u8:2+events_unbound11:43:571
817777993015,5cyclictest131rcu_preempt07:28:311
817777993013,10cyclictest131rcu_preempt07:55:221
817777993013,10cyclictest131rcu_preempt07:50:171
817774993024,4cyclictest0-21swapper/008:35:120
817774993019,7cyclictest0-21swapper/008:25:270
817774993019,6cyclictest0-21swapper/011:55:250
817786992922,4cyclictest928977-21/usr/sbin/munin12:30:213
817786992920,6cyclictest0-21swapper/310:50:013
81777799298,12cyclictest24-21ksoftirqd/107:40:021
81777799293,6cyclictest24-21ksoftirqd/110:25:221
817777992915,4cyclictest131rcu_preempt12:05:011
817777992914,5cyclictest131rcu_preempt12:20:111
817777992914,5cyclictest131rcu_preempt07:24:491
817777992912,4cyclictest131rcu_preempt07:46:511
817777992911,4cyclictest131rcu_preempt10:10:181
817777992911,4cyclictest131rcu_preempt09:55:171
817774992920,5cyclictest923177-21grep12:10:240
817786992821,4cyclictest0-21swapper/311:55:243
817786992821,4cyclictest0-21swapper/308:05:293
817786992820,4cyclictest0-21swapper/308:15:163
817777992810,4cyclictest131rcu_preempt07:35:181
817774992821,4cyclictest0-21swapper/011:35:240
817774992821,4cyclictest0-21swapper/007:30:010
817774992818,6cyclictest0-21swapper/010:00:260
817774992816,9cyclictest121ktimers/008:05:150
817786992721,3cyclictest0-21swapper/309:10:003
817786992720,4cyclictest0-21swapper/311:50:253
817786992719,6cyclictest0-21swapper/310:05:293
817786992717,6cyclictest852430-21grep08:45:253
817786992715,8cyclictest850666-21grep08:40:243
817774992719,5cyclictest0-21swapper/010:25:000
817774992718,6cyclictest0-21swapper/009:45:010
817774992718,6cyclictest0-21swapper/009:05:250
817774992718,4cyclictest0-21swapper/011:40:250
817774992714,8cyclictest204-21dbus-daemon12:00:230
817786992616,8cyclictest812299-21kworker/u8:0+events_unbound07:14:503
817786992616,8cyclictest812299-21kworker/u8:0+events_unbound07:14:493
817774992618,5cyclictest840687-21cron08:15:000
817786992519,3cyclictest0-21swapper/309:10:143
817786992519,3cyclictest0-21swapper/309:10:143
817786992518,4cyclictest0-21swapper/312:05:013
817786992518,4cyclictest0-21swapper/310:50:253
817786992516,5cyclictest0-21swapper/311:20:153
817786992515,6cyclictest870494-21/usr/sbin/munin09:40:173
817786992514,8cyclictest899332-21sh11:05:003
817774992519,3cyclictest0-21swapper/011:15:010
817774992519,3cyclictest0-21swapper/011:15:000
817774992519,2cyclictest0-21swapper/007:55:290
817774992517,4cyclictest0-21swapper/011:55:000
817786992418,3cyclictest0-21swapper/307:25:113
817786992417,3cyclictest0-21swapper/307:20:153
817786992416,5cyclictest0-21swapper/307:50:013
817786992415,6cyclictest0-21swapper/308:35:003
817786992414,7cyclictest842768-21diskstats08:20:153
817786992414,7cyclictest842768-21diskstats08:20:153
817786992410,10cyclictest1-21systemd11:05:173
817774992418,3cyclictest0-21swapper/011:00:000
817774992417,4cyclictest866017-21unixbench_multi09:25:250
817774992417,4cyclictest438-21cron10:30:000
817774992415,6cyclictest0-21swapper/008:35:000
817774992413,8cyclictest876304-21grep09:55:260
81777499241,19cyclictest0-21swapper/011:25:580
81778699236,12cyclictest926665-21sshd12:20:263
817786992317,3cyclictest0-21swapper/311:30:193
817786992316,4cyclictest0-21swapper/310:55:143
817774992317,3cyclictest875099-21latency_hist09:55:010
817774992317,3cyclictest13850irq/36-mmc107:50:000
817774992317,3cyclictest0-21swapper/010:30:200
817774992316,3cyclictest0-21swapper/011:05:280
817774992316,3cyclictest0-21swapper/009:36:480
817774992316,3cyclictest0-21swapper/009:19:270
81777499231,4cyclictest855354-21ntp_states08:55:200
817774992313,7cyclictest927818-21ntpq12:25:190
81777499231,20cyclictest0-21swapper/008:40:510
817774992311,8cyclictest11-21ksoftirqd/007:19:550
81777499231,18cyclictest0-21swapper/007:42:540
81777499230,19cyclictest0-21swapper/011:17:300
81777499230,19cyclictest0-21swapper/011:17:300
81777499230,19cyclictest0-21swapper/009:45:090
817786992216,3cyclictest0-21swapper/311:10:203
817786992216,3cyclictest0-21swapper/311:10:203
817786992216,3cyclictest0-21swapper/310:20:163
817786992216,3cyclictest0-21swapper/308:15:013
817786992215,4cyclictest0-21swapper/312:25:233
817786992215,4cyclictest0-21swapper/312:10:243
817786992215,4cyclictest0-21swapper/308:50:253
817786992212,6cyclictest0-21swapper/309:50:253
817774992217,3cyclictest13550irq/42-30be0000.ethernet11:00:140
817774992215,5cyclictest879957-21kworker/u8:0+events_unbound10:10:110
817774992215,3cyclictest0-21swapper/009:31:000
817774992214,5cyclictest121ktimers/010:05:280
817774992213,5cyclictest925502-21sed12:20:010
817774992212,7cyclictest894710-21basename10:50:160
81777499221,17cyclictest0-21swapper/007:50:150
81777499220,20cyclictest0-21swapper/011:30:150
81777499220,19cyclictest0-21swapper/007:31:590
817786992116,3cyclictest0-21swapper/309:30:183
817786992115,3cyclictest0-21swapper/311:35:173
817786992114,4cyclictest391ktimers/310:34:583
81778699209,8cyclictest869259-21cat09:35:253
817786992014,3cyclictest0-21swapper/310:15:023
817786992013,4cyclictest391ktimers/312:05:043
81778699199,7cyclictest912653-21seq11:41:043
817786991912,5cyclictest391ktimers/309:20:253
817786991912,3cyclictest0-21swapper/309:55:243
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional