You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-11 - 18:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Thu Dec 11, 2025 12:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
890617995347,4cyclictest951644-21kworker/u8:2+events_unbound10:15:580
890617995347,4cyclictest951644-21kworker/u8:2+events_unbound10:15:570
890626995243,5cyclictest922487-21munin-plugin-st08:40:012
890617995145,4cyclictest0-21swapper/011:25:130
890617995042,4cyclictest936168-21idleruntime-cro09:20:000
890626994925,19cyclictest939345-21grep09:25:262
890617994638,4cyclictest960238-21latency_hist10:30:000
890617994637,6cyclictest121ktimers/009:20:130
890617994536,5cyclictest943170-21auditctl09:40:000
890617994534,6cyclictest913083-21grep08:10:240
89062699445,3cyclictest311ktimers/207:40:122
890626994414,23cyclictest0-21swapper/209:20:002
89062199442,7cyclictest131rcu_preempt08:10:121
890617994437,4cyclictest901616-21sendmail07:40:000
89062699433,8cyclictest995786-21unixbench_multi12:10:252
89062699431,11cyclictest920317-21unixbench_multi08:30:262
890626994230,8cyclictest953415-21idleruntime-cro10:10:002
89062699421,9cyclictest1004128-21/usr/sbin/munin12:35:272
89062699421,10cyclictest962726-21/usr/sbin/munin10:35:222
89062699420,9cyclictest912066-21apt-get08:10:122
89062199426,6cyclictest24-21ksoftirqd/110:50:121
890621994221,6cyclictest944698-21kworker/u8:2+events_unbound09:55:171
890617994236,4cyclictest978903-21kworker/u8:1+events_unbound11:46:130
89062699412,11cyclictest915482-21awk08:20:002
89062699412,11cyclictest1000046-21/usr/sbin/munin12:25:182
89062699411,5cyclictest630-21snmpd08:48:082
890630994030,6cyclictest0-21swapper/311:50:003
890630994029,7cyclictest0-21swapper/311:00:003
89062699407,7cyclictest926597-21sort08:50:202
89062699404,4cyclictest988419-21meminfo11:50:212
890626994026,9cyclictest892626-21latency_hist07:15:022
89062699401,9cyclictest896024-21cron07:22:012
89062699401,7cyclictest970245-21sshd10:57:302
89062699401,6cyclictest954089-21meminfo10:10:182
890626994012,25cyclictest961930-21sh10:35:012
89062699401,11cyclictest987752-21awk11:50:002
89062699401,10cyclictest909719-21unixbench_singl08:00:252
890630993931,5cyclictest989450-21idleruntime-cro11:55:003
89062699394,5cyclictest893924-21sed07:15:262
89062699394,3cyclictest930769-21cron09:02:002
89062699393,4cyclictest998557-21irqstats12:20:162
89062699393,3cyclictest916028-21diskstats08:20:152
89062699392,9cyclictest975322-21grep11:10:262
89062699392,10cyclictest311ktimers/211:25:132
89062699391,8cyclictest968904-21latency_hist10:55:012
89062699391,6cyclictest990014-21irqstats11:55:182
89062699391,11cyclictest959075-21if_eth110:25:192
89062699391,10cyclictest991630-21perl12:00:172
89062699391,10cyclictest957064-21/usr/sbin/munin10:20:252
89062699391,10cyclictest907073-21/usr/sbin/munin07:55:182
890621993932,4cyclictest963326-21kworker/u8:1+events_unbound11:11:041
890617993933,4cyclictest963326-21kworker/u8:1+events_unbound10:46:000
890617993928,6cyclictest906724-21grep07:55:010
890630993831,4cyclictest953410-21cron10:10:003
89062699385,5cyclictest0-21swapper/209:51:402
890626993830,5cyclictest956823-21grep10:20:002
890626993830,5cyclictest956823-21grep10:20:002
89062699382,4cyclictest963889-21apt-get10:40:122
89062699382,11cyclictest946155-21grep09:45:272
89062699381,7cyclictest977085-21sed11:15:382
89062699381,7cyclictest971015-21/usr/sbin/munin11:00:152
89062699381,7cyclictest931396-21fschecks_count09:05:162
89062699381,7cyclictest931396-21fschecks_count09:05:162
89062699381,6cyclictest951315-21/usr/sbin/munin10:00:262
89062699381,6cyclictest937118-21/usr/sbin/munin09:20:212
89062699381,6cyclictest906457-21cron07:52:012
89062699381,5cyclictest911202-21/usr/sbin/munin08:05:222
89062699381,4cyclictest943968-21tr09:40:202
89062699381,4cyclictest942777-21users09:35:262
890626993813,22cyclictest918661-21unixbench_singl08:25:272
89062699381,11cyclictest997064-21ntp_states12:15:212
89062699381,11cyclictest982442-21cron11:33:002
89062699381,10cyclictest934039-21users09:10:272
89062699381,10cyclictest897061-21awk07:25:212
890630993729,4cyclictest0-21swapper/307:10:223
890630993728,6cyclictest974466-21fschecks_count11:10:163
890630993727,6cyclictest0-21swapper/312:35:003
890630993724,7cyclictest0-21swapper/307:40:263
89062699374,4cyclictest0-21swapper/209:55:172
89062699373,6cyclictest0-21swapper/211:37:372
89062699373,5cyclictest0-21swapper/207:49:542
89062699371,9cyclictest978196-21memory11:20:192
89062699371,9cyclictest978196-21memory11:20:192
89062699371,6cyclictest993207-21df12:05:162
89062699371,5cyclictest898211-21apt-get07:30:122
890621993730,4cyclictest997978-21latency_hist12:20:001
890621993727,7cyclictest923732-21grep08:40:271
89061799375,24cyclictest11-21ksoftirqd/009:30:010
890630993629,4cyclictest943172-21cron09:40:003
890630993627,5cyclictest919089-21munin-plugin-st08:30:013
890630993626,6cyclictest0-21swapper/308:25:013
89062699363,6cyclictest927958-21diskstats08:55:192
89062699362,6cyclictest901182-21unixbench_singl07:35:262
89062699362,12cyclictest1002667-21grep12:30:252
89062699361,9cyclictest985017-21memory11:40:192
89062699361,9cyclictest923419-21/usr/sbin/munin08:40:252
89062699361,8cyclictest940385-21ls09:30:202
89062699361,5cyclictest973466-21/usr/sbin/munin11:05:242
890621993628,5cyclictest922480-21sh08:40:011
890621993626,6cyclictest0-21swapper/107:15:271
890617993627,5cyclictest892355-21grep07:15:020
890617993625,4cyclictest131rcu_preempt12:35:220
890617993621,4cyclictest131rcu_preempt11:50:150
890617993615,3cyclictest131rcu_preempt10:30:170
890630993524,6cyclictest0-21swapper/309:50:253
89062699351,5cyclictest965729-21cut10:45:162
890621993527,5cyclictest0-21swapper/108:50:251
890617993520,5cyclictest131rcu_preempt10:05:240
890617993517,4cyclictest131rcu_preempt11:43:300
890617993516,4cyclictest131rcu_preempt10:55:150
890617993515,9cyclictest131rcu_preempt07:30:220
890630993424,7cyclictest0-21swapper/311:55:263
890630993424,6cyclictest0-21swapper/307:25:003
890621993428,4cyclictest982580-21kworker/u8:2+events_unbound11:57:431
890621993421,5cyclictest946409-21kworker/u8:1+events_unbound09:50:541
89061799342,6cyclictest11-21ksoftirqd/010:00:010
890617993416,3cyclictest131rcu_preempt11:05:240
890617993414,5cyclictest131rcu_preempt07:40:170
890617993412,11cyclictest11-21ksoftirqd/008:00:480
890630993326,4cyclictest0-21swapper/312:10:253
890630993322,7cyclictest0-21swapper/309:05:263
890630993322,7cyclictest0-21swapper/309:05:263
89062199332,7cyclictest131rcu_preempt09:30:131
89062199332,4cyclictest131rcu_preempt11:30:131
890621993323,6cyclictest0-21swapper/108:20:001
890621993313,11cyclictest955062-21kworker/u8:3+events_unbound10:29:321
890617993325,4cyclictest0-21swapper/012:00:000
890617993323,7cyclictest121ktimers/008:25:210
890617993323,6cyclictest975318-21grep11:10:260
890617993323,6cyclictest0-21swapper/012:30:250
890617993319,11cyclictest121ktimers/007:55:150
890617993317,5cyclictest131rcu_preempt10:40:010
890617993317,4cyclictest131rcu_preempt09:31:140
890617993316,4cyclictest131rcu_preempt11:00:230
890617993316,10cyclictest131rcu_preempt08:40:150
890617993313,12cyclictest11-21ksoftirqd/012:05:150
890630993224,4cyclictest0-21swapper/311:05:253
890630993221,7cyclictest0-21swapper/311:40:263
890630993221,6cyclictest0-21swapper/309:15:263
89062199329,5cyclictest935447-21switchtime09:15:251
890621993224,5cyclictest986415-21runrttasks11:45:181
890621993224,4cyclictest0-21swapper/107:35:261
890621993223,5cyclictest0-21swapper/111:20:151
890621993223,5cyclictest0-21swapper/111:20:151
89061799325,18cyclictest11-21ksoftirqd/007:25:250
890617993222,6cyclictest0-21swapper/008:45:370
890617993216,9cyclictest131rcu_preempt08:57:160
890617993215,3cyclictest131rcu_preempt07:15:260
890617993214,9cyclictest131rcu_preempt11:20:190
890617993214,9cyclictest131rcu_preempt11:20:190
890617993214,7cyclictest131rcu_preempt09:50:010
890617993213,3cyclictest131rcu_preempt08:39:010
890630993123,5cyclictest0-21swapper/311:05:003
890630993122,5cyclictest0-21swapper/311:20:013
890630993121,6cyclictest0-21swapper/310:15:263
890630993121,6cyclictest0-21swapper/310:15:263
89062199314,4cyclictest131rcu_preempt12:00:121
890621993124,4cyclictest977499-21kthreadd11:20:001
890621993123,4cyclictest0-21swapper/108:25:171
89061799317,8cyclictest11-21ksoftirqd/012:00:190
89061799315,8cyclictest11-21ksoftirqd/010:50:230
890617993124,4cyclictest121ktimers/008:21:280
890617993116,4cyclictest131rcu_preempt12:13:000
890617993115,9cyclictest131rcu_preempt12:17:310
890617993114,4cyclictest0-21swapper/008:05:220
890617993114,10cyclictest131rcu_preempt12:21:400
890617993114,10cyclictest131rcu_preempt09:50:150
890617993112,4cyclictest131rcu_preempt11:18:130
890617993112,10cyclictest131rcu_preempt10:20:200
890630993020,6cyclictest0-21swapper/310:45:003
890630993020,6cyclictest0-21swapper/309:30:273
890630993020,6cyclictest0-21swapper/308:05:233
890630993020,6cyclictest0-21swapper/307:50:173
890630993019,7cyclictest0-21swapper/309:25:013
890621993022,4cyclictest0-21swapper/112:35:281
890621993022,4cyclictest0-21swapper/109:05:161
890621993022,4cyclictest0-21swapper/109:05:161
890621993022,4cyclictest0-21swapper/107:55:181
890621993020,6cyclictest0-21swapper/111:00:001
89061799304,8cyclictest11-21ksoftirqd/012:27:280
890617993022,4cyclictest0-21swapper/009:40:250
890617993020,7cyclictest904587-21grep07:45:260
890617993019,8cyclictest121ktimers/007:20:130
890617993019,7cyclictest121ktimers/008:30:190
890617993014,9cyclictest131rcu_preempt11:30:230
890617993014,9cyclictest131rcu_preempt09:00:150
890617993014,5cyclictest131rcu_preempt10:45:010
890617993011,11cyclictest131rcu_preempt10:05:000
890630992923,3cyclictest984353-21modprobe11:40:013
890630992921,4cyclictest0-21swapper/309:45:003
890630992919,7cyclictest0-21swapper/308:00:253
890630992919,6cyclictest0-21swapper/310:35:173
890630992919,6cyclictest0-21swapper/307:55:273
890630992918,7cyclictest0-21swapper/307:35:273
890630992918,6cyclictest0-21swapper/309:25:263
89063099291,5cyclictest0-21swapper/311:20:123
89063099291,5cyclictest0-21swapper/311:20:123
890630992910,3cyclictest131rcu_preempt07:50:003
890621992923,3cyclictest0-21swapper/109:40:001
890621992922,3cyclictest0-21swapper/110:40:021
890621992921,3cyclictest0-21swapper/107:50:001
890621992919,6cyclictest939340-21grep09:25:261
890621992917,8cyclictest954686-21grep10:10:261
89062199291,6cyclictest131rcu_preempt08:20:121
890617992918,8cyclictest121ktimers/009:05:260
890617992918,8cyclictest121ktimers/009:05:260
890617992912,4cyclictest131rcu_preempt09:10:140
890617992912,4cyclictest131rcu_preempt08:50:220
890617992911,4cyclictest131rcu_preempt10:10:150
890630992820,4cyclictest0-21swapper/311:25:263
890621992822,4cyclictest906597-21kworker/u8:0+events_unbound08:00:411
890621992818,6cyclictest999233-21tail12:20:241
890617992816,5cyclictest131rcu_preempt11:35:270
890617992811,10cyclictest131rcu_preempt08:15:280
890630992721,4cyclictest894173-21kworker/u8:1+events_unbound07:30:143
890630992720,4cyclictest0-21swapper/312:05:283
890630992719,4cyclictest0-21swapper/308:10:153
890630992718,5cyclictest0-21swapper/310:30:003
890621992721,4cyclictest958192-21kworker/u8:0+events_unbound10:30:171
890621992720,5cyclictest935115-21kworker/u8:3+events_unbound09:20:241
890621992720,3cyclictest0-21swapper/111:40:011
890621992719,4cyclictest0-21swapper/111:05:251
89062199271,5cyclictest995863-21grep12:10:251
89062199271,2cyclictest0-21swapper/112:05:141
89063099267,8cyclictest0-21swapper/312:00:123
890630992620,4cyclictest953353-21kworker/u8:0+events_unbound10:10:393
890630992620,4cyclictest925672-21kworker/u8:0+events_unbound08:50:173
890630992619,4cyclictest0-21swapper/312:35:293
890630992618,6cyclictest908649-21kworker/u8:2+events_unbound08:35:453
89062199263,3cyclictest0-21swapper/112:30:111
890621992619,5cyclictest978903-21kworker/u8:1+events_unbound11:40:221
89062199261,7cyclictest895800-21grep07:20:251
890621992616,6cyclictest0-21swapper/108:05:231
890621992614,8cyclictest956836-21tr10:20:001
890621992614,8cyclictest956836-21tr10:20:001
890630992519,3cyclictest0-21swapper/312:21:143
890630992516,4cyclictest0-21swapper/310:55:003
890630992515,7cyclictest0-21swapper/307:15:213
89062199258,5cyclictest131rcu_preempt11:00:131
890621992519,4cyclictest975435-21kworker/u8:0+events_unbound11:27:411
890621992519,3cyclictest0-21swapper/110:00:201
890621992518,5cyclictest932745-21kworker/u8:2+events_unbound09:10:511
890621992518,5cyclictest927473-21kworker/u8:1+events_unbound09:01:291
890621992518,4cyclictest927473-21kworker/u8:1+events_unbound08:55:231
890621992518,4cyclictest0-21swapper/110:20:261
890621992517,5cyclictest0-21swapper/108:50:001
890621992515,3cyclictest24-21ksoftirqd/107:55:021
890621992511,11cyclictest24-21ksoftirqd/107:40:171
890630992417,4cyclictest0-21swapper/312:20:003
890630992415,5cyclictest0-21swapper/311:30:263
890630992414,7cyclictest928432-21seq08:55:263
890621992418,4cyclictest963326-21kworker/u8:1+events_unbound10:47:391
890621992418,4cyclictest958192-21kworker/u8:0+events_unbound10:41:111
890621992418,4cyclictest944698-21kworker/u8:2+events_unbound09:49:181
890621992418,4cyclictest942925-21kworker/u8:0+events_unbound09:40:411
890621992418,4cyclictest919013-21kworker/u8:0+events_unbound08:32:431
890621992418,3cyclictest0-21swapper/107:25:261
890621992417,4cyclictest0-21swapper/107:30:161
890621992416,4cyclictest0-21swapper/110:05:261
89063099233,3cyclictest131rcu_preempt10:00:233
890630992317,4cyclictest920717-21kworker/u8:1+events_unbound08:43:073
890630992316,4cyclictest0-21swapper/308:30:273
890630992315,4cyclictest0-21swapper/309:55:163
890630992315,4cyclictest0-21swapper/309:45:273
890630992314,5cyclictest0-21swapper/308:20:013
890630992313,7cyclictest966141-21seq10:45:223
89062199238,8cyclictest131rcu_preempt11:50:251
89062199232,8cyclictest131rcu_preempt07:13:011
89063099222,10cyclictest0-21swapper/309:10:143
890630992216,4cyclictest908649-21kworker/u8:2+events_unbound08:47:393
890630992216,3cyclictest0-21swapper/310:30:153
890630992216,3cyclictest0-21swapper/309:00:253
890630992211,7cyclictest1000157-21grep12:25:193
890630992115,3cyclictest0-21swapper/310:20:183
890630992014,4cyclictest391ktimers/307:30:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional