You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-30 - 21:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Tue Dec 30, 2025 12:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
220355996739,23cyclictest312121-21grep11:30:260
220355995238,11cyclictest121ktimers/010:35:140
220367994937,9cyclictest391ktimers/308:15:143
220358994940,5cyclictest1-21systemd10:30:201
22035599482,35cyclictest0-21swapper/008:15:140
22035599470,38cyclictest0-21swapper/008:30:110
220358994534,7cyclictest279332-21grep09:55:251
220358994534,7cyclictest279332-21grep09:55:251
220355994521,20cyclictest298050-21grep10:50:260
22035599450,36cyclictest0-21swapper/009:35:110
220367994431,9cyclictest272905-21latency_hist09:40:013
220358994434,8cyclictest231ktimers/110:40:141
22035599441,38cyclictest279979-21apt-get10:00:120
22035599441,38cyclictest279979-21apt-get10:00:120
22035599441,38cyclictest276556-21/usr/sbin/munin09:50:130
22035599441,24cyclictest227800-21latency_hist07:30:000
220358994332,8cyclictest260759-21cron09:05:011
22035599432,34cyclictest240319-21apt-get08:05:160
22035599432,25cyclictest304977-21chrt11:10:540
22035599431,39cyclictest237471-21/usr/sbin/munin07:55:210
22035599430,35cyclictest0-21swapper/007:10:120
22035599430,34cyclictest0-21swapper/010:05:150
220367994231,8cyclictest391ktimers/311:35:133
22035599421,36cyclictest288645-21/usr/sbin/munin10:25:180
22035599421,27cyclictest331942-21/usr/sbin/munin12:30:180
220367994132,5cyclictest307237-21apt11:20:003
22035599413,35cyclictest231278-21sshd07:39:300
22035599412,24cyclictest307237-21apt-get11:20:000
220355994122,14cyclictest0-21swapper/008:45:260
22035599411,37cyclictest333961-21/usr/sbin/munin12:35:190
22035599411,35cyclictest302757-21/usr/sbin/munin11:05:230
22035599411,35cyclictest232602-21/usr/sbin/munin07:40:250
22035599411,34cyclictest295329-21/usr/sbin/munin10:45:120
22035599411,34cyclictest252474-21apt-get08:40:130
22035599411,13cyclictest0-21swapper/009:55:190
22035599411,13cyclictest0-21swapper/009:55:190
220367994033,3cyclictest270991-21sh09:35:003
22035599403,34cyclictest2434142sleep008:14:230
22035599401,36cyclictest251125-21/usr/sbin/munin08:35:200
22035599401,36cyclictest248473-21cron08:26:020
22035599401,35cyclictest260895-21latency_hist09:05:010
22035599401,34cyclictest328703-21/usr/sbin/munin12:20:220
22035599401,34cyclictest260998-21apt-get09:05:140
22035599401,32cyclictest257575-21apt-get08:55:110
220367993926,9cyclictest391ktimers/310:30:123
220363993928,6cyclictest0-21swapper/210:25:192
220358993926,7cyclictest0-21swapper/110:05:011
220358993926,7cyclictest0-21swapper/110:05:001
22035599395,22cyclictest264782-21latency09:15:180
220355993932,4cyclictest295105-21idleruntime-cro10:45:000
22035599392,32cyclictest263028-21/usr/sbin/munin09:10:170
22035599392,24cyclictest270609-21users09:30:280
22035599391,35cyclictest300992-21/usr/sbin/munin11:00:220
22035599391,33cyclictest316227-21apt-get11:45:110
22035599391,33cyclictest222737-21munin-node07:15:040
22035599391,31cyclictest319629-21apt-get11:55:120
22035599391,24cyclictest312802-21apt-get11:35:110
220367993828,6cyclictest208-21systemd-logind07:14:193
220367993824,9cyclictest1-21systemd10:35:213
220363993829,4cyclictest0-21swapper/211:00:242
220363993825,8cyclictest310398-21grep11:25:252
220358993831,4cyclictest334976-21idleruntime-cro12:40:001
220358993825,9cyclictest305402-21apt-config11:15:001
22035599384,31cyclictest325035-21/usr/sbin/munin12:10:180
22035599383,32cyclictest275989-21cron09:46:000
22035599382,33cyclictest291340-21cron10:31:010
22035599382,33cyclictest287937-21cron10:21:000
220355993815,20cyclictest286627-21latency_hist10:20:000
22035599381,34cyclictest314858-21/usr/sbin/munin11:40:180
22035599381,34cyclictest236030-21/usr/sbin/munin07:50:240
22035599381,34cyclictest233297-21cpu07:45:140
22035599381,34cyclictest225670-21cron07:21:010
22035599381,32cyclictest323164-21df_inode12:05:160
22035599381,31cyclictest329872-21apt-get12:25:130
22035599381,31cyclictest298734-21apt-get10:55:130
22035599381,23cyclictest247153-21latency_hist08:25:020
22035599380,33cyclictest0-21swapper/011:50:120
22035599380,33cyclictest0-21swapper/011:25:110
220367993728,5cyclictest301932-21munin-plugin-st11:05:003
220367993728,4cyclictest0-21swapper/307:45:163
220363993730,4cyclictest279718-21cron10:00:012
220363993730,4cyclictest279718-21cron10:00:002
220363993727,6cyclictest321097-21cron12:00:002
220363993725,10cyclictest311ktimers/211:05:122
220358993726,7cyclictest0-21swapper/110:25:281
22035599372,31cyclictest220410-21sed07:10:030
22035599372,31cyclictest220410-21sed07:10:020
22035599371,33cyclictest273152-21sshd09:40:110
22035599371,33cyclictest267417-21cron09:23:010
22035599371,31cyclictest321402-21/usr/sbin/munin12:00:150
22035599371,31cyclictest321402-21/usr/sbin/munin12:00:140
22035599371,31cyclictest283494-21/usr/sbin/munin10:10:170
22035599371,30cyclictest0-21swapper/012:15:120
22035599371,30cyclictest0-21swapper/009:25:130
220363993628,4cyclictest226007-21cron07:25:012
220363993626,7cyclictest318970-21grep11:50:252
220358993629,4cyclictest238377-21sendmail08:00:011
22035599361,32cyclictest239145-21/usr/sbin/munin08:00:220
22035599361,32cyclictest239145-21/usr/sbin/munin08:00:210
22035599361,32cyclictest228430-21/usr/sbin/munin07:30:220
220367993526,5cyclictest0-21swapper/308:25:173
220363993527,4cyclictest0-21swapper/209:20:002
220363993526,5cyclictest0-21swapper/211:20:162
220363993526,4cyclictest0-21swapper/209:35:172
220358993527,5cyclictest208-21systemd-logind10:45:201
220358993519,11cyclictest1-21systemd10:15:181
220367993425,4cyclictest0-21swapper/309:15:253
220367993424,5cyclictest325781-21head12:10:263
220363993426,4cyclictest0-21swapper/207:55:162
220363993423,6cyclictest0-21swapper/212:00:262
220363993423,6cyclictest0-21swapper/212:00:262
220358993425,5cyclictest0-21swapper/109:24:581
220363993323,6cyclictest251805-21unixbench_singl08:35:282
220363993320,7cyclictest0-21swapper/211:20:012
220358993321,8cyclictest318957-21grep11:50:261
220358993224,4cyclictest0-21swapper/112:30:001
220358993223,6cyclictest0-21swapper/107:50:011
220358993222,6cyclictest0-21swapper/109:50:261
220358993212,6cyclictest131rcu_preempt08:40:131
220367993123,4cyclictest0-21swapper/311:40:253
220367993123,4cyclictest0-21swapper/308:45:173
220363993121,6cyclictest327493-21grep12:15:252
220363993119,8cyclictest204-21dbus-daemon07:14:182
220358993122,5cyclictest0-21swapper/108:35:181
220358993122,4cyclictest0-21swapper/112:15:401
220358993121,6cyclictest309944-21ntpq11:25:211
220358993121,5cyclictest0-21swapper/109:10:171
220358993111,4cyclictest131rcu_preempt07:10:121
220367993023,4cyclictest0-21swapper/307:25:263
220367993022,4cyclictest0-21swapper/308:05:293
22036399305,12cyclictest0-21swapper/210:40:242
220363993023,3cyclictest0-21swapper/211:50:012
220363993022,4cyclictest0-21swapper/208:40:272
220358993022,4cyclictest0-21swapper/111:20:001
220358993022,4cyclictest0-21swapper/110:35:251
220367992921,4cyclictest233060-21munin-plugin-st07:45:013
220367992920,5cyclictest327926-21munin-plugin-st12:19:593
220367992919,6cyclictest322366-21grep12:00:273
220367992919,6cyclictest322366-21grep12:00:263
220367992917,8cyclictest0-21swapper/312:25:173
220367992917,7cyclictest1-21systemd11:05:263
22036399293,5cyclictest131rcu_preempt08:45:142
220363992922,4cyclictest220348-21cyclictest10:55:012
220363992919,6cyclictest0-21swapper/208:20:002
220363992918,6cyclictest0-21swapper/212:30:162
220358992923,4cyclictest256521-21kworker/u8:2+events_unbound09:16:391
220358992921,4cyclictest0-21swapper/110:05:171
220358992919,5cyclictest0-21swapper/107:25:001
220358992916,9cyclictest259075-21idleruntime-cro09:00:011
220358992914,5cyclictest131rcu_preempt09:05:131
22035899291,15cyclictest229564-21cat07:35:011
220367992818,7cyclictest256893-21unixbench_multi08:50:273
220367992817,6cyclictest0-21swapper/312:25:013
220363992821,5cyclictest232328-21kworker/u8:2+events_unbound07:44:312
220363992821,4cyclictest0-21swapper/208:30:252
220363992820,4cyclictest0-21swapper/210:35:002
220363992818,6cyclictest245811-21fschecks_count08:20:162
220358992820,4cyclictest0-21swapper/112:30:251
220358992820,4cyclictest0-21swapper/111:50:001
220358992819,5cyclictest0-21swapper/112:00:251
220358992819,5cyclictest0-21swapper/112:00:251
220358992818,7cyclictest227257-21grep07:25:261
220358992817,7cyclictest308755-21grep11:20:261
220367992719,4cyclictest0-21swapper/310:25:003
220367992718,4cyclictest0-21swapper/311:45:253
220363992720,5cyclictest260487-21kworker/u8:0+events_unbound09:04:462
220363992720,4cyclictest326205-21cron12:14:592
220363992720,4cyclictest267593-21cron09:25:002
220363992720,4cyclictest0-21swapper/210:55:262
220363992719,4cyclictest0-21swapper/209:10:252
220363992719,4cyclictest0-21swapper/208:10:262
220363992719,4cyclictest0-21swapper/208:04:322
220363992719,4cyclictest0-21swapper/208:04:322
220363992719,4cyclictest0-21swapper/207:40:002
220363992717,7cyclictest1-21systemd10:05:172
22035899275,11cyclictest24-21ksoftirqd/107:50:181
220358992717,7cyclictest0-21swapper/109:35:241
220358992716,7cyclictest248342-21grep08:25:251
220367992619,3cyclictest0-21swapper/312:35:243
220363992618,4cyclictest0-21swapper/208:55:242
220363992615,7cyclictest1-21systemd10:20:192
22035899261,12cyclictest0-21swapper/111:40:561
22035899261,12cyclictest0-21swapper/108:18:311
220367992519,3cyclictest0-21swapper/312:05:273
220367992519,3cyclictest0-21swapper/309:50:263
220367992518,3cyclictest0-21swapper/311:25:233
220367992517,4cyclictest0-21swapper/311:30:263
220363992519,3cyclictest0-21swapper/207:50:222
220363992518,4cyclictest0-21swapper/209:30:282
220363992517,4cyclictest0-21swapper/212:35:252
220363992517,4cyclictest0-21swapper/210:15:152
220363992517,4cyclictest0-21swapper/208:25:252
220363992515,6cyclictest0-21swapper/207:15:272
220363992511,10cyclictest311ktimers/207:30:142
22035899259,4cyclictest221rcuc/111:00:251
220358992519,4cyclictest303244-21kworker/u8:0+events_unbound11:36:191
220358992519,3cyclictest0-21swapper/109:25:251
220358992518,5cyclictest319380-21kworker/u8:1+events_unbound12:12:391
220358992517,5cyclictest298486-21kworker/u8:2+events_unbound10:55:171
220358992516,7cyclictest273399-21kworker/u8:1+events_unbound09:42:021
22035899251,12cyclictest0-21swapper/112:20:211
220367992418,3cyclictest0-21swapper/310:50:213
220367992418,3cyclictest0-21swapper/310:25:193
220367992418,3cyclictest0-21swapper/308:20:193
220367992417,3cyclictest0-21swapper/312:35:003
220367992417,3cyclictest0-21swapper/310:55:263
220367992416,4cyclictest0-21swapper/308:10:163
220367992415,5cyclictest274636-21cut09:45:003
220363992418,3cyclictest0-21swapper/211:30:232
220363992418,3cyclictest0-21swapper/209:40:232
220363992416,5cyclictest292965-21grep10:35:252
22035899246,3cyclictest240498-21fschecks_count08:05:201
22035899246,10cyclictest24-21ksoftirqd/111:30:121
220358992418,4cyclictest303244-21kworker/u8:0+events_unbound11:05:511
220358992418,3cyclictest0-21swapper/108:45:271
220358992417,5cyclictest284516-21kworker/u8:2+events_unbound10:11:021
220358992417,5cyclictest229852-21kworker/u8:1+events_unbound07:40:151
220358992417,4cyclictest0-21swapper/108:20:251
220367992317,3cyclictest0-21swapper/310:45:213
220367992317,3cyclictest0-21swapper/310:10:193
220367992317,3cyclictest0-21swapper/310:05:163
220367992317,3cyclictest0-21swapper/309:45:213
220367992317,3cyclictest0-21swapper/308:40:163
220367992316,4cyclictest0-21swapper/307:55:173
220367992316,4cyclictest0-21swapper/307:20:243
220367992314,7cyclictest259054-21cut09:00:023
220367992314,4cyclictest0-21swapper/309:05:263
220363992317,3cyclictest0-21swapper/207:45:222
220363992316,5cyclictest260487-21kworker/u8:0+events_unbound09:08:282
220363992316,3cyclictest0-21swapper/210:45:222
220363992314,6cyclictest0-21swapper/211:40:262
220363992314,6cyclictest0-21swapper/210:00:172
220363992314,6cyclictest0-21swapper/210:00:162
22035899239,9cyclictest231ktimers/111:55:131
22035899236,3cyclictest0-21swapper/108:14:001
220358992317,4cyclictest315853-21kworker/u8:2+events_unbound12:06:051
220358992317,4cyclictest294942-21kworker/u8:0+events_unbound10:54:001
220358992317,4cyclictest244813-21kworker/u8:2+events_unbound08:30:231
220358992316,5cyclictest250225-21kworker/u8:1+events_unbound08:50:211
220358992316,5cyclictest226001-21kworker/u8:0-events_freezable_power_07:35:451
220358992314,4cyclictest0-21swapper/109:30:171
220358992310,6cyclictest24-21ksoftirqd/110:20:111
220367992216,4cyclictest277799-21kworker/u8:1+events_unbound09:55:193
220367992216,4cyclictest277799-21kworker/u8:1+events_unbound09:55:183
220367992216,3cyclictest53-21kcompactd011:10:153
220367992214,5cyclictest0-21swapper/308:40:003
220367992213,6cyclictest0-21swapper/311:55:253
220363992217,3cyclictest283924-21ntp_kernel_pll_10:10:232
220363992215,3cyclictest0-21swapper/212:10:012
220363992212,7cyclictest328572-21sed12:20:192
220363992210,9cyclictest330321-21memory12:25:202
220358992218,2cyclictest0-21swapper/107:15:041
220367992115,3cyclictest308150-21missed_timers11:20:193
220367992115,3cyclictest0-21swapper/309:25:173
220367992115,3cyclictest0-21swapper/307:35:013
220367992113,5cyclictest391ktimers/308:00:183
220367992113,5cyclictest391ktimers/308:00:183
220367992113,4cyclictest0-21swapper/310:40:213
220367992112,4cyclictest0-21swapper/309:20:193
220363992112,6cyclictest311ktimers/207:25:212
220363992112,6cyclictest305492-21apt-key11:15:012
220367992014,3cyclictest0-21swapper/309:10:203
220367992012,5cyclictest0-21swapper/311:50:183
220363992014,4cyclictest311ktimers/209:50:242
220363992014,3cyclictest0-21swapper/211:35:242
220363992013,5cyclictest311ktimers/209:49:292
220363992011,6cyclictest0-21swapper/208:05:212
220363992010,7cyclictest257252-21seq08:54:052
22036799198,6cyclictest0-21swapper/310:00:253
22036799198,6cyclictest0-21swapper/310:00:253
220367991912,5cyclictest391ktimers/307:35:213
220367991910,6cyclictest0-21swapper/309:00:233
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional