You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-07 - 22:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Thu May 07, 2026 12:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
261483995446,5cyclictest279275-21idleruntime-cro08:00:002
261487994935,11cyclictest391ktimers/311:15:113
261474994941,5cyclictest293542-21munin-plugin-st08:40:000
261474994941,5cyclictest293542-21munin-plugin-st08:40:000
261483994837,7cyclictest277107-21grep07:50:242
261483994635,7cyclictest311ktimers/208:35:132
261483994635,7cyclictest311ktimers/208:35:132
261483994633,9cyclictest311ktimers/211:40:122
261478994536,5cyclictest1-21systemd07:35:131
261487994437,4cyclictest286496-21cron08:20:003
261487994337,4cyclictest265428-21sendmail07:20:013
261478994316,7cyclictest131rcu_preempt12:20:101
261487994233,5cyclictest208-21systemd-logind09:00:403
261478994132,5cyclictest277554-21cron07:55:011
261474994133,4cyclictest314212-21latency_hist09:40:000
261474994133,4cyclictest314212-21latency_hist09:40:000
261487994030,7cyclictest284825-21cat08:15:003
261487994029,7cyclictest391ktimers/312:20:113
261483994030,7cyclictest267349-21idleruntime-cro07:25:012
261487993931,5cyclictest303994-21munin-plugin-st09:10:003
261487993931,5cyclictest208-21systemd-logind10:10:513
261487993929,7cyclictest0-21swapper/308:05:013
261483993931,5cyclictest337820-21kworker/u8:0-ext4-rsv-conversion11:54:592
261478993930,4cyclictest0-21swapper/112:35:001
261478993930,4cyclictest0-21swapper/112:34:591
261474993928,8cyclictest341496-21sh11:00:000
261478993830,5cyclictest322744-21cron10:05:011
261478993829,4cyclictest0-21swapper/111:30:001
261478993827,6cyclictest335979-21grep10:40:241
261483993730,4cyclictest0-21swapper/210:20:012
261474993730,4cyclictest316326-21fschecks_count09:45:140
261474993729,4cyclictest0-21swapper/009:20:010
261483993629,4cyclictest263102-21sh07:15:012
261474993627,5cyclictest0-21swapper/010:45:000
261474993626,6cyclictest0-21swapper/008:00:010
261487993526,6cyclictest0-21swapper/312:20:003
261487993525,7cyclictest0-21swapper/307:25:003
261483993528,4cyclictest0-21swapper/210:25:152
261483993527,4cyclictest0-21swapper/210:00:132
261483993524,6cyclictest0-21swapper/209:55:252
261483993521,10cyclictest311ktimers/212:30:112
261483993521,10cyclictest311ktimers/212:30:112
261483993510,5cyclictest32-21ksoftirqd/208:55:172
261478993524,7cyclictest264976-21grep07:15:241
261478993522,9cyclictest231ktimers/108:35:121
261478993522,9cyclictest231ktimers/108:35:121
26147499359,6cyclictest11-21ksoftirqd/007:20:000
261474993526,4cyclictest0-21swapper/012:34:590
261474993526,4cyclictest0-21swapper/012:34:590
261474993525,6cyclictest0-21swapper/008:05:010
261487993425,5cyclictest0-21swapper/311:30:163
26148399347,9cyclictest347438-21wc11:15:182
261478993426,4cyclictest0-21swapper/112:05:161
261478993423,8cyclictest314206-21sh09:40:001
261478993423,8cyclictest314206-21sh09:39:591
261474993426,4cyclictest0-21swapper/011:20:000
261487993323,7cyclictest341093-21grep10:55:273
261483993326,4cyclictest0-21swapper/212:15:142
261483993325,4cyclictest0-21swapper/210:55:262
261483993325,4cyclictest0-21swapper/210:10:162
261483993321,9cyclictest438-21cron10:50:012
26147499339,9cyclictest0-21swapper/007:15:010
261478993226,4cyclictest300475-21kworker/u8:3+events_unbound09:54:421
261478993225,5cyclictest266978-21kworker/u8:3+events_unbound07:30:141
261478993220,7cyclictest363626-21grep12:00:231
261474993225,4cyclictest0-21swapper/007:45:230
261474993225,3cyclictest269045-21kthreadd07:30:010
261474993223,4cyclictest131rcu_preempt10:06:050
261487993124,4cyclictest0-21swapper/311:20:263
261487993123,4cyclictest0-21swapper/308:39:593
261487993123,4cyclictest0-21swapper/308:39:593
261487993121,7cyclictest277116-21grep07:50:233
261487993120,7cyclictest360462-21auditctl11:54:593
26148399319,6cyclictest32-21ksoftirqd/210:35:002
261483993125,3cyclictest0-21swapper/208:20:242
261483993124,4cyclictest0-21swapper/208:10:252
261483993123,4cyclictest0-21swapper/211:10:242
261483993119,9cyclictest329240-21cron10:21:012
261478993123,5cyclictest339787-21cron10:55:001
261478993123,4cyclictest0-21swapper/110:05:251
261478993121,6cyclictest0-21swapper/108:20:011
261478993119,8cyclictest0-21swapper/111:00:011
26147499318,5cyclictest0-21swapper/010:15:240
26147499317,5cyclictest11-21ksoftirqd/007:35:020
261474993124,4cyclictest356657-21unixbench_singl11:40:230
26147499310,10cyclictest131rcu_preempt11:33:050
261487993023,5cyclictest300572-21cron09:00:013
261487993022,5cyclictest312087-21unixbench_singl09:30:243
261487993019,7cyclictest278791-21grep07:55:253
261487993017,9cyclictest1-21systemd07:40:153
261483993020,7cyclictest290362-21/usr/sbin/munin08:30:252
261483993020,7cyclictest290362-21/usr/sbin/munin08:30:252
261483993020,6cyclictest0-21swapper/208:10:012
261483993020,6cyclictest0-21swapper/208:10:012
261483993016,11cyclictest333343-21/usr/sbin/munin10:35:152
261478993023,5cyclictest295054-21kworker/u8:2+events_unbound09:15:421
261478993023,4cyclictest0-21swapper/108:40:161
261478993019,6cyclictest0-21swapper/109:45:251
26147499306,6cyclictest0-21swapper/008:15:170
261474993021,6cyclictest438-21cron09:30:000
261474993020,6cyclictest0-21swapper/011:20:170
261474993019,6cyclictest131rcu_preempt11:54:000
26147499301,15cyclictest11-21ksoftirqd/009:20:210
26148399292,9cyclictest0-21swapper/209:41:012
261483992922,4cyclictest0-21swapper/207:35:262
261483992921,4cyclictest289441-21grep08:25:242
261483992919,7cyclictest335266-21irqstats10:40:182
261483992919,6cyclictest0-21swapper/207:40:262
261483992918,9cyclictest375042-21/usr/sbin/munin12:35:182
261483992916,10cyclictest367179-21sshd12:11:172
261483992915,9cyclictest279509-21apt-get08:00:112
261483992915,11cyclictest308087-21/usr/sbin/munin09:20:182
26147899293,4cyclictest131rcu_preempt11:15:121
261474992923,3cyclictest0-21swapper/011:05:260
261474992923,3cyclictest0-21swapper/009:05:000
261474992922,4cyclictest0-21swapper/011:35:250
261474992921,4cyclictest13850irq/36-mmc112:20:010
261474992919,6cyclictest283015-21grep08:10:010
261474992919,6cyclictest283015-21grep08:10:000
261474992918,7cyclictest328738-21grep10:20:210
261474992917,9cyclictest300585-21tr09:00:000
261474992913,4cyclictest131rcu_preempt07:20:030
261474992912,10cyclictest337820-21kworker/u8:0-events_freezable_power_11:57:310
261487992820,5cyclictest326524-21cut10:15:153
261487992820,4cyclictest0-21swapper/308:35:013
261487992820,4cyclictest0-21swapper/308:35:013
261487992818,7cyclictest334676-21apt10:40:013
261483992821,4cyclictest369660-21apt-get12:20:102
261483992821,4cyclictest0-21swapper/212:05:012
261483992818,7cyclictest371608-21/usr/sbin/munin12:25:172
261483992818,7cyclictest371608-21/usr/sbin/munin12:25:162
261483992818,7cyclictest267700-21/usr/sbin/munin07:25:152
261483992817,8cyclictest365625-21cron12:08:012
261483992816,9cyclictest344338-21/usr/sbin/munin11:05:232
261483992816,9cyclictest309647-21/usr/sbin/munin09:25:172
261483992814,11cyclictest357296-21/usr/sbin/munin11:45:252
26148399281,13cyclictest0-21swapper/211:25:262
26147899286,4cyclictest262491-21cat07:10:241
26147899284,5cyclictest131rcu_preempt10:20:111
261478992819,6cyclictest0-21swapper/108:30:011
26147499285,7cyclictest11-21ksoftirqd/010:30:150
261474992822,4cyclictest276663-21ntp_states07:50:190
261474992818,6cyclictest53-21kcompactd011:26:100
261474992815,4cyclictest131rcu_preempt08:48:590
26147499281,15cyclictest0-21swapper/012:05:150
261487992722,3cyclictest289714-21kworker/u8:1+events_unbound08:40:393
261487992720,4cyclictest331649-21fschecks_count10:30:163
261487992720,4cyclictest0-21swapper/307:25:253
261487992718,6cyclictest0-21swapper/311:35:263
26148399279,5cyclictest32-21ksoftirqd/207:47:342
261483992718,6cyclictest263715-21cat07:15:032
261483992717,7cyclictest312741-21/usr/sbin/munin09:35:252
261483992717,7cyclictest312741-21/usr/sbin/munin09:35:252
261483992717,7cyclictest295825-21/usr/sbin/munin08:45:162
261483992717,6cyclictest342973-21grep11:00:242
261483992716,8cyclictest361978-21/usr/sbin/munin11:55:262
261483992716,8cyclictest338575-21/usr/sbin/munin10:50:152
261483992716,8cyclictest307220-21sshd09:18:012
261483992715,9cyclictest353883-21apt-get11:35:142
261483992715,9cyclictest318497-21/usr/sbin/munin09:50:252
261483992714,10cyclictest294878-21sshd08:40:362
261483992710,4cyclictest32-21ksoftirqd/209:30:152
261478992720,4cyclictest0-21swapper/112:35:261
261478992720,3cyclictest0-21swapper/109:25:451
261478992719,4cyclictest0-21swapper/112:25:161
261478992719,4cyclictest0-21swapper/112:25:151
26147499275,6cyclictest11-21ksoftirqd/010:35:240
261474992718,6cyclictest370645-21grep12:20:240
261474992714,3cyclictest131rcu_preempt09:50:330
261474992713,7cyclictest131rcu_preempt12:04:010
261474992712,7cyclictest131rcu_preempt07:35:250
261474992711,4cyclictest0-21swapper/010:45:160
261487992614,8cyclictest204-21dbus-daemon07:30:143
261483992620,3cyclictest285030-21apt-get08:15:122
261483992619,4cyclictest0-21swapper/211:20:262
261483992616,7cyclictest316152-21sshd09:45:062
261483992616,7cyclictest301865-21grep09:00:252
261483992614,9cyclictest353023-21/usr/sbin/munin11:30:242
261483992613,10cyclictest303064-21/usr/sbin/munin09:05:222
261478992620,3cyclictest0-21swapper/108:00:231
261478992619,5cyclictest295054-21kworker/u8:2+events_unbound09:10:421
261478992619,4cyclictest0-21swapper/109:55:261
261478992618,5cyclictest266978-21kworker/u8:3+events_unbound08:09:161
261478992618,5cyclictest266978-21kworker/u8:3+events_unbound08:09:161
261478992617,6cyclictest287095-21kernelversion08:20:181
26147899261,21cyclictest332561-21unixbench_singl10:30:251
26147499269,4cyclictest131rcu_preempt08:53:360
26147499268,5cyclictest0-21swapper/010:50:190
26147499268,11cyclictest131rcu_preempt07:41:220
26147499266,5cyclictest0-21swapper/009:40:160
26147499265,8cyclictest11-21ksoftirqd/012:35:160
26147499265,5cyclictest11-21ksoftirqd/008:25:170
26147499264,7cyclictest11-21ksoftirqd/009:35:010
26147499264,14cyclictest11-21ksoftirqd/009:06:170
26147499263,5cyclictest11-21ksoftirqd/012:10:240
26147499262,6cyclictest11-21ksoftirqd/008:30:160
26147499262,6cyclictest11-21ksoftirqd/008:30:150
261474992619,3cyclictest261468-21cyclictest11:46:400
261474992616,4cyclictest131rcu_preempt11:03:270
261474992612,8cyclictest324321-21kworker/u8:2-events_freezable_power_10:10:040
26147499261,15cyclictest0-21swapper/010:26:470
261487992518,5cyclictest0-21swapper/311:10:233
261487992518,4cyclictest331282-21idleruntime-cro10:30:013
261487992518,4cyclictest308682-21head09:20:243
261487992518,4cyclictest261821-21grep07:10:163
261487992516,5cyclictest0-21swapper/308:50:003
26148399259,13cyclictest269515-21/usr/sbin/munin07:30:152
261483992511,8cyclictest131rcu_preempt10:05:512
26148399251,11cyclictest0-21swapper/209:13:272
261483992510,3cyclictest131rcu_preempt08:50:252
261478992519,4cyclictest324869-21fschecks_time10:10:151
261478992518,5cyclictest286137-21kworker/u8:2+events_unbound08:30:351
261478992518,5cyclictest286137-21kworker/u8:2+events_unbound08:30:351
261478992518,3cyclictest355349-21kthreadd11:40:001
261478992517,5cyclictest0-21swapper/109:05:281
261478992517,4cyclictest279281-21sendmail08:00:011
261478992514,8cyclictest0-21swapper/110:35:191
261478992514,7cyclictest0-21swapper/109:40:251
261478992513,9cyclictest231ktimers/109:00:121
261478992513,8cyclictest204-21dbus-daemon07:40:141
261478992513,8cyclictest0-21swapper/109:35:011
261478992511,10cyclictest231ktimers/108:50:101
26147499259,4cyclictest131rcu_preempt11:10:030
26147499254,4cyclictest11-21ksoftirqd/012:27:290
26147499254,4cyclictest11-21ksoftirqd/012:27:290
26147499252,5cyclictest11-21ksoftirqd/010:00:110
261474992514,4cyclictest131rcu_preempt08:14:000
261487992418,3cyclictest0-21swapper/311:00:233
261487992418,3cyclictest0-21swapper/309:35:253
261487992418,3cyclictest0-21swapper/309:35:253
261487992418,3cyclictest0-21swapper/308:20:143
261487992417,4cyclictest335948-21grep10:40:253
261487992417,4cyclictest0-21swapper/312:00:243
261487992417,4cyclictest0-21swapper/311:45:233
261487992417,3cyclictest0-21swapper/310:05:173
261487992416,6cyclictest298946-21sed08:55:023
261487992416,4cyclictest0-21swapper/308:05:173
261487992416,4cyclictest0-21swapper/308:05:173
26147899245,4cyclictest131rcu_preempt07:25:121
261478992417,5cyclictest254449-21kworker/u8:1+events_unbound07:20:051
261478992417,3cyclictest0-21swapper/111:20:261
261478992416,6cyclictest231ktimers/109:20:161
261478992416,4cyclictest0-21swapper/110:25:151
26147899241,5cyclictest3575072cut11:45:151
261478992412,9cyclictest342962-21seq11:00:241
26147899241,12cyclictest0-21swapper/111:51:001
26147899240,3cyclictest0-21swapper/111:40:221
261474992418,3cyclictest0-21swapper/009:10:180
261474992411,4cyclictest131rcu_preempt08:40:120
261474992411,4cyclictest131rcu_preempt08:20:110
261474992410,8cyclictest131rcu_preempt09:57:510
261487992318,3cyclictest320094-21ntpq09:55:203
261487992317,4cyclictest362400-21sendmail12:00:013
261487992316,4cyclictest438-21cron09:45:003
261487992316,4cyclictest365800-21kthreadd12:10:013
261487992316,4cyclictest352157-21latency_hist11:30:023
261487992316,4cyclictest316318-21tune2fs09:45:143
261487992316,4cyclictest0-21swapper/310:50:143
261487992313,7cyclictest307413-21sendmail09:20:013
26148799230,3cyclictest0-21swapper/312:26:063
26148799230,3cyclictest0-21swapper/312:26:063
26147899231,7cyclictest346417-21head11:10:241
261478992314,5cyclictest0-21swapper/107:45:231
261487992216,3cyclictest0-21swapper/309:15:013
261487992216,3cyclictest0-21swapper/308:26:013
261487992215,4cyclictest0-21swapper/312:39:593
261487992214,5cyclictest391ktimers/307:35:213
261487992214,4cyclictest0-21swapper/310:05:013
26147899222,15cyclictest164-21systemd-journal08:45:381
261478992214,5cyclictest199-21systemd-network08:10:251
261478992214,4cyclictest0-21swapper/110:20:011
261487992114,5cyclictest391ktimers/312:32:073
261487992114,5cyclictest391ktimers/312:32:063
261487992114,4cyclictest356675-21users11:40:243
261487992113,5cyclictest391ktimers/311:05:123
261478992113,4cyclictest0-21swapper/112:10:241
261478992113,4cyclictest0-21swapper/111:30:241
261487992015,3cyclictest366028-21/usr/sbin/munin12:10:163
261487992014,3cyclictest0-21swapper/309:50:113
261487992013,5cyclictest300475-21kworker/u8:3+events_unbound10:45:573
261487992012,5cyclictest0-21swapper/310:25:003
261478992014,3cyclictest0-21swapper/111:05:131
261478992012,4cyclictest0-21swapper/111:55:191
261478992011,7cyclictest299675-21ntpq08:55:231
26148799199,7cyclictest274611-21cut07:45:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional