You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-07 - 21:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Mon Sep 07, 2026 12:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
695495996020,17cyclictest802154-21tail12:15:242
695495995320,11cyclictest781042-21/usr/sbin/munin11:15:172
695495995039,7cyclictest783887-21sh11:25:002
695495995035,11cyclictest311ktimers/210:25:122
695495994817,12cyclictest785606-21awk11:30:002
695500994538,4cyclictest713135-21latency_hist08:00:013
695495994429,10cyclictest798077-21/usr/sbin/munin12:05:172
695495994418,9cyclictest697368-21ls07:15:022
695495994233,6cyclictest716720-21idleruntime-cro08:10:012
695495994122,15cyclictest762579-21unixbench_singl10:20:252
695495994120,12cyclictest0-21swapper/210:45:122
695495994031,5cyclictest768781-21apt-get10:40:122
695495994027,9cyclictest718352-21sshd08:14:182
695495994026,11cyclictest786509-21/usr/sbin/munin11:30:222
695495994026,11cyclictest786509-21/usr/sbin/munin11:30:222
695495994023,12cyclictest805268-21/usr/sbin/munin12:25:232
695485994033,4cyclictest754899-21fschecks_time10:00:170
695500993932,5cyclictest693436-21kworker/u8:1+events_unbound07:28:423
695495993931,4cyclictest727196-21apt-get08:40:132
695495993931,4cyclictest0-21swapper/212:25:002
695495993927,7cyclictest789481-21/usr/sbin/munin11:40:172
695495993927,7cyclictest739339-21/usr/sbin/munin09:15:162
695495993925,10cyclictest746222-21/usr/sbin/munin09:35:142
695495993925,10cyclictest702632-21sshd07:27:182
695488993932,4cyclictest729901-21unixbench_multi08:45:251
695485993931,5cyclictest744016-21cron09:30:000
695500993829,5cyclictest0-21swapper/311:30:153
695500993829,5cyclictest0-21swapper/311:30:143
695495993831,4cyclictest737533-21df09:10:142
695495993828,7cyclictest754712-21apt-get10:00:142
695495993828,7cyclictest709455-21sshd07:47:182
695495993827,8cyclictest753276-21/usr/sbin/munin09:55:162
695495993827,7cyclictest797469-21sshd12:04:172
695495993826,9cyclictest757570-21sshd10:06:172
695495993825,9cyclictest703654-21/usr/sbin/munin07:30:212
695495993825,10cyclictest751474-21/usr/sbin/munin09:50:162
695495993825,10cyclictest711863-21/usr/sbin/munin07:55:172
695495993824,10cyclictest795104-21/usr/sbin/munin11:55:242
695495993824,10cyclictest772494-21if_eth110:50:222
695495993823,10cyclictest759946-21/usr/sbin/munin10:15:152
695495993822,12cyclictest732822-21/usr/sbin/munin08:55:192
695488993824,10cyclictest231ktimers/107:35:121
695485993831,4cyclictest747191-21unixbench_multi09:35:250
69550099373,4cyclictest131rcu_preempt10:20:123
695500993729,4cyclictest0-21swapper/311:40:003
695500993728,6cyclictest0-21swapper/308:20:003
695500993728,5cyclictest0-21swapper/310:20:013
69550099372,5cyclictest131rcu_preempt12:30:113
695500993725,8cyclictest754476-21sendmail10:00:013
695495993731,3cyclictest779001-21apt-get11:10:132
695495993730,4cyclictest792645-21apt-get11:50:122
695495993729,5cyclictest723774-21apt-get08:30:132
695495993727,7cyclictest768438-21cron10:39:012
695495993727,7cyclictest726940-21sh08:40:012
695495993726,8cyclictest750807-21cron09:47:002
695495993726,8cyclictest736357-21/usr/sbin/munin09:05:232
695495993725,9cyclictest765871-21/usr/sbin/munin10:30:232
695495993725,9cyclictest765871-21/usr/sbin/munin10:30:232
695495993725,9cyclictest718897-21/usr/sbin/munin08:15:172
695495993724,7cyclictest707972-21cron07:45:012
695495993723,10cyclictest698673-21/usr/sbin/munin07:15:242
695495993722,11cyclictest720661-21/usr/sbin/munin08:20:162
695495993721,12cyclictest777644-21/usr/sbin/munin11:05:192
695495993719,13cyclictest801111-21date12:15:012
695485993730,4cyclictest0-21swapper/008:00:010
695485993726,6cyclictest795380-21grep11:55:250
695500993630,4cyclictest711263-21kworker/u8:1+events_unbound08:05:263
695500993624,9cyclictest438-21cron11:30:003
695495993628,5cyclictest709917-21apt-get07:50:132
695495993627,7cyclictest741135-21/usr/sbin/munin09:20:172
695495993626,7cyclictest745061-21/usr/sbin/munin09:30:222
695495993626,7cyclictest713652-21df08:00:132
695495993626,6cyclictest749567-21cat09:45:032
695495993625,8cyclictest758812-21/usr/sbin/munin10:10:242
695495993625,8cyclictest734308-21/usr/sbin/munin09:00:172
695495993625,8cyclictest734308-21/usr/sbin/munin09:00:172
695495993624,7cyclictest704917-21/usr/sbin/munin07:35:142
695495993623,9cyclictest774403-21/usr/sbin/munin10:55:192
695495993621,10cyclictest438-21cron11:40:002
695495993619,13cyclictest1-21systemd11:45:552
695488993628,6cyclictest792157-21kworker/u8:1+events_unbound11:50:561
695488993624,8cyclictest0-21swapper/107:15:021
695485993629,4cyclictest785599-21munin-plugin-st11:30:000
695485993629,4cyclictest720137-21sendmail08:20:010
69548599361,5cyclictest131rcu_preempt08:55:120
69548599361,4cyclictest131rcu_preempt08:40:120
695500993529,4cyclictest737064-21kworker/u8:1+events_unbound09:25:423
695500993529,4cyclictest723385-21kworker/u8:2+events_unbound08:30:313
695500993527,4cyclictest0-21swapper/311:00:253
695495993529,3cyclictest699698-21munin-node07:20:122
695495993526,7cyclictest808561-21/usr/sbin/munin12:35:192
695495993526,6cyclictest53-21kcompactd008:25:022
695495993522,9cyclictest775599-21apt-get11:00:122
695495993521,10cyclictest729911-21grep08:45:252
695495993520,11cyclictest742552-21munin-node09:25:122
695495993520,10cyclictest731691-21sshd08:50:342
695488993527,4cyclictest0-21swapper/108:10:011
695488993525,6cyclictest0-21swapper/108:00:011
695485993528,4cyclictest0-21swapper/009:10:000
69548599352,5cyclictest131rcu_preempt12:05:140
695485993525,6cyclictest0-21swapper/012:40:000
695500993428,4cyclictest764395-21kworker/u8:0+events_unbound10:29:423
695500993426,4cyclictest0-21swapper/308:40:253
695500993425,5cyclictest0-21swapper/308:05:013
695485993427,3cyclictest0-21swapper/011:15:250
695500993321,8cyclictest804358-21audit_send_reply12:25:003
695488993327,4cyclictest701043-21kworker/u8:0+events_unbound08:25:291
695488993326,4cyclictest0-21swapper/109:40:011
695488993325,4cyclictest0-21swapper/107:20:011
695485993327,3cyclictest726947-21latency_hist08:40:010
695500993225,4cyclictest0-21swapper/309:30:163
695500993225,3cyclictest0-21swapper/310:35:003
695500993225,3cyclictest0-21swapper/310:35:003
695500993224,5cyclictest774937-21unixbench_singl10:55:243
695500993224,4cyclictest0-21swapper/310:00:173
695488993226,4cyclictest776886-21kworker/u8:2+events_unbound11:05:531
69548899321,4cyclictest131rcu_preempt11:10:141
695485993225,5cyclictest802292-21kworker/u8:2+events_unbound12:20:590
695485993225,3cyclictest0-21swapper/010:25:250
695485993220,6cyclictest749050-21kworker/u8:2+events_unbound09:45:440
695500993124,4cyclictest740605-21cron09:20:003
695500993123,4cyclictest0-21swapper/312:10:253
695500993123,4cyclictest0-21swapper/310:40:003
695500993122,6cyclictest749727-21fschecks_count09:45:163
695488993123,4cyclictest0-21swapper/108:30:241
695485993124,4cyclictest0-21swapper/010:45:250
695500993022,4cyclictest0-21swapper/310:40:263
695500993021,6cyclictest802216-21grep12:15:253
69550099300,5cyclictest131rcu_preempt11:40:133
695488993022,4cyclictest0-21swapper/109:00:251
695488993022,4cyclictest0-21swapper/109:00:241
695488993021,6cyclictest0-21swapper/111:55:251
695488993021,5cyclictest718431-21munin-plugin-st08:15:011
69548599306,4cyclictest131rcu_preempt12:30:110
695485993024,3cyclictest0-21swapper/007:50:130
695485993022,4cyclictest0-21swapper/010:20:010
695485993021,6cyclictest0-21swapper/009:14:590
695500992923,4cyclictest711263-21kworker/u8:1+events_unbound08:35:333
695500992921,6cyclictest701043-21kworker/u8:0+events_unbound07:30:113
695500992921,4cyclictest0-21swapper/311:55:243
695488992922,4cyclictest807334-21unixbench_singl12:30:241
695488992922,4cyclictest0-21swapper/112:15:001
695488992922,4cyclictest0-21swapper/107:25:251
695488992921,5cyclictest0-21swapper/109:30:251
695488992920,6cyclictest751751-21cat09:50:211
695488992920,6cyclictest720602-21tune2fs08:20:161
695488992920,6cyclictest0-21swapper/108:35:251
695488992917,7cyclictest719658-21grep08:15:251
695485992922,4cyclictest0-21swapper/010:35:000
695485992922,4cyclictest0-21swapper/010:34:590
695485992919,6cyclictest699472-21basename07:20:010
695485992919,5cyclictest0-21swapper/009:40:420
695500992822,3cyclictest0-21swapper/311:20:533
695500992822,3cyclictest0-21swapper/308:55:003
695500992817,7cyclictest809692-21sed12:40:013
695500992811,4cyclictest747289-21kworker/u8:1+events_unbound10:08:213
695488992822,4cyclictest797242-21kworker/u8:1+events_unbound12:15:561
695488992820,5cyclictest0-21swapper/112:35:251
695488992819,6cyclictest0-21swapper/111:40:001
695488992819,6cyclictest0-21swapper/109:20:001
69548599286,4cyclictest131rcu_preempt11:05:170
695485992822,4cyclictest730015-21kworker/u8:2+events_unbound09:02:080
695485992822,4cyclictest730015-21kworker/u8:2+events_unbound09:02:080
695485992821,4cyclictest0-21swapper/010:40:260
69548599281,10cyclictest782657-21/usr/sbin/munin11:20:150
69550099277,4cyclictest131rcu_preempt11:15:133
695500992721,4cyclictest711263-21kworker/u8:1+events_unbound08:21:433
695500992719,4cyclictest0-21swapper/307:10:253
695488992721,3cyclictest0-21swapper/112:20:241
695488992720,4cyclictest743717-21kworker/u8:0+events_unbound09:30:001
695488992720,4cyclictest0-21swapper/111:40:151
695488992719,5cyclictest0-21swapper/110:10:011
695488992719,4cyclictest0-21swapper/111:25:251
695488992718,6cyclictest0-21swapper/112:05:261
695488992717,6cyclictest0-21swapper/111:20:231
69548599276,4cyclictest131rcu_preempt07:10:260
695485992721,3cyclictest0-21swapper/008:10:190
695485992718,6cyclictest0-21swapper/007:40:000
695500992619,5cyclictest768257-21kworker/u8:0+events_unbound10:49:503
695500992619,4cyclictest0-21swapper/309:20:173
695500992610,5cyclictest773427-21kworker/u8:1+events_unbound11:10:033
695488992619,4cyclictest0-21swapper/110:45:251
695488992619,4cyclictest0-21swapper/109:10:251
695488992619,4cyclictest0-21swapper/107:45:251
695488992618,5cyclictest0-21swapper/110:30:001
695488992615,8cyclictest231ktimers/110:50:161
69548599269,12cyclictest121ktimers/010:00:010
695485992622,2cyclictest13550irq/42-30be0000.ethernet10:35:230
695485992621,2cyclictest0-21swapper/011:40:220
695485992620,4cyclictest699283-21kworker/u8:2+events_unbound07:23:040
695485992620,3cyclictest0-21swapper/009:50:170
695485992619,4cyclictest13550irq/42-30be0000.ethernet11:50:240
695485992619,4cyclictest13550irq/42-30be0000.ethernet08:45:250
695485992616,7cyclictest702450-21grep07:25:260
695485992615,7cyclictest0-21swapper/010:55:240
69548599261,4cyclictest715451-21chrt08:05:160
69548599261,21cyclictest0-21swapper/008:00:040
69550099256,3cyclictest805319-21sendmail_mailtr12:25:233
695500992519,4cyclictest725103-21kworker/u8:0+events_unbound08:48:413
695500992519,3cyclictest0-21swapper/310:10:143
695500992519,3cyclictest0-21swapper/307:20:183
695500992515,7cyclictest773244-21grep10:50:303
695500992515,6cyclictest0-21swapper/311:50:163
695488992519,3cyclictest0-21swapper/110:10:171
695488992518,4cyclictest0-21swapper/112:25:261
695488992518,4cyclictest0-21swapper/110:40:261
695488992515,7cyclictest731529-21cat08:50:271
69548899251,13cyclictest0-21swapper/109:58:001
69548599253,5cyclictest131rcu_preempt11:35:110
695485992519,4cyclictest730015-21kworker/u8:2+events_unbound08:50:370
695485992518,3cyclictest0-21swapper/012:05:010
695485992517,4cyclictest0-21swapper/011:10:170
695485992517,4cyclictest0-21swapper/010:25:010
695485992516,5cyclictest0-21swapper/008:34:450
695485992516,5cyclictest0-21swapper/008:26:460
695485992515,7cyclictest791558-21proc_pri11:45:240
695485992515,6cyclictest709216-21grep07:45:250
69548599251,4cyclictest131rcu_preempt07:30:130
695485992514,8cyclictest799989-21awk12:10:200
695500992418,4cyclictest793768-21kworker/u8:3+events_unbound12:00:083
695500992418,4cyclictest741997-21kworker/u8:2+events_unbound09:35:123
695500992417,4cyclictest0-21swapper/307:40:243
69548899246,4cyclictest131rcu_preempt08:40:211
69548899242,3cyclictest131rcu_preempt07:55:011
695488992418,4cyclictest756085-21kworker/u8:2+events_unbound10:20:531
695488992418,3cyclictest0-21swapper/109:45:141
695488992417,4cyclictest0-21swapper/112:00:151
695488992417,3cyclictest0-21swapper/110:35:001
695488992417,3cyclictest0-21swapper/110:35:001
695488992415,6cyclictest767238-21tune2fs10:35:161
695488992415,6cyclictest759950-21grep10:15:151
695488992415,6cyclictest732858-21grep08:55:201
695488992415,6cyclictest0-21swapper/111:20:001
69548899241,4cyclictest131rcu_preempt10:55:121
695488992414,7cyclictest748020-21awk09:40:151
69548899241,20cyclictest704285-21seq07:31:451
69548599247,10cyclictest0-21swapper/012:26:170
695485992418,4cyclictest768257-21kworker/u8:0+events_unbound11:00:070
69548599241,19cyclictest0-21swapper/012:18:540
69548599241,19cyclictest0-21swapper/010:12:050
695500992318,3cyclictest737064-21kworker/u8:1-events_unbound09:10:163
695500992317,3cyclictest0-21swapper/307:45:253
695500992316,5cyclictest749050-21kworker/u8:2+events_unbound09:43:463
695500992315,4cyclictest0-21swapper/311:05:163
695500992315,4cyclictest0-21swapper/307:35:153
695500992313,6cyclictest0-21swapper/309:50:263
695488992314,6cyclictest776585-21grep11:00:251
695488992314,6cyclictest700700-21grep07:20:271
69548899230,14cyclictest0-21swapper/111:31:501
69548899230,14cyclictest0-21swapper/111:31:501
69548899230,12cyclictest0-21swapper/109:09:161
695485992315,6cyclictest747289-21kworker/u8:1+events_unbound10:05:200
695485992314,5cyclictest0-21swapper/011:33:330
695485992314,5cyclictest0-21swapper/011:33:330
69548599231,18cyclictest0-21swapper/010:53:440
69548599231,18cyclictest0-21swapper/007:44:060
69548599230,19cyclictest0-21swapper/009:34:400
69550099223,3cyclictest131rcu_preempt12:05:133
695500992216,3cyclictest0-21swapper/309:05:243
695500992215,5cyclictest731854-21kworker/u8:1+events_unbound08:59:093
695500992214,5cyclictest718564-21grep08:15:013
695500992211,7cyclictest698996-21grep07:15:263
69548899227,6cyclictest695483-21cyclictest11:45:171
695488992216,3cyclictest0-21swapper/110:00:271
695488992216,3cyclictest0-21swapper/108:00:141
69548599221,19cyclictest0-21swapper/008:24:010
69550099215,11cyclictest710161-21sshd07:50:173
69548899212,4cyclictest741024-21cut09:20:171
69550099203,3cyclictest131rcu_preempt09:00:123
69550099203,3cyclictest131rcu_preempt09:00:123
69550099199,7cyclictest791820-21sed11:45:263
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional