You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-06 - 13:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Sun Sep 06, 2026 00:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
890553995333,15cyclictest0-21swapper/121:30:001
890553995228,20cyclictest0-21swapper/120:10:171
890549994940,6cyclictest964420-21grep22:40:170
890549994940,6cyclictest920497-21cron20:35:000
890562994741,4cyclictest934257-21kworker/u8:1+events_unbound21:32:463
890553994736,7cyclictest978903-21grep23:20:261
890558994638,5cyclictest965735-21munin-plugin-st22:44:592
890558994635,8cyclictest915441-21apt-config20:20:012
890553994629,13cyclictest0-21swapper/122:24:591
890553994621,20cyclictest0-21swapper/122:45:281
89055399460,11cyclictest890715-21apt-get19:10:131
890549994639,4cyclictest629-21snmpd22:59:590
890549994635,7cyclictest961644-21grep22:30:290
890562994539,4cyclictest948209-21kworker/u8:1+events_unbound22:32:573
890553994534,7cyclictest904289-21grep19:45:281
890562994438,4cyclictest927281-21kworker/u8:0+events_unbound20:57:413
890553994419,21cyclictest1004760-21grep00:35:281
890553994415,25cyclictest0-21swapper/123:51:521
890558994335,5cyclictest1005217-21sendmail00:40:002
890553994333,6cyclictest948435-21cron21:55:011
89055399431,39cyclictest951095-21/usr/sbin/munin22:00:251
89055399421,9cyclictest941231-21/usr/sbin/munin21:30:291
89055399421,3cyclictest0-21swapper/123:35:101
89055399421,3cyclictest0-21swapper/122:35:141
890549994232,6cyclictest0-21swapper/021:47:460
890562994135,4cyclictest953446-21kworker/u8:2+events_unbound22:12:513
890562994127,4cyclictest984246-21kworker/u8:1+events_unbound23:38:083
890558994132,4cyclictest0-21swapper/222:55:002
89055399412,34cyclictest941974-21diskstats21:35:161
89055399411,9cyclictest902286-21/usr/sbin/munin19:40:241
89055399411,8cyclictest922457-21/usr/sbin/munin20:40:271
89055399411,8cyclictest922457-21/usr/sbin/munin20:40:271
89055399411,6cyclictest997626-21/usr/sbin/munin00:15:231
89055399411,3cyclictest0-21swapper/122:25:121
89055399411,3cyclictest0-21swapper/122:25:111
89055399411,10cyclictest979607-21apt-get23:25:121
89055399411,10cyclictest919145-21df20:30:151
890562994029,8cyclictest963889-21latency_hist22:40:003
890558994033,4cyclictest939930-21idleruntime-cro21:30:012
89055399402,30cyclictest645-21runrttasks20:50:151
89055399401,9cyclictest921413-21/usr/sbin/munin20:35:241
89055399401,5cyclictest915636-21/usr/sbin/munin20:20:301
890553994015,21cyclictest0-21swapper/120:00:231
890553994015,21cyclictest0-21swapper/120:00:221
89055399401,3cyclictest0-21swapper/121:20:141
89055399401,3cyclictest0-21swapper/121:20:141
89055399401,35cyclictest900880-21head19:35:261
89055399400,3cyclictest0-21swapper/122:50:171
89055399400,3cyclictest0-21swapper/119:50:141
89055399400,10cyclictest925237-21users20:45:251
890549994029,7cyclictest0-21swapper/022:54:590
890562993931,6cyclictest899362-21kworker/u8:1+events_unbound19:37:293
890562993928,6cyclictest0-21swapper/319:20:273
890562993917,5cyclictest131rcu_preempt21:55:013
890558993927,9cyclictest311ktimers/220:20:152
89055399393,33cyclictest993579-21df_inode00:05:151
89055399391,8cyclictest952108-21/usr/sbin/munin22:05:131
89055399391,4cyclictest933716-21/usr/sbin/munin21:10:221
89055399391,4cyclictest933716-21/usr/sbin/munin21:10:221
89055399391,3cyclictest0-21swapper/121:15:131
89055399391,3cyclictest0-21swapper/121:15:131
89055399391,3cyclictest0-21swapper/120:15:141
89055399391,3cyclictest0-21swapper/100:25:121
89055399391,33cyclictest931978-21grep21:05:261
89055399390,3cyclictest0-21swapper/121:45:121
890558993825,8cyclictest1003470-21cut00:35:012
890553993824,11cyclictest231ktimers/120:05:121
890553993824,11cyclictest231ktimers/120:05:121
89055399382,32cyclictest929657-21cut21:00:161
89055399382,31cyclictest990879-21head23:55:241
89055399381,9cyclictest974665-21/usr/sbin/munin23:10:161
89055399381,8cyclictest898125-21latency_hist19:30:021
89055399381,4cyclictest906789-21diskstats19:55:161
89055399381,3cyclictest0-21swapper/123:45:111
89055399381,3cyclictest0-21swapper/123:30:111
89055399381,3cyclictest0-21swapper/123:05:141
89055399381,3cyclictest0-21swapper/123:05:131
89055399381,3cyclictest0-21swapper/119:20:141
89055399381,34cyclictest971644-21ntp_states23:00:221
89055399381,34cyclictest1002100-21df00:30:181
89055399381,33cyclictest944580-21unixbench_multi21:40:271
89055399381,32cyclictest894481-21cron19:20:011
89055399381,2cyclictest0-21swapper/122:30:161
89055399381,2cyclictest0-21swapper/122:10:131
89055399380,3cyclictest0-21swapper/122:40:141
89055399380,3cyclictest0-21swapper/120:55:121
89055399380,3cyclictest0-21swapper/100:20:141
890549993823,12cyclictest121ktimers/020:00:110
890549993823,12cyclictest121ktimers/020:00:110
890562993730,5cyclictest894525-21kworker/u8:3+events_unbound19:27:283
890562993729,4cyclictest0-21swapper/300:38:403
890562993727,5cyclictest0-21swapper/323:50:163
890562993722,5cyclictest891934-21kworker/u8:0+events_unbound19:18:063
890562993717,11cyclictest131rcu_preempt19:55:203
890558993729,4cyclictest0-21swapper/220:35:012
89055399372,33cyclictest995737-21ntp_states00:10:221
89055399371,6cyclictest984946-21fschecks_time23:40:151
89055399371,4cyclictest976301-21diskstats23:15:151
89055399371,3cyclictest0-21swapper/122:55:131
89055399371,3cyclictest0-21swapper/119:30:121
89055399370,3cyclictest0-21swapper/122:15:131
890549993727,6cyclictest0-21swapper/019:40:250
890562993628,6cyclictest987777-21kworker/u8:1+events_unbound23:58:123
890562993624,8cyclictest391ktimers/300:20:173
890562993622,4cyclictest131rcu_preempt21:22:433
890562993622,4cyclictest131rcu_preempt21:22:433
890562993616,5cyclictest131rcu_preempt20:25:263
890558993628,4cyclictest0-21swapper/222:39:592
89055399361,7cyclictest917500-21fschecks_count20:25:181
89055399361,3cyclictest0-21swapper/121:55:121
890549993627,6cyclictest933343-21tune2fs21:10:170
890549993627,6cyclictest933343-21tune2fs21:10:170
890562993528,5cyclictest992730-21kworker/u8:0+events_unbound00:08:153
890562993523,5cyclictest131rcu_preempt21:45:003
890558993528,4cyclictest953568-21auditctl22:10:012
890549993528,5cyclictest894525-21kworker/u8:3+events_unbound19:47:290
890562993428,4cyclictest994557-21kworker/u8:3+events_unbound00:13:143
890562993415,11cyclictest131rcu_preempt21:15:013
890562993414,11cyclictest131rcu_preempt21:00:133
890558993426,4cyclictest0-21swapper/222:19:592
890558993426,4cyclictest0-21swapper/220:57:402
890558993425,4cyclictest0-21swapper/222:00:012
890558993424,6cyclictest0-21swapper/222:25:002
890549993425,5cyclictest0-21swapper/021:25:240
890549993425,5cyclictest0-21swapper/000:15:000
890562993326,5cyclictest982489-21kworker/u8:0+events_unbound23:42:083
890562993322,6cyclictest0-21swapper/321:25:263
890562993320,9cyclictest391ktimers/320:00:243
890562993320,9cyclictest391ktimers/320:00:243
890562993319,4cyclictest131rcu_preempt23:30:503
89056299331,8cyclictest40-21ksoftirqd/319:45:123
890562993318,5cyclictest131rcu_preempt21:08:413
890562993316,5cyclictest131rcu_preempt22:05:013
890562993316,10cyclictest131rcu_preempt22:45:213
890562993314,9cyclictest131rcu_preempt20:42:163
890562993314,9cyclictest131rcu_preempt20:42:163
890562993314,6cyclictest131rcu_preempt21:40:013
890562993314,12cyclictest131rcu_preempt22:55:153
890562993313,4cyclictest0-21swapper/321:15:003
890558993326,4cyclictest0-21swapper/219:20:012
890558993325,4cyclictest0-21swapper/221:15:252
890558993325,4cyclictest0-21swapper/221:15:252
890558993323,7cyclictest311ktimers/222:30:172
890549993326,3cyclictest0-21swapper/020:55:240
890549993325,4cyclictest0-21swapper/000:05:250
890549993324,5cyclictest0-21swapper/023:10:260
89056299329,14cyclictest40-21ksoftirqd/323:10:263
890562993226,4cyclictest976170-21kworker/u8:0+events_unbound23:18:053
890562993226,3cyclictest0-21swapper/320:20:013
890562993225,4cyclictest0-21swapper/300:30:203
890562993214,10cyclictest131rcu_preempt19:50:253
890562993213,4cyclictest131rcu_preempt21:20:013
890562993213,4cyclictest131rcu_preempt21:20:003
890562993213,4cyclictest131rcu_preempt20:50:263
890562993213,11cyclictest131rcu_preempt22:25:013
890562993213,10cyclictest131rcu_preempt20:20:233
890562993212,12cyclictest131rcu_preempt00:05:013
890562993210,13cyclictest40-21ksoftirqd/321:55:183
890558993224,4cyclictest0-21swapper/223:35:252
890558993224,4cyclictest0-21swapper/221:25:002
890558993224,4cyclictest0-21swapper/221:24:592
890549993222,7cyclictest0-21swapper/023:55:250
89054999322,19cyclictest131rcu_preempt21:10:010
890549993220,9cyclictest121ktimers/022:05:110
89056299319,5cyclictest131rcu_preempt21:45:243
890562993125,4cyclictest899362-21kworker/u8:1+events_unbound19:32:273
890562993123,4cyclictest0-21swapper/320:35:253
890562993120,4cyclictest131rcu_preempt23:49:093
890562993120,4cyclictest131rcu_preempt22:15:333
890562993117,5cyclictest131rcu_preempt22:40:263
890562993114,9cyclictest131rcu_preempt23:03:143
890562993114,10cyclictest131rcu_preempt20:10:153
890562993112,6cyclictest131rcu_preempt23:25:243
890562993111,5cyclictest131rcu_preempt22:28:513
890562993111,5cyclictest131rcu_preempt22:28:513
890562993111,5cyclictest131rcu_preempt19:10:153
890562993110,10cyclictest131rcu_preempt23:23:493
89054999314,4cyclictest131rcu_preempt23:40:110
890549993121,7cyclictest0-21swapper/021:45:010
890549993119,7cyclictest0-21swapper/021:30:300
89056299308,12cyclictest40-21ksoftirqd/323:10:003
89056299308,12cyclictest40-21ksoftirqd/323:10:003
89056299307,4cyclictest131rcu_preempt20:05:163
89056299307,4cyclictest131rcu_preempt20:05:153
890562993023,5cyclictest999807-21kworker/u8:2+events_unbound00:25:083
890562993012,10cyclictest131rcu_preempt20:32:043
890558993022,4cyclictest0-21swapper/222:00:272
890558993022,4cyclictest0-21swapper/219:50:172
890549993020,6cyclictest0-21swapper/000:20:270
890562992921,6cyclictest391ktimers/322:50:173
890562992916,5cyclictest131rcu_preempt20:45:213
890562992915,5cyclictest131rcu_preempt00:15:253
890562992914,4cyclictest131rcu_preempt19:40:183
890558992922,4cyclictest948435-21cron21:55:002
89054999299,12cyclictest11-21ksoftirqd/022:35:280
890549992922,4cyclictest0-21swapper/020:20:010
890549992919,7cyclictest892268-21munin-setwarn19:15:000
89054999291,13cyclictest0-21swapper/000:37:590
89056299284,14cyclictest40-21ksoftirqd/322:05:233
890558992820,4cyclictest0-21swapper/220:00:242
890558992820,4cyclictest0-21swapper/220:00:242
890549992822,4cyclictest986029-21kworker/u8:2+events_unbound23:45:470
890549992820,5cyclictest0-21swapper/019:50:270
890549992818,8cyclictest890543-21cyclictest00:35:000
890549992818,6cyclictest0-21swapper/000:30:010
89054999281,7cyclictest942263-21wc21:35:180
890549992817,7cyclictest204-21dbus-daemon19:17:260
890549992813,12cyclictest0-21swapper/000:05:010
890558992719,5cyclictest0-21swapper/200:25:172
890558992719,5cyclictest0-21swapper/200:05:002
890558992719,4cyclictest0-21swapper/219:35:172
890558992715,9cyclictest991325-21basename00:00:002
890549992721,4cyclictest894525-21kworker/u8:3+events_unbound19:36:410
890549992717,6cyclictest0-21swapper/020:35:260
890549992717,6cyclictest0-21swapper/020:05:250
890549992717,6cyclictest0-21swapper/020:05:240
89054999271,15cyclictest0-21swapper/020:45:130
890549992710,5cyclictest131rcu_preempt23:30:120
890558992618,4cyclictest0-21swapper/220:10:252
890558992615,6cyclictest0-21swapper/221:30:292
890549992619,5cyclictest948209-21kworker/u8:1+events_unbound21:55:170
890549992616,6cyclictest0-21swapper/020:25:270
890549992616,6cyclictest0-21swapper/019:30:260
890549992614,5cyclictest948209-21kworker/u8:1+events_unbound22:00:160
890549992614,4cyclictest131rcu_preempt22:30:010
890549992614,4cyclictest131rcu_preempt22:30:000
89054999261,22cyclictest936754-21sort21:20:180
89054999261,22cyclictest936754-21sort21:20:180
890558992519,3cyclictest997885-21unixbench_multi00:15:242
890558992519,3cyclictest0-21swapper/221:00:232
890558992518,4cyclictest0-21swapper/221:10:002
890558992516,6cyclictest892366-21latency_hist19:15:022
890558992515,6cyclictest0-21swapper/223:15:252
890549992521,2cyclictest13550irq/42-30be0000.ethernet23:00:130
890549992519,4cyclictest982489-21kworker/u8:0+events_unbound23:35:570
890549992519,4cyclictest976170-21kworker/u8:0+events_unbound23:19:050
890549992519,4cyclictest936019-21kworker/u8:0+events_unbound21:18:420
890549992519,4cyclictest936019-21kworker/u8:0+events_unbound21:18:410
890549992518,3cyclictest0-21swapper/023:25:260
890549992517,6cyclictest920132-21kworker/u8:0+events_unbound20:40:150
890549992517,6cyclictest920132-21kworker/u8:0+events_unbound20:40:150
890549992517,4cyclictest0-21swapper/022:50:000
890549992516,7cyclictest896973-21ntpq19:25:210
89054999251,5cyclictest955507-21apt22:15:120
89054999251,4cyclictest131rcu_preempt20:50:150
890549992512,7cyclictest131rcu_preempt23:50:220
890549992510,3cyclictest131rcu_preempt21:00:250
890558992418,4cyclictest984246-21kworker/u8:1+events_unbound23:40:172
890558992418,3cyclictest0-21swapper/221:35:172
890558992416,4cyclictest0-21swapper/220:35:172
890558992415,6cyclictest0-21swapper/223:05:172
890558992415,6cyclictest0-21swapper/223:05:162
890558992414,7cyclictest927322-21sh20:55:002
890549992418,4cyclictest956915-21kworker/u8:2+events_unbound22:23:180
890549992418,3cyclictest0-21swapper/019:20:250
890549992415,6cyclictest204-21dbus-daemon23:08:030
890549992415,6cyclictest204-21dbus-daemon23:08:030
89054999241,19cyclictest0-21swapper/022:10:350
89054999241,19cyclictest0-21swapper/000:18:310
890558992318,2cyclictest0-21swapper/222:25:132
890558992318,2cyclictest0-21swapper/222:25:132
890558992317,3cyclictest0-21swapper/219:30:252
890558992316,4cyclictest438-21cron20:10:002
890558992316,4cyclictest438-21cron20:10:002
890558992315,6cyclictest311ktimers/200:05:042
890558992315,4cyclictest0-21swapper/219:45:282
89054999233,5cyclictest911403-21kworker/u8:3+events_unbound20:10:240
890549992317,4cyclictest902886-21kworker/u8:0+events_unbound19:55:260
890558992216,3cyclictest0-21swapper/219:20:262
890558992215,4cyclictest924708-21ntpq20:45:202
890558992215,4cyclictest0-21swapper/220:40:162
890558992215,4cyclictest0-21swapper/220:40:152
890558992213,7cyclictest906670-21apt-get19:55:132
890558992213,6cyclictest0-21swapper/223:30:242
890558992213,6cyclictest0-21swapper/220:25:272
890549992217,3cyclictest13550irq/42-30be0000.ethernet21:50:210
89054999220,20cyclictest0-21swapper/023:22:360
890558992116,2cyclictest0-21swapper/222:10:262
890558992115,3cyclictest0-21swapper/222:55:242
890558992114,4cyclictest966163-21fschecks_time22:45:182
890558992113,6cyclictest979363-21cron23:25:012
890558992110,8cyclictest971910-21sed23:00:252
89055899202,15cyclictest975521-21grep23:10:262
890558992014,3cyclictest0-21swapper/223:50:162
890558992014,3cyclictest0-21swapper/223:45:242
890558992014,3cyclictest0-21swapper/200:15:012
890558992011,6cyclictest944097-21/usr/sbin/munin21:40:222
890558991913,4cyclictest311ktimers/221:45:112
890558991912,5cyclictest311ktimers/221:10:062
890558991912,5cyclictest311ktimers/221:10:062
890558991912,5cyclictest311ktimers/200:20:122
890558991912,3cyclictest0-21swapper/219:25:172
890558991810,5cyclictest902502-21/usr/sbin/munin19:40:252
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional