You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-22 - 03:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Fri May 22, 2026 00:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1147357995648,5cyclictest1233804-21sh23:20:003
1147348995649,5cyclictest1180502-21kworker/u8:0+events_unbound20:47:201
1147348995644,7cyclictest1245474-21grep23:50:271
1147352995446,4cyclictest1236733-21unixbench_multi23:25:262
1147352995042,4cyclictest1199476-21cron21:40:002
1147348994840,5cyclictest1206307-21idleruntime-cro22:00:001
1147357994740,5cyclictest1256180-21kworker/u8:3+events_unbound00:22:493
1147357994740,5cyclictest1256180-21kworker/u8:3+events_unbound00:22:493
1147352994739,5cyclictest438-21cron21:09:592
1147352994737,7cyclictest311ktimers/223:40:112
1147357994636,6cyclictest0-21swapper/319:30:253
1147352994640,4cyclictest1175384-21latency_hist20:30:012
1147357994429,12cyclictest391ktimers/320:15:133
1147357994335,5cyclictest1206296-21munin-plugin-st22:00:003
1147352994337,4cyclictest1228559-21kworker/u8:0+events_unbound23:57:472
1147352994337,4cyclictest1171391-21kworker/u8:1+events_unbound20:42:192
1147343994228,11cyclictest121ktimers/020:50:110
1147357994133,4cyclictest0-21swapper/319:10:173
1147352994135,4cyclictest1152824-21kworker/u8:1+events_unbound19:27:062
1147357994031,5cyclictest1169597-21unixbench_multi20:10:233
1147357994030,6cyclictest208-21systemd-logind22:22:313
1147348994029,8cyclictest231ktimers/123:15:121
1147348994029,8cyclictest1254689-21cron00:20:001
1147357993931,5cyclictest1252975-21cron00:15:003
1147352993927,8cyclictest1185806-21cron21:00:002
1147352993927,8cyclictest1185806-21cron21:00:002
1147352993927,8cyclictest1167861-21grep20:05:232
1147352993921,11cyclictest131rcu_preempt19:30:182
1147343993930,5cyclictest0-21swapper/020:15:260
1147343993927,8cyclictest1238902-21cron23:35:000
1147357993831,4cyclictest1244032-21idleruntime-cro23:50:003
1147357993829,5cyclictest0-21swapper/322:17:313
1147352993828,6cyclictest1158094-21cron19:40:002
1147352993823,8cyclictest131rcu_preempt19:23:512
1147348993831,5cyclictest1228559-21kworker/u8:0+events_unbound23:22:411
1147348993828,6cyclictest0-21swapper/100:20:261
1147348993828,6cyclictest0-21swapper/100:20:251
1147348993826,8cyclictest0-21swapper/121:40:011
1147343993826,7cyclictest0-21swapper/022:45:240
1147357993731,4cyclictest1202659-21kworker/u8:1+events_unbound21:52:273
1147357993731,4cyclictest1199411-21kworker/u8:0+events_unbound22:32:343
1147357993728,6cyclictest1241908-21unixbench_singl23:40:263
1147357993727,6cyclictest0-21swapper/320:45:243
1147352993726,7cyclictest1217972-21grep22:30:252
114735299362,24cyclictest1171781-21sendmail-msp20:20:012
1147352993618,4cyclictest131rcu_preempt21:34:542
1147352993618,10cyclictest131rcu_preempt22:50:182
1147357993529,4cyclictest1148616-21kworker/u8:0+events_unbound19:18:403
1147357993526,6cyclictest0-21swapper/319:40:013
1147357993524,7cyclictest0-21swapper/319:20:403
1147352993526,6cyclictest0-21swapper/221:20:262
1147352993526,5cyclictest0-21swapper/200:10:152
1147352993515,12cyclictest131rcu_preempt19:15:252
1147352993510,7cyclictest311ktimers/223:05:242
1147348993525,6cyclictest0-21swapper/119:20:351
1147348993513,3cyclictest131rcu_preempt19:30:121
1147343993528,4cyclictest1159813-21cron19:45:000
1147343993528,4cyclictest0-21swapper/000:40:010
1147343993527,4cyclictest0-21swapper/021:55:000
1147357993423,7cyclictest0-21swapper/321:40:243
1147352993423,7cyclictest311ktimers/221:25:242
1147352993423,5cyclictest131rcu_preempt23:20:562
1147352993422,7cyclictest0-21swapper/221:50:272
1147352993422,5cyclictest1175314-21kworker/u8:3+events_unbound20:47:132
1147352993421,9cyclictest311ktimers/220:10:252
1147352993421,9cyclictest1202477-21grep21:45:252
1147352993417,3cyclictest131rcu_preempt23:16:392
1147352993417,3cyclictest0-21swapper/220:31:082
1147352993416,4cyclictest131rcu_preempt00:09:352
1147352993415,5cyclictest131rcu_preempt23:10:432
1147348993425,4cyclictest0-21swapper/120:15:161
1147348993423,7cyclictest1232095-21awk23:15:001
1147357993323,7cyclictest0-21swapper/320:40:233
1147357993323,6cyclictest0-21swapper/323:10:253
1147352993325,4cyclictest0-21swapper/223:45:212
1147352993324,5cyclictest1255983-21grep00:20:262
1147352993324,5cyclictest1255983-21grep00:20:262
1147352993324,5cyclictest0-21swapper/223:50:172
1147352993324,4cyclictest0-21swapper/223:35:152
1147352993324,4cyclictest0-21swapper/223:35:152
1147352993322,7cyclictest0-21swapper/200:15:262
1147352993321,4cyclictest131rcu_preempt22:40:122
1147352993321,4cyclictest131rcu_preempt00:25:152
1147352993316,3cyclictest131rcu_preempt22:15:182
1147352993316,3cyclictest0-21swapper/222:55:362
1147348993326,5cyclictest1218393-21kworker/u8:1+events_unbound22:52:351
1147348993326,5cyclictest1171391-21kworker/u8:1+events_unbound20:20:061
1147343993326,4cyclictest11853762sleep020:55:240
1147343993326,4cyclictest11853762sleep020:55:240
1147343993325,5cyclictest0-21swapper/022:00:000
1147343993324,6cyclictest0-21swapper/021:25:260
1147343993323,6cyclictest0-21swapper/020:47:180
114734399331,13cyclictest0-21swapper/022:20:120
1147357993224,4cyclictest0-21swapper/320:35:013
1147357993224,4cyclictest0-21swapper/300:05:253
1147357993221,7cyclictest0-21swapper/320:05:243
1147352993221,7cyclictest0-21swapper/220:40:012
1147352993221,4cyclictest131rcu_preempt23:00:332
1147352993219,9cyclictest1219686-21grep22:35:262
1147352993219,7cyclictest0-21swapper/200:35:252
1147352993219,5cyclictest131rcu_preempt21:00:222
1147352993219,5cyclictest131rcu_preempt21:00:222
1147352993218,4cyclictest131rcu_preempt21:15:052
1147352993213,9cyclictest131rcu_preempt20:20:122
1147352993213,4cyclictest131rcu_preempt22:24:532
1147352993212,5cyclictest131rcu_preempt20:50:212
1147352993212,11cyclictest32-21ksoftirqd/222:10:012
1147352993211,11cyclictest32-21ksoftirqd/219:55:172
1147348993216,4cyclictest1164678-21kworker/u8:0+events_unbound20:28:031
1147343993226,3cyclictest0-21swapper/022:50:250
1147343993223,6cyclictest1244163-21latency_hist23:50:000
1147357993123,5cyclictest1185380-21unixbench_singl20:55:243
1147357993123,5cyclictest1185380-21unixbench_singl20:55:243
1147357993123,4cyclictest0-21swapper/321:30:153
1147357993123,3cyclictest0-21swapper/320:00:003
1147357993121,6cyclictest0-21swapper/323:55:263
1147357993121,6cyclictest0-21swapper/322:55:263
1147357993120,7cyclictest0-21swapper/320:50:243
1147352993120,4cyclictest131rcu_preempt23:32:422
1147352993120,3cyclictest131rcu_preempt22:45:162
1147352993118,9cyclictest1148502-21grep19:10:262
1147352993117,4cyclictest131rcu_preempt22:11:572
1147352993117,4cyclictest131rcu_preempt22:11:572
1147352993113,4cyclictest131rcu_preempt21:10:512
1147348993123,4cyclictest0-21swapper/100:00:001
1147348993122,5cyclictest1161526-21idleruntime-cro19:50:001
1147348993122,5cyclictest1161526-21idleruntime-cro19:50:001
1147348993121,6cyclictest0-21swapper/120:35:261
1147348993117,5cyclictest1156368-21kworker/u8:2+events_unbound19:54:231
1147357993022,6cyclictest1206240-21kworker/u8:2+events_unbound22:00:183
1147357993022,4cyclictest0-21swapper/322:55:013
1147357993020,6cyclictest0-21swapper/300:25:273
1147357993020,6cyclictest0-21swapper/300:15:153
1147357993018,7cyclictest0-21swapper/322:10:263
1147357993018,7cyclictest0-21swapper/322:10:263
1147357993015,5cyclictest1247376-21kworker/u8:1+events_unbound00:00:173
1147357993012,5cyclictest131rcu_preempt20:20:173
1147357993010,6cyclictest1240393-21kworker/u8:2+events_unbound23:53:163
114735299307,13cyclictest32-21ksoftirqd/222:00:112
1147352993018,6cyclictest1185469-21kworker/u8:2+events_unbound21:42:142
1147352993016,7cyclictest1164678-21kworker/u8:0+events_unbound20:00:322
1147352993016,4cyclictest131rcu_preempt00:35:002
1147352993015,4cyclictest131rcu_preempt00:00:282
1147352993014,4cyclictest131rcu_preempt21:59:482
1147352993013,9cyclictest131rcu_preempt19:53:362
1147352993013,4cyclictest131rcu_preempt19:40:202
114735299301,17cyclictest0-21swapper/219:45:202
114735299301,17cyclictest0-21swapper/219:45:202
114734899307,4cyclictest131rcu_preempt21:10:231
1147348993022,6cyclictest231ktimers/120:40:111
1147348993019,7cyclictest0-21swapper/121:45:251
114734399306,4cyclictest131rcu_preempt19:30:170
1147343993022,3cyclictest0-21swapper/020:00:000
1147343993020,6cyclictest0-21swapper/020:25:250
114734399301,15cyclictest438-21cron00:25:000
114734399301,15cyclictest438-21cron00:25:000
1147357992921,4cyclictest0-21swapper/320:00:253
1147357992921,4cyclictest0-21swapper/319:50:233
1147357992921,4cyclictest0-21swapper/300:40:013
1147357992920,6cyclictest0-21swapper/321:40:013
1147348992920,5cyclictest0-21swapper/121:35:011
1147348992916,7cyclictest24-21ksoftirqd/121:50:121
114734899291,12cyclictest0-21swapper/120:54:151
1147343992921,4cyclictest0-21swapper/022:37:340
1147343992920,5cyclictest0-21swapper/019:15:010
1147343992918,7cyclictest0-21swapper/023:40:260
1147343992918,6cyclictest0-21swapper/023:55:000
1147343992917,5cyclictest1228559-21kworker/u8:0+events_unbound00:05:260
1147343992916,9cyclictest121ktimers/000:00:110
114734399291,3cyclictest131rcu_preempt23:10:090
114735799286,9cyclictest0-21swapper/321:10:233
1147357992822,3cyclictest1187534-21kthreadd21:05:003
1147357992822,3cyclictest1187534-21kthreadd21:04:593
1147357992820,4cyclictest0-21swapper/323:35:163
1147357992820,4cyclictest0-21swapper/323:35:163
1147357992820,4cyclictest0-21swapper/321:15:273
1147357992820,4cyclictest0-21swapper/320:35:263
1147357992815,7cyclictest40-21ksoftirqd/321:45:243
1147352992810,10cyclictest32-21ksoftirqd/222:25:252
114734899284,4cyclictest131rcu_preempt19:25:131
1147348992822,3cyclictest0-21swapper/121:20:001
1147348992820,5cyclictest1196074-21idleruntime-cro21:30:011
1147348992820,4cyclictest0-21swapper/122:05:251
1147348992817,7cyclictest0-21swapper/123:40:261
114734399289,3cyclictest0-21swapper/021:45:180
1147343992821,4cyclictest0-21swapper/021:05:260
114734399281,12cyclictest0-21swapper/023:02:000
1147357992720,4cyclictest1236730-21unixbench_multi23:25:263
114735799271,16cyclictest0-21swapper/319:25:133
114734899272,4cyclictest131rcu_preempt19:40:111
1147348992720,4cyclictest1208208-21kworker/u8:1+events_unbound22:26:421
1147348992719,5cyclictest1251078-21munin-plugin-st00:10:001
1147348992718,4cyclictest0-21swapper/100:27:491
1147348992711,13cyclictest24-21ksoftirqd/100:00:311
114734399279,12cyclictest131rcu_preempt00:30:180
1147343992721,4cyclictest1171391-21kworker/u8:1+events_unbound20:20:120
1147343992719,4cyclictest0-21swapper/000:25:150
1147343992718,6cyclictest1254212-21unixbench_multi00:15:250
1147343992718,5cyclictest0-21swapper/023:55:260
1147343992716,5cyclictest1233521-21kworker/u8:1+events_unbound23:35:300
1147343992716,5cyclictest1233521-21kworker/u8:1+events_unbound23:35:290
1147343992711,9cyclictest131rcu_preempt21:35:170
1147357992619,3cyclictest0-21swapper/322:05:233
1147357992619,3cyclictest0-21swapper/321:20:263
1147357992618,5cyclictest199-21systemd-network19:40:143
1147357992618,5cyclictest1238476-21grep23:30:253
114735799261,3cyclictest131rcu_preempt23:05:003
114734899264,10cyclictest24-21ksoftirqd/100:37:251
1147348992622,2cyclictest0-21swapper/122:55:121
1147348992620,4cyclictest1218393-21kworker/u8:1+events_unbound23:06:401
1147348992620,4cyclictest1199411-21kworker/u8:0+events_unbound22:48:411
1147348992619,5cyclictest1218393-21kworker/u8:1+events_unbound22:42:371
1147348992618,5cyclictest231ktimers/121:20:111
1147348992617,5cyclictest1243103-21ntpq23:45:201
1147348992616,5cyclictest0-21swapper/120:12:111
114734899261,12cyclictest0-21swapper/122:03:071
114734899261,12cyclictest0-21swapper/121:00:181
114734899261,12cyclictest0-21swapper/121:00:181
114734399269,4cyclictest131rcu_preempt19:40:010
1147343992619,4cyclictest13550irq/42-30be0000.ethernet22:05:260
1147343992619,4cyclictest1147338-21cyclictest22:00:250
1147343992618,4cyclictest0-21swapper/020:35:240
1147343992617,4cyclictest0-21swapper/019:25:260
1147343992615,7cyclictest204-21dbus-daemon19:22:070
1147343992615,6cyclictest0-21swapper/021:10:250
1147343992612,7cyclictest131rcu_preempt22:12:310
1147343992612,7cyclictest131rcu_preempt22:12:310
1147343992612,6cyclictest131rcu_preempt22:35:010
114735799256,6cyclictest131rcu_preempt23:20:143
1147357992519,4cyclictest1159451-21kworker/u8:3+events_unbound19:45:223
1147357992519,4cyclictest1159451-21kworker/u8:3+events_unbound19:45:223
1147357992519,3cyclictest0-21swapper/323:05:173
1147357992517,5cyclictest1216302-21tail22:25:263
114734899258,10cyclictest24-21ksoftirqd/122:35:141
114734899256,4cyclictest131rcu_preempt19:35:101
1147348992519,4cyclictest1195974-21kworker/u8:3+events_unbound21:42:391
1147348992518,5cyclictest1228559-21kworker/u8:0+events_unbound23:38:411
1147348992518,5cyclictest1228559-21kworker/u8:0+events_unbound23:38:411
1147348992518,5cyclictest1180502-21kworker/u8:0+events_unbound21:09:301
1147348992517,6cyclictest1250953-21kworker/u8:1+events_unbound00:32:071
1147348992516,6cyclictest1213488-21grep22:20:011
1147348992515,6cyclictest1167875-21grep20:05:241
1147348992514,3cyclictest24-21ksoftirqd/120:32:181
114734899251,3cyclictest1184348-21apt-get20:55:121
114734899251,3cyclictest1184348-21apt-get20:55:111
1147348992513,9cyclictest24-21ksoftirqd/122:33:551
114734899251,13cyclictest0-21swapper/123:25:211
114734899251,12cyclictest0-21swapper/123:02:561
114734899251,11cyclictest0-21swapper/123:30:101
1147343992519,3cyclictest0-21swapper/021:05:010
1147343992519,3cyclictest0-21swapper/021:05:010
1147343992517,5cyclictest0-21swapper/020:05:240
1147343992517,4cyclictest0-21swapper/000:15:000
1147343992516,7cyclictest1229016-21cat23:05:140
114734399251,20cyclictest0-21swapper/019:51:050
114735799247,5cyclictest1188373-21/usr/sbin/munin21:05:233
1147357992416,5cyclictest0-21swapper/320:25:253
114734899247,10cyclictest24-21ksoftirqd/120:00:171
114734899245,7cyclictest24-21ksoftirqd/119:15:141
1147348992418,4cyclictest1161164-21kworker/u8:1+events_unbound19:58:421
1147348992417,4cyclictest0-21swapper/100:10:211
1147348992416,5cyclictest629-21snmpd19:11:541
1147343992418,4cyclictest1175314-21kworker/u8:3+events_unbound20:44:400
1147343992415,5cyclictest0-21swapper/020:35:010
1147343992414,7cyclictest1225608-21seq22:55:150
1147343992414,6cyclictest0-21swapper/023:25:260
1147343992414,6cyclictest0-21swapper/023:20:250
114734399241,19cyclictest0-21swapper/020:11:050
114734399241,19cyclictest0-21swapper/019:48:130
114734399241,19cyclictest0-21swapper/019:48:120
114734399241,12cyclictest0-21swapper/021:33:010
1147343992411,10cyclictest11-21ksoftirqd/021:40:150
1147357992317,4cyclictest645-21runrttasks22:40:153
1147357992316,4cyclictest0-21swapper/322:45:233
1147343992313,7cyclictest1215859-21ntpq22:25:230
114734399231,18cyclictest0-21swapper/022:41:500
114734399231,18cyclictest0-21swapper/020:04:110
114734399231,11cyclictest1192810-21latency_hist21:20:020
1147357992216,4cyclictest1250953-21kworker/u8:1+events_unbound00:31:023
1147357992215,4cyclictest1216678-21kworker/u8:2+events_unbound22:38:293
1147357992214,5cyclictest1195148-21ntpq21:25:213
1147348992213,7cyclictest24-21ksoftirqd/122:20:171
114734399228,7cyclictest131rcu_preempt21:23:500
114734399222,4cyclictest131rcu_preempt22:15:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional