You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-02 - 09:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot5s.osadl.org (updated Tue Jun 02, 2026 00:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1058973994737,6cyclictest1161375-21grep00:00:243
1058973994734,9cyclictest391ktimers/320:05:113
1058965994736,8cyclictest1060597-21cron19:15:002
1058958994738,5cyclictest1060596-21cron19:15:000
1058973994636,6cyclictest1060613-21seq19:15:003
1058965994636,6cyclictest1069765-21idleruntime-cro19:40:012
1058973994538,4cyclictest1087230-21munin-plugin-st20:30:013
1058973994436,5cyclictest1062748-21kworker/u8:2+events_unbound19:22:443
1058973994436,5cyclictest1062748-21kworker/u8:2+events_unbound19:22:443
1058973994337,4cyclictest1090865-21kworker/u8:2+events_unbound20:48:003
1058965994334,7cyclictest311ktimers/222:20:132
1058973994033,4cyclictest1139233-21munin-plugin-st23:00:013
1058958994031,6cyclictest121ktimers/020:05:120
1058973993931,4cyclictest0-21swapper/322:55:013
1058965993931,6cyclictest311ktimers/222:15:122
1058965993927,10cyclictest311ktimers/223:20:122
1058959993932,4cyclictest1135828-21latency_hist22:50:021
1058958993927,8cyclictest1159694-21grep23:55:260
1058973993827,7cyclictest1090651-21sendmail20:40:013
1058958993828,6cyclictest1147972-21cron23:25:000
1058958993827,8cyclictest121ktimers/022:40:130
1058958993827,8cyclictest1142445-21grep23:05:290
1058973993729,5cyclictest1073359-21cron19:50:003
1058958993730,4cyclictest1132213-21sendmail22:40:000
1058965993627,5cyclictest0-21swapper/219:55:252
1058965993625,8cyclictest1100870-21munin-plugin-st21:10:002
1058965993610,6cyclictest1070567-21latency19:40:192
1058959993626,7cyclictest0-21swapper/121:15:281
1058959993622,8cyclictest1140898-21kworker/u8:1+events_unbound23:05:061
1058965993527,4cyclictest1089309-21tune2fs20:35:162
1058965993524,7cyclictest0-21swapper/223:05:012
1058965993523,9cyclictest311ktimers/221:55:122
1058959993524,7cyclictest1064628-21sh19:25:001
1058959993524,7cyclictest1064628-21sh19:25:001
1058958993527,4cyclictest0-21swapper/000:20:010
1058973993427,5cyclictest1064527-21kworker/u8:0+events_unbound20:42:593
1058973993424,6cyclictest0-21swapper/321:45:273
1058965993426,4cyclictest1102157-21unixbench_singl21:10:252
1058965993426,4cyclictest0-21swapper/220:45:172
1058959993426,4cyclictest0-21swapper/123:20:231
1058958993424,5cyclictest0-21swapper/021:43:080
1058973993327,3cyclictest0-21swapper/300:35:003
1058973993326,5cyclictest1147919-21kworker/u8:0+events_unbound23:38:213
1058973993324,4cyclictest0-21swapper/319:42:473
1058973993314,5cyclictest1144461-21kworker/u8:3+events_unbound23:19:223
1058965993325,4cyclictest0-21swapper/219:55:002
1058965993324,5cyclictest1163537-21sh00:10:002
1058965993324,5cyclictest0-21swapper/200:18:232
1058965993324,4cyclictest131rcu_preempt00:29:542
1058965993324,4cyclictest131rcu_preempt00:29:542
1058959993325,4cyclictest0-21swapper/122:50:171
1058959993325,4cyclictest0-21swapper/121:05:181
1058959993324,6cyclictest0-21swapper/123:35:001
1058959993324,6cyclictest0-21swapper/123:35:001
1058973993226,4cyclictest1164872-21kworker/u8:0+events_unbound00:18:253
1058973993219,9cyclictest204-21dbus-daemon19:57:503
1058965993223,5cyclictest0-21swapper/221:00:252
1058965993221,7cyclictest1103836-21grep21:15:282
1058965993218,9cyclictest204-21dbus-daemon00:33:242
105895999324,4cyclictest131rcu_preempt20:30:141
1058959993225,4cyclictest1090645-21sendmail20:40:011
1058959993224,6cyclictest1075030-21kworker/u8:3+events_unbound20:05:181
1058959993223,5cyclictest0-21swapper/120:20:161
1058959993223,4cyclictest0-21swapper/123:50:161
1058959993222,6cyclictest1098683-21grep21:00:261
1058958993223,6cyclictest0-21swapper/019:30:000
1058958993222,6cyclictest0-21swapper/021:20:260
1058958993221,7cyclictest0-21swapper/019:45:270
105897399314,24cyclictest1135408-21grep22:45:273
1058973993124,5cyclictest1105617-21kworker/u8:1+events_unbound21:24:413
1058973993121,7cyclictest1062449-21grep19:15:243
1058973993121,7cyclictest1062449-21grep19:15:243
1058973993116,6cyclictest1107353-21kworker/u8:2+events_unbound21:35:203
1058965993122,6cyclictest0-21swapper/221:50:252
1058965993121,7cyclictest301rcuc/222:58:132
1058965993120,7cyclictest1122756-21grep22:10:252
1058965993120,7cyclictest0-21swapper/223:20:002
1058965993119,8cyclictest1088921-21apt20:35:012
1058959993121,6cyclictest0-21swapper/100:20:251
1058959993120,7cyclictest0-21swapper/121:35:001
1058959993120,7cyclictest0-21swapper/121:35:001
1058958993124,4cyclictest0-21swapper/000:30:260
1058958993123,4cyclictest1104294-21sendmail21:20:000
1058958993123,4cyclictest0-21swapper/000:35:250
1058958993120,8cyclictest1130280-21auditctl22:35:000
1058973993023,5cyclictest1154423-21kworker/u8:2+events_unbound23:52:413
1058973993023,5cyclictest1064527-21kworker/u8:0+events_unbound20:56:423
1058973993022,4cyclictest0-21swapper/322:30:003
1058973993021,6cyclictest0-21swapper/300:05:243
1058973993013,5cyclictest1123136-21kworker/u8:2+events_unbound22:23:393
1058973993013,5cyclictest1103472-21kworker/u8:2+events_unbound21:15:353
105896599307,7cyclictest32-21ksoftirqd/221:25:252
105896599305,7cyclictest32-21ksoftirqd/200:00:242
105896599305,6cyclictest32-21ksoftirqd/222:30:012
105896599305,6cyclictest32-21ksoftirqd/222:05:162
105896599305,5cyclictest301rcuc/219:30:252
105896599305,4cyclictest301rcuc/223:40:012
1058965993021,6cyclictest311ktimers/220:01:372
1058965993020,7cyclictest311ktimers/222:25:252
1058965993020,6cyclictest0-21swapper/223:55:262
1058965993019,6cyclictest0-21swapper/220:15:002
1058965993019,4cyclictest131rcu_preempt22:39:282
1058965993018,4cyclictest131rcu_preempt23:10:132
1058959993024,4cyclictest1160067-21kworker/u8:1+events_unbound00:05:231
1058959993024,4cyclictest1066266-21kworker/u8:2+events_unbound19:32:471
1058959993023,4cyclictest0-21swapper/122:15:001
1058959993021,5cyclictest1081683-21kworker/u8:120:10:251
1058959993021,5cyclictest0-21swapper/122:38:121
1058959993021,5cyclictest0-21swapper/122:08:101
1058973992923,4cyclictest1073217-21kworker/u8:2+events_unbound19:50:143
105896599298,7cyclictest32-21ksoftirqd/221:45:142
105896599295,6cyclictest32-21ksoftirqd/222:50:252
105896599295,5cyclictest32-21ksoftirqd/220:20:002
105896599295,5cyclictest32-21ksoftirqd/200:20:182
105896599294,7cyclictest32-21ksoftirqd/223:30:232
105896599294,7cyclictest32-21ksoftirqd/223:30:232
1058965992922,4cyclictest311ktimers/220:45:012
1058965992922,4cyclictest0-21swapper/222:45:272
1058965992922,4cyclictest0-21swapper/219:20:252
1058965992922,4cyclictest0-21swapper/219:20:252
1058965992921,4cyclictest0-21swapper/222:00:152
1058965992921,4cyclictest0-21swapper/221:35:252
1058965992919,7cyclictest311ktimers/200:11:582
1058965992914,6cyclictest131rcu_preempt19:30:012
1058959992921,4cyclictest0-21swapper/121:25:161
1058959992921,4cyclictest0-21swapper/119:50:011
1058959992915,6cyclictest1129950-21kworker/u8:2+events_unbound23:03:401
1058958992921,4cyclictest0-21swapper/021:48:090
1058958992919,6cyclictest0-21swapper/000:25:250
1058958992919,6cyclictest0-21swapper/000:25:250
1058973992821,5cyclictest1154423-21kworker/u8:2+events_unbound23:40:533
1058973992820,5cyclictest1060427-21kworker/u8:1+events_unbound19:28:463
1058973992820,4cyclictest0-21swapper/319:40:013
1058973992818,7cyclictest1156712-21sh23:50:003
105896599286,8cyclictest32-21ksoftirqd/220:50:132
105896599285,4cyclictest32-21ksoftirqd/220:05:192
1058965992819,6cyclictest311ktimers/222:45:002
1058965992818,7cyclictest311ktimers/221:24:452
1058965992813,9cyclictest131rcu_preempt23:54:592
1058959992822,3cyclictest0-21swapper/122:55:171
1058959992818,8cyclictest1076773-21sendmail20:00:001
1058959992816,6cyclictest1064527-21kworker/u8:0+events_unbound19:25:441
1058958992822,4cyclictest1094047-21munin-plugin-st20:50:010
1058958992822,3cyclictest0-21swapper/020:20:010
105897399278,9cyclictest1081781-21kworker/u8:2+events_unbound20:11:443
1058973992721,4cyclictest1129950-21kworker/u8:2+events_unbound22:34:463
1058973992721,4cyclictest1093730-21kworker/u8:1+events_unbound21:02:403
1058973992720,3cyclictest0-21swapper/321:55:233
1058973992712,7cyclictest40-21ksoftirqd/300:11:583
1058973992711,6cyclictest1129950-21kworker/u8:2+events_unbound23:06:043
105897399270,12cyclictest0-21swapper/300:38:003
105896599279,5cyclictest32-21ksoftirqd/219:20:012
105896599279,5cyclictest32-21ksoftirqd/219:20:012
105896599279,4cyclictest131rcu_preempt23:43:202
105896599278,4cyclictest311ktimers/223:45:222
105896599278,4cyclictest131rcu_preempt00:35:112
105896599276,8cyclictest32-21ksoftirqd/220:20:012
105896599274,7cyclictest32-21ksoftirqd/223:05:302
1058965992719,5cyclictest0-21swapper/219:45:272
1058965992719,4cyclictest0-21swapper/221:40:162
1058965992718,6cyclictest311ktimers/220:55:322
1058965992718,6cyclictest311ktimers/220:26:202
1058965992716,3cyclictest131rcu_preempt23:25:182
1058965992711,9cyclictest131rcu_preempt21:30:162
1058965992711,9cyclictest131rcu_preempt21:30:162
1058959992721,4cyclictest1068261-21kworker/u8:1+events_unbound19:38:431
1058959992720,4cyclictest0-21swapper/120:50:231
1058959992718,6cyclictest1161378-21unixbench_multi00:00:241
105895999271,5cyclictest131rcu_preempt22:00:121
1058958992720,4cyclictest1153094-21idleruntime-cro23:40:000
1058958992720,4cyclictest1102566-21auditctl21:15:000
1058958992720,3cyclictest0-21swapper/023:45:000
1058958992717,7cyclictest0-21swapper/023:05:010
1058958992716,7cyclictest0-21swapper/019:40:010
105897399269,5cyclictest1166591-21kworker/u8:1+events_unbound00:23:223
1058973992620,4cyclictest1129950-21kworker/u8:2+events_unbound23:32:193
1058973992620,4cyclictest1129950-21kworker/u8:2+events_unbound23:32:183
1058973992620,4cyclictest1064527-21kworker/u8:0+events_unbound20:22:553
1058973992619,5cyclictest1075030-21kworker/u8:3+events_unbound20:01:373
1058973992617,7cyclictest1116019-21kworker/u8:1+events_unbound22:14:543
1058973992613,7cyclictest40-21ksoftirqd/321:07:223
1058973992613,7cyclictest40-21ksoftirqd/320:30:493
105897399261,14cyclictest0-21swapper/323:20:193
105895999268,10cyclictest24-21ksoftirqd/122:20:141
1058959992620,4cyclictest1123136-21kworker/u8:2+events_unbound22:17:421
1058959992620,4cyclictest1060427-21kworker/u8:1+events_unbound19:15:551
1058959992620,4cyclictest1060427-21kworker/u8:1+events_unbound19:15:541
1058959992615,7cyclictest1117928-21basename22:00:011
105895999261,11cyclictest1104941-21sed21:20:191
1058958992620,4cyclictest0-21swapper/019:15:110
1058958992620,4cyclictest0-21swapper/019:15:110
1058958992620,3cyclictest0-21swapper/021:25:250
1058958992619,4cyclictest13550irq/42-30be0000.ethernet22:20:000
1058958992618,4cyclictest0-21swapper/021:40:000
1058958992618,4cyclictest0-21swapper/019:52:490
1058958992618,4cyclictest0-21swapper/000:08:220
1058958992616,6cyclictest0-21swapper/020:00:010
105897399255,11cyclictest0-21swapper/322:02:093
1058973992519,4cyclictest1129950-21kworker/u8:2+events_unbound23:10:413
1058973992519,3cyclictest0-21swapper/322:40:013
1058973992518,5cyclictest1109071-21kworker/u8:1+events_unbound21:32:093
1058973992518,5cyclictest1109071-21kworker/u8:1+events_unbound21:32:093
1058973992518,4cyclictest1112808-21sh21:45:003
1058973992518,4cyclictest0-21swapper/323:55:263
1058973992517,6cyclictest1168358-21kworker/u8:2+events_unbound00:27:553
1058973992517,6cyclictest1168358-21kworker/u8:2+events_unbound00:27:553
1058973992512,7cyclictest40-21ksoftirqd/319:33:203
1058973992510,11cyclictest391ktimers/323:00:113
1058959992519,3cyclictest0-21swapper/123:15:001
1058959992519,3cyclictest0-21swapper/100:35:001
1058959992518,5cyclictest1112547-21kworker/u8:1+events_unbound21:45:181
1058959992518,5cyclictest1075030-21kworker/u8:3+events_unbound20:00:301
1058959992517,4cyclictest438-21cron21:55:011
1058959992517,4cyclictest0-21swapper/123:55:261
1058959992516,6cyclictest0-21swapper/100:20:001
1058959992515,7cyclictest1154814-21pluginstate23:45:001
1058959992515,7cyclictest1096065-21awk20:55:171
1058959992515,7cyclictest0-21swapper/119:15:011
1058959992510,9cyclictest131rcu_preempt22:33:561
1058958992518,4cyclictest1136265-21fschecks_time22:50:170
1058958992518,4cyclictest1128415-21apt-key22:30:000
1058958992517,4cyclictest1087612-21fschecks_count20:30:160
1058958992512,10cyclictest121ktimers/021:30:110
1058958992512,10cyclictest121ktimers/021:30:100
105895899251,20cyclictest0-21swapper/021:54:420
105897399248,3cyclictest0-21swapper/321:25:493
1058973992417,5cyclictest1064527-21kworker/u8:0+events_unbound21:12:093
1058973992417,3cyclictest0-21swapper/321:50:163
1058973992416,5cyclictest1064527-21kworker/u8:0+events_unbound20:15:173
1058973992411,7cyclictest40-21ksoftirqd/322:08:363
105895999246,7cyclictest0-21swapper/123:45:231
1058959992418,3cyclictest0-21swapper/123:25:201
1058959992418,3cyclictest0-21swapper/100:35:211
1058959992417,3cyclictest0-21swapper/123:15:271
1058959992417,3cyclictest0-21swapper/121:40:001
1058959992416,5cyclictest0-21swapper/120:15:161
1058958992418,4cyclictest0-21swapper/023:10:130
1058958992416,5cyclictest1091887-21grep20:40:280
105895899241,19cyclictest0-21swapper/023:17:060
105895899241,19cyclictest0-21swapper/022:10:430
105895899241,19cyclictest0-21swapper/020:27:370
105895899240,20cyclictest0-21swapper/019:44:210
1058973992317,4cyclictest1116019-21kworker/u8:1+events_unbound22:19:023
1058973992317,3cyclictest0-21swapper/322:40:163
105895999232,3cyclictest131rcu_preempt20:40:271
1058959992317,4cyclictest1081781-21kworker/u8:2+events_unbound20:25:091
1058959992316,4cyclictest1153089-21munin-plugin-st23:40:001
1058959992316,4cyclictest0-21swapper/121:10:251
1058959992313,7cyclictest1111512-21cut21:40:161
1058959992311,9cyclictest1163911-21cut00:10:171
1058958992317,3cyclictest0-21swapper/021:05:200
1058958992317,3cyclictest0-21swapper/019:20:200
1058958992317,3cyclictest0-21swapper/019:20:190
105895899231,6cyclictest1134495-21fschecks_count22:45:160
1058958992316,4cyclictest1118391-21tune2fs22:00:160
1058958992316,3cyclictest0-21swapper/020:36:560
1058958992316,3cyclictest0-21swapper/020:11:030
1058958992316,3cyclictest0-21swapper/019:34:080
105895899231,3cyclictest1167766-21ntp_states00:20:210
105895899231,20cyclictest0-21swapper/023:50:130
105895899231,18cyclictest0-21swapper/021:59:340
105895899231,18cyclictest0-21swapper/020:51:450
105895899231,18cyclictest0-21swapper/020:20:090
105895899230,21cyclictest0-21swapper/023:45:040
105895899230,19cyclictest0-21swapper/023:25:520
1058959992216,3cyclictest0-21swapper/122:40:161
1058958992217,3cyclictest0-21swapper/020:00:140
1058958992215,4cyclictest1163909-21fschecks_count00:10:170
1058958992215,3cyclictest0-21swapper/023:33:460
1058958992215,3cyclictest0-21swapper/023:33:460
105895899221,19cyclictest0-21swapper/022:21:170
105895899220,4cyclictest1096600-21ps20:55:250
105895899220,3cyclictest0-21swapper/000:00:310
1058959992115,4cyclictest0-21swapper/119:40:221
1058959992115,3cyclictest0-21swapper/120:45:171
1058958992114,3cyclictest0-21swapper/021:03:000
105895899211,3cyclictest0-21swapper/022:09:370
1058959992012,4cyclictest0-21swapper/122:25:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional