You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-20 - 12:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Fri Mar 20, 2026 00:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1184557995728,25cyclictest1272056-21cut23:20:001
1184557995626,4cyclictest0-21swapper/121:30:171
1184557995224,23cyclictest0-21swapper/120:30:261
1184564994840,5cyclictest1223247-21run-parts21:00:013
1184557994820,5cyclictest0-21swapper/122:50:241
1184557994818,6cyclictest0-21swapper/122:45:241
1184557994536,5cyclictest1245801-21unixbench_multi22:00:251
1184564994434,7cyclictest1200651-21cut19:55:003
1184557994331,8cyclictest438-21cron22:10:011
1184564994235,5cyclictest1223161-21kworker/u8:1+events_unbound22:02:583
1184564994030,6cyclictest1209167-21apt-get20:20:003
1184561994028,7cyclictest0-21swapper/223:58:212
1184561994019,7cyclictest131rcu_preempt21:25:122
1184557994032,5cyclictest1241158-21cut21:50:011
1184557994029,7cyclictest0-21swapper/100:10:241
1184564993932,4cyclictest1263969-21fschecks_time22:55:153
1184561993929,6cyclictest1242428-21grep21:50:252
1184557993826,7cyclictest0-21swapper/119:15:001
1184557993825,8cyclictest0-21swapper/122:20:241
1184564993730,4cyclictest0-21swapper/321:45:003
1184564993719,5cyclictest1226621-21kworker/u8:2+events_unbound21:11:483
1184557993729,5cyclictest1291392-21fschecks_count00:15:161
1184557993726,7cyclictest0-21swapper/120:20:261
1184557993726,7cyclictest0-21swapper/120:20:261
1184552993731,4cyclictest1228781-21sh21:15:000
1184564993618,5cyclictest1216060-21kworker/u8:0+events_unbound20:47:383
1184561993625,7cyclictest1297602-21grep00:30:262
1184561993529,4cyclictest1280513-21kworker/u8:3+events_unbound00:28:252
1184557993528,4cyclictest1228784-21kthreadd21:15:001
1184557993527,4cyclictest0-21swapper/123:39:591
1184557993525,6cyclictest0-21swapper/122:30:011
1184557993525,6cyclictest0-21swapper/122:30:011
1184557993525,6cyclictest0-21swapper/119:15:251
1184564993426,3cyclictest0-21swapper/323:50:153
1184564993424,7cyclictest1206993-21grep20:10:273
1184564993421,8cyclictest1232415-21apt21:25:013
1184564993417,4cyclictest131rcu_preempt00:15:123
1184561993427,5cyclictest1280513-21kworker/u8:3+events_unbound23:53:202
1184561993426,4cyclictest0-21swapper/221:10:012
1184561993424,7cyclictest1228779-21sh21:15:002
1184561993423,6cyclictest0-21swapper/223:15:002
1184561993421,9cyclictest0-21swapper/221:20:002
1184561993421,10cyclictest311ktimers/219:20:112
1184557993427,4cyclictest1202364-21sendmail20:00:011
1184557993426,4cyclictest0-21swapper/119:40:241
1184557993424,6cyclictest0-21swapper/100:10:011
1184552993428,3cyclictest0-21swapper/021:40:000
1184564993326,5cyclictest1251008-21kworker/u8:0+events_unbound22:18:043
1184564993326,4cyclictest1278889-21sendmail23:40:003
1184564993323,5cyclictest0-21swapper/321:55:013
1184561993326,4cyclictest0-21swapper/219:40:152
1184561993320,8cyclictest1235393-21grep21:30:272
1184557993326,5cyclictest1193662-21kworker/u8:3+events_unbound20:17:331
1184557993324,6cyclictest0-21swapper/119:30:021
1184557993324,4cyclictest0-21swapper/122:45:001
1184557993321,7cyclictest0-21swapper/123:45:261
1184552993322,8cyclictest1203600-21unixbench_multi20:00:270
1184564993226,4cyclictest1193662-21kworker/u8:3+events_unbound19:44:423
1184564993225,3cyclictest0-21swapper/300:10:143
1184564993224,4cyclictest0-21swapper/319:15:253
1184564993221,8cyclictest381rcuc/321:25:143
118456199324,4cyclictest131rcu_preempt20:05:122
1184561993224,4cyclictest0-21swapper/222:43:072
1184561993223,5cyclictest208-21systemd-logind20:47:382
1184561993222,7cyclictest1209268-21sort20:20:012
1184557993224,4cyclictest0-21swapper/123:25:001
1184557993224,3cyclictest0-21swapper/123:10:001
1184557993222,6cyclictest0-21swapper/120:45:011
1184552993222,6cyclictest1209188-21sendmail20:20:000
1184552993220,7cyclictest1193392-21grep19:30:240
1184564993123,4cyclictest0-21swapper/321:55:263
118456499311,8cyclictest12209792grep20:50:263
1184564993116,6cyclictest1190022-21kworker/u8:1+events_unbound19:30:113
1184564993114,8cyclictest1223161-21kworker/u8:1+events_unbound22:05:023
1184561993124,5cyclictest1244224-21kworker/u8:3+events_unbound23:02:312
1184561993124,3cyclictest0-21swapper/222:50:152
1184561993123,5cyclictest0-21swapper/222:20:252
1184561993123,5cyclictest0-21swapper/222:15:252
1184561993122,4cyclictest0-21swapper/220:37:362
1184561993121,7cyclictest1231125-21tune2fs21:20:162
1184561993119,4cyclictest1193662-21kworker/u8:3+events_unbound19:56:172
1184557993119,8cyclictest0-21swapper/122:00:001
1184552993123,6cyclictest121ktimers/022:05:120
1184552993123,4cyclictest0-21swapper/020:05:250
118456499303,18cyclictest40-21ksoftirqd/323:25:113
118456499303,18cyclictest40-21ksoftirqd/323:25:113
118456499301,5cyclictest0-21swapper/321:00:163
1184561993023,5cyclictest1230308-21kworker/u8:3+events_unbound21:42:412
1184561993023,4cyclictest0-21swapper/221:55:262
1184561993023,3cyclictest0-21swapper/220:40:162
1184561993021,7cyclictest311ktimers/219:35:112
1184561993020,6cyclictest0-21swapper/220:55:002
1184561993019,6cyclictest0-21swapper/223:20:242
118456199301,26cyclictest1244939-21fschecks_count22:00:162
1184557993022,4cyclictest0-21swapper/100:40:011
1184557993021,6cyclictest0-21swapper/100:05:001
1184552993023,4cyclictest0-21swapper/019:25:000
1184552993019,8cyclictest1258406-21cron22:40:010
1184552993010,17cyclictest0-21swapper/020:45:010
1184564992922,5cyclictest1261602-21kworker/u8:2+events_unbound22:49:193
1184564992922,5cyclictest1230308-21kworker/u8:3+events_unbound21:35:103
1184564992921,6cyclictest1213424-21kworker/u8:3+events_unbound20:34:423
1184564992920,6cyclictest0-21swapper/322:45:013
1184564992917,7cyclictest1230491-21sh21:20:013
118456499291,5cyclictest0-21swapper/300:30:113
1184564992915,5cyclictest1238212-21kworker/u8:2+events_unbound22:25:123
1184564992915,5cyclictest1238212-21kworker/u8:2+events_unbound22:25:123
1184564992912,4cyclictest1184400-21kworker/u8:0+events_freezable_power_19:10:243
1184561992923,4cyclictest1278716-21kworker/u8:0+events_unbound23:48:402
1184561992920,4cyclictest0-21swapper/200:05:242
1184557992921,5cyclictest1219840-21idleruntime-cro20:50:011
1184557992921,5cyclictest0-21swapper/120:35:261
1184557992921,4cyclictest0-21swapper/123:25:221
1184557992921,4cyclictest0-21swapper/123:25:221
1184557992921,4cyclictest0-21swapper/121:00:141
1184557992920,7cyclictest1283995-21cut23:55:011
1184557992919,6cyclictest0-21swapper/120:50:261
1184557992919,6cyclictest0-21swapper/119:50:011
1184557992919,6cyclictest0-21swapper/100:25:251
1184552992921,4cyclictest1289114-21audit_send_reply00:10:000
1184552992920,6cyclictest0-21swapper/019:45:150
1184552992910,7cyclictest1195594-21cut19:40:010
118456499288,12cyclictest40-21ksoftirqd/319:35:233
1184564992821,4cyclictest1235808-21cron21:35:003
1184564992820,6cyclictest1193662-21kworker/u8:3+events_unbound20:00:423
118456499281,8cyclictest0-21swapper/320:35:113
1184564992817,7cyclictest1241146-21sh21:50:013
1184564992817,7cyclictest0-21swapper/320:25:013
1184564992817,7cyclictest0-21swapper/320:25:003
118456499281,6cyclictest0-21swapper/323:05:113
1184564992815,9cyclictest1289121-21basename00:10:013
1184561992822,2cyclictest1216060-21kworker/u8:0+events_unbound21:02:432
1184561992821,5cyclictest1261602-21kworker/u8:2+events_unbound23:07:192
1184561992820,5cyclictest0-21swapper/219:30:002
1184561992819,6cyclictest1256698-21sh22:35:002
1184561992818,6cyclictest0-21swapper/222:50:012
1184561992817,6cyclictest0-21swapper/223:40:242
1184561992811,8cyclictest131rcu_preempt00:20:172
1184561992811,8cyclictest131rcu_preempt00:20:162
1184557992820,5cyclictest1257975-21unixbench_singl22:35:251
1184557992818,7cyclictest1230058-21grep21:15:251
1184557992818,6cyclictest0-21swapper/119:30:141
1184557992818,6cyclictest0-21swapper/119:25:011
1184557992817,7cyclictest0-21swapper/121:40:261
1184557992817,7cyclictest0-21swapper/119:50:241
118455299289,16cyclictest1296434-21date00:30:000
1184552992821,4cyclictest0-21swapper/023:55:260
1184552992820,6cyclictest121ktimers/023:25:130
1184552992820,6cyclictest121ktimers/023:25:130
1184552992820,5cyclictest0-21swapper/022:05:000
1184552992819,6cyclictest1225229-21cat21:05:000
1184552992819,6cyclictest0-21swapper/021:00:010
1184552992817,8cyclictest121ktimers/021:40:120
1184552992817,7cyclictest1218498-21grep20:45:150
1184552992816,9cyclictest1297528-21grep00:30:250
1184564992720,3cyclictest0-21swapper/319:47:263
1184564992719,4cyclictest0-21swapper/323:15:253
1184564992719,4cyclictest0-21swapper/322:30:253
1184564992719,4cyclictest0-21swapper/319:20:243
1184564992710,6cyclictest40-21ksoftirqd/322:35:253
1184561992721,4cyclictest1208813-21kworker/u8:0+events_unbound20:26:422
1184561992720,5cyclictest1190022-21kworker/u8:1+events_unbound19:32:242
1184561992717,6cyclictest0-21swapper/222:25:262
1184561992717,6cyclictest0-21swapper/222:25:262
1184561992717,6cyclictest0-21swapper/200:15:252
1184561992716,7cyclictest0-21swapper/219:15:022
1184557992718,6cyclictest0-21swapper/121:10:011
1184557992718,6cyclictest0-21swapper/120:55:251
1184557992717,6cyclictest0-21swapper/121:55:001
1184557992716,8cyclictest1237087-21grep21:35:251
1184552992722,3cyclictest13550irq/42-30be0000.ethernet19:10:210
1184552992717,7cyclictest1254999-21seq22:30:000
1184552992717,7cyclictest1254999-21seq22:30:000
1184552992716,7cyclictest1230508-21sendmail21:20:010
118455299271,10cyclictest1250921-21sed22:15:250
118456499268,4cyclictest0-21swapper/319:30:013
118456499266,10cyclictest40-21ksoftirqd/300:20:173
118456499266,10cyclictest40-21ksoftirqd/300:20:173
1184564992619,5cyclictest1289070-21kworker/u8:2+events_unbound00:35:173
1184564992619,5cyclictest1268551-21kworker/u8:1+events_unbound00:04:393
1184564992619,5cyclictest1216060-21kworker/u8:0+events_unbound20:40:133
1184564992618,5cyclictest1244224-21kworker/u8:3+events_unbound22:51:563
1184564992618,4cyclictest0-21swapper/320:25:173
1184564992617,7cyclictest1265195-21kworker/u8:0+events_unbound23:01:423
1184564992615,8cyclictest1285694-21cron00:00:013
1184564992612,5cyclictest1268551-21kworker/u8:1+events_unbound23:31:163
118456499260,14cyclictest1296194-21runrttasks00:28:143
1184561992619,5cyclictest1244224-21kworker/u8:3+events_unbound23:34:422
1184561992619,5cyclictest1197477-21kworker/u8:2+events_unbound20:30:142
1184561992616,6cyclictest0-21swapper/221:45:252
1184561992616,6cyclictest0-21swapper/220:20:262
1184561992616,6cyclictest0-21swapper/220:20:252
1184561992613,7cyclictest32-21ksoftirqd/222:05:252
1184561992612,11cyclictest32-21ksoftirqd/223:25:172
1184561992612,11cyclictest32-21ksoftirqd/223:25:172
1184557992616,6cyclictest0-21swapper/100:00:001
1184552992619,4cyclictest1280126-21tail23:40:230
1184552992618,5cyclictest0-21swapper/023:19:590
1184552992618,4cyclictest0-21swapper/021:50:200
1184552992617,5cyclictest1261830-21munin-plugin-st22:50:000
1184552992614,8cyclictest204-21dbus-daemon19:42:250
118455299260,7cyclictest1244539-21taskset21:59:590
118456499255,12cyclictest1175944-21kworker/3:1-mm_percpu_wq20:09:593
1184564992519,4cyclictest1261602-21kworker/u8:2+events_unbound23:42:263
1184564992513,5cyclictest131rcu_preempt22:20:173
1184561992517,4cyclictest0-21swapper/200:00:282
1184561992515,6cyclictest0-21swapper/220:00:252
1184561992514,7cyclictest0-21swapper/223:35:252
1184557992517,5cyclictest0-21swapper/119:35:211
1184557992517,4cyclictest0-21swapper/122:15:241
118455299252,21cyclictest0-21swapper/023:14:220
1184552992519,3cyclictest0-21swapper/021:30:260
1184552992518,4cyclictest1299350-21unixbench_singl00:35:260
1184552992518,4cyclictest0-21swapper/023:50:150
1184552992518,3cyclictest0-21swapper/021:30:010
118455299251,20cyclictest0-21swapper/023:38:020
118455299251,10cyclictest1202335-21cron20:00:010
118456499249,3cyclictest131rcu_preempt19:55:223
1184564992417,5cyclictest1268551-21kworker/u8:1+events_unbound23:48:433
1184564992417,3cyclictest0-21swapper/322:10:133
1184561992418,4cyclictest1200068-21timerandwakeup19:50:232
1184561992417,3cyclictest0-21swapper/219:20:012
1184561992416,6cyclictest1280513-21kworker/u8:3+events_unbound00:12:242
118455799242,4cyclictest1203155-21ntp_states20:00:231
1184557992414,5cyclictest0-21swapper/120:10:261
1184557992413,7cyclictest204-21dbus-daemon23:43:181
118455299243,6cyclictest1259729-21users22:40:260
1184552992419,3cyclictest1272512-21fschecks_time23:20:150
1184552992418,4cyclictest1213424-21kworker/u8:3+events_unbound20:32:320
1184552992418,3cyclictest1294728-21latency_hist00:25:010
1184552992418,3cyclictest0-21swapper/000:10:230
1184552992417,3cyclictest0-21swapper/020:27:390
1184552992416,5cyclictest1267342-21fschecks_count23:05:150
1184552992416,3cyclictest0-21swapper/022:50:230
1184552992414,7cyclictest1287403-21sh00:05:010
1184552992413,7cyclictest1215733-21grep20:35:240
118455299241,20cyclictest1186535-21munin-node19:15:020
118455299241,19cyclictest0-21swapper/022:21:530
1184564992316,4cyclictest0-21swapper/321:05:153
1184561992317,4cyclictest1237525-21grep21:40:012
1184561992317,3cyclictest0-21swapper/220:10:152
1184561992316,5cyclictest1197477-21kworker/u8:2+events_unbound19:45:152
1184561992314,6cyclictest1263985-21tune2fs22:55:162
1184557992317,3cyclictest0-21swapper/100:20:161
1184557992317,3cyclictest0-21swapper/100:20:151
1184557992315,5cyclictest0-21swapper/121:25:241
1184557992314,6cyclictest0-21swapper/100:30:261
1184552992319,2cyclictest0-21swapper/021:20:240
1184552992317,4cyclictest645-21runrttasks23:00:130
1184552992317,3cyclictest0-21swapper/021:05:260
1184552992315,5cyclictest0-21swapper/000:20:000
118455299231,18cyclictest0-21swapper/022:58:450
118455299231,18cyclictest0-21swapper/022:33:040
118455299230,19cyclictest0-21swapper/020:22:510
118455299230,19cyclictest0-21swapper/020:22:510
118455299230,19cyclictest0-21swapper/019:26:050
118455299230,19cyclictest0-21swapper/000:20:100
1184564992216,4cyclictest391ktimers/323:10:113
1184564992216,3cyclictest0-21swapper/323:20:113
1184561992216,3cyclictest0-21swapper/222:35:192
1184561992213,6cyclictest1299765-21ls00:40:012
1184557992212,7cyclictest1265245-21tr23:00:011
118455299220,18cyclictest0-21swapper/023:46:300
118455299220,18cyclictest0-21swapper/022:12:140
118455299220,18cyclictest0-21swapper/020:13:240
1184557992111,7cyclictest1-21systemd23:33:151
118455299211,3cyclictest0-21swapper/019:50:550
1184557992013,4cyclictest0-21swapper/123:10:191
1184561991912,4cyclictest0-21swapper/222:10:242
1184557991913,4cyclictest231ktimers/123:03:391
1184557991912,3cyclictest0-21swapper/121:20:161
1184557991811,5cyclictest231ktimers/120:05:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional