You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-13 - 09:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Wed May 13, 2026 00:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2321253995949,5cyclictest2325200-21cut19:20:000
2321264995541,9cyclictest2392975-21apt-key22:35:003
2321257995522,29cyclictest2388947-21unixbench_singl22:20:261
2321257995320,5cyclictest2366106-21grep21:15:271
2321264995239,9cyclictest391ktimers/322:50:133
2321253995244,5cyclictest0-21swapper/023:55:110
2321260995143,5cyclictest2415339-21cron23:40:002
2321257994925,4cyclictest0-21swapper/122:10:261
2321253994927,17cyclictest0-21swapper/020:40:280
2321253994927,17cyclictest0-21swapper/020:40:280
2321253994810,4cyclictest2322981-21munin-node19:15:000
2321257994719,7cyclictest2392291-21grep22:30:231
2321264994633,10cyclictest391ktimers/320:15:133
2321253994632,11cyclictest121ktimers/023:25:120
2321264994534,8cyclictest391ktimers/320:55:123
2321264994532,9cyclictest2415359-21sendmail23:40:013
2321257994521,4cyclictest0-21swapper/123:50:161
2321253994535,7cyclictest2428541-21grep00:15:250
2321253994535,7cyclictest2428541-21grep00:15:250
2321264994435,6cyclictest2376816-21grep21:45:253
2321253994415,5cyclictest0-21swapper/019:40:010
2321257994335,5cyclictest204-21dbus-daemon00:18:041
2321257994335,5cyclictest204-21dbus-daemon00:18:031
2321253994335,4cyclictest2339067-21sendmail20:00:010
2321253994214,6cyclictest2347887-21sed20:25:020
2321253994115,6cyclictest2341297-21if_eth020:05:160
2321264993931,6cyclictest2420149-21kworker/u8:1+events_unbound00:03:033
2321264993931,6cyclictest2349150-21kworker/u8:0+events_unbound20:47:223
2321264993926,10cyclictest391ktimers/300:10:153
2321260993930,4cyclictest0-21swapper/220:20:002
2321260993928,7cyclictest0-21swapper/200:35:002
2321260993927,7cyclictest2335169-21grep19:45:252
2321257993931,4cyclictest0-21swapper/121:35:001
2321253993927,8cyclictest2431966-21grep00:25:270
2321264993829,6cyclictest2327540-21cut19:25:173
2321264993827,8cyclictest2394686-21grep22:40:003
2321257993827,7cyclictest2426857-21grep00:10:271
2321253993828,6cyclictest0-21swapper/023:20:000
2321253993828,6cyclictest0-21swapper/023:20:000
2321264993729,5cyclictest2339049-21munin-run20:00:013
232126499372,12cyclictest40-21ksoftirqd/321:30:143
2321260993729,5cyclictest311ktimers/220:44:312
2321260993729,5cyclictest311ktimers/220:44:302
2321253993727,6cyclictest0-21swapper/023:35:260
2321253993628,3cyclictest0-21swapper/020:50:250
2321264993527,4cyclictest2411743-21ls23:29:593
2321264993527,4cyclictest0-21swapper/323:22:533
2321264993526,4cyclictest0-21swapper/322:12:393
2321260993527,4cyclictest0-21swapper/219:10:162
2321260993524,6cyclictest2402759-21grep23:00:282
2321257993523,7cyclictest0-21swapper/121:40:001
2321253993528,4cyclictest2345870-21munin-plugin-st20:20:010
2321253993525,6cyclictest0-21swapper/000:30:260
2321253993523,7cyclictest2373800-21apt21:40:010
2321260993426,4cyclictest0-21swapper/222:20:152
2321257993426,5cyclictest2339047-21cron20:00:001
2321257993425,6cyclictest0-21swapper/121:25:011
2321253993425,6cyclictest0-21swapper/023:24:590
232125399340,30cyclictest0-21swapper/020:25:130
2321264993326,5cyclictest2386290-21kworker/u8:0+events_unbound23:17:523
2321264993326,5cyclictest2386290-21kworker/u8:0+events_unbound23:17:523
2321264993325,6cyclictest2323027-21latency_hist19:15:013
232126099335,7cyclictest32-21ksoftirqd/219:40:182
2321257993326,4cyclictest2332230-21munin-plugin-st19:40:001
2321257993325,4cyclictest0-21swapper/120:45:241
2321257993324,5cyclictest2401491-21cron23:00:001
2321257993322,6cyclictest0-21swapper/122:15:251
2321257993320,8cyclictest0-21swapper/119:50:261
2321253993322,7cyclictest2383781-21grep22:05:240
2321264993224,2cyclictest2357961-21kworker/u8:3+events_unbound22:42:463
2321260993223,6cyclictest2350788-21grep20:30:252
2321260993223,5cyclictest2406605-21cron23:14:592
2321260993222,4cyclictest0-21swapper/219:55:002
2321260993210,4cyclictest301rcuc/223:40:142
2321257993224,4cyclictest0-21swapper/121:05:231
2321257993222,5cyclictest0-21swapper/119:15:271
2321257993220,8cyclictest2399320-21grep22:50:251
2321253993220,7cyclictest2387218-21grep22:15:250
2321264993116,6cyclictest2345620-21kworker/u8:3+events_unbound20:28:413
232126499311,4cyclictest131rcu_preempt22:45:123
2321260993124,4cyclictest0-21swapper/220:10:262
2321260993122,5cyclictest0-21swapper/200:15:262
2321260993122,5cyclictest0-21swapper/200:15:262
2321257993124,4cyclictest2396397-21auditctl22:45:011
2321257993122,5cyclictest0-21swapper/122:25:151
2321253993124,3cyclictest0-21swapper/022:50:010
2321253993120,6cyclictest2363140-21cron21:10:010
2321264993023,5cyclictest2420149-21kworker/u8:1+events_unbound00:38:073
2321264993021,6cyclictest391ktimers/322:15:123
2321264993019,4cyclictest2428703-21kworker/u8:2+events_unbound00:17:223
2321264993019,4cyclictest2428703-21kworker/u8:2+events_unbound00:17:223
2321264993018,8cyclictest204-21dbus-daemon21:17:283
2321264993018,6cyclictest2370034-21kworker/u8:2+events_unbound21:29:283
232126099307,5cyclictest32-21ksoftirqd/222:40:252
232126099307,14cyclictest32-21ksoftirqd/219:25:012
2321260993024,3cyclictest0-21swapper/219:30:252
2321260993023,4cyclictest0-21swapper/221:00:162
2321260993023,4cyclictest0-21swapper/220:50:262
2321260993023,4cyclictest0-21swapper/220:00:002
2321260993022,4cyclictest0-21swapper/222:45:252
2321260993011,5cyclictest131rcu_preempt22:25:122
2321257993022,4cyclictest0-21swapper/122:05:001
2321257993020,7cyclictest438-21cron22:50:001
2321257993020,6cyclictest2322411-21grep19:10:251
2321257993020,5cyclictest0-21swapper/123:40:001
2321257993019,6cyclictest0-21swapper/119:40:231
2321253993024,3cyclictest0-21swapper/023:50:150
2321253993023,4cyclictest2368281-21latency_hist21:25:010
2321253993022,5cyclictest0-21swapper/023:35:000
2321253993018,7cyclictest2336893-21grep19:50:260
2321253993017,9cyclictest121ktimers/020:30:100
232126499298,4cyclictest0-21swapper/300:35:013
2321264992922,5cyclictest2338689-21kworker/u8:2+events_unbound21:14:423
2321264992922,4cyclictest0-21swapper/321:00:263
2321264992920,5cyclictest0-21swapper/323:00:013
2321264992914,5cyclictest2306402-21kworker/u8:1+events_unbound19:15:493
232126099296,7cyclictest32-21ksoftirqd/221:40:022
232126099295,7cyclictest32-21ksoftirqd/221:25:262
232126099294,6cyclictest2380080-21sed21:55:252
232126099294,5cyclictest301rcuc/222:05:172
2321260992921,5cyclictest0-21swapper/223:05:252
2321260992921,4cyclictest0-21swapper/223:30:242
2321260992919,7cyclictest2386520-21kernelversion22:15:172
2321260992915,6cyclictest2321244-21cyclictest20:25:232
2321260992913,9cyclictest131rcu_preempt22:03:512
2321253992921,4cyclictest2418776-21munin-plugin-st23:50:000
2321253992919,6cyclictest0-21swapper/021:50:000
2321253992918,7cyclictest2333498-21grep19:40:230
2321253992916,8cyclictest2385534-21grep22:10:250
232125399291,5cyclictest2423882-21cron00:05:000
2321253992915,10cyclictest121ktimers/021:55:120
232126499282,4cyclictest131rcu_preempt23:05:113
232126499282,4cyclictest131rcu_preempt20:30:113
2321264992821,5cyclictest2378556-21kworker/u8:2+events_unbound22:09:403
2321264992821,4cyclictest0-21swapper/323:05:003
2321264992811,8cyclictest2372326-21kworker/u8:0+events_unbound21:38:373
232126099288,6cyclictest32-21ksoftirqd/220:45:212
232126099288,5cyclictest32-21ksoftirqd/221:10:282
232126099285,6cyclictest32-21ksoftirqd/221:15:232
232126099285,5cyclictest32-21ksoftirqd/223:45:162
232126099285,5cyclictest301rcuc/200:10:262
232126099284,8cyclictest32-21ksoftirqd/200:30:002
232126099282,7cyclictest32-21ksoftirqd/220:35:202
232126099282,7cyclictest32-21ksoftirqd/220:35:192
2321260992821,4cyclictest2368314-21latency_hist21:25:002
2321260992820,3cyclictest0-21swapper/223:25:002
2321260992810,11cyclictest131rcu_preempt20:21:052
2321253992821,4cyclictest2416602-21tail23:40:260
2321253992819,6cyclictest2392849-21ls22:35:000
2321264992721,4cyclictest2372326-21kworker/u8:0+events_unbound21:52:373
2321264992720,5cyclictest2338689-21kworker/u8:2+events_unbound20:22:213
2321264992720,5cyclictest2322645-21kworker/u8:0+events_unbound19:35:153
2321264992718,6cyclictest2422168-21sh23:59:593
2321264992718,6cyclictest2416595-21grep23:40:263
2321264992718,6cyclictest2368271-21sh21:25:003
2321264992718,6cyclictest0-21swapper/319:30:173
2321264992712,6cyclictest2349150-21kworker/u8:0+events_unbound20:35:303
2321264992712,6cyclictest2349150-21kworker/u8:0+events_unbound20:35:303
2321264992711,4cyclictest381rcuc/300:30:013
232126099279,11cyclictest131rcu_preempt00:05:232
232126099278,12cyclictest131rcu_preempt21:30:262
2321260992720,4cyclictest0-21swapper/200:35:262
2321260992719,4cyclictest0-21swapper/223:25:272
2321260992712,8cyclictest131rcu_preempt21:45:182
2321257992720,4cyclictest0-21swapper/120:45:001
2321257992720,4cyclictest0-21swapper/120:45:001
2321257992720,3cyclictest0-21swapper/121:25:201
2321257992719,4cyclictest0-21swapper/100:30:261
2321257992718,5cyclictest2377218-21apt21:50:011
2321257992716,8cyclictest2435831-21tr00:40:011
2321257992716,7cyclictest0-21swapper/121:50:251
2321253992721,3cyclictest0-21swapper/022:40:000
2321253992720,4cyclictest2402099-21kernelversion23:00:200
2321253992718,4cyclictest0-21swapper/021:15:260
2321253992713,11cyclictest121ktimers/021:00:140
232126499262,5cyclictest2340994-21apt-get20:05:123
2321264992619,5cyclictest2409884-21kworker/u8:3+events_unbound23:32:103
2321264992619,5cyclictest2357961-21kworker/u8:3+events_unbound21:42:483
2321264992619,5cyclictest2329049-21kworker/u8:3+events_unbound19:40:243
2321264992617,7cyclictest2338689-21kworker/u8:2+events_unbound20:44:453
2321264992617,7cyclictest2338689-21kworker/u8:2+events_unbound20:44:453
232126499261,3cyclictest0-21swapper/323:50:193
232126499261,12cyclictest0-21swapper/320:14:283
232126099264,7cyclictest32-21ksoftirqd/219:15:022
2321260992617,6cyclictest311ktimers/200:20:222
2321260992617,6cyclictest311ktimers/200:20:222
2321260992613,4cyclictest131rcu_preempt00:00:222
2321257992620,3cyclictest0-21swapper/120:20:011
2321257992620,3cyclictest0-21swapper/119:25:011
2321253992619,5cyclictest121ktimers/019:45:120
2321253992618,5cyclictest0-21swapper/023:00:000
2321253992618,4cyclictest0-21swapper/019:25:000
232125399261,6cyclictest2381651-21ntp_states22:00:230
2321264992516,6cyclictest2389778-21tune2fs22:25:163
2321264992515,7cyclictest0-21swapper/319:45:243
2321264992512,5cyclictest2349150-21kworker/u8:0+events_unbound20:52:223
232126499251,12cyclictest0-21swapper/320:03:093
232126499251,12cyclictest0-21swapper/320:03:093
232126499250,13cyclictest2430333-21runrttasks00:20:343
232126499250,13cyclictest2430333-21runrttasks00:20:333
232126099258,3cyclictest131rcu_preempt23:55:102
232126099254,6cyclictest32-21ksoftirqd/219:35:132
232126099254,5cyclictest32-21ksoftirqd/223:15:162
232126099254,5cyclictest32-21ksoftirqd/223:15:162
2321260992519,3cyclictest0-21swapper/222:55:172
2321260992519,3cyclictest0-21swapper/222:10:142
2321260992519,3cyclictest0-21swapper/221:00:002
2321260992518,4cyclictest0-21swapper/221:40:162
232126099251,6cyclictest32-21ksoftirqd/222:50:152
2321260992515,7cyclictest311ktimers/222:30:462
2321260992514,5cyclictest131rcu_preempt22:35:222
2321260992514,4cyclictest131rcu_preempt19:21:002
232126099251,21cyclictest2419714-21cut23:50:232
2321260992510,4cyclictest131rcu_preempt21:07:482
2321257992518,4cyclictest2429457-21grep00:20:171
2321257992518,4cyclictest2429457-21grep00:20:171
2321257992517,5cyclictest2421709-21unixbench_multi23:55:251
2321257992517,4cyclictest2341153-21fschecks_count20:05:161
2321257992516,5cyclictest0-21swapper/122:05:151
2321257992513,9cyclictest0-21swapper/122:00:001
2321253992518,3cyclictest13550irq/42-30be0000.ethernet22:30:010
2321253992518,3cyclictest0-21swapper/000:35:560
2321253992517,4cyclictest0-21swapper/023:10:000
2321253992516,6cyclictest2375545-21grep21:45:000
2321253992515,6cyclictest0-21swapper/000:09:180
2321264992417,5cyclictest2372326-21kworker/u8:0+events_unbound21:57:453
2321264992416,6cyclictest2320889-21kworker/u8:3+events_unbound19:20:263
232126499241,14cyclictest0-21swapper/322:24:113
232126499241,12cyclictest0-21swapper/300:05:243
232126099243,7cyclictest32-21ksoftirqd/220:05:192
232126099241,4cyclictest0-21swapper/220:00:212
232126099241,4cyclictest0-21swapper/220:00:202
2321257992418,3cyclictest0-21swapper/100:00:251
2321257992416,4cyclictest2328827-21ls19:30:011
2321257992416,4cyclictest0-21swapper/120:22:181
2321257992415,6cyclictest2393441-21tune2fs22:35:171
2321257992411,10cyclictest2359750-21tr21:00:011
2321253992417,3cyclictest0-21swapper/019:30:230
2321253992416,4cyclictest0-21swapper/021:27:320
2321253992413,7cyclictest2378466-21grep21:50:250
232125399241,19cyclictest0-21swapper/023:14:130
232125399241,19cyclictest0-21swapper/022:51:450
232125399241,19cyclictest0-21swapper/022:41:580
232125399241,19cyclictest0-21swapper/020:35:070
232125399241,19cyclictest0-21swapper/020:35:060
232125399241,19cyclictest0-21swapper/020:02:440
232125399241,19cyclictest0-21swapper/020:02:430
2321264992317,4cyclictest2409884-21kworker/u8:3+events_unbound23:47:403
2321264992317,4cyclictest2386290-21kworker/u8:0+events_unbound23:10:393
2321260992312,3cyclictest131rcu_preempt21:50:262
232125799237,10cyclictest2375116-21unixbench_singl21:40:241
2321257992317,3cyclictest0-21swapper/123:00:251
2321257992317,3cyclictest0-21swapper/119:45:151
2321257992316,4cyclictest0-21swapper/120:35:171
2321257992316,4cyclictest0-21swapper/120:35:171
2321257992316,3cyclictest0-21swapper/123:20:221
2321257992314,6cyclictest23502722sleep120:30:211
2321257992313,7cyclictest2405673-21grep23:10:231
2321253992317,2cyclictest0-21swapper/019:26:150
2321253992316,3cyclictest0-21swapper/020:48:100
2321253992316,3cyclictest0-21swapper/020:14:300
2321253992315,4cyclictest0-21swapper/020:55:260
2321253992312,8cyclictest2371373-21sed21:30:270
232125399231,18cyclictest0-21swapper/022:21:040
232125399231,18cyclictest0-21swapper/000:23:050
232125399231,18cyclictest0-21swapper/000:23:050
232125399230,19cyclictest0-21swapper/000:12:280
2321257992216,3cyclictest0-21swapper/123:15:241
2321257992216,3cyclictest0-21swapper/123:15:241
2321257992216,3cyclictest0-21swapper/120:25:211
2321257992215,4cyclictest0-21swapper/100:05:261
2321257992213,5cyclictest0-21swapper/121:15:001
2321257992212,6cyclictest0-21swapper/123:30:001
2321257992211,8cyclictest2343713-21grep20:10:271
2321253992217,3cyclictest13550irq/42-30be0000.ethernet21:10:200
2321257992115,3cyclictest0-21swapper/120:00:161
2321257992115,3cyclictest0-21swapper/120:00:161
2321257992114,3cyclictest0-21swapper/123:05:251
2321257992014,3cyclictest2358133-21latency_hist20:55:011
2321257992014,3cyclictest0-21swapper/100:25:171
2321257992010,7cyclictest2418347-21grep23:45:241
2321257992010,7cyclictest0-21swapper/121:00:231
2321257992010,6cyclictest2330516-21cron19:35:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional