You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-24 - 17:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Fri Apr 24, 2026 12:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3394396995143,4cyclictest3422214-21ls08:30:013
3394392995143,6cyclictest3417030-21kworker/u8:1+events_unbound09:09:402
3394383995144,4cyclictest3439510-21idleruntime-cro09:20:010
3394383995042,5cyclictest3459948-21munin-plugin-st10:20:000
3394387994939,6cyclictest3446719-21tune2fs09:40:151
3394396994838,7cyclictest3499135-21grep12:10:253
3394396994739,5cyclictest3463362-21latency_hist10:30:003
3394396994737,7cyclictest3497414-21grep12:05:243
3394392994741,4cyclictest3455052-21kworker/u8:1+events_unbound11:00:072
3394392994639,4cyclictest3406856-21cron07:45:012
3394387994537,5cyclictest3418785-21sh08:20:021
3394383994532,9cyclictest3468056-21grep10:40:240
3394392994431,9cyclictest3401305-21grep07:25:252
3394387994430,10cyclictest3501281-21munin-run12:20:001
3394383994426,4cyclictest131rcu_preempt08:15:220
3394396994233,5cyclictest3442897-21ls09:30:013
3394396994232,7cyclictest3414938-21grep08:05:253
3394396994230,8cyclictest3487455-21idleruntime-cro11:40:003
3394392994217,6cyclictest131rcu_preempt09:40:102
3394383994235,4cyclictest3483609-21unixbench_singl11:25:250
3394387994129,8cyclictest3454410-21grep10:00:241
3394383994127,10cyclictest3476745-21grep11:05:250
3394383994127,10cyclictest3476745-21grep11:05:250
3394396994027,9cyclictest391ktimers/310:35:143
3394396993929,7cyclictest3506136-21grep12:30:233
3394392993933,4cyclictest3494312-21kworker/u8:3+events_unbound12:30:272
3394392993827,7cyclictest3504897-21cron12:30:012
3394383993829,6cyclictest3493979-21grep11:55:240
3394383993826,8cyclictest3463360-21idleruntime-cro10:30:000
3394392993730,5cyclictest3370601-21kworker/u8:3+events_unbound07:18:422
3394392993730,5cyclictest3370601-21kworker/u8:3+events_unbound07:18:412
3394392993730,4cyclictest3459958-21sendmail10:20:012
3394392993729,4cyclictest0-21swapper/208:30:152
3394392993728,6cyclictest3465428-21fschecks_count10:35:162
3394392993713,7cyclictest32-21ksoftirqd/207:20:242
3394387993729,4cyclictest0-21swapper/109:15:241
3394387993720,14cyclictest24-21ksoftirqd/112:05:121
3394396993628,4cyclictest0-21swapper/308:15:153
3394387993626,6cyclictest3468466-21cron10:45:001
3394383993625,7cyclictest3481897-21grep11:20:250
3394383993610,7cyclictest11-21ksoftirqd/011:40:170
3394396993525,7cyclictest3454827-21sh10:05:003
3394396993525,7cyclictest3433961-21grep09:00:253
3394392993527,4cyclictest0-21swapper/207:35:012
339439299351,7cyclictest0-21swapper/208:55:112
3394392993515,7cyclictest131rcu_preempt09:50:112
339438399359,6cyclictest11-21ksoftirqd/011:15:000
339438399359,5cyclictest11-21ksoftirqd/009:00:000
339438399356,10cyclictest3409109-21if_eth107:50:170
3394383993525,7cyclictest3473322-21grep10:55:250
3394383993525,6cyclictest0-21swapper/008:30:240
3394383993524,6cyclictest0-21swapper/009:29:420
3394383993510,5cyclictest11-21ksoftirqd/012:25:010
3394396993424,6cyclictest0-21swapper/307:50:253
3394392993424,6cyclictest0-21swapper/208:05:022
3394392993419,5cyclictest3492403-21kworker/u8:1+events_unbound12:21:432
3394392993413,4cyclictest0-21swapper/210:05:152
3394392993413,4cyclictest0-21swapper/210:05:152
3394392993413,12cyclictest131rcu_preempt11:05:252
3394392993413,12cyclictest131rcu_preempt11:05:252
3394387993424,7cyclictest3432225-21unixbench_singl08:55:241
3394387993424,6cyclictest0-21swapper/111:24:591
3394383993426,5cyclictest3395591-21unixbench_singl07:10:250
3394383993426,5cyclictest3395591-21unixbench_singl07:10:240
3394383993424,7cyclictest3451407-21sh09:55:000
3394383993424,7cyclictest0-21swapper/012:20:000
3394383993420,11cyclictest121ktimers/012:05:110
3394383993411,5cyclictest3414394-21missed_timers08:05:200
339439699331,3cyclictest131rcu_preempt12:20:123
339439299339,13cyclictest32-21ksoftirqd/210:30:232
3394392993327,4cyclictest3420209-21kworker/u8:2+events_unbound08:29:312
3394392993326,5cyclictest3404835-21kworker/u8:0+events_unbound07:54:412
3394392993326,3cyclictest0-21swapper/211:35:262
3394392993325,4cyclictest0-21swapper/211:30:252
3394392993322,7cyclictest3444164-21grep09:30:252
3394392993312,3cyclictest131rcu_preempt10:00:012
3394387993324,5cyclictest0-21swapper/109:25:151
3394387993321,8cyclictest3476762-21grep11:05:251
3394387993321,8cyclictest3476762-21grep11:05:251
3394383993322,4cyclictest131rcu_preempt08:51:410
3394396993224,4cyclictest0-21swapper/310:20:243
3394396993220,9cyclictest391ktimers/309:10:123
3394392993226,4cyclictest3434374-21grep09:05:012
3394392993224,4cyclictest0-21swapper/210:49:592
3394392993214,9cyclictest131rcu_preempt10:57:032
3394392993211,11cyclictest32-21ksoftirqd/210:20:152
3394387993225,4cyclictest0-21swapper/112:20:241
3394387993225,4cyclictest0-21swapper/107:20:261
3394387993224,4cyclictest0-21swapper/112:00:221
3394387993224,4cyclictest0-21swapper/109:09:391
3394387993223,5cyclictest0-21swapper/110:45:151
3394387993222,6cyclictest0-21swapper/107:35:151
3394387993218,11cyclictest3394377-21cyclictest08:00:121
3394387993215,14cyclictest24-21ksoftirqd/111:55:121
339438399329,7cyclictest11-21ksoftirqd/010:20:120
339438399329,6cyclictest3402151-21tune2fs07:30:150
339438399329,6cyclictest11-21ksoftirqd/007:45:250
339438399329,6cyclictest11-21ksoftirqd/007:45:240
339438399329,5cyclictest11-21ksoftirqd/008:25:020
339438399328,7cyclictest0-21swapper/012:00:220
339438399328,6cyclictest0-21swapper/008:45:240
339438399328,6cyclictest0-21swapper/008:45:240
3394383993223,6cyclictest0-21swapper/007:55:160
3394396993123,4cyclictest0-21swapper/309:35:163
3394396993121,7cyclictest0-21swapper/311:55:013
3394392993125,4cyclictest3370601-21kworker/u8:3+events_unbound08:14:262
3394392993125,3cyclictest3425614-21kthreadd08:40:012
3394392993124,4cyclictest0-21swapper/207:35:252
3394392993113,11cyclictest32-21ksoftirqd/208:45:012
3394387993122,6cyclictest3507901-21grep12:35:261
339438399318,6cyclictest0-21swapper/010:50:190
3394383993123,5cyclictest3480608-21cut11:20:000
3394383993111,6cyclictest11-21ksoftirqd/009:45:340
3394383993110,6cyclictest11-21ksoftirqd/012:25:160
3394396993023,4cyclictest0-21swapper/311:45:183
3394396993022,4cyclictest0-21swapper/310:30:243
339439299309,12cyclictest32-21ksoftirqd/211:15:002
339439299309,12cyclictest32-21ksoftirqd/210:25:232
339439299309,12cyclictest32-21ksoftirqd/209:20:242
3394392993023,5cyclictest3455052-21kworker/u8:1+events_unbound10:42:422
3394392993023,4cyclictest0-21swapper/211:45:162
3394392993021,6cyclictest3445873-21unixbench_singl09:35:252
3394392993020,6cyclictest0-21swapper/212:10:252
339439299301,9cyclictest34430382sort09:30:022
3394392993010,12cyclictest32-21ksoftirqd/211:20:212
339438399308,7cyclictest0-21swapper/007:20:170
339438399308,4cyclictest11-21ksoftirqd/010:00:210
339438399302,10cyclictest3465286-21/usr/sbin/munin10:35:210
3394396992922,4cyclictest3429244-21kthreadd08:50:003
3394396992922,4cyclictest3429244-21kthreadd08:50:003
3394396992921,5cyclictest3500818-21tail12:15:243
3394396992921,5cyclictest0-21swapper/311:05:163
3394396992921,5cyclictest0-21swapper/311:05:163
3394396992921,4cyclictest0-21swapper/308:40:163
3394396992921,4cyclictest0-21swapper/307:35:253
339439299299,12cyclictest32-21ksoftirqd/207:50:002
339439299299,12cyclictest32-21ksoftirqd/207:50:002
339439299299,11cyclictest32-21ksoftirqd/212:00:142
3394392992923,4cyclictest3439134-21kworker/u8:1+events_unbound09:17:312
3394392992922,3cyclictest0-21swapper/210:00:242
3394392992919,7cyclictest3493530-21ntp_kernel_pll_11:55:212
3394392992916,3cyclictest131rcu_preempt12:35:222
339439299291,15cyclictest0-21swapper/211:25:212
3394392992910,11cyclictest32-21ksoftirqd/211:20:002
3394387992921,4cyclictest3486038-21cpuspeed11:35:131
339438399299,6cyclictest11-21ksoftirqd/009:21:590
339438399299,5cyclictest0-21swapper/009:40:220
339438399299,5cyclictest0-21swapper/008:00:190
339438399296,6cyclictest0-21swapper/009:10:220
3394383992923,3cyclictest0-21swapper/008:40:000
3394383992922,4cyclictest3422219-21idleruntime-cro08:30:010
3394383992910,16cyclictest0-21swapper/012:30:240
3394396992821,4cyclictest0-21swapper/307:20:163
3394396992820,5cyclictest0-21swapper/311:20:153
3394396992820,4cyclictest0-21swapper/311:55:253
3394396992820,4cyclictest0-21swapper/311:15:153
3394396992819,5cyclictest3478483-21grep11:10:243
3394396992819,5cyclictest0-21swapper/308:10:153
3394396992818,7cyclictest3419589-21ntp_offset08:20:203
339439299289,11cyclictest32-21ksoftirqd/210:55:002
339439299287,5cyclictest131rcu_preempt07:11:342
339439299287,5cyclictest131rcu_preempt07:11:332
339439299286,4cyclictest0-21swapper/211:51:582
3394392992819,6cyclictest0-21swapper/211:40:242
3394392992817,5cyclictest3370601-21kworker/u8:3+events_unbound08:24:282
3394392992816,6cyclictest3370601-21kworker/u8:3+events_unbound08:17:542
3394392992814,4cyclictest131rcu_preempt07:57:562
3394392992812,5cyclictest131rcu_preempt10:10:172
3394392992812,5cyclictest131rcu_preempt10:10:172
3394387992819,5cyclictest3453118-21sendmail10:00:001
3394387992817,8cyclictest3505661-21ntpq12:30:191
3394387992816,9cyclictest3400473-21grep07:25:151
339438399287,4cyclictest11-21ksoftirqd/011:35:240
339438399282,21cyclictest3453307-21latency_hist10:00:010
3394383992820,4cyclictest0-21swapper/010:35:010
3394383992815,9cyclictest121ktimers/012:10:120
3394383992810,4cyclictest11-21ksoftirqd/009:00:210
3394396992720,4cyclictest3489352-21sh11:45:003
3394396992719,4cyclictest0-21swapper/310:40:243
3394396992718,6cyclictest0-21swapper/308:35:243
3394396992718,5cyclictest0-21swapper/310:20:003
339439299277,12cyclictest131rcu_preempt08:45:252
339439299277,12cyclictest131rcu_preempt08:45:252
339439299277,11cyclictest131rcu_preempt09:45:172
339439299270,6cyclictest3497864-21cron12:10:012
3394387992720,3cyclictest0-21swapper/109:20:241
3394387992718,6cyclictest3460417-21tune2fs10:20:161
3394387992717,6cyclictest0-21swapper/110:25:241
3394387992717,6cyclictest0-21swapper/109:05:001
339438399278,5cyclictest0-21swapper/009:30:130
339438399276,6cyclictest0-21swapper/011:45:270
3394383992719,5cyclictest3492837-21date11:55:010
3394396992618,5cyclictest0-21swapper/308:55:143
3394396992618,4cyclictest0-21swapper/309:15:243
3394396992617,6cyclictest3456918-21fschecks_count10:10:163
3394396992617,6cyclictest3456918-21fschecks_count10:10:163
3394396992617,6cyclictest3430345-21cat08:50:223
3394392992613,6cyclictest32-21ksoftirqd/208:05:152
3394387992619,4cyclictest0-21swapper/107:50:211
3394387992618,4cyclictest0-21swapper/110:35:161
3394387992618,4cyclictest0-21swapper/108:40:261
3394387992618,4cyclictest0-21swapper/107:55:241
3394387992617,5cyclictest0-21swapper/107:45:011
3394387992615,8cyclictest3419965-21sed08:20:231
339438399267,5cyclictest11-21ksoftirqd/007:37:090
3394383992621,3cyclictest0-21swapper/007:15:030
3394383992621,3cyclictest0-21swapper/007:15:030
3394383992615,3cyclictest131rcu_preempt07:29:050
3394383992610,9cyclictest131rcu_preempt09:35:230
3394396992519,4cyclictest391ktimers/309:55:093
3394396992519,4cyclictest3439134-21kworker/u8:1+events_unbound09:34:453
3394396992519,3cyclictest0-21swapper/307:15:023
3394396992519,3cyclictest0-21swapper/307:15:023
3394396992518,4cyclictest0-21swapper/308:05:013
339439299258,11cyclictest32-21ksoftirqd/208:50:102
3394387992517,4cyclictest0-21swapper/111:00:001
3394387992517,4cyclictest0-21swapper/107:20:011
3394387992517,4cyclictest0-21swapper/107:20:011
3394387992515,6cyclictest0-21swapper/110:50:231
3394387992513,9cyclictest3448243-21apt-get09:45:101
3394387992513,9cyclictest3394377-21cyclictest07:45:131
3394387992513,9cyclictest3394377-21cyclictest07:45:131
339438399258,15cyclictest0-21swapper/011:00:110
339438399256,11cyclictest645-21runrttasks08:40:220
3394383992512,10cyclictest3506832-21/usr/sbin/munin12:35:110
3394383992511,5cyclictest0-21swapper/010:50:010
339438399250,6cyclictest0-21swapper/011:30:120
3394396992418,3cyclictest0-21swapper/309:20:233
3394396992416,5cyclictest0-21swapper/307:55:163
3394396992416,4cyclictest0-21swapper/309:05:253
3394396992416,4cyclictest0-21swapper/307:30:163
3394387992418,4cyclictest3455052-21kworker/u8:1+events_unbound10:15:161
3394387992418,4cyclictest3420209-21kworker/u8:2+events_unbound08:25:221
3394387992418,3cyclictest0-21swapper/111:25:181
3394387992418,3cyclictest0-21swapper/111:15:251
3394387992418,3cyclictest0-21swapper/111:00:131
3394387992417,4cyclictest0-21swapper/108:40:001
3394387992416,5cyclictest0-21swapper/109:30:241
3394387992416,3cyclictest0-21swapper/111:50:241
339438799241,12cyclictest0-21swapper/110:10:211
339438799241,12cyclictest0-21swapper/110:10:211
339438399241,19cyclictest0-21swapper/008:11:230
339438399241,12cyclictest0-21swapper/010:05:230
339438399241,12cyclictest0-21swapper/010:05:220
3394396992317,4cyclictest391ktimers/309:50:313
3394396992317,4cyclictest3447939-21kworker/u8:0+events_unbound09:44:523
3394396992317,3cyclictest0-21swapper/312:25:193
3394396992317,3cyclictest0-21swapper/312:00:203
3394396992317,3cyclictest0-21swapper/311:30:233
3394387992317,3cyclictest0-21swapper/112:15:011
3394387992317,3cyclictest0-21swapper/108:05:231
3394387992316,3cyclictest0-21swapper/111:40:161
3394387992315,5cyclictest3450079-21cut09:50:151
3394387992315,5cyclictest231ktimers/112:25:161
339438399238,6cyclictest131rcu_preempt10:10:070
339438399238,6cyclictest131rcu_preempt10:10:060
3394383992317,3cyclictest0-21swapper/009:05:160
339438399230,19cyclictest0-21swapper/007:41:280
3394396992216,3cyclictest0-21swapper/311:25:203
3394396992216,3cyclictest0-21swapper/307:45:243
3394396992216,3cyclictest0-21swapper/307:45:243
3394396992214,6cyclictest391ktimers/310:50:063
3394387992216,3cyclictest0-21swapper/107:10:221
3394387992216,3cyclictest0-21swapper/107:10:221
3394387992215,4cyclictest0-21swapper/108:30:241
3394387992214,5cyclictest0-21swapper/108:50:221
3394396992115,3cyclictest0-21swapper/310:10:003
3394396992113,6cyclictest0-21swapper/307:15:013
3394396992113,6cyclictest0-21swapper/307:15:003
3394387992114,4cyclictest3490146-21ntp_offset11:45:211
3394396992012,6cyclictest3468707-21apt-get10:45:123
3394396992011,7cyclictest3401032-21swap07:25:243
339439699201,12cyclictest0-21swapper/310:55:093
3394396992010,7cyclictest3455118-21cpuspeed10:05:123
3394387992014,4cyclictest231ktimers/109:11:011
3394387992014,3cyclictest3484353-21cstates11:30:121
3394387992012,4cyclictest3429245-21latency_hist08:50:011
3394387992012,4cyclictest3429245-21latency_hist08:50:001
3394387992011,6cyclictest0-21swapper/108:10:161
3394396991913,4cyclictest3422438-21/usr/sbin/munin08:30:163
3394396991912,5cyclictest391ktimers/311:00:133
3394387991812,3cyclictest0-21swapper/109:40:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional