You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-05 - 00:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Tue Aug 04, 2026 12:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2480309995446,4cyclictest2487673-21munin-plugin-st07:30:002
2480309995446,4cyclictest2487673-21munin-plugin-st07:30:002
2480301994638,4cyclictest0-21swapper/011:40:010
2480309994534,7cyclictest2592567-21grep12:30:252
2480309994534,5cyclictest2494472-21kworker/u8:0+events_unbound07:54:052
2480306994538,5cyclictest2556676-21kworker/u8:1+events_unbound11:09:371
2480309994332,8cyclictest311ktimers/210:30:122
2480306994337,3cyclictest2501320-21munin-plugin-st08:10:011
2480314994134,4cyclictest2537559-21grep09:50:273
2480309994134,5cyclictest2592775-21kworker/u8:0+events_unbound12:39:462
2480309994133,4cyclictest2489355-21cron07:35:002
2480314994030,7cyclictest2491059-21sh07:40:013
2480309994033,5cyclictest2482769-21kworker/u8:3+events_unbound07:39:052
2480309994031,6cyclictest2573535-21unixbench_multi11:35:272
2480309994029,8cyclictest311ktimers/212:25:132
2480306994027,9cyclictest231ktimers/109:40:121
2480306994024,5cyclictest131rcu_preempt10:45:301
2480309993930,5cyclictest2529244-21ls09:30:012
248030999391,15cyclictest0-21swapper/209:10:152
2480306993830,6cyclictest231ktimers/109:30:121
2480306993820,4cyclictest2532827-21kworker/u8:2-events_freezable_power_09:53:141
2480301993830,4cyclictest2499489-21kworker/u8:0-ext4-rsv-conversion08:20:010
2480309993718,6cyclictest2518452-21kworker/u8:2+events_unbound08:57:562
2480306993731,4cyclictest2506109-21kworker/u8:1+events_unbound08:34:141
2480306993729,4cyclictest2581037-21munin-plugin-st11:59:591
2480306993727,7cyclictest2552001-21fschecks_count10:35:191
2480306993726,5cyclictest131rcu_preempt07:40:271
2480306993715,5cyclictest131rcu_preempt11:20:141
2480314993626,8cyclictest2572339-21apt-config11:35:003
2480314993626,8cyclictest2572339-21apt-config11:35:003
2480314993626,7cyclictest391ktimers/308:40:133
2480309993628,4cyclictest2506584-21latency_hist08:25:012
248030999361,8cyclictest0-21swapper/211:20:142
2480309993615,11cyclictest131rcu_preempt12:00:252
2480306993625,5cyclictest0-21swapper/109:10:181
2480314993528,4cyclictest0-21swapper/310:50:003
2480309993525,6cyclictest2555036-21cron10:45:012
2480309993523,9cyclictest311ktimers/209:45:132
2480306993517,3cyclictest131rcu_preempt12:15:121
2480306993515,10cyclictest131rcu_preempt12:05:211
2480306993514,11cyclictest131rcu_preempt07:38:121
2480301993528,5cyclictest2482769-21kworker/u8:3+events_unbound07:44:050
2480301993528,4cyclictest2581042-21sendmail11:59:590
248030199350,31cyclictest0-21swapper/011:20:150
2480309993424,7cyclictest2492779-21sh07:45:022
2480309993423,6cyclictest0-21swapper/211:25:272
2480309993423,6cyclictest0-21swapper/211:25:262
2480309993419,8cyclictest131rcu_preempt11:05:132
2480309993418,6cyclictest2481647-21kworker/u8:2+events_unbound07:14:282
248030999341,5cyclictest131rcu_preempt10:45:112
2480306993428,4cyclictest2462480-21kworker/u8:1+events_unbound07:18:411
2480306993427,5cyclictest221rcuc/109:35:201
2480306993423,5cyclictest0-21swapper/111:35:281
2480306993421,5cyclictest2514997-21kworker/u8:0+events_unbound09:08:231
2480306993421,4cyclictest131rcu_preempt12:26:141
2480306993418,3cyclictest131rcu_preempt09:05:011
2480306993417,9cyclictest131rcu_preempt08:35:451
2480306993413,8cyclictest24-21ksoftirqd/108:25:131
2480306993411,5cyclictest131rcu_preempt09:55:251
2480301993423,7cyclictest2502555-21grep08:10:260
2480301993422,7cyclictest0-21swapper/008:55:260
248030199340,32cyclictest0-21swapper/010:10:120
2480309993325,4cyclictest0-21swapper/209:50:282
2480309993324,6cyclictest2584460-21basename12:09:592
248030699339,15cyclictest24-21ksoftirqd/108:50:181
2480306993321,8cyclictest231ktimers/111:00:001
2480306993318,3cyclictest131rcu_preempt07:30:261
2480306993316,9cyclictest131rcu_preempt10:30:221
2480306993316,7cyclictest2542936-21kworker/u8:0+events_unbound10:25:551
2480306993316,5cyclictest131rcu_preempt11:05:001
2480306993314,4cyclictest131rcu_preempt09:45:141
2480306993313,12cyclictest131rcu_preempt11:45:001
2480301993328,3cyclictest2561854-21kworker/u8:0+events_unbound11:14:360
2480301993327,4cyclictest2562656-21ntp_offset11:05:210
2480301993325,4cyclictest0-21swapper/008:40:000
2480314993224,4cyclictest0-21swapper/312:10:263
2480314993224,4cyclictest0-21swapper/312:10:263
2480314993222,7cyclictest2529452-21latency_hist09:30:003
2480314993221,7cyclictest0-21swapper/311:40:013
248030999328,5cyclictest131rcu_preempt10:20:112
2480309993225,4cyclictest2544651-21kworker/u8:2+events_unbound10:15:212
2480309993225,3cyclictest0-21swapper/210:35:282
2480309993224,4cyclictest0-21swapper/212:14:432
2480309993224,4cyclictest0-21swapper/212:14:432
2480309993217,6cyclictest131rcu_preempt08:15:132
2480306993224,4cyclictest2589141-21grep12:20:261
2480306993224,4cyclictest2529447-21latency_hist09:30:011
2480306993223,5cyclictest0-21swapper/107:30:011
2480306993223,5cyclictest0-21swapper/107:30:011
2480306993221,8cyclictest231ktimers/108:40:231
2480306993221,5cyclictest131rcu_preempt10:15:081
2480306993220,8cyclictest231ktimers/112:05:001
2480306993220,8cyclictest231ktimers/110:50:131
2480306993220,5cyclictest131rcu_preempt07:50:141
2480306993215,4cyclictest131rcu_preempt10:05:121
2480306993215,4cyclictest131rcu_preempt10:05:121
2480306993212,5cyclictest131rcu_preempt12:33:081
2480306993211,5cyclictest131rcu_preempt11:40:181
2480306993211,5cyclictest131rcu_preempt11:33:391
2480306993211,5cyclictest131rcu_preempt11:33:391
2480306993210,15cyclictest24-21ksoftirqd/108:20:251
2480301993225,5cyclictest2482769-21kworker/u8:3+events_unbound07:49:050
2480301993224,5cyclictest2556310-21unixbench_singl10:45:260
2480301993223,5cyclictest0-21swapper/009:30:000
2480301993222,6cyclictest0-21swapper/009:05:000
2480314993124,3cyclictest0-21swapper/312:30:003
2480314993123,4cyclictest2581039-21grep11:59:593
2480309993125,4cyclictest2539438-21kworker/u8:0+events_unbound10:00:242
2480309993123,4cyclictest0-21swapper/209:35:262
2480309993122,6cyclictest2564789-21grep11:10:242
2480309993120,8cyclictest438-21cron07:50:002
2480309993120,7cyclictest2520503-21basename09:05:012
248030699319,5cyclictest131rcu_preempt07:22:131
2480306993121,4cyclictest131rcu_preempt08:00:181
2480306993119,4cyclictest131rcu_preempt11:29:231
2480306993119,4cyclictest131rcu_preempt11:29:231
2480306993116,8cyclictest131rcu_preempt12:35:241
2480306993116,4cyclictest131rcu_preempt11:50:041
2480306993115,9cyclictest131rcu_preempt08:55:181
2480306993115,5cyclictest131rcu_preempt08:15:241
2480306993113,11cyclictest131rcu_preempt07:10:131
2480306993111,13cyclictest131rcu_preempt10:20:251
248030199314,5cyclictest131rcu_preempt07:25:150
248030199314,5cyclictest131rcu_preempt07:25:150
2480301993124,4cyclictest0-21swapper/010:55:280
2480314993023,3cyclictest0-21swapper/308:00:273
2480314993022,4cyclictest0-21swapper/310:50:263
2480309993024,3cyclictest0-21swapper/209:15:282
2480309993023,4cyclictest2543101-21latency_hist10:10:002
2480309993023,4cyclictest2543101-21latency_hist10:09:592
2480309993022,4cyclictest0-21swapper/208:50:172
2480309993021,5cyclictest0-21swapper/211:00:262
2480309993021,5cyclictest0-21swapper/210:00:002
2480309993019,8cyclictest2508346-21idleruntime-cro08:30:012
248030699309,11cyclictest2493145-21/usr/sbin/munin07:45:181
248030699303,14cyclictest24-21ksoftirqd/109:20:171
2480306993020,7cyclictest231ktimers/111:15:181
2480306993020,7cyclictest231ktimers/109:20:011
2480306993014,9cyclictest131rcu_preempt12:10:151
2480306993014,9cyclictest131rcu_preempt12:10:141
2480306993014,9cyclictest131rcu_preempt08:12:301
2480306993014,4cyclictest131rcu_preempt10:41:071
2480306993013,10cyclictest131rcu_preempt11:10:221
2480306993012,5cyclictest131rcu_preempt08:45:231
2480306993011,6cyclictest131rcu_preempt07:55:191
2480301993024,3cyclictest0-21swapper/011:20:000
2480314992922,4cyclictest2497895-21munin-run08:00:013
2480314992921,4cyclictest0-21swapper/311:25:273
2480314992921,4cyclictest0-21swapper/311:25:273
2480309992922,3cyclictest0-21swapper/211:30:252
2480309992922,3cyclictest0-21swapper/211:30:252
2480309992918,4cyclictest2570617-21kworker/u8:1+events_unbound12:15:112
2480309992916,4cyclictest2544651-21kworker/u8:2+events_unbound10:14:542
2480306992918,5cyclictest131rcu_preempt10:00:291
2480306992913,5cyclictest131rcu_preempt10:10:211
2480301992922,4cyclictest2525656-21kworker/u8:2+events_unbound09:24:180
2480301992922,3cyclictest0-21swapper/010:55:010
2480301992921,5cyclictest2593399-21fschecks_time12:35:170
2480301992919,6cyclictest2577175-21grep11:45:250
2480314992822,3cyclictest0-21swapper/310:19:593
2480314992821,4cyclictest2518790-21idleruntime-cro09:00:003
2480314992819,4cyclictest0-21swapper/307:15:023
248030999283,3cyclictest0-21swapper/207:55:132
2480309992822,4cyclictest2587698-21kworker/u8:2+events_unbound12:22:412
2480309992822,4cyclictest2499489-21kworker/u8:0+events_unbound08:14:112
2480309992818,7cyclictest2483772-21grep07:15:272
2480309992814,8cyclictest131rcu_preempt09:30:202
2480314992719,5cyclictest0-21swapper/310:20:263
2480309992721,4cyclictest2579240-21kworker/u8:0+events_unbound11:59:412
2480309992720,5cyclictest2556676-21kworker/u8:1+events_unbound10:51:402
2480309992720,3cyclictest0-21swapper/211:45:232
2480309992720,3cyclictest0-21swapper/209:40:172
2480309992719,4cyclictest0-21swapper/208:45:232
2480309992718,6cyclictest2526258-21fschecks_time09:20:162
2480309992717,4cyclictest2499489-21kworker/u8:0+events_unbound08:36:012
2480301992720,4cyclictest2522808-21fschecks_count09:10:180
2480301992720,3cyclictest0-21swapper/008:20:260
2480301992714,10cyclictest2480295-21cyclictest07:10:140
248030199270,25cyclictest0-21swapper/011:40:150
248031499265,4cyclictest25208492gpg-connect-age09:05:023
2480314992619,3cyclictest0-21swapper/308:05:213
2480314992616,6cyclictest0-21swapper/307:30:013
2480314992616,6cyclictest0-21swapper/307:30:003
2480309992619,4cyclictest2508903-21df_inode08:30:162
2480309992612,7cyclictest32-21ksoftirqd/210:56:542
2480309992612,3cyclictest0-21swapper/211:43:142
2480301992620,4cyclictest2582636-21kworker/u8:2+events_unbound12:04:440
2480301992619,3cyclictest0-21swapper/009:09:160
2480301992617,6cyclictest2570387-21sh11:30:000
2480301992617,6cyclictest2570387-21sh11:30:000
2480301992616,6cyclictest204-21dbus-daemon10:39:320
2480314992518,4cyclictest391ktimers/312:38:103
2480314992518,4cyclictest2494033-21tail07:45:273
2480314992517,5cyclictest0-21swapper/311:45:253
2480314992517,5cyclictest0-21swapper/308:25:183
2480314992515,7cyclictest2549492-21awk10:25:273
248030999258,10cyclictest32-21ksoftirqd/209:05:232
248030999257,5cyclictest32-21ksoftirqd/210:25:212
248030999256,12cyclictest0-21swapper/211:54:422
2480309992518,5cyclictest2490946-21kworker/u8:1+events_unbound08:05:092
2480309992512,11cyclictest32-21ksoftirqd/207:20:202
248030199252,5cyclictest131rcu_preempt08:50:140
2480301992521,2cyclictest13550irq/42-30be0000.ethernet08:25:150
2480301992519,4cyclictest0-21swapper/012:20:120
2480301992518,5cyclictest2462480-21kworker/u8:1+events_unbound07:19:000
2480301992518,4cyclictest0-21swapper/012:10:000
2480301992518,4cyclictest0-21swapper/009:55:270
2480301992518,3cyclictest0-21swapper/010:34:320
2480301992516,6cyclictest0-21swapper/010:25:170
248030199251,3cyclictest2487897-21apt-get07:30:140
248030199251,20cyclictest0-21swapper/007:50:280
2480301992511,11cyclictest2480295-21cyclictest09:45:120
2480314992418,3cyclictest0-21swapper/312:15:223
2480314992418,3cyclictest0-21swapper/312:05:153
2480314992418,3cyclictest0-21swapper/310:40:263
2480314992418,3cyclictest0-21swapper/308:15:243
2480314992417,4cyclictest0-21swapper/308:20:273
2480314992416,5cyclictest0-21swapper/307:55:013
2480314992412,8cyclictest2482138-21grep07:15:023
2480309992417,4cyclictest0-21swapper/211:15:252
2480309992416,4cyclictest0-21swapper/208:00:272
2480309992414,7cyclictest2512844-21cut08:40:232
2480301992418,3cyclictest0-21swapper/008:40:170
2480301992418,3cyclictest0-21swapper/008:30:150
2480301992417,4cyclictest13850irq/36-mmc112:30:000
2480301992417,4cyclictest13550irq/42-30be0000.ethernet11:34:590
2480301992417,4cyclictest13550irq/42-30be0000.ethernet11:34:590
2480301992416,5cyclictest0-21swapper/010:00:290
248030199241,20cyclictest0-21swapper/007:55:220
248030199241,19cyclictest0-21swapper/009:44:400
2480314992318,2cyclictest0-21swapper/309:00:253
2480314992317,3cyclictest0-21swapper/311:05:243
2480314992317,3cyclictest0-21swapper/310:55:183
2480314992316,3cyclictest0-21swapper/309:10:283
2480314992314,5cyclictest0-21swapper/310:00:003
2480314992313,7cyclictest2511976-21sendmail08:40:003
248031499230,3cyclictest0-21swapper/310:39:503
2480301992318,3cyclictest2531428-21cpu09:35:150
2480301992317,2cyclictest0-21swapper/011:05:010
2480301992317,2cyclictest0-21swapper/009:19:170
2480301992316,4cyclictest121ktimers/009:30:120
2480301992316,3cyclictest0-21swapper/010:23:000
2480301992316,3cyclictest0-21swapper/009:53:400
2480301992315,4cyclictest438-21cron12:35:010
2480301992314,5cyclictest0-21swapper/010:05:150
2480301992314,5cyclictest0-21swapper/010:05:150
248030199231,18cyclictest0-21swapper/012:13:520
248030199231,18cyclictest0-21swapper/012:13:520
248030199230,19cyclictest0-21swapper/010:18:230
248030199230,19cyclictest0-21swapper/008:01:160
2480314992218,2cyclictest0-21swapper/311:40:153
2480314992216,3cyclictest0-21swapper/312:20:243
2480314992216,3cyclictest0-21swapper/307:20:213
2480314992215,5cyclictest391ktimers/310:05:013
2480314992215,3cyclictest0-21swapper/309:20:153
2480314992213,6cyclictest0-21swapper/309:45:233
2480301992216,3cyclictest0-21swapper/011:55:000
2480301992215,3cyclictest0-21swapper/010:41:190
2480301992215,3cyclictest0-21swapper/007:39:050
248030199221,19cyclictest0-21swapper/012:15:550
248030199220,20cyclictest0-21swapper/008:45:330
2480314992115,3cyclictest0-21swapper/310:05:103
2480314992115,3cyclictest0-21swapper/310:05:103
2480314992115,3cyclictest0-21swapper/309:40:253
2480314992114,3cyclictest0-21swapper/311:10:233
2480314992113,5cyclictest391ktimers/309:15:133
2480314992111,7cyclictest2550752-21open_inodes10:30:213
2480301992115,2cyclictest0-21swapper/007:20:130
2480314992014,3cyclictest2561976-21latency_hist11:05:013
2480314992014,3cyclictest2503033-21latency_hist08:15:003
2480314992014,3cyclictest0-21swapper/308:45:243
2480314992013,5cyclictest391ktimers/307:30:393
2480314992013,4cyclictest0-21swapper/310:10:263
2480314992012,6cyclictest391ktimers/312:00:123
2480314992011,6cyclictest2567773-21tr11:20:233
2480314991912,5cyclictest391ktimers/309:35:233
2480314991810,5cyclictest2491548-21fschecks_time07:40:173
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional