You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-20 - 00:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Sun Apr 19, 2026 12:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
343544923450,2sleep3481ktimers/312:06:203
335785021320,4chrt75-21kworker/3:1-events10:51:123
3137328996029,21cyclictest3432027-21latency_hist12:05:011
3137332995953,4cyclictest3402197-21kworker/u8:2+events_unbound11:56:262
3137328995944,12cyclictest3273303-21latency_hist09:25:011
3137332995852,4cyclictest3243437-21kworker/u8:2+flush-8:009:41:292
3137332995450,3cyclictest3085761-21kworker/u8:1+events_unbound07:15:052
34404402530,1sleep13440444-21tr12:11:201
3137326995245,5cyclictest3187689-21ntpq07:56:220
3137332995147,3cyclictest3342529-21kworker/u8:0+flush-8:010:51:292
3137332995043,5cyclictest280-21systemd-journal12:35:002
3137326995043,5cyclictest3320908-21kworker/u8:2+events_unbound10:41:230
3137326994842,4cyclictest3085761-21kworker/u8:1+flush-8:009:56:140
3137332994742,4cyclictest3327662-21kworker/u8:1+flush-8:010:26:282
3137332994642,3cyclictest3327662-21kworker/u8:1+events_unbound10:31:272
3137332994642,3cyclictest3085761-21kworker/u8:1+flush-8:008:06:252
3137328994637,6cyclictest3397401-21latency_hist11:30:001
33755962450,4sleep1161rcu_preempt11:06:191
3137326994538,5cyclictest3243437-21kworker/u8:2+flush-8:009:36:150
3137332994439,4cyclictest3085761-21kworker/u8:1+events_unbound09:10:042
3137328994416,14cyclictest3277420-21ntpq09:26:221
3137328994334,6cyclictest280-21systemd-journal07:16:511
3137328994332,8cyclictest3416364-21ntpq11:46:241
3137326994338,4cyclictest3085761-21kworker/u8:1+flush-8:008:11:160
3137326994338,4cyclictest3085761-21kworker/u8:1+flush-8:008:11:160
3137326994336,5cyclictest3085761-21kworker/u8:1+flush-8:008:56:260
3137328994232,8cyclictest3227805-21ntpq08:36:261
3137326994237,3cyclictest3342529-21kworker/u8:0+flush-8:011:36:250
3137326994233,7cyclictest3462173-21/usr/sbin/munin12:36:280
3137332994137,3cyclictest3307943-21kworker/u8:3+flush-8:011:51:252
3137332994136,4cyclictest3307943-21kworker/u8:3+events_unbound11:06:122
3137332994136,4cyclictest3101172-21kworker/u8:0+flush-8:007:41:242
3137332994135,4cyclictest3085761-21kworker/u8:1+events_unbound10:10:052
3137328994134,5cyclictest3228979-21apt-get08:41:101
3137328994034,4cyclictest3303307-21apt-get09:56:091
3137332993935,3cyclictest3327662-21kworker/u8:1+flush-8:010:21:252
3137328993932,5cyclictest3442182-21/usr/sbin/munin12:16:211
3137326993929,8cyclictest3388122-21diskstats11:21:140
3137326993929,8cyclictest3388122-21diskstats11:21:140
3137332993833,4cyclictest3307943-21kworker/u8:3+flush-8:012:21:322
3137328993832,4cyclictest3422426-21/usr/sbin/munin11:56:281
3137328993828,8cyclictest3331730-21needreboot10:21:211
3137328993828,8cyclictest280-21systemd-journal09:30:371
3137328993811,17cyclictest0-21swapper/111:34:221
3137328993810,17cyclictest0-21swapper/111:02:041
3137328993810,16cyclictest0-21swapper/110:33:421
3137326993832,4cyclictest3307943-21kworker/u8:3+flush-8:011:51:110
3137332993729,6cyclictest280-21systemd-journal10:19:502
3137328993711,17cyclictest0-21swapper/108:06:151
3137326993731,4cyclictest3402197-21kworker/u8:2+flush-8:011:46:290
3137326993728,6cyclictest280-21systemd-journal07:15:010
313732899367,19cyclictest0-21swapper/108:10:571
313732899367,19cyclictest0-21swapper/108:10:561
3137328993629,5cyclictest3357742-21apt-get10:51:101
3137328993626,8cyclictest3461553-21unixbench_singl12:31:301
3137328993625,9cyclictest3267487-21ntpq09:16:211
3137328993624,10cyclictest3436092-21ntpq12:06:231
3137326993631,3cyclictest3357396-21cron10:50:000
3137326993630,4cyclictest3144292-21kworker/u8:2+flush-8:007:26:140
3137326993627,6cyclictest280-21systemd-journal09:10:000
34644312350,1sleep13464436-21cut12:36:201
3137332993531,3cyclictest3085761-21kworker/u8:1+events_unbound08:16:302
313732899355,21cyclictest0-21swapper/111:36:511
3137328993526,7cyclictest3307943-21kworker/u8:3+flush-8:012:26:241
3137328993523,9cyclictest3188924-21apt-get08:01:091
3137328993522,11cyclictest3283531-21apt-get09:36:101
313732899351,28cyclictest3323063-21apt-get10:16:111
313732699351,31cyclictest1-21systemd08:55:010
313732899346,19cyclictest0-21swapper/107:33:051
313732899346,18cyclictest0-21swapper/107:20:411
3137328993427,5cyclictest3258814-21apt-get09:11:091
3137328993427,5cyclictest3167997-21ntpq07:36:221
3137328993423,9cyclictest3350044-21kthreadcore10:41:201
3137326993428,5cyclictest3307943-21kworker/u8:3+flush-8:010:36:230
3137326993428,4cyclictest3243437-21kworker/u8:2+events_unbound09:11:180
3137326993424,7cyclictest3387285-21latency_hist11:20:000
3137332993328,3cyclictest3144292-21kworker/u8:2+events_unbound07:30:202
313732899335,19cyclictest0-21swapper/110:48:191
3137328993324,7cyclictest3421252-21ntpq11:51:231
3137328993321,10cyclictest0-21swapper/110:15:011
3137328993315,11cyclictest0-21swapper/108:31:101
3137326993327,5cyclictest3327662-21kworker/u8:1+flush-8:010:26:230
313732899323,2cyclictest0-21swapper/109:51:111
313732899322,24cyclictest3362698-21apt-get10:56:091
3137328993217,13cyclictest3183621-21cron07:55:001
3137328993215,14cyclictest0-21swapper/111:11:111
3137326993227,4cyclictest3085761-21kworker/u8:1+flush-8:010:01:280
3137326993227,3cyclictest3154002-21systemd-run07:25:010
31370862324,8sleep10-21swapper/107:09:281
3137332993126,4cyclictest3101172-21kworker/u8:0+events_unbound08:01:282
313732899313,5cyclictest0-21swapper/108:46:081
3137328993126,3cyclictest3204269-21cut08:16:141
3137328993125,4cyclictest3342850-21apt-get10:36:101
313732899312,22cyclictest407-21mta-sts-daemon09:46:101
3137328993118,11cyclictest0-21swapper/109:10:011
3137328993118,10cyclictest3213537-21latency_hist08:25:011
3137326993127,3cyclictest3327662-21kworker/u8:1+flush-8:010:31:290
3137326993125,4cyclictest3371429-21ntpq11:01:220
3137326993123,6cyclictest3377725-21apt-get11:11:090
3137332993023,5cyclictest280-21systemd-journal09:20:002
313732899308,19cyclictest3451193-21ntpq12:21:261
313732899303,5cyclictest0-21swapper/107:41:091
313732899303,3cyclictest0-21swapper/110:01:111
313732899302,11cyclictest3411522-21ntpq11:41:261
3137328993018,10cyclictest3188197-21unixbench_multi07:56:291
3137328993017,11cyclictest0-21swapper/109:41:171
3137326993025,4cyclictest3320908-21kworker/u8:2+flush-8:010:11:200
3137326993025,4cyclictest3307943-21kworker/u8:3+flush-8:012:16:190
3137326993025,4cyclictest3292784-21kworker/u8:0+flush-8:009:51:150
3137326993025,4cyclictest3101172-21kworker/u8:0+flush-8:009:16:310
3137326993023,5cyclictest3193552-21kworker/u8:3+flush-8:008:31:240
3137332992924,3cyclictest3401955-21unixbench_multi11:31:302
3137332992924,3cyclictest3317471-21unixbench_singl10:06:272
313732899295,12cyclictest421rcuog/208:56:231
313732899293,5cyclictest0-21swapper/107:26:091
313732899293,20cyclictest3248733-21apt-get09:01:101
3137328992924,3cyclictest3101172-21kworker/u8:0+flush-8:007:45:391
3137328992917,10cyclictest0-21swapper/108:26:271
3137328992915,11cyclictest0-21swapper/110:06:091
3137328992914,13cyclictest0-21swapper/111:21:301
3137328992914,13cyclictest0-21swapper/111:21:301
3137326992924,3cyclictest3411953-21unixbench_singl11:41:300
3137326992923,4cyclictest3377212-21apt-key11:10:000
3137326992923,4cyclictest3292784-21kworker/u8:0+flush-8:010:06:210
3137326992922,5cyclictest3101172-21kworker/u8:0+events_unbound08:01:240
313732699291,25cyclictest3208617-21true08:20:000
3137332992825,2cyclictest3446491-21unixbench_singl12:16:292
313732899282,11cyclictest3137544-21apt-get07:11:091
3137328992814,12cyclictest3238848-21apt-get08:51:121
3137328992810,15cyclictest0-21swapper/110:26:101
3137326992823,3cyclictest3377614-21kworker/u8:1+flush-8:011:31:190
3137326992822,5cyclictest3342529-21kworker/u8:0+flush-8:011:26:240
3137326992822,4cyclictest3446829-21apt-get12:20:010
3137326992821,4cyclictest3243437-21kworker/u8:2+flush-8:009:46:170
313732699281,25cyclictest401-21dbus-daemon09:31:260
31325352283,8sleep20-21swapper/207:05:442
3137332992718,7cyclictest280-21systemd-journal11:30:002
3137328992722,4cyclictest3307943-21kworker/u8:3+flush-8:011:18:551
3137326992723,3cyclictest3402197-21kworker/u8:2+events_unbound12:11:290
3137332992622,3cyclictest3377614-21kworker/u8:1+events_unbound11:21:032
3137332992622,3cyclictest3377614-21kworker/u8:1+events_unbound11:21:032
3137332992622,3cyclictest3085761-21kworker/u8:1+flush-8:009:01:582
3137332992622,3cyclictest3085761-21kworker/u8:1+events_unbound08:46:582
3137332992622,2cyclictest3303597-21fschecks_count09:56:132
3137332992621,4cyclictest3101172-21kworker/u8:0-ext4-rsv-conversion08:00:002
3137332992617,7cyclictest3377948-21cpuspeed_turbos11:11:122
3137326992622,3cyclictest3292784-21kworker/u8:0+events_unbound10:16:190
3137326992621,3cyclictest0-21swapper/007:11:280
3137326992620,5cyclictest3422340-21kworker/u8:1+flush-8:012:26:220
3137326992620,5cyclictest3307943-21kworker/u8:3+flush-8:012:01:230
3137326992620,4cyclictest3342529-21kworker/u8:0+flush-8:010:51:190
3137326992619,5cyclictest3307943-21kworker/u8:3+flush-8:010:56:250
3137326992619,5cyclictest3085761-21kworker/u8:1+events_unbound08:21:210
3137326992617,7cyclictest3169168-21/usr/sbin/munin07:41:200
3137326992617,2cyclictest421rcuog/209:21:110
3137332992522,2cyclictest3218111-21unixbench_multi08:26:292
3137332992521,3cyclictest3101172-21kworker/u8:0+events_unbound08:10:412
3137332992521,3cyclictest3101172-21kworker/u8:0+events_unbound08:10:412
3137332992520,3cyclictest3243437-21kworker/u8:2+events_unbound08:55:022
3137332992518,5cyclictest3258233-21apt-get09:10:002
3137326992521,3cyclictest3277928-21unixbench_singl09:26:280
3137326992521,3cyclictest3144292-21kworker/u8:2+flush-8:007:31:260
3137326992519,4cyclictest3422340-21kworker/u8:1+events_unbound12:31:240
3137326992519,4cyclictest3085761-21kworker/u8:1+flush-8:008:36:210
3137326992515,8cyclictest280-21systemd-journal08:05:510
3137332992420,3cyclictest3307943-21kworker/u8:3+events_unbound12:25:032
3137332992420,2cyclictest3297712-21grep09:46:292
3137332992420,2cyclictest3283643-21aten2_r5power_v09:36:112
3137332992420,2cyclictest3272974-21unixbench_singl09:21:292
3137332992419,4cyclictest3433109-21irqrtprio12:06:172
3137332992419,4cyclictest3213198-21unixbench_singl08:21:292
313733299241,11cyclictest32984872grep09:51:132
313733299240,14cyclictest371rcuc/208:40:002
3137326992420,3cyclictest3231135-21kthreadcore08:41:180
3137326992419,4cyclictest3307943-21kworker/u8:3+flush-8:011:56:380
3137326992418,5cyclictest3101172-21kworker/u8:0+events_unbound07:51:230
3137326992418,4cyclictest3243437-21kworker/u8:2+flush-8:009:01:140
31325702242,13sleep03132596-21apt-get07:06:100
34131202230,6sleep20-21swapper/211:46:172
313733299230,7cyclictest31824822cut07:51:212
3137326992318,3cyclictest3327662-21kworker/u8:1+events_unbound10:21:290
313733299226,3cyclictest161rcu_preempt09:26:182
3137332992213,7cyclictest280-21systemd-journal12:11:492
3137326992218,3cyclictest3085761-21kworker/u8:1+events_unbound07:46:300
3137326992216,3cyclictest0-21swapper/009:41:100
33637982210,3sleep30-21swapper/310:56:183
313733299212,5cyclictest0-21swapper/210:41:492
313733299212,5cyclictest0-21swapper/207:20:022
3137332992118,2cyclictest3343068-21cpuspeed_turbos10:36:132
3137332992117,3cyclictest3085761-21kworker/u8:1+flush-8:007:45:572
3137332992117,2cyclictest3367280-21cron11:00:002
3137332992117,2cyclictest3154539-21cpuspeed_turbos07:26:122
3137326992117,3cyclictest3165133-21kthreadcore07:36:170
3137326992113,6cyclictest3402197-21kworker/u8:2+flush-8:012:06:250
313733299202,13cyclictest3462198-21apt-get12:36:122
3137332992017,2cyclictest3164271-21aten2_r5power_e07:36:112
3137332992016,2cyclictest3278791-21cpuspeed_turbos09:31:132
3137332992016,2cyclictest0-21swapper/207:15:002
34286482190,2sleep3481ktimers/312:01:183
313733299198,2cyclictest161rcu_preempt10:46:192
3137332991914,4cyclictest3407878-21cpuspeed_turbos11:41:122
3137332991914,3cyclictest0-21swapper/208:35:002
3137332991913,4cyclictest0-21swapper/211:20:002
3137332991911,6cyclictest3406093-21tr11:36:212
3137326991915,3cyclictest3214404-21sort08:26:170
313733299186,3cyclictest371rcuc/210:01:192
313733299182,8cyclictest0-21swapper/208:41:142
3137332991814,2cyclictest3367878-21cpuspeed_turbos11:01:112
3137332991814,2cyclictest0-21swapper/212:02:462
3137326991814,2cyclictest0-21swapper/008:46:220
31370532182,9sleep30-21swapper/307:09:023
313733299173,6cyclictest0-21swapper/208:53:562
33924522142,8sleep30-21swapper/311:25:003
33924522142,8sleep30-21swapper/311:25:003
32015972144,7sleep30-21swapper/308:11:223
32015972144,7sleep30-21swapper/308:11:223
34124242132,6sleep30-21swapper/311:45:023
34072812132,7sleep30-21swapper/311:40:013
33769982132,6sleep30-21swapper/311:08:103
33334722132,7sleep30-21swapper/310:26:173
33023822133,6sleep30-21swapper/309:51:303
32637472132,7sleep30-21swapper/309:16:113
32293242132,7sleep30-21swapper/308:41:163
32188642132,7sleep30-21swapper/308:31:123
31490682132,6sleep30-21swapper/307:20:023
34517322122,6sleep30-21swapper/312:21:503
34426312122,6sleep30-21swapper/312:16:153
34221282122,5sleep30-21swapper/311:55:013
34116702122,6sleep30-21swapper/311:41:293
33977152122,6sleep30-21swapper/311:31:103
33718132122,6sleep30-21swapper/311:01:273
33567242122,6sleep30-21swapper/310:46:283
33483682122,6sleep30-21swapper/310:41:183
33419582122,6sleep30-21swapper/310:31:313
33227402122,5sleep30-21swapper/310:15:013
33185522122,6sleep30-21swapper/310:11:153
33130352122,5sleep30-21swapper/310:05:023
33060832122,6sleep30-21swapper/309:56:203
32974492122,6sleep30-21swapper/309:46:283
32902962122,6sleep30-21swapper/309:41:193
32803702122,6sleep30-21swapper/309:31:203
32484182122,5sleep30-21swapper/309:00:023
32277862122,6sleep30-21swapper/308:36:263
32137052122,5sleep30-21swapper/308:25:023
32131422122,6sleep30-21swapper/308:21:293
31803392122,6sleep30-21swapper/307:51:203
31738562122,5sleep30-21swapper/307:45:023
31605922122,6sleep30-21swapper/307:31:173
31543282122,6sleep30-21swapper/307:26:123
31375482122,6sleep30-21swapper/307:11:113
34629572112,5sleep30-21swapper/312:36:193
34573632112,5sleep30-21swapper/312:31:133
34523342112,5sleep30-21swapper/312:26:113
34371562112,5sleep30-21swapper/312:10:023
34178642112,6sleep30-21swapper/311:51:163
33926932112,5sleep30-21swapper/311:25:043
33826422112,5sleep30-21swapper/311:16:003
33816012112,5sleep30-21swapper/311:11:283
33432202112,5sleep30-21swapper/310:36:163
33279972112,5sleep30-21swapper/310:20:553
33082672112,5sleep30-21swapper/310:01:133
32840332112,5sleep30-21swapper/309:36:173
32733312112,5sleep30-21swapper/309:25:023
32691732112,6sleep30-21swapper/309:21:163
32587882112,5sleep30-21swapper/309:11:093
32540482112,5sleep30-21swapper/309:06:153
32438422112,5sleep30-21swapper/308:56:123
32387282112,5sleep30-21swapper/308:50:023
32382992112,6sleep30-21swapper/308:47:303
32043872112,5sleep30-21swapper/308:16:163
31939842112,5sleep30-21swapper/308:05:073
31889272111,6sleep30-21swapper/308:01:113
31836172112,5sleep30-21swapper/307:55:013
31696852112,5sleep30-21swapper/307:41:163
31640862112,5sleep30-21swapper/307:35:023
31444602112,5sleep30-21swapper/307:16:113
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional