You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-03 - 20:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Fri Apr 03, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
252531421920,6sleep30-21swapper/312:21:233
2214914995736,18cyclictest2250659-21ntpq07:41:342
24872062540,6chrt0-21swapper/211:41:292
2214912995044,5cyclictest2178060-21kworker/u8:2+flush-8:007:26:381
2214912994943,5cyclictest2445572-21kworker/u8:1+flush-8:011:11:381
2214912994743,3cyclictest2400405-21kworker/u8:1+events_unbound10:31:381
2214909994742,3cyclictest2445572-21kworker/u8:1+flush-8:011:06:400
2214912994641,4cyclictest2400405-21kworker/u8:1+flush-8:010:16:411
2214912994641,3cyclictest2236569-21kworker/u8:0+flush-8:008:21:381
2214912994539,5cyclictest2236569-21kworker/u8:0+flush-8:008:06:391
2214912994539,4cyclictest2261593-21kworker/u8:3+events_unbound09:00:011
2214909994540,3cyclictest2214785-21kworker/u8:1+events_unbound07:15:040
2214912994439,3cyclictest2465286-21kworker/u8:0+events_unbound11:36:381
2214912994439,3cyclictest2178060-21kworker/u8:2+events_unbound07:36:381
2214912994338,4cyclictest2236569-21kworker/u8:0+events_unbound09:11:371
2214912994337,5cyclictest2420491-21kworker/u8:3+flush-8:010:46:381
2214909994339,3cyclictest2214785-21kworker/u8:1+flush-8:007:15:010
2214912994238,3cyclictest2178060-21kworker/u8:2+events_unbound07:46:341
2214912994237,4cyclictest2236569-21kworker/u8:0+events_unbound09:41:331
2214912994236,5cyclictest2420491-21kworker/u8:3+events_unbound10:56:351
2214909994238,3cyclictest2360598-21kworker/u8:1+flush-8:009:56:400
221491499411,37cyclictest2360067-21grep09:31:312
2214912994136,4cyclictest2465286-21kworker/u8:0+events_unbound11:56:331
2214912994136,3cyclictest1919123-21kworker/u8:3+flush-8:007:11:281
2214914994024,14cyclictest2276639-21aten2_r5power_e08:11:222
2214912994036,3cyclictest2485624-21kworker/u8:3+events_unbound12:06:371
2214912993935,3cyclictest2420491-21kworker/u8:3+events_unbound10:51:401
2214912993934,4cyclictest2524621-21kworker/u8:3+flush-8:012:21:261
2214912993934,4cyclictest2519175-21kworker/u8:1+flush-8:012:16:361
2214912993934,4cyclictest2445572-21kworker/u8:1+flush-8:011:31:261
221490999390,36cyclictest2326172-21munin-run09:00:010
2214914993825,11cyclictest2351461-21aten2_r5power_c09:26:222
221491499382,15cyclictest2346498-21apt-get09:21:232
2214912993834,3cyclictest2236569-21kworker/u8:0+flush-8:008:11:331
2214912993831,6cyclictest2440333-21kworker/u8:2+flush-8:012:01:391
22101592384,11sleep10-21swapper/107:05:431
2214914993722,13cyclictest2510655-21cpuspeed_turbos12:06:232
2214912993732,3cyclictest2261593-21kworker/u8:3+events_unbound08:41:291
2214912993731,4cyclictest2261593-21kworker/u8:3+events_unbound09:01:381
2214912993631,4cyclictest2345635-21kworker/u8:2+events_unbound10:10:001
2214912993629,5cyclictest2345635-21kworker/u8:2+flush-8:010:01:411
2214912993627,7cyclictest2535098-21/usr/sbin/munin12:31:331
2214909993629,5cyclictest2400405-21kworker/u8:1+events_unbound10:26:390
2214912993531,3cyclictest2400405-21kworker/u8:1+events_unbound10:26:291
2214912993530,4cyclictest2261593-21kworker/u8:3+events_unbound09:31:351
2214912993530,4cyclictest2261593-21kworker/u8:3+events_unbound09:06:251
2214912993530,3cyclictest2261593-21kworker/u8:3+events_unbound08:31:291
2214912993530,3cyclictest1919123-21kworker/u8:3+events_unbound07:16:301
2214912993529,5cyclictest2420491-21kworker/u8:3+flush-8:011:16:361
2214909993531,3cyclictest2440333-21kworker/u8:2+events_unbound11:46:350
2214909993530,4cyclictest2236569-21kworker/u8:0+events_unbound09:15:010
221491499348,9cyclictest24837072kthreadcore11:36:312
2214912993430,3cyclictest2465286-21kworker/u8:0+flush-8:011:21:381
2214912993430,3cyclictest2465286-21kworker/u8:0+flush-8:011:21:381
2214912993428,4cyclictest2440333-21kworker/u8:2+flush-8:011:26:361
2214909993429,3cyclictest2236569-21kworker/u8:0+flush-8:008:21:280
2214909993428,4cyclictest2465286-21kworker/u8:0+flush-8:011:21:330
2214909993428,4cyclictest2465286-21kworker/u8:0+flush-8:011:21:330
2214909993427,5cyclictest2236569-21kworker/u8:0+flush-8:009:21:360
221491499332,24cyclictest2256782-21apt-get07:51:222
2214912993329,3cyclictest2485624-21kworker/u8:3+flush-8:011:41:391
2214912993329,3cyclictest2445572-21kworker/u8:1+events_unbound11:06:411
2214912993329,3cyclictest2440333-21kworker/u8:2+flush-8:011:46:421
2214912993328,3cyclictest2360598-21kworker/u8:1+events_unbound09:56:311
2214912993327,5cyclictest2420491-21kworker/u8:3+flush-8:010:36:321
2214912993327,5cyclictest2395412-21kworker/u8:0+events_unbound10:21:391
2214912993324,7cyclictest2376193-21/usr/sbin/munin09:51:321
2214909993328,3cyclictest2276230-21latency_hist08:10:010
2214909993323,8cyclictest2514147-21ntpq12:06:330
221491499322,22cyclictest2376218-21apt-get09:51:202
2214914993217,13cyclictest0-21swapper/210:41:302
2214914993210,17cyclictest2440919-21apt-get10:56:212
2214909993227,3cyclictest2519934-21cron12:15:000
2214909993227,3cyclictest2441646-21irqrtprio10:56:280
221490999321,28cyclictest2395692-21munin-run10:10:000
22147152324,9sleep20-21swapper/207:09:412
2214914993116,12cyclictest0-21swapper/207:15:052
2214914993114,14cyclictest2271264-21cron08:05:002
2214912993127,3cyclictest2261593-21kworker/u8:3+events_unbound07:56:311
2214912993126,4cyclictest2440333-21kworker/u8:2+flush-8:011:51:281
2214912993126,3cyclictest2371574-21cut09:46:251
2214912993124,5cyclictest280-21systemd-journal08:15:501
2214912993124,5cyclictest2236569-21kworker/u8:0+events_unbound07:31:321
2214909993127,3cyclictest2440333-21kworker/u8:2+events_unbound11:01:300
2214909993127,3cyclictest2400405-21kworker/u8:1+flush-8:010:41:410
2214909993127,3cyclictest2400405-21kworker/u8:1+events_unbound10:31:280
2214909993126,3cyclictest2405587-21kworker/u8:2+events_unbound10:20:010
2214909993125,4cyclictest2440333-21kworker/u8:2+flush-8:012:01:340
2214909993125,4cyclictest2345635-21kworker/u8:2+events_unbound09:31:270
221491499302,7cyclictest2475806-21apt-get11:31:212
2214914993026,2cyclictest2320801-21unixbench_multi08:51:392
2214914993018,11cyclictest2539361-21unixbench_multi12:31:422
2214914993016,12cyclictest2316060-21apt-config08:50:012
2214914993016,12cyclictest0-21swapper/211:25:002
2214914993016,12cyclictest0-21swapper/211:25:002
2214914993014,14cyclictest0-21swapper/211:46:262
2214914993014,14cyclictest0-21swapper/209:56:512
2214914993011,16cyclictest2451175-21aten2_r5power_p11:06:242
2214912993026,2cyclictest2465286-21kworker/u8:0+events_unbound12:26:411
2214912993025,4cyclictest2306365-21kworker/u8:2+events_unbound08:46:341
2214912993025,4cyclictest2236569-21kworker/u8:0+flush-8:009:16:261
2214912993024,4cyclictest2305925-21gpgv08:40:011
2214912993024,4cyclictest2305925-21gpgv08:40:011
2214909993026,3cyclictest2440333-21kworker/u8:2+flush-8:011:51:390
2214909993026,3cyclictest1919123-21kworker/u8:3+events_unbound07:21:370
2214909993025,3cyclictest2270378-21needreboot08:01:320
2214909993025,3cyclictest2236569-21kworker/u8:0+events_unbound09:26:380
2214909993024,5cyclictest2445572-21kworker/u8:1+events_unbound11:31:370
2214909993024,4cyclictest2534359-21kworker/u8:2+events_unbound12:31:250
2214909993023,5cyclictest280-21systemd-journal09:40:300
2214909993023,5cyclictest2251483-21cron07:45:000
221491499293,20cyclictest2326499-21apt-get09:01:212
221491499293,20cyclictest2291385-21apt-get08:26:212
221491499293,20cyclictest2291385-21apt-get08:26:212
2214914992924,3cyclictest2530523-21fschecks_time12:26:262
221491499291,5cyclictest2500541-21apt-get11:56:222
221491499291,5cyclictest2391086-21apt-get10:06:222
2214912992925,3cyclictest2236569-21kworker/u8:0+flush-8:009:36:341
2214912992925,2cyclictest2268840-21kthreadcore08:01:301
2214912992924,3cyclictest2261365-21cat07:55:001
2214912992923,4cyclictest2295674-21grep08:26:411
2214912992923,4cyclictest2295674-21grep08:26:411
2214909992925,3cyclictest2345635-21kworker/u8:2+flush-8:010:01:260
2214909992924,3cyclictest2505118-21cron12:00:000
221491499282,20cyclictest2296344-21apt-get08:31:232
221491499281,8cyclictest2290418-21awk08:21:382
2214914992817,9cyclictest0-21swapper/209:50:012
2214914992813,13cyclictest2450387-21unixbench_multi11:01:422
2214914992812,14cyclictest2331635-21cpuspeed_turbos09:06:242
2214914992811,15cyclictest2321742-21cpuspeed_turbos08:56:242
221491499280,8cyclictest2411509-21/usr/sbin/munin10:26:252
221491499280,24cyclictest2526291-21tr12:21:292
2214912992822,5cyclictest2236569-21kworker/u8:0+flush-8:009:26:391
2214912992822,5cyclictest2178060-21kworker/u8:2+flush-8:007:41:291
2214912992819,6cyclictest280-21systemd-journal12:11:541
2214909992824,3cyclictest2519175-21kworker/u8:1+flush-8:012:16:560
2214909992824,3cyclictest2236569-21kworker/u8:0+flush-8:009:06:360
2214909992822,4cyclictest2300925-21latency_hist08:35:000
2214909992821,5cyclictest2316022-21apt-get08:50:010
2214909992821,5cyclictest2305883-21apt-get08:40:010
2214909992821,5cyclictest2305883-21apt-get08:40:010
2214914992724,2cyclictest2431365-21fschecks_time10:46:242
2214914992723,2cyclictest2416529-21fschecks_time10:31:252
221491499271,8cyclictest2281915-21/usr/sbin/munin08:16:272
2214914992713,13cyclictest0-21swapper/210:20:012
2214914992711,14cyclictest0-21swapper/208:36:282
2214914992711,14cyclictest0-21swapper/208:36:282
221491499270,8cyclictest2410234-21awk10:21:382
2214912992723,2cyclictest0-21swapper/107:21:281
2214909992724,2cyclictest2261593-21kworker/u8:3+events_unbound08:11:370
2214909992723,3cyclictest2306365-21kworker/u8:2+events_unbound08:41:370
2214909992723,2cyclictest0-21swapper/012:30:000
2214909992722,3cyclictest2524621-21kworker/u8:3+flush-8:012:21:290
2214909992721,4cyclictest401-21dbus-daemon11:15:000
2214909992721,4cyclictest2440333-21kworker/u8:2+flush-8:011:26:310
2214909992721,4cyclictest1-21systemd09:40:010
221491499266,5cyclictest2234268-21tr07:26:302
221491499261,8cyclictest2459776-21awk11:11:322
221491499261,8cyclictest2425734-21awk10:39:592
221491499261,5cyclictest2305883-21apt-get08:40:042
221491499261,3cyclictest2366327-21apt-get09:41:212
2214914992611,13cyclictest0-21swapper/210:01:232
221491499260,9cyclictest2544713-21grep12:40:012
221491499260,8cyclictest2519171-21/usr/sbin/munin12:11:362
221491499260,8cyclictest2399596-21/usr/sbin/munin10:11:342
2214912992621,4cyclictest2306365-21kworker/u8:2+events_unbound08:51:231
2214912992620,5cyclictest2440333-21kworker/u8:2+events_unbound11:01:381
2214912992619,5cyclictest2396026-21apt-get10:11:231
2214909992622,3cyclictest2236569-21kworker/u8:0+events_unbound07:56:370
2214909992621,3cyclictest2435626-21cron10:50:000
2214909992620,4cyclictest2236569-21kworker/u8:0+events_unbound07:51:440
221491499257,2cyclictest2365955-21latency_hist09:40:002
221491499256,4cyclictest2239793-21cut07:31:302
221491499255,6cyclictest2473017-21tr11:26:302
221491499254,6cyclictest2272288-21sed08:06:272
221491499252,9cyclictest2340108-21ntpq09:11:342
221491499251,8cyclictest2464671-21ntpq11:16:332
221491499251,8cyclictest2345887-21idleruntime-cro09:20:002
221491499251,8cyclictest2230619-21/usr/sbin/munin07:21:312
221491499251,6cyclictest2435962-21/usr/sbin/munin10:51:212
2214914992510,13cyclictest0-21swapper/207:56:322
221491499250,8cyclictest2251951-21cut07:46:242
221491499250,7cyclictest2499749-21/usr/sbin/munin11:51:392
2214912992522,2cyclictest2351074-21cron09:25:001
2214912992521,3cyclictest2524621-21kworker/u8:3+flush-8:012:36:271
2214912992519,5cyclictest2400405-21kworker/u8:1+flush-8:010:41:271
2214909992522,2cyclictest2330162-21needreboot09:01:320
2214909992521,3cyclictest2490314-21sh11:45:000
2214909992521,3cyclictest2400405-21kworker/u8:1+events_unbound10:40:010
2214909992521,2cyclictest0-21swapper/009:20:010
2214909992520,4cyclictest2345635-21kworker/u8:2+events_unbound09:51:240
2214909992520,4cyclictest1-21systemd07:28:510
2214909992520,3cyclictest2465213-21unixbench_singl11:16:410
2214909992519,4cyclictest2439179-21kthreadcore10:51:320
2214909992518,5cyclictest2316669-21tr08:51:210
2214914992420,2cyclictest2524544-21unixbench_multi12:16:412
221491499241,10cyclictest2245771-21ntp_states07:36:352
221490999248,14cyclictest2475483-21kworker/0:2+events11:39:060
2214909992419,4cyclictest2345635-21kworker/u8:2+flush-8:009:46:410
221490999240,22cyclictest2281428-21sshd08:15:500
221491499231,7cyclictest2505875-21smartctl12:01:262
221491499230,8cyclictest2215767-21cut07:11:272
2214909992320,2cyclictest2395412-21kworker/u8:0+flush-8:010:20:130
2214909992319,3cyclictest2524621-21kworker/u8:3+flush-8:012:36:380
2214909992318,4cyclictest2236569-21kworker/u8:0+flush-8:007:31:330
2214909992318,4cyclictest2178060-21kworker/u8:2+events_unbound07:46:380
2214909992317,4cyclictest2345635-21kworker/u8:2+events_unbound10:11:280
2214909992218,3cyclictest2261593-21kworker/u8:3+flush-8:008:26:280
2214909992218,3cyclictest2261593-21kworker/u8:3+flush-8:008:26:280
2214909992015,3cyclictest0-21swapper/007:39:500
22102052193,11sleep00-21swapper/007:06:180
22145842183,8sleep30-21swapper/307:07:583
23800212170,2chrt481ktimers/309:51:343
22712592178,5sleep30-21swapper/308:05:013
22655832166,6sleep30-21swapper/307:56:383
25414182132,7sleep30-21swapper/312:36:293
25057542132,7sleep30-21swapper/312:01:263
24577072133,6sleep30-21swapper/311:11:293
24208182132,6sleep30-21swapper/310:35:023
25390152122,6sleep30-21swapper/312:31:403
25247812122,6sleep30-21swapper/312:18:553
25159452121,7sleep30-21swapper/312:11:293
25109002122,6sleep30-21swapper/312:06:273
25045462122,6sleep30-21swapper/311:56:403
24956212122,6sleep30-21swapper/311:51:223
24902942122,6sleep30-21swapper/311:44:523
24845982122,6sleep30-21swapper/311:36:383
24711762123,5sleep30-21swapper/311:26:263
24670742122,6sleep30-21swapper/311:21:293
24670742122,6sleep30-21swapper/311:21:293
24459972122,5sleep30-21swapper/311:00:023
24306862122,5sleep30-21swapper/310:45:013
24264402122,6sleep30-21swapper/310:41:283
23956932122,5sleep30-21swapper/310:10:013
23873402122,5sleep30-21swapper/310:01:313
23708952122,5sleep30-21swapper/309:45:013
23663592122,6sleep30-21swapper/309:41:243
23608772122,6sleep30-21swapper/309:33:583
23519032122,6sleep30-21swapper/309:26:273
23507012122,6sleep30-21swapper/309:21:423
23458792122,6sleep30-21swapper/309:20:013
23360462122,5sleep30-21swapper/309:10:023
23257502122,6sleep30-21swapper/308:56:413
23168522122,6sleep30-21swapper/308:51:243
23123982122,6sleep30-21swapper/308:46:303
23071882122,6sleep30-21swapper/308:41:283
23033772123,5sleep30-21swapper/308:36:313
23033772123,5sleep30-21swapper/308:36:313
22954012123,5sleep30-21swapper/308:26:403
22954012123,5sleep30-21swapper/308:26:403
22868232122,6sleep30-21swapper/308:21:263
22811252122,6sleep30-21swapper/308:15:003
22605742122,6sleep30-21swapper/307:51:363
22562482122,6sleep30-21swapper/307:47:513
22476022123,5sleep30-21swapper/307:41:293
22365652122,5sleep30-21swapper/307:30:013
22270602122,6sleep30-21swapper/307:21:223
22151892122,6sleep30-21swapper/307:11:233
25298822112,5sleep30-21swapper/312:25:013
24945292112,5sleep30-21swapper/311:46:413
24757572112,6sleep30-21swapper/311:31:043
24630822112,5sleep30-21swapper/311:16:313
24510932112,6sleep30-21swapper/311:06:243
24450152112,5sleep30-21swapper/310:56:413
24358552112,5sleep30-21swapper/310:50:023
24110702112,5sleep30-21swapper/310:25:023
24064702112,5sleep30-21swapper/310:21:253
24019132112,6sleep30-21swapper/310:16:323
23910602112,5sleep30-21swapper/310:06:203
23849502112,5sleep30-21swapper/309:56:373
23610242112,5sleep30-21swapper/309:35:023
23318862112,5sleep30-21swapper/309:06:293
22960042112,5sleep30-21swapper/308:30:013
22814362112,6sleep30-21swapper/308:15:563
22759272112,5sleep30-21swapper/308:06:413
22418632112,5sleep30-21swapper/307:36:193
22319102112,5sleep30-21swapper/307:25:563
22203022112,5sleep30-21swapper/307:15:043
24160512102,5sleep30-21swapper/310:30:043
23264032102,5sleep30-21swapper/309:00:273
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional