You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-03 - 17:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Thu Sep 03, 2026 12:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
227262522270,2sleep3481ktimers/309:25:003
220823321790,2sleep3575-21kworker/3:2-events08:22:283
235303521390,22sleep3451irq_work/310:47:313
2136251996252,7cyclictest2292422-21latency_hist09:45:010
2136255995748,6cyclictest2362093-21latency_hist10:55:011
2136251995747,7cyclictest275-21systemd-journal11:04:590
2136251995445,6cyclictest2157931-21latency_hist07:30:010
2136251995041,6cyclictest2312628-21latency_hist10:05:000
2136251994940,6cyclictest2381868-21latency_hist11:15:010
2136255994841,5cyclictest2461575-21latency_hist12:35:001
2136251994842,4cyclictest2342577-21kworker/u8:1+events_unbound10:40:010
2136255994738,6cyclictest2232651-21latency_hist08:45:001
2136251994739,6cyclictest2317562-21latency_hist10:10:010
2136255994537,5cyclictest2446453-21latency_hist12:20:011
2136255994536,7cyclictest275-21systemd-journal08:32:341
2136251994535,7cyclictest275-21systemd-journal09:35:000
2136255994435,6cyclictest2411831-21latency_hist11:45:011
2136255994426,16cyclictest2336554-21needreboot10:27:381
2136259994336,5cyclictest275-21systemd-journal12:10:002
2136255994336,5cyclictest2094097-21kworker/u8:0+flush-8:007:22:391
2136255994323,18cyclictest20823-21cron11:30:001
2136255994125,14cyclictest2202762-21systemd-run08:15:011
2136255994124,15cyclictest275-21systemd-journal11:39:491
2136255994123,16cyclictest2159289-21kthreadcore07:32:351
2136255994023,5cyclictest275-21systemd-journal10:10:501
2136255994022,17cyclictest2347950-21cpuspeed_turbos10:42:291
2136255993917,7cyclictest2431997-21/usr/sbin/munin12:07:451
2136255993831,5cyclictest2437002-21apt-get12:12:261
2136255993818,5cyclictest0-21swapper/107:47:351
2136251993833,3cyclictest1-21systemd12:38:490
2136251993833,3cyclictest1-21systemd12:38:490
2136251993831,5cyclictest275-21systemd-journal10:34:500
213625199381,35cyclictest1-21systemd10:19:500
213625199381,35cyclictest1-21systemd10:19:500
21360962384,11sleep10-21swapper/107:09:591
21321302384,9sleep20-21swapper/207:07:362
2136255993717,5cyclictest275-21systemd-journal07:38:481
2136251993730,4cyclictest2141184-21kworker/u8:1+flush-8:007:22:280
2136251993729,5cyclictest2426634-21latency_hist12:00:010
2136251993729,5cyclictest2212614-21latency_hist08:25:000
2136251993630,4cyclictest275-21systemd-journal07:12:140
2136255993531,3cyclictest275-21systemd-journal09:10:001
2136255993529,4cyclictest2412262-21apt-get11:47:251
2136255993521,7cyclictest2258226-21apt-get09:12:281
2136251993528,5cyclictest2317787-21kworker/u8:3+flush-8:011:17:390
2136251993527,5cyclictest2193071-21kworker/u8:1+events_unbound08:20:010
2136251993526,7cyclictest275-21systemd-journal07:35:000
2136251993525,4cyclictest0-21swapper/010:42:270
2136259993426,6cyclictest275-21systemd-journal08:30:012
2136255993427,5cyclictest275-21systemd-journal08:50:001
2136251993429,3cyclictest2227667-21idleruntime-cro08:40:000
2136251993429,3cyclictest1-21systemd07:53:480
2136251993419,11cyclictest275-21systemd-journal09:37:490
2136259993329,2cyclictest2136644-21aten2_r5power_c07:12:292
2136259993324,7cyclictest2297464-21gpgv09:50:002
2136259993324,6cyclictest2222873-21base6408:35:012
2136255993326,5cyclictest2431356-21grep12:02:431
2136251993326,5cyclictest2256769-21ntpq09:07:380
2136259993227,3cyclictest2457160-21aten2_r5power_v12:32:272
2136259993226,4cyclictest2268116-21apt-get09:22:252
2136255993225,5cyclictest2268090-21/usr/sbin/munin09:22:371
2136255993225,5cyclictest2213042-21apt-get08:27:271
2136255993221,2cyclictest2338176-21hddtemp_smartct10:32:291
2136251993221,8cyclictest275-21systemd-journal12:05:000
2136255993126,3cyclictest2280158-21kthreadcore09:32:351
2136255993120,9cyclictest275-21systemd-journal11:32:491
2136251993125,4cyclictest2446222-21grep12:17:500
2136251993125,4cyclictest2277381-21kworker/u8:2+flush-8:009:57:500
2136251993124,5cyclictest275-21systemd-journal08:27:330
2136251993123,6cyclictest2193071-21kworker/u8:1+flush-8:008:12:390
23016122300,7sleep20-21swapper/209:52:362
2136259993027,2cyclictest2327489-21sendmail10:20:002
2136259993027,2cyclictest2327489-21sendmail10:20:002
2136259993020,8cyclictest2168083-21awk07:40:002
2136255993023,5cyclictest2462011-21apt-get12:37:301
2136255993023,5cyclictest2462011-21apt-get12:37:291
2136255993021,7cyclictest2306907-21ntpq09:57:431
2136255993020,8cyclictest2386852-21apt-get11:20:001
2136251993022,6cyclictest2237560-21latency_hist08:50:010
2136259992924,3cyclictest2203525-21fschecks_time08:17:292
2136259992922,5cyclictest275-21systemd-journal10:26:492
2136255992926,2cyclictest2252391-21idleruntime-cro09:05:001
2136255992925,2cyclictest2242487-21cron08:55:001
2136255992922,5cyclictest275-21systemd-journal10:02:491
2136251992922,5cyclictest571-21snmpd08:52:440
213625999288,4cyclictest0-21swapper/210:57:302
2136259992823,3cyclictest2442274-21fschecks_time12:17:342
2136259992823,3cyclictest2173070-21cat07:45:002
2136259992823,3cyclictest2168334-21kworker/u8:2+flush-8:007:52:312
2136255992825,2cyclictest2328520-21irqcore10:22:331
2136255992821,5cyclictest2263183-21apt-get09:17:261
213625199289,10cyclictest2317787-21kworker/u8:3+flush-8:011:37:430
2136251992821,5cyclictest2094097-21kworker/u8:0+events_unbound09:17:390
2136251992819,7cyclictest2197013-21ntpq08:07:400
2136259992724,2cyclictest2163077-21latency_hist07:35:002
2136259992723,2cyclictest2247124-21unixbench_multi08:57:482
2136255992722,3cyclictest2325129-21kthreadcore10:17:411
2136255992722,3cyclictest2325129-21kthreadcore10:17:411
2136255992721,4cyclictest2182662-21unixbench_multi07:52:461
2136255992720,5cyclictest275-21systemd-journal11:14:491
2136255992720,5cyclictest2172837-21grep07:42:471
2136255992719,7cyclictest2367063-21kworker/u8:0+flush-8:011:52:451
2136251992723,3cyclictest2382100-21kworker/u8:1+events_unbound11:25:000
2136251992723,2cyclictest2367013-21cron11:00:000
2136251992721,4cyclictest2182518-21kworker/u8:3+flush-8:009:30:000
2136251992720,5cyclictest2396171-21ntpq11:27:380
2136251992720,5cyclictest2337197-21kworker/u8:2+flush-8:011:07:430
2136251992714,10cyclictest2163789-21grep07:37:290
2136259992622,3cyclictest2173585-21aten2_r5power_p07:47:282
2136259992622,2cyclictest0-21swapper/208:40:002
2136255992620,4cyclictest2212377-21unixbench_singl08:22:461
2136255992620,4cyclictest2153449-21apt-get07:27:251
2136255992619,5cyclictest275-21systemd-journal09:50:501
2136255992618,6cyclictest0-21swapper/109:37:371
2136251992624,1cyclictest0-21swapper/007:15:030
2136251992621,3cyclictest2222528-21systemd-run08:35:010
2136251992620,4cyclictest2171781-21kthreadcore07:42:370
213625999259,4cyclictest0-21swapper/209:07:262
2136259992521,2cyclictest2416547-21unixbench_singl11:47:462
2136259992521,2cyclictest2328281-21fschecks_time10:22:312
213625999250,9cyclictest22396292cut08:52:352
2136255992522,2cyclictest2288153-21cpuspeed_turbos09:42:281
2136255992517,6cyclictest2392045-21latency_hist11:25:011
2136251992521,2cyclictest2321702-21needreboot10:12:380
2136251992520,3cyclictest0-21swapper/009:05:010
2136251992517,6cyclictest2183345-21/usr/sbin/munin07:57:450
2136251992517,6cyclictest2183345-21/usr/sbin/munin07:57:450
2136251992514,8cyclictest275-21systemd-journal11:50:010
2136259992421,2cyclictest2397420-21aten2_r5power_c11:32:272
2136259992421,2cyclictest2382623-21fschecks_time11:17:302
2136259992421,2cyclictest2308473-21fschecks_time10:02:312
2136259992420,3cyclictest2277381-21kworker/u8:2+events_unbound09:32:432
2136259992420,3cyclictest0-21swapper/211:15:002
2136259992420,2cyclictest2466298-21unixbench_singl12:37:512
2136259992420,2cyclictest2466298-21unixbench_singl12:37:512
2136255992421,2cyclictest2347283-21sendmail10:40:011
2136255992420,3cyclictest2247418-21munin-run08:59:591
2136255992420,2cyclictest0-21swapper/112:22:351
2136251992422,1cyclictest0-21swapper/012:27:440
2136251992422,1cyclictest0-21swapper/012:27:430
2136251992420,2cyclictest2446961-21aten2_r5power_p12:22:270
2136251992420,2cyclictest2243152-21cpuspeed_turbos08:57:290
2136251992420,2cyclictest0-21swapper/009:50:000
2136251992420,2cyclictest0-21swapper/009:12:320
2136251992419,3cyclictest2272344-21unixbench_multi09:22:450
2136251992415,5cyclictest0-21swapper/012:32:250
2136259992320,2cyclictest2456380-21unixbench_singl12:27:462
2136259992320,2cyclictest2456380-21unixbench_singl12:27:462
2136259992319,2cyclictest2303225-21aten2_r5power_c09:57:322
2136259992319,2cyclictest2188569-21cpuspeed_turbos08:02:272
2136255992319,3cyclictest2353243-21irqcore10:47:331
2136255992319,3cyclictest0-21swapper/107:15:051
2136255992318,3cyclictest2193876-21irqcore08:07:351
2136255992317,5cyclictest2287511-21kworker/u8:1+flush-8:009:47:421
2136255992312,3cyclictest0-21swapper/108:37:531
213625199232,20cyclictest0-21swapper/010:22:450
2136251992318,4cyclictest2342577-21kworker/u8:1+flush-8:010:52:310
2136251992318,4cyclictest2277381-21kworker/u8:2+flush-8:009:52:210
2136251992318,3cyclictest2401940-21systemd-run11:35:000
2136251992318,3cyclictest2174423-21kthreadcore07:47:350
2136251992316,5cyclictest2136118-21latency_hist07:10:010
2136251992315,6cyclictest2352625-21/usr/sbin/munin10:47:410
2136251992314,6cyclictest275-21systemd-journal08:45:010
213625999227,2cyclictest0-21swapper/212:02:232
2136259992219,2cyclictest2283242-21fschecks_count09:37:342
2136259992219,2cyclictest2212596-21cron08:25:002
2136259992217,4cyclictest2367063-21kworker/u8:0+flush-8:011:05:012
2136255992219,2cyclictest2192847-21munin-run08:05:001
2136255992218,2cyclictest0-21swapper/110:57:341
2136255992218,2cyclictest0-21swapper/110:07:441
2136255992217,3cyclictest2422523-21fschecks_time11:57:341
2136255992212,3cyclictest0-21swapper/111:00:471
2136251992218,2cyclictest0-21swapper/011:55:000
2136259992117,2cyclictest2193315-21aten2_r5power_c08:07:292
2136259992117,2cyclictest0-21swapper/209:05:002
2136255992118,2cyclictest0-21swapper/107:57:311
2136255992118,2cyclictest0-21swapper/107:57:311
2136255992112,7cyclictest2203151-21find08:17:241
2136251992116,3cyclictest0-21swapper/012:07:370
2136251992115,4cyclictest2094097-21kworker/u8:0+flush-8:008:02:340
2136251992115,3cyclictest0-21swapper/010:30:010
2136251992113,6cyclictest2411597-21unixbench_singl11:42:460
2136251992111,8cyclictest2411848-21kworker/u8:1+flush-8:012:12:410
213625999202,14cyclictest2152312-21ntpq07:22:402
2136259992017,2cyclictest2338093-21fschecks_count10:32:292
2136259992017,2cyclictest2313088-21aten2_r5power_c10:07:272
2136259992016,2cyclictest0-21swapper/211:37:502
2136259992016,2cyclictest0-21swapper/209:27:372
213625599209,3cyclictest0-21swapper/112:26:271
213625599209,3cyclictest0-21swapper/112:26:271
2136255992016,2cyclictest2141266-21systemctl07:15:011
2136255992016,2cyclictest0-21swapper/109:27:331
2136255992014,4cyclictest0-21swapper/111:07:481
213625999192,12cyclictest2417218-21apt-get11:52:262
2136259991916,2cyclictest2407336-21aten2_r5power_c11:42:262
2136259991915,2cyclictest2347030-21unixbench_singl10:37:502
2136259991915,2cyclictest0-21swapper/209:17:342
2136259991915,2cyclictest0-21swapper/207:27:372
2136259991912,5cyclictest2441669-21latency_hist12:15:012
2136259991911,6cyclictest2350647-21tr10:42:362
213625999187,8cyclictest275-21systemd-journal09:15:002
2136259991815,2cyclictest2352709-21aten2_r5power_e10:47:272
2136259991814,2cyclictest0-21swapper/208:42:252
2136259991814,2cyclictest0-21swapper/207:15:012
2136259991813,3cyclictest2396951-21idleruntime-cro11:30:002
2136259991813,3cyclictest0-21swapper/212:22:462
2136259991812,4cyclictest2361418-21ntpq10:52:432
213625999180,15cyclictest2237708-21latency_hist08:50:012
21314582183,9sleep30-21swapper/307:05:203
213625999177,2cyclictest0-21swapper/211:07:412
2136259991713,2cyclictest2426350-21unixbench_multi11:57:492
2136259991713,2cyclictest0-21swapper/211:22:312
2136259991713,2cyclictest0-21swapper/207:57:402
2136259991713,2cyclictest0-21swapper/207:57:402
213625999166,7cyclictest2201638-21cut08:12:362
213625999162,13cyclictest0-21swapper/210:10:252
2136259991613,2cyclictest0-21swapper/209:40:382
24072772132,6sleep30-21swapper/311:42:253
23912872132,7sleep30-21swapper/311:22:393
23662662132,7sleep30-21swapper/310:57:393
23324192132,6sleep30-21swapper/310:25:003
22473932132,5sleep30-21swapper/309:00:013
22238572132,7sleep30-21swapper/308:37:343
22018312132,7sleep30-21swapper/308:12:383
21765962134,6sleep30-21swapper/307:47:383
21587362132,7sleep30-21swapper/307:32:333
24607582122,6sleep30-21swapper/312:32:383
24560352122,6sleep30-21swapper/312:27:443
24560352122,6sleep30-21swapper/312:27:443
24471552122,6sleep30-21swapper/312:22:303
24319962122,6sleep30-21swapper/312:07:253
24307722122,6sleep30-21swapper/312:02:353
24230752122,6sleep30-21swapper/311:57:383
23969802122,5sleep30-21swapper/311:30:013
23863682122,6sleep30-21swapper/311:17:453
23774222122,7sleep30-21swapper/311:12:283
23720172122,5sleep30-21swapper/311:05:013
23673512122,6sleep30-21swapper/311:01:083
23580082122,6sleep30-21swapper/310:52:333
23427992123,6sleep30-21swapper/310:37:323
23373962122,6sleep30-21swapper/310:30:023
23328832122,6sleep30-21swapper/310:27:293
23267552122,6sleep30-21swapper/310:17:463
23267552122,6sleep30-21swapper/310:17:463
23179972122,6sleep30-21swapper/310:12:283
23139532122,6sleep30-21swapper/310:07:353
23125172122,6sleep30-21swapper/310:03:503
23031982122,6sleep30-21swapper/309:57:323
22974212122,5sleep30-21swapper/309:50:013
22917612122,6sleep30-21swapper/309:42:433
22726252122,5sleep30-21swapper/309:25:013
22630212124,5sleep30-21swapper/309:15:423
22519012122,6sleep30-21swapper/309:02:463
22375862122,6sleep30-21swapper/308:50:023
22334822120,2sleep3481ktimers/308:47:313
22318702122,6sleep30-21swapper/308:42:393
22126302122,6sleep30-21swapper/308:25:023
22031772122,6sleep30-21swapper/308:17:273
21973632122,6sleep30-21swapper/308:07:483
21887532122,6sleep30-21swapper/308:02:303
21671792122,6sleep30-21swapper/307:37:383
21572962122,6sleep30-21swapper/307:27:433
21420422122,6sleep30-21swapper/307:15:033
21371132122,6sleep30-21swapper/307:12:343
24656902112,5sleep30-21swapper/312:37:433
24656902112,5sleep30-21swapper/312:37:433
24419562112,5sleep30-21swapper/312:17:333
24367932112,5sleep30-21swapper/312:10:023
24212292112,5sleep30-21swapper/311:52:453
24120542112,5sleep30-21swapper/311:45:023
24023192112,6sleep30-21swapper/311:37:243
23958002112,5sleep30-21swapper/311:27:373
23475882112,5sleep30-21swapper/310:41:063
22932032112,5sleep30-21swapper/309:47:323
22862092112,5sleep30-21swapper/309:37:413
22817382111,6sleep30-21swapper/309:32:403
22580262112,6sleep30-21swapper/309:10:123
22567792112,5sleep30-21swapper/309:07:393
22183512112,5sleep30-21swapper/308:32:323
21831642112,5sleep30-21swapper/307:55:083
21831642112,5sleep30-21swapper/307:55:083
21784032113,5sleep30-21swapper/307:52:233
21683852112,5sleep30-21swapper/307:40:473
21487552112,6sleep30-21swapper/307:22:303
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional