You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-21 - 21:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Sun Dec 21, 2025 12:44:11)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
26704622950,2sleep00-21swapper/011:38:580
25545772630,2sleep3471rcuc/309:39:033
2405980995736,18cyclictest2496651-21awk08:40:002
2405977995444,8cyclictest278-21systemd-journal10:10:011
2405974995046,3cyclictest2600697-21kworker/u8:3+events_unbound11:49:100
2405977994939,7cyclictest2501569-21latency_hist08:45:011
2405974994943,4cyclictest2674557-21kworker/u8:0+events_unbound12:34:150
2405974994939,7cyclictest2699524-21latency_hist12:05:000
2405977994742,3cyclictest2427955-21kworker/u8:0+flush-8:008:04:101
2405974994743,3cyclictest2600697-21kworker/u8:3+flush-8:011:54:100
2405974994743,3cyclictest2477190-21kworker/u8:2+events_unbound10:09:150
2405974994740,6cyclictest2650154-21kworker/u8:2+flush-8:011:19:120
27162022460,2chrt371rcuc/212:24:012
2405974994639,5cyclictest2477190-21kworker/u8:2+events_unbound09:59:100
2405980994525,17cyclictest2689440-21awk11:55:002
2405974994541,3cyclictest2477190-21kworker/u8:2+events_unbound08:44:130
2405977994439,4cyclictest2373770-21kworker/u8:3+flush-8:008:09:121
2405977994436,6cyclictest278-21systemd-journal07:15:011
2405977994433,9cyclictest2427641-21/usr/sbin/munin07:30:011
2405974994435,3cyclictest2477190-21kworker/u8:2+events_unbound08:39:000
2405974994410,30cyclictest2386149-21kworker/0:0+events08:48:550
2405974994339,3cyclictest2373770-21kworker/u8:3+flush-8:008:29:110
2405974994338,4cyclictest2600697-21kworker/u8:3+events_unbound12:09:120
2405974994338,3cyclictest2410931-21kworker/u8:2+events_unbound07:28:570
2405974994337,4cyclictest2600697-21kworker/u8:3+events_unbound11:58:590
2405974994335,3cyclictest2477190-21kworker/u8:2+events_unbound09:25:010
2405974994331,3cyclictest2580958-21kworker/u8:1+events_unbound10:41:100
2405977994238,3cyclictest2729290-21kworker/u8:2+flush-8:012:39:111
2405974994238,3cyclictest2551142-21kworker/u8:1+events_unbound09:54:130
2405974994236,4cyclictest2580958-21kworker/u8:1+events_unbound10:29:080
2405974994235,5cyclictest2410931-21kworker/u8:2+events_unbound07:40:000
2405974994232,7cyclictest278-21systemd-journal11:20:010
2405974994136,3cyclictest2580958-21kworker/u8:1+events_unbound10:14:010
2405974994133,6cyclictest2467069-21latency_hist08:10:010
2405977994035,3cyclictest2600697-21kworker/u8:3+flush-8:011:23:581
2405977994033,5cyclictest2406496-21apt-get07:13:541
2405974994036,3cyclictest2709570-21kworker/u8:3+flush-8:012:29:130
2405974994036,3cyclictest2679527-21kworker/u8:1+flush-8:012:23:580
2405974994035,3cyclictest2580958-21kworker/u8:1+events_unbound10:24:120
2405974994034,4cyclictest2561266-21kworker/u8:3+events_unbound10:03:590
240597499403,35cyclictest2410937-21munin-run07:15:010
2405974994032,3cyclictest2511664-21kworker/u8:0+events_unbound09:09:010
2405977993933,5cyclictest2600697-21kworker/u8:3+flush-8:011:34:101
2405974993934,3cyclictest2410931-21kworker/u8:2+events_unbound07:54:120
2405974993931,3cyclictest2551142-21kworker/u8:1+events_unbound09:35:370
2405974993931,3cyclictest2373770-21kworker/u8:3+events_unbound07:43:440
2405977993834,3cyclictest2704346-21kworker/u8:2+flush-8:012:14:121
2405977993834,3cyclictest2427955-21kworker/u8:0+flush-8:007:39:111
2405977993829,6cyclictest2654722-21latency_hist11:20:011
2405977993828,8cyclictest2601245-21diskstats10:28:581
2405974993832,4cyclictest2373770-21kworker/u8:3+flush-8:008:30:100
2405974993830,3cyclictest2620183-21kworker/u8:0+events_unbound10:49:090
2405980993723,12cyclictest2684388-21unixbench_singl11:49:132
2405977993728,6cyclictest2447397-21latency_hist07:50:001
2405977993727,8cyclictest2471421-21ntpq08:14:071
2405974993733,3cyclictest2600697-21kworker/u8:3+events_unbound10:38:540
2405974993733,3cyclictest2477190-21kworker/u8:2+flush-8:009:49:130
2405974993731,4cyclictest2580958-21kworker/u8:1+events_unbound10:34:060
2405974993731,4cyclictest2391551-21kworker/u8:0+events_unbound07:18:550
2405974993724,10cyclictest278-21systemd-journal08:05:010
240128023726,6sleep10-21swapper/107:08:081
2405980993627,7cyclictest2501563-21awk08:45:002
2405977993629,5cyclictest2650154-21kworker/u8:2+flush-8:011:39:131
2405974993632,3cyclictest2650154-21kworker/u8:2+events_unbound11:33:580
2405974993632,3cyclictest2526507-21kworker/u8:1+events_unbound09:19:040
2405974993628,3cyclictest2630216-21kworker/u8:1+events_unbound11:13:110
2405974993627,3cyclictest2600697-21kworker/u8:3+events_unbound11:25:030
2405977993529,5cyclictest2580958-21kworker/u8:1+flush-8:010:14:151
2405974993531,3cyclictest2600697-21kworker/u8:3+events_unbound11:04:130
2405974993531,3cyclictest2526507-21kworker/u8:1+flush-8:009:14:110
2405974993531,3cyclictest2427955-21kworker/u8:0+events_unbound07:35:000
2405974993528,2cyclictest2427955-21kworker/u8:0+events_unbound07:58:470
2405974993527,3cyclictest2580958-21kworker/u8:1+events_unbound10:15:260
2405980993428,4cyclictest2405651-21apt-get07:10:032
2405980993413,8cyclictest2634942-21awk11:00:002
2405974993430,3cyclictest2679527-21kworker/u8:1+flush-8:012:19:130
2405974993430,3cyclictest2600697-21kworker/u8:3+events_unbound11:43:580
2405974993430,3cyclictest2373770-21kworker/u8:3+flush-8:008:19:140
2405974993424,9cyclictest2467326-21kworker/u8:1+flush-8:008:20:050
2405977993328,4cyclictest2477190-21kworker/u8:2+flush-8:009:54:121
2405977993328,3cyclictest2477190-21kworker/u8:2+flush-8:008:49:111
2405977993325,6cyclictest2556105-21latency_hist09:40:011
2405974993328,4cyclictest2373770-21kworker/u8:3+events_unbound08:11:100
24011642334,9sleep20-21swapper/207:06:362
2405980993224,6cyclictest2531185-21apt-get09:15:002
2405980993220,10cyclictest2506367-21unixbench_multi08:49:142
2405980993213,6cyclictest2490317-21tr08:34:052
2405977993224,6cyclictest2709570-21kworker/u8:3+flush-8:012:29:121
2405974993228,3cyclictest2511664-21kworker/u8:0+flush-8:009:25:100
2405974993228,3cyclictest2391551-21kworker/u8:0+events_unbound07:10:020
2405974993227,4cyclictest2679527-21kworker/u8:1+flush-8:012:35:210
2405974993224,3cyclictest2477190-21kworker/u8:2+events_unbound09:41:120
2405974993224,3cyclictest2477190-21kworker/u8:2+events_unbound08:59:500
240598099317,4cyclictest0-21swapper/208:13:532
2405980993117,12cyclictest2725038-21fschecks_time12:33:592
2405980993117,12cyclictest2521912-21aten2_r5power_c09:08:592
2405977993126,3cyclictest2729053-21awk12:35:001
2405974993125,4cyclictest2477190-21kworker/u8:2+events_unbound08:55:000
2405980993022,6cyclictest278-21systemd-journal12:30:002
240598099302,11cyclictest2555544-21ntpq09:39:092
2405980993014,2cyclictest0-21swapper/212:39:112
240598099301,11cyclictest2570270-21ntpq09:54:082
2405977993025,4cyclictest2410931-21kworker/u8:2+flush-8:007:59:121
2405974993026,3cyclictest2511664-21kworker/u8:0+events_unbound09:01:100
2405974993026,3cyclictest2391551-21kworker/u8:0+flush-8:007:24:040
2405974993026,3cyclictest2373770-21kworker/u8:3+flush-8:007:45:100
2405974993022,3cyclictest2600697-21kworker/u8:3+events_unbound10:56:540
240598099293,8cyclictest2541901-21apt-get09:28:542
2405980992913,3cyclictest2437552-21sh07:40:002
2405980992913,3cyclictest0-21swapper/211:05:002
2405977992924,4cyclictest2561266-21kworker/u8:3+events_unbound09:50:001
2405974992925,3cyclictest2600697-21kworker/u8:3+events_unbound11:08:560
2405974992925,3cyclictest2511664-21kworker/u8:0+events_unbound09:31:110
2405974992925,3cyclictest2477190-21kworker/u8:2+flush-8:010:50:100
240598099287,8cyclictest2453616-21cut07:59:012
240598099287,7cyclictest2413211-21seq07:17:052
240598099283,6cyclictest2629449-21ntpq10:54:122
240598099282,7cyclictest2604767-21ntpq10:29:082
2405980992812,4cyclictest2541232-21unixbench_singl09:24:132
240598099281,11cyclictest2655513-21apt-get11:23:542
2405977992824,3cyclictest2561266-21kworker/u8:3+flush-8:010:04:101
2405977992823,4cyclictest2526507-21kworker/u8:1+flush-8:009:14:301
2405977992823,4cyclictest2373770-21kworker/u8:3+flush-8:007:44:121
2405977992822,5cyclictest2580958-21kworker/u8:1+flush-8:010:34:131
240598099276,2cyclictest0-21swapper/210:08:582
240598099273,3cyclictest25931822cut10:19:052
240598099272,7cyclictest2700067-21apt-get12:08:562
2405980992720,5cyclictest278-21systemd-journal12:00:002
2405980992713,2cyclictest0-21swapper/211:14:002
2405980992713,2cyclictest0-21swapper/208:54:122
2405980992712,2cyclictest0-21swapper/207:29:092
240598099270,3cyclictest25512122true09:35:002
2405977992723,3cyclictest2620183-21kworker/u8:0+flush-8:010:59:111
2405977992723,3cyclictest2546681-21anacron09:32:371
2405977992722,3cyclictest2689646-21awk11:55:001
2405977992721,4cyclictest2615799-21apt-get10:43:541
2405977992719,6cyclictest278-21systemd-journal08:32:091
2405977992719,6cyclictest2580958-21kworker/u8:1+flush-8:010:39:051
2405977992719,6cyclictest2571676-21cut09:59:011
2405977992719,4cyclictest2410931-21kworker/u8:2+events_unbound07:34:131
2405980992611,3cyclictest2644187-21ntpq11:09:092
2405977992622,3cyclictest2600697-21kworker/u8:3+flush-8:012:09:071
2405977992621,4cyclictest2546105-21unixbench_multi09:29:131
2405977992615,9cyclictest2644223-21ntpq11:09:091
2405974992618,3cyclictest2704346-21kworker/u8:2+events_unbound12:13:090
2405977992521,3cyclictest2679527-21kworker/u8:1+flush-8:012:19:031
2405977992521,3cyclictest2644767-21kworker/u8:0+events_unbound11:14:151
2405977992521,3cyclictest2620183-21kworker/u8:0+flush-8:010:54:001
2405977992521,3cyclictest2373770-21kworker/u8:3+flush-8:007:20:311
2405977992520,3cyclictest0-21swapper/111:45:001
2405977992518,6cyclictest2625104-21sh10:50:001
2405977992518,5cyclictest2595398-21grep10:19:161
2405977992517,6cyclictest2516403-21latency_hist09:00:001
2405977992516,4cyclictest2674557-21kworker/u8:0+events_unbound12:03:581
2405977992511,5cyclictest0-21swapper/109:44:251
240598099249,6cyclictest2654125-21sshd11:19:092
2405980992419,4cyclictest2600330-21unixbench_singl10:24:142
2405977992421,2cyclictest2521315-21cron09:04:591
2405977992420,3cyclictest2600697-21kworker/u8:3+events_unbound11:28:571
2405977992419,3cyclictest2684271-21wc11:49:131
2405977992418,5cyclictest2427955-21kworker/u8:0+flush-8:007:54:091
2405977992417,6cyclictest2506516-21kworker/u8:1+flush-8:008:54:101
2405980992318,4cyclictest2590483-21unixbench_singl10:14:142
2405980992311,2cyclictest0-21swapper/210:04:022
2405977992319,3cyclictest2481737-21unixbench_multi08:24:141
2405977992319,3cyclictest20643-21cron12:00:001
2405977992319,2cyclictest0-21swapper/110:24:111
2405977992319,2cyclictest0-21swapper/108:19:121
2405977992318,4cyclictest2526507-21kworker/u8:1+flush-8:009:19:011
2405977992318,4cyclictest2427955-21kworker/u8:0+flush-8:008:39:121
2405977992317,4cyclictest2635489-21apt-get11:03:541
2405977992314,7cyclictest278-21systemd-journal09:24:011
2405980992218,2cyclictest2472840-21fschecks_count08:18:582
2405980992218,2cyclictest2457899-21aten2_r5power_v08:03:552
2405977992217,4cyclictest2373770-21kworker/u8:3+events_unbound08:29:011
2405980992118,2cyclictest2556757-21aten2_r5power_p09:43:562
2405977992117,3cyclictest2679527-21kworker/u8:1+flush-8:012:20:311
2405980992017,2cyclictest2670566-21fschecks_count11:38:592
2405977992016,2cyclictest0-21swapper/109:08:591
2405980991915,2cyclictest0-21swapper/208:10:012
2405980991914,3cyclictest2512210-21cpuspeed_turbos08:58:572
240598099186,4cyclictest0-21swapper/211:29:052
2405980991815,2cyclictest2616724-21tr10:44:022
2405980991815,2cyclictest2428245-21aten2_r5power_e07:33:572
2405980991814,3cyclictest2710107-21cpuspeed_turbos12:18:572
2405980991814,3cyclictest0-21swapper/211:34:162
2405980991814,2cyclictest0-21swapper/209:59:042
24010502183,8sleep30-21swapper/307:05:093
2405980991713,3cyclictest0-21swapper/207:54:142
2405980991713,2cyclictest0-21swapper/212:14:002
2405980991713,2cyclictest0-21swapper/209:49:022
2405980991713,2cyclictest0-21swapper/207:24:002
240598099167,7cyclictest2676263-21tr11:44:022
240598099167,7cyclictest2611549-21sed10:39:002
240598099162,13cyclictest0-21swapper/209:01:172
2405980991613,2cyclictest0-21swapper/212:00:172
2405980991613,2cyclictest0-21swapper/210:32:402
2405980991613,2cyclictest0-21swapper/209:18:152
2405980991613,2cyclictest0-21swapper/208:27:402
2405980991613,2cyclictest0-21swapper/207:41:072
2405980991612,2cyclictest0-21swapper/210:49:062
2405980991610,4cyclictest2443288-21sh07:48:592
2405980991510,3cyclictest0-21swapper/208:24:052
26498892146,5sleep30-21swapper/311:15:023
26945732132,7sleep30-21swapper/312:00:003
26201592133,6sleep30-21swapper/310:45:013
26053682132,7sleep30-21swapper/310:30:003
25807142132,6sleep30-21swapper/310:05:003
25717582132,7sleep30-21swapper/309:59:033
24917042132,6sleep30-21swapper/308:35:013
24346472132,7sleep30-21swapper/307:39:033
24115362132,7sleep30-21swapper/307:15:043
24061692132,7sleep30-21swapper/307:10:023
27339752122,6sleep30-21swapper/312:40:003
27241362122,5sleep30-21swapper/312:30:013
27237812122,6sleep30-21swapper/312:29:133
27148632122,6sleep30-21swapper/312:23:553
27135942123,5sleep30-21swapper/312:19:063
27043022122,6sleep30-21swapper/312:09:153
26844362122,6sleep30-21swapper/311:49:173
26650952122,6sleep30-21swapper/311:30:473
26598882122,6sleep30-21swapper/311:25:013
26587442122,6sleep30-21swapper/311:24:053
26448312122,6sleep30-21swapper/311:10:013
26424092122,6sleep30-21swapper/311:09:043
26357452122,6sleep30-21swapper/311:03:593
26347982122,6sleep30-21swapper/310:59:133
26135212122,6sleep30-21swapper/310:39:033
26057252122,6sleep30-21swapper/310:31:333
25954352122,6sleep30-21swapper/310:19:173
25904642122,6sleep30-21swapper/310:14:153
25700622122,6sleep30-21swapper/309:54:053
25613512122,6sleep30-21swapper/309:46:113
25367152122,6sleep30-21swapper/309:21:153
25272892122,6sleep30-21swapper/309:14:013
25244352122,6sleep30-21swapper/309:09:083
25128742122,6sleep30-21swapper/308:59:043
25079322123,5sleep30-21swapper/308:54:033
25025522122,6sleep30-21swapper/308:49:013
24989662123,5sleep30-21swapper/308:44:033
24859832122,6sleep30-21swapper/308:29:033
24722542122,6sleep30-21swapper/308:15:113
24627342122,6sleep30-21swapper/308:08:573
24577502122,6sleep30-21swapper/308:03:473
24522922122,5sleep30-21swapper/307:55:003
24430662122,6sleep30-21swapper/307:48:593
24276182123,5sleep30-21swapper/307:30:013
24183582122,6sleep30-21swapper/307:23:553
27089512112,5sleep30-21swapper/312:14:123
26950292112,5sleep30-21swapper/312:02:373
26845212112,5sleep30-21swapper/311:50:013
26751142112,5sleep30-21swapper/311:43:033
26700982112,6sleep30-21swapper/311:36:573
26253692112,6sleep30-21swapper/310:50:393
26161782112,5sleep30-21swapper/310:44:013
25963232112,5sleep30-21swapper/310:23:583
25760352112,6sleep30-21swapper/310:00:153
25603462112,5sleep30-21swapper/309:44:063
25470482112,5sleep30-21swapper/309:33:593
25416592112,6sleep30-21swapper/309:26:043
25316412112,5sleep30-21swapper/309:15:053
25174812112,5sleep30-21swapper/309:04:023
24920352112,5sleep30-21swapper/308:36:133
24773662112,6sleep30-21swapper/308:22:453
24673212112,6sleep30-21swapper/308:10:293
24380852112,5sleep30-21swapper/307:43:453
24279502113,5sleep30-21swapper/307:31:143
24525502102,5sleep30-21swapper/307:55:163
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional