You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-07 - 04:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Sun Dec 07, 2025 00:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
253180921140,3chrt0-21swapper/119:41:041
269569821060,4sleep30-21swapper/322:26:123
2499674997349,8cyclictest2540629-21ntpq19:46:192
2499673996252,7cyclictest2724831-21latency_hist22:55:011
2499669996254,6cyclictest2550414-21ntpq19:56:150
2499673996052,6cyclictest2634996-21kworker/u8:2+flush-8:021:51:231
2499673996049,9cyclictest2594894-21ntpq20:41:181
2499673995646,8cyclictest2709019-21ntpq22:36:141
2499669995546,6cyclictest2605602-21latency_hist20:55:010
2499669995444,8cyclictest2619563-21ntpq21:06:160
2499673995345,6cyclictest2536713-21kworker/u8:1+flush-8:020:26:171
2499673995248,3cyclictest2724383-21kworker/u8:2+events_unbound00:31:261
2499673995242,8cyclictest2669249-21ntpq21:56:131
2499673995045,4cyclictest2536713-21kworker/u8:1+flush-8:019:51:211
2499673995044,4cyclictest2724383-21kworker/u8:2+events_unbound23:31:151
2499673995044,4cyclictest2605622-21kworker/u8:3+events_unbound21:06:201
2499673995043,4cyclictest2511764-21apt-get19:21:021
2499673994841,5cyclictest2468024-21kworker/u8:1+flush-8:019:26:221
2499673994838,7cyclictest282-21systemd-journal19:15:061
2499673994835,10cyclictest2555346-21ntpq20:01:161
2499669994839,7cyclictest2570197-21ntpq20:16:170
2499673994742,4cyclictest2668207-21kworker/u8:0+events_unbound22:31:181
2499673994737,8cyclictest2714058-21ntpq22:41:171
2499669994738,7cyclictest282-21systemd-journal20:40:000
2499669994738,6cyclictest2828916-21latency_hist00:40:010
2499673994641,4cyclictest2536713-21kworker/u8:1+events_unbound20:21:151
2499673994640,5cyclictest2605622-21kworker/u8:3+flush-8:022:11:211
2499669994639,6cyclictest2521557-21kworker/u8:0+flush-8:019:46:080
2499673994541,3cyclictest2536713-21kworker/u8:1+flush-8:020:51:091
2499673994438,4cyclictest2605622-21kworker/u8:3+events_unbound21:36:221
2499673994437,5cyclictest2536713-21kworker/u8:1+events_unbound20:31:191
2499673994435,7cyclictest2644294-21ntpq21:31:171
2499669994439,4cyclictest2521557-21kworker/u8:0+flush-8:020:46:130
2499673994338,4cyclictest2605622-21kworker/u8:3+events_unbound21:26:201
2499673994338,3cyclictest2605622-21kworker/u8:3+flush-8:023:41:151
2499673994336,5cyclictest2724383-21kworker/u8:2+flush-8:023:51:181
2499669994336,5cyclictest282-21systemd-journal22:03:490
2499669994333,8cyclictest2700584-21diskstats22:31:050
2499673994237,4cyclictest2605622-21kworker/u8:3+flush-8:022:16:071
2499673994237,4cyclictest2605622-21kworker/u8:3+events_unbound20:56:231
2499673994236,4cyclictest2724383-21kworker/u8:2+flush-8:023:36:231
2499673994233,7cyclictest2605622-21kworker/u8:3+flush-8:000:16:061
2499673994232,8cyclictest2589988-21ntpq20:36:171
2499669994237,3cyclictest2536713-21kworker/u8:1+flush-8:019:51:070
2499669994230,9cyclictest282-21systemd-journal23:25:010
2499673994136,4cyclictest2605622-21kworker/u8:3+events_unbound00:21:181
2499673994036,3cyclictest2521557-21kworker/u8:0+flush-8:021:11:181
2499673994033,5cyclictest2715262-21apt-get22:46:021
2499673994030,7cyclictest282-21systemd-journal19:31:331
2499669994034,4cyclictest2605622-21kworker/u8:3+events_unbound23:41:200
26670872390,7sleep3451irq_work/321:56:103
2499673993934,3cyclictest2724383-21kworker/u8:2+events_unbound23:26:171
2499673993933,4cyclictest2605622-21kworker/u8:3+events_unbound23:21:191
2499673993931,6cyclictest2817941-21ntpq00:26:171
2499673993929,7cyclictest282-21systemd-journal21:49:321
2499669993935,3cyclictest2521557-21kworker/u8:0+events_unbound21:11:140
2499669993921,15cyclictest282-21systemd-journal22:59:330
2499669993921,15cyclictest282-21systemd-journal22:59:330
27744552380,5sleep3451irq_work/323:45:013
2499673993834,3cyclictest2732805-21kworker/u8:1+events_unbound23:06:231
253079323727,5sleep30-21swapper/319:36:213
2499674993726,8cyclictest2709962-21awk22:40:002
2499673993732,4cyclictest2784381-21kworker/u8:0+events_unbound00:06:221
2499673993731,5cyclictest2605622-21kworker/u8:3+events_unbound23:16:141
2499673993728,6cyclictest282-21systemd-journal20:17:331
2499673993727,7cyclictest2779191-21latency_hist23:50:011
2499669993729,6cyclictest282-21systemd-journal21:55:000
2499669993729,6cyclictest2526287-21latency_hist19:35:010
2499669993727,8cyclictest2690483-21diskstats22:21:080
2499673993631,4cyclictest2605622-21kworker/u8:3+events_unbound22:01:231
2499673993624,8cyclictest282-21systemd-journal23:56:351
2499669993628,6cyclictest2784125-21latency_hist23:55:000
2499669993628,6cyclictest2605622-21kworker/u8:3+events_unbound23:16:200
2499669993627,6cyclictest2585839-21latency_hist20:35:010
2499669993625,8cyclictest2354085-21kworker/u8:2+flush-8:019:21:030
2499673993530,4cyclictest2724383-21kworker/u8:2+events_unbound00:11:191
2499673993529,4cyclictest2605622-21kworker/u8:3+flush-8:022:26:241
2499673993528,5cyclictest2540525-21ntpq19:46:161
2499669993523,9cyclictest2715511-21diskstats22:46:070
2499673993429,3cyclictest2468024-21kworker/u8:1+events_unbound19:11:101
2499673993427,6cyclictest2625594-21kworker/u8:1+flush-8:021:21:151
2499673993427,5cyclictest2625594-21kworker/u8:1+events_unbound21:16:091
2499673993424,7cyclictest2600682-21latency_hist20:50:011
2499669993430,3cyclictest2724383-21kworker/u8:2+events_unbound23:31:200
2499669993429,3cyclictest2610564-21basename21:00:000
2499673993329,3cyclictest2536713-21kworker/u8:1+flush-8:020:11:241
2499673993329,3cyclictest2536713-21kworker/u8:1+flush-8:020:11:231
2499673993327,4cyclictest2468024-21kworker/u8:1+events_unbound19:36:151
2499673993326,5cyclictest2521557-21kworker/u8:0+flush-8:019:56:211
2499673993324,6cyclictest2729767-21latency_hist23:00:011
2499673993324,6cyclictest2729767-21latency_hist23:00:011
2499669993328,4cyclictest2605622-21kworker/u8:3+flush-8:000:21:230
2499669993325,6cyclictest2803985-21latency_hist00:15:010
24992432334,9sleep20-21swapper/219:06:502
24948812333,9sleep10-21swapper/119:05:241
2499673993226,4cyclictest2605622-21kworker/u8:3+flush-8:000:36:151
2499673993226,4cyclictest2605622-21kworker/u8:3+events_unbound21:41:271
2499669993220,10cyclictest2698955-21ntpq22:26:190
2499673993125,4cyclictest2605622-21kworker/u8:3+events_unbound00:01:211
2499669993127,3cyclictest2605622-21kworker/u8:3+events_unbound21:36:200
2499669993127,3cyclictest2605622-21kworker/u8:3+events_unbound21:31:210
2499669993126,4cyclictest2732805-21kworker/u8:1+flush-8:023:56:160
2499669993125,5cyclictest2468024-21kworker/u8:1+events_unbound19:36:200
2499669993124,5cyclictest2605622-21kworker/u8:3+events_unbound21:26:150
2499669993120,8cyclictest2759409-21latency_hist23:30:010
249966999311,25cyclictest2489778-21kworker/0:0+events19:10:220
2499669993026,2cyclictest2670167-21sendmail22:00:000
2499669993024,5cyclictest2732805-21kworker/u8:1+flush-8:023:06:160
2499669993021,7cyclictest2675683-21diskstats22:06:080
249967399296,3cyclictest25608532grep20:06:231
2499673992918,3cyclictest2521557-21kworker/u8:0+flush-8:021:01:131
2499674992824,2cyclictest2724814-21cron22:55:002
2499674992824,2cyclictest2571028-21cron20:20:002
2499674992823,3cyclictest2789788-21fschecks_time00:01:082
249967499280,26cyclictest1-21systemd21:50:012
2499673992822,4cyclictest2668207-21kworker/u8:0+flush-8:022:21:181
2499669992822,4cyclictest2555841-21unixbench_multi20:01:240
2499674992724,2cyclictest2819199-21latency_hist00:30:012
2499674992723,2cyclictest2784737-21fschecks_count23:56:052
2499674992721,4cyclictest2516414-21cron19:25:002
2499673992723,2cyclictest2734723-21idleruntime-cro23:05:001
2499669992723,2cyclictest2511408-21cron19:20:000
2499669992721,5cyclictest2605622-21kworker/u8:3+flush-8:000:04:380
2499669992721,4cyclictest2605622-21kworker/u8:3+flush-8:022:51:120
2499669992718,7cyclictest2605622-21kworker/u8:3+flush-8:021:21:030
2499674992623,2cyclictest2819439-21aten2_r5power_e00:31:082
2499674992623,2cyclictest2783773-21unixbench_singl23:51:242
2499674992622,2cyclictest2749159-21unixbench_multi23:16:272
249966999262,23cyclictest0-21swapper/023:01:200
2499669992621,4cyclictest2724383-21kworker/u8:2+flush-8:023:39:350
2499669992621,4cyclictest2605622-21kworker/u8:3+flush-8:000:19:440
249966999261,23cyclictest2615118-21unixbench_multi21:01:240
24993882262,5sleep00-21swapper/019:08:410
2499674992521,2cyclictest2630314-21cron21:19:592
2499673992520,3cyclictest2605622-21kworker/u8:3+events_unbound23:11:111
2499673992519,4cyclictest2668207-21kworker/u8:0+events_unbound22:06:131
249966999257,3cyclictest28149202irqrtprio00:26:130
249966999252,22cyclictest2541434-21kworker/0:2+events20:11:100
249966999252,22cyclictest2541434-21kworker/0:2+events20:11:100
2499669992521,3cyclictest2795122-21tr00:06:110
2499669992520,4cyclictest2536713-21kworker/u8:1+flush-8:020:06:260
2499669992520,3cyclictest0-21swapper/019:26:100
249966999251,22cyclictest2709526-21unixbench_multi22:36:220
2499674992421,2cyclictest2675491-21aten2_r5power_e22:06:042
2499674992421,2cyclictest2586276-21aten2_r5power_v20:36:052
2499674992420,2cyclictest2794685-21fschecks_count00:06:082
2499674992420,2cyclictest2704931-21cron22:35:002
2499674992420,2cyclictest2504221-21grep19:11:222
2499674992415,7cyclictest2611222-21fschecks_time21:01:082
249966999245,17cyclictest2789127-21kworker/0:0+events00:31:220
249966999242,21cyclictest0-21swapper/020:26:210
2499669992419,4cyclictest2732805-21kworker/u8:1+events_unbound23:46:170
2499669992419,4cyclictest2644672-21kworker/u8:1+events_unbound21:41:170
2499669992418,4cyclictest2744259-21unixbench_singl23:11:240
2499669992418,4cyclictest2668207-21kworker/u8:0+events_unbound22:41:180
2499669992417,5cyclictest2688995-21ntpq22:16:150
2499674992319,2cyclictest2571440-21aten2_r5power_e20:21:042
2499674992318,3cyclictest2828521-21unixbench_multi00:36:232
2499674992318,3cyclictest2556233-21turbostat.cron20:05:002
2499674992317,4cyclictest2750154-21fschecks_count23:21:082
2499669992313,8cyclictest2629434-21ntpq21:16:150
249967499224,3cyclictest27738292cat23:41:212
2499674992219,2cyclictest2531939-21aten2_r5power_v19:41:052
2499674992218,3cyclictest0-21swapper/223:15:012
2499674992218,2cyclictest2764699-21aten2_r5power_c23:36:052
2499674992218,2cyclictest2585826-21cron20:35:012
2499674992212,8cyclictest2680427-21aten2_r5power_e22:11:082
249966999225,16cyclictest2489778-21kworker/0:0+events19:41:060
2499669992216,4cyclictest2634996-21kworker/u8:2+events_unbound21:46:080
2499674992117,3cyclictest2732259-21kthreadcore23:01:122
2499674992116,4cyclictest18912-21cron20:50:002
2499669992116,4cyclictest2682508-21kthreadcore22:11:160
2499669992115,4cyclictest2571615-21cpuspeed_turbos20:21:050
249967499208,4cyclictest0-21swapper/221:21:222
249967499202,13cyclictest2774581-21apt-get23:46:052
249967499202,13cyclictest2661523-21ps21:51:122
2499674992017,2cyclictest2714553-21unixbench_multi22:41:242
2499674992017,2cyclictest2690548-21fschecks_time22:21:072
2499674992016,3cyclictest2755109-21fschecks_count23:26:052
2499674992016,2cyclictest2689502-21grep22:16:242
2499674992016,2cyclictest2546333-21cron19:55:002
2499674992016,2cyclictest0-21swapper/222:56:152
2499674992016,2cyclictest0-21swapper/222:56:142
2499674992016,2cyclictest0-21swapper/221:11:142
2499674992015,3cyclictest2809554-21fschecks_count00:21:082
2499674992015,3cyclictest2759997-21fschecks_count23:31:072
2499674992012,6cyclictest2527198-21fschecks_time19:36:072
2499674992012,6cyclictest2521947-21fschecks_count19:31:082
2499674992011,7cyclictest2735306-21fschecks_count23:06:072
2499674992011,7cyclictest2519616-21tr19:26:122
2499669992016,2cyclictest2591397-21cpuspeed_turbos20:41:080
249967499199,7cyclictest2645503-21cat21:35:012
249967499192,8cyclictest25608532grep20:06:232
2499674991915,2cyclictest2715484-21tr22:46:062
2499674991915,2cyclictest2610564-21basename21:00:002
2499674991913,4cyclictest2562418-21kthreadcore20:11:142
2499674991913,4cyclictest2562418-21kthreadcore20:11:142
2499674991911,6cyclictest2672038-21tr22:01:132
2499674991910,8cyclictest2804599-21fschecks_count00:16:092
2499674991910,7cyclictest2651867-21tr21:41:122
2499674991910,7cyclictest2505036-21tr19:15:022
24949302193,9sleep30-21swapper/319:06:033
2499674991815,2cyclictest0-21swapper/221:10:002
2499674991814,2cyclictest2551291-21cron20:00:002
2499674991814,2cyclictest0-21swapper/220:41:202
2499674991810,6cyclictest2603333-21tr20:51:142
2499674991810,6cyclictest2576581-21fschecks_count20:26:062
2499674991713,2cyclictest0-21swapper/221:26:052
249967499170,3cyclictest2802659-21tr00:11:172
249967499167,7cyclictest2669753-21unixbench_multi21:56:212
249967499163,3cyclictest26957012tr22:26:122
249967499162,13cyclictest0-21swapper/221:37:042
28288982143,7sleep30-21swapper/300:40:003
27439982142,8sleep30-21swapper/323:11:223
27672212130,3sleep3481ktimers/323:36:143
27593922132,6sleep30-21swapper/323:30:003
27161442133,7sleep30-21swapper/322:46:113
26849342132,6sleep30-21swapper/322:15:013
26711152132,6sleep30-21swapper/322:01:123
26105472131,8sleep30-21swapper/321:00:003
25412052133,6sleep30-21swapper/319:47:333
25164412132,6sleep30-21swapper/319:25:013
28197562122,6sleep30-21swapper/300:31:133
28141252122,6sleep30-21swapper/300:25:363
28086662122,6sleep30-21swapper/300:17:003
28033852122,6sleep30-21swapper/300:11:273
27747422122,6sleep30-21swapper/323:46:073
27453062122,6sleep30-21swapper/323:16:133
27347392122,6sleep30-21swapper/323:05:013
27304162122,6sleep30-21swapper/323:01:083
27251262122,6sleep30-21swapper/322:56:023
27251262122,6sleep30-21swapper/322:56:023
27241382122,6sleep30-21swapper/322:51:213
27146332122,6sleep30-21swapper/322:41:253
26852802122,6sleep30-21swapper/322:16:053
26602622122,6sleep30-21swapper/321:50:013
26507392122,6sleep30-21swapper/321:41:063
26409442122,6sleep30-21swapper/321:31:113
26394832122,6sleep30-21swapper/321:26:213
26048452122,6sleep30-21swapper/320:51:223
25880982122,6sleep30-21swapper/320:36:133
25760142122,6sleep30-21swapper/320:25:013
25713422122,6sleep30-21swapper/320:20:523
25708982122,6sleep30-21swapper/320:18:273
25601512122,6sleep30-21swapper/320:06:153
25512892122,6sleep30-21swapper/320:00:003
25414752122,5sleep30-21swapper/319:50:023
25318322121,7sleep30-21swapper/319:41:073
25256892122,6sleep30-21swapper/319:31:233
25121342122,6sleep30-21swapper/319:21:083
25003192122,6sleep30-21swapper/319:11:083
28096562112,5sleep30-21swapper/300:21:103
27946682112,5sleep30-21swapper/300:06:093
27896822110,7sleep30-21swapper/300:01:083
27841382112,5sleep30-21swapper/323:55:023
27797732112,5sleep30-21swapper/323:51:083
27596382113,5sleep30-21swapper/323:30:093
27503662112,5sleep30-21swapper/323:21:103
27090282112,5sleep30-21swapper/322:36:163
27003072112,5sleep30-21swapper/322:31:023
26903352112,5sleep30-21swapper/322:21:073
26791762112,5sleep30-21swapper/322:06:183
26608582112,5sleep30-21swapper/321:51:093
26457382112,5sleep30-21swapper/321:36:033
26343912112,5sleep30-21swapper/321:21:153
26253692112,5sleep30-21swapper/321:15:013
26208192112,5sleep30-21swapper/321:11:083
26198122112,5sleep30-21swapper/321:06:223
26111632112,5sleep30-21swapper/321:01:093
26000722112,5sleep30-21swapper/320:46:233
25920512112,5sleep30-21swapper/320:41:143
25812572111,6sleep30-21swapper/320:31:073
25618742112,5sleep30-21swapper/320:11:123
25618742112,5sleep30-21swapper/320:11:113
25475552112,6sleep30-21swapper/319:56:123
25106402112,5sleep30-21swapper/319:16:193
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional