You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-16 - 14:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Thu Apr 16, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
38191262650,9chrt291ktimers/108:46:221
39356512600,4sleep2371rcuc/210:45:012
39666452550,2chrt75-21kworker/3:1+events11:16:203
3720320995549,4cyclictest3915955-21kworker/u8:2+flush-8:010:26:291
3720320995547,5cyclictest3714900-21kworker/u8:1+events_unbound07:21:271
3720320995346,5cyclictest3806660-21kworker/u8:3+flush-8:008:36:311
3720320995240,9cyclictest3806660-21kworker/u8:3+flush-8:009:51:261
3720316995238,10cyclictest280-21systemd-journal07:36:240
3720320995145,4cyclictest3720544-21kworker/u8:0+flush-8:009:56:301
3720320995145,4cyclictest3720544-21kworker/u8:0+flush-8:009:56:301
3720320995144,5cyclictest3994921-21kworker/u8:3+flush-8:012:11:251
372031699511,47cyclictest1-21systemd09:40:000
3720320995044,4cyclictest3806660-21kworker/u8:3+events_unbound09:01:241
3720320995044,4cyclictest3781950-21kworker/u8:3+flush-8:008:21:281
3720320995043,4cyclictest3720544-21kworker/u8:0+flush-8:011:31:331
3720316995043,5cyclictest3915963-21kworker/u8:4+flush-8:010:26:150
39861322490,6sleep3451irq_work/311:36:183
3720320994943,4cyclictest3915955-21kworker/u8:2+events_unbound11:06:261
3720320994942,5cyclictest3720544-21kworker/u8:0+flush-8:009:11:271
3720320994940,6cyclictest3720544-21kworker/u8:0+flush-8:010:41:271
3720316994940,6cyclictest3816325-21latency_hist08:45:010
3720320994841,5cyclictest3720544-21kworker/u8:0+flush-8:010:06:291
3720320994841,4cyclictest3955607-21latency_hist11:05:011
3720316994841,5cyclictest3906142-21apt-get10:16:110
3720320994740,5cyclictest3720544-21kworker/u8:0+flush-8:008:06:291
3720320994740,5cyclictest3720544-21kworker/u8:0+flush-8:008:06:291
3720320994740,5cyclictest3720544-21kworker/u8:0+flush-8:008:01:271
3720320994733,10cyclictest4010089-21latency_hist12:00:001
3720320994733,10cyclictest4010089-21latency_hist12:00:001
3720316994737,7cyclictest3737176-21latency_hist07:25:010
38079532460,5sleep30-21swapper/308:36:213
3720320994641,3cyclictest4030566-21kworker/u8:4+events_unbound12:26:141
3720320994640,4cyclictest3985133-21kworker/u8:2+flush-8:011:46:181
3720320994640,4cyclictest3985133-21kworker/u8:2+flush-8:011:46:181
3720320994540,4cyclictest3742381-21kworker/u8:2+events_unbound07:51:251
3720320994537,6cyclictest3720544-21kworker/u8:0+flush-8:010:21:301
3720316994537,5cyclictest3678225-21kworker/u8:3+flush-8:007:26:190
3720320994439,3cyclictest3994921-21kworker/u8:3+events_unbound12:01:161
3720320994438,4cyclictest3801701-21kworker/u8:2+flush-8:009:26:191
3720320994438,3cyclictest3678225-21kworker/u8:3+events_unbound07:26:211
3720320994437,5cyclictest3720544-21kworker/u8:0+flush-8:007:36:291
3720316994436,6cyclictest280-21systemd-journal12:20:240
3720316994435,6cyclictest3747073-21latency_hist07:35:010
3720320994337,4cyclictest3678225-21kworker/u8:3+events_unbound07:15:001
3720320994336,5cyclictest3720544-21kworker/u8:0+flush-8:007:41:281
3720320994336,5cyclictest3720544-21kworker/u8:0+events_unbound09:16:291
3720320994332,8cyclictest3949814-21ntpq10:56:271
39681112420,1sleep13968112-21kthreadcore11:16:221
3720325994236,4cyclictest3720544-21kworker/u8:0+flush-8:011:46:232
3720325994236,4cyclictest3720544-21kworker/u8:0+flush-8:011:46:232
3720320994236,5cyclictest3985133-21kworker/u8:2+flush-8:012:06:251
3720320994235,6cyclictest3806660-21kworker/u8:3+flush-8:009:36:241
3720320994235,5cyclictest3801701-21kworker/u8:2+flush-8:008:41:271
3720320994235,5cyclictest3781950-21kworker/u8:3+flush-8:008:11:261
3720320994234,5cyclictest3970926-21grep11:21:141
3720320994135,4cyclictest3720544-21kworker/u8:0+flush-8:011:11:311
3720320994134,5cyclictest3720544-21kworker/u8:0+events_unbound11:36:281
3720320994133,6cyclictest3985133-21kworker/u8:2+flush-8:011:41:281
3720320994133,5cyclictest3806660-21kworker/u8:3+events_unbound08:51:241
3720320994035,3cyclictest4030566-21kworker/u8:4+events_unbound12:31:271
3720320994034,4cyclictest3985133-21kworker/u8:2+events_unbound12:16:261
3720320994033,5cyclictest3801701-21kworker/u8:2+flush-8:009:21:251
3720320994033,5cyclictest3801701-21kworker/u8:2+flush-8:009:06:231
3720320994033,5cyclictest3742381-21kworker/u8:2+flush-8:007:46:291
3720316994033,5cyclictest3720544-21kworker/u8:0+events_unbound10:36:240
3720325993933,4cyclictest3720544-21kworker/u8:0+flush-8:008:31:282
3720325993929,7cyclictest280-21systemd-journal08:40:002
3720320993932,5cyclictest3720544-21kworker/u8:0+events_unbound10:01:241
3720320993929,7cyclictest280-21systemd-journal07:20:001
372031699391,36cyclictest3786676-21true08:15:000
3720320993832,4cyclictest3720544-21kworker/u8:0+flush-8:011:26:321
3720320993829,7cyclictest3806394-21latency_hist08:35:011
3720320993826,8cyclictest3747071-21turbostat.cron07:35:001
3720320993731,4cyclictest3791599-21latency_hist08:20:011
3720320993731,3cyclictest4035305-21cron12:25:001
3720320993729,6cyclictest4030559-21kworker/u8:1+flush-8:012:36:261
3720316993732,3cyclictest3985133-21kworker/u8:2+events_unbound12:06:310
3720316993731,4cyclictest3714900-21kworker/u8:1+flush-8:007:16:190
3720316993730,5cyclictest3831735-21apt-get09:01:110
37197532374,11sleep10-21swapper/107:06:551
3720320993631,4cyclictest3720544-21kworker/u8:0+events_unbound10:11:191
3720320993631,4cyclictest3720544-21kworker/u8:0+events_unbound09:46:141
3720320993630,5cyclictest3781950-21kworker/u8:3+events_unbound08:26:151
3720320993630,4cyclictest3915955-21kworker/u8:2+flush-8:010:31:241
3720320993629,5cyclictest3906039-21kworker/u8:1+events_unbound10:16:161
3720320993629,5cyclictest3720544-21kworker/u8:0+flush-8:010:46:271
3720320993628,6cyclictest3806660-21kworker/u8:3+flush-8:009:41:261
3720320993529,4cyclictest3826761-21apt-get08:56:121
3720316993525,8cyclictest3914838-21ntpq10:21:240
3720320993429,3cyclictest3720544-21kworker/u8:0+events_unbound10:36:151
3720316993424,8cyclictest4010085-21apt-get12:00:000
3720316993424,8cyclictest4010085-21apt-get12:00:000
3720316993417,14cyclictest280-21systemd-journal08:57:240
40470952330,6sleep20-21swapper/212:36:202
3720316993325,6cyclictest3776789-21latency_hist08:05:000
3720325993226,4cyclictest3678225-21kworker/u8:3+flush-8:007:26:292
3720320993226,4cyclictest3801701-21kworker/u8:2+events_unbound09:31:271
3720320993225,5cyclictest3720544-21kworker/u8:0+flush-8:007:56:261
3720320993224,6cyclictest3940452-21kworker/u8:1+flush-8:010:51:281
3720316993226,4cyclictest3980408-21true11:30:000
3720316993225,5cyclictest3806660-21kworker/u8:3+flush-8:008:51:150
3720316993126,3cyclictest3950616-21cron11:00:000
3720325993025,4cyclictest3806660-21kworker/u8:3+flush-8:009:06:272
3720325993024,4cyclictest3756637-21unixbench_multi07:41:322
3720316993025,3cyclictest401-21dbus-daemon09:50:000
3720316993022,6cyclictest3801801-21apt-get08:31:110
3720316993021,7cyclictest280-21systemd-journal09:24:240
3720325992924,3cyclictest3720544-21kworker/u8:0+events_unbound11:16:252
37197792293,8sleep20-21swapper/207:07:162
39214292280,3sleep2371rcuc/210:31:152
3720325992823,3cyclictest4034991-21unixbench_singl12:21:312
3720325992822,4cyclictest3720544-21kworker/u8:0+flush-8:008:56:272
3720325992818,8cyclictest280-21systemd-journal10:11:242
3720325992818,7cyclictest4010514-21cat12:00:012
3720325992818,7cyclictest4010514-21cat12:00:012
3720316992824,3cyclictest4050265-21latency_hist12:40:010
3720316992820,6cyclictest3720544-21kworker/u8:0+flush-8:010:01:240
372031699273,17cyclictest3720311-21gpgv07:10:010
3720316992721,4cyclictest3945367-21unixbench_singl10:51:330
3720316992721,4cyclictest3720544-21kworker/u8:0+flush-8:011:51:220
3720316992718,6cyclictest3781725-21latency_hist08:10:010
3720316992718,6cyclictest3781725-21latency_hist08:10:010
38709422260,7sleep2371rcuc/209:40:002
3720325992623,2cyclictest3939836-21sshd10:46:242
3720325992622,2cyclictest3733487-21kthreadcore07:21:202
3720325992620,4cyclictest3950304-21unixbench_singl10:56:332
372031699262,23cyclictest0-21swapper/008:26:300
3720316992621,4cyclictest3999864-21unixbench_singl11:46:330
3720316992621,4cyclictest3999864-21unixbench_singl11:46:330
3720316992621,4cyclictest3965172-21unixbench_singl11:11:320
3720316992621,3cyclictest3771494-21unixbench_multi07:56:310
3720316992614,4cyclictest1-21systemd11:06:350
3720316992610,5cyclictest0-21swapper/011:31:320
3720325992522,2cyclictest3841826-21fschecks_count09:11:162
3720325992520,3cyclictest3930260-21unixbench_singl10:36:322
3720325992520,3cyclictest3891165-21aten2_r5power_e10:01:132
3720320992517,6cyclictest4000534-21apt-get11:51:121
372031699252,22cyclictest0-21swapper/011:21:300
3720316992520,3cyclictest3862315-21kthreadcore09:31:200
3720316992520,3cyclictest3720544-21kworker/u8:0+events_unbound11:36:140
3720316992519,4cyclictest3845827-21unixbench_singl09:11:320
3720316992515,8cyclictest3905667-21cp10:15:010
3720325992420,2cyclictest4015903-21fschecks_count12:06:162
3720325992420,2cyclictest3820903-21unixbench_multi08:46:322
3720325992419,3cyclictest3920317-21unixbench_multi10:26:302
3720325992415,7cyclictest280-21systemd-journal08:55:002
372032599241,10cyclictest37462802ld07:31:252
3720316992420,2cyclictest4024254-21needreboot12:11:230
3720316992420,2cyclictest3841247-21systemd-run09:10:010
3720316992420,2cyclictest0-21swapper/010:45:000
3720316992419,4cyclictest3994921-21kworker/u8:3+events_unbound12:01:260
3720316992419,3cyclictest0-21swapper/011:20:010
3720316992418,4cyclictest3915963-21kworker/u8:4+flush-8:010:33:550
3720316992418,4cyclictest3720544-21kworker/u8:0+flush-8:007:41:300
3720316992415,7cyclictest3936113-21munin-node10:46:110
3720325992321,1cyclictest3720544-21kworker/u8:0+events_unbound09:20:002
3720325992319,2cyclictest3811781-21aten2_r5power_c08:41:142
3720325992318,4cyclictest3781950-21kworker/u8:3+events_unbound08:25:012
3720325992318,3cyclictest3767508-21fschecks_count07:56:152
3720325992317,5cyclictest3985133-21kworker/u8:2+flush-8:011:41:332
3720316992320,2cyclictest3955601-21sh11:05:000
3720316992319,3cyclictest3994893-21unixbench_multi11:41:330
3720316992319,3cyclictest3890441-21unixbench_singl09:56:290
3720316992319,3cyclictest3890441-21unixbench_singl09:56:280
3720316992319,3cyclictest3720544-21kworker/u8:0+flush-8:008:47:550
3720316992319,2cyclictest3861046-21sh09:30:000
372031699231,18cyclictest589-21runrttasks08:36:130
372032599222,19cyclictest0-21swapper/211:21:302
3720325992218,3cyclictest3781717-21idleruntime-cro08:10:002
3720325992218,3cyclictest3781717-21idleruntime-cro08:10:002
3720325992218,2cyclictest3960886-21aten2_r5power_c11:11:142
3720325992218,2cyclictest3896097-21aten2_r5power_e10:06:122
3720325992217,4cyclictest3940452-21kworker/u8:1+flush-8:010:51:332
3720325992217,3cyclictest0-21swapper/210:25:002
3720325992213,7cyclictest3884954-21sshd09:51:252
3720316992218,3cyclictest3791288-21unixbench_singl08:16:310
3720316992217,4cyclictest3985133-21kworker/u8:2+flush-8:012:16:180
3720316992217,4cyclictest0-21swapper/012:26:200
372032599212,14cyclictest3861391-21apt-get09:31:122
3720325992117,2cyclictest3886158-21aten2_r5power_c09:56:112
3720325992117,2cyclictest3886158-21aten2_r5power_c09:56:112
3720325992117,2cyclictest3876612-21fschecks_time09:46:152
3720325992117,2cyclictest3851670-21cpuspeed_turbos09:21:142
3720316992117,3cyclictest3742381-21kworker/u8:2+flush-8:007:51:270
3720316992117,2cyclictest0-21swapper/009:51:130
3720316992116,4cyclictest876-21mta-sts-daemon10:06:210
3720316992116,4cyclictest3720544-21kworker/u8:0+flush-8:007:46:550
3720316992115,4cyclictest1-21systemd09:15:240
372032599202,1cyclictest0-21swapper/212:16:282
3720325992017,2cyclictest3787264-21fschecks_count08:16:162
3720325992017,2cyclictest3782331-21fschecks_count08:11:172
3720325992016,2cyclictest4020764-21cpuspeed_turbos12:11:142
3720325992015,3cyclictest0-21swapper/212:26:322
3720325992014,4cyclictest4004773-21unixbench_multi11:51:322
3720325992012,6cyclictest3985295-21cron11:35:002
3720325992012,6cyclictest280-21systemd-journal07:55:002
372031699207,11cyclictest3875018-21needreboot09:41:240
3720325991916,2cyclictest3955602-21cron11:05:002
3720325991915,3cyclictest3775528-21kthreadcore08:01:232
3720325991915,2cyclictest3747762-21fschecks_time07:36:152
3720325991914,3cyclictest0-21swapper/209:45:002
3720316991913,4cyclictest4041489-21kernelversion12:31:180
37153322193,8sleep30-21swapper/307:05:043
372032599188,8cyclictest3727793-21sort07:16:132
372032599187,8cyclictest3985643-21apt-get11:36:122
372032599183,9cyclictest3720645-21apt-get07:11:112
372032599182,10cyclictest3979621-21ntpq11:26:282
3720325991814,2cyclictest0-21swapper/209:26:152
372031699181,3cyclictest3795965-21python308:21:310
3720316991813,3cyclictest3723856-21kthreadcore07:11:220
372032599177,7cyclictest4012400-21cut12:01:202
3720325991714,2cyclictest3831792-21aten2_r5power_e09:01:132
3720325991713,2cyclictest0-21swapper/210:16:312
372032599162,13cyclictest0-21swapper/212:31:272
3720325991613,2cyclictest0-21swapper/207:46:292
3720325991611,3cyclictest0-21swapper/211:06:242
38850972156,6sleep30-21swapper/309:51:303
372032599156,7cyclictest3797764-21sed08:26:192
39396392142,7sleep30-21swapper/310:46:233
40346422132,7sleep30-21swapper/312:21:293
38996302132,7sleep30-21swapper/310:06:223
38876842132,7sleep30-21swapper/309:56:193
38876842132,7sleep30-21swapper/309:56:193
38765062133,6sleep30-21swapper/309:46:163
38613652132,7sleep30-21swapper/309:31:113
38502802133,6sleep30-21swapper/309:16:253
37965742132,6sleep30-21swapper/308:25:023
37736412132,7sleep30-21swapper/308:01:223
40481152122,6sleep30-21swapper/312:36:223
40292222122,7sleep30-21swapper/312:16:243
40202312122,6sleep30-21swapper/312:10:023
40066852123,6sleep30-21swapper/311:56:213
40066852123,6sleep30-21swapper/311:56:213
40045742122,6sleep30-21swapper/311:51:323
39999072122,6sleep30-21swapper/311:46:343
39999072122,6sleep30-21swapper/311:46:343
39809772122,6sleep30-21swapper/311:31:173
39761972122,6sleep30-21swapper/311:26:203
39706432122,6sleep30-21swapper/311:20:023
39601782122,6sleep30-21swapper/311:06:333
39514092122,6sleep30-21swapper/311:01:203
39457262122,6sleep30-21swapper/310:55:023
39311992122,6sleep30-21swapper/310:41:173
39260852123,6sleep30-21swapper/310:36:163
39244432122,6sleep30-21swapper/310:31:223
39054312122,6sleep30-21swapper/310:13:253
38752042122,6sleep30-21swapper/309:41:303
38667232122,6sleep30-21swapper/309:36:173
38370132122,6sleep30-21swapper/309:06:153
38307952122,6sleep30-21swapper/308:56:323
38222902122,6sleep30-21swapper/308:51:183
38020482122,6sleep30-21swapper/308:31:163
37964842122,6sleep30-21swapper/308:24:223
37829532123,5sleep30-21swapper/308:11:213
37815102122,6sleep30-21swapper/308:07:243
37815102122,6sleep30-21swapper/308:07:243
37685942122,6sleep30-21swapper/307:56:213
37570292122,5sleep30-21swapper/307:45:013
37473562122,6sleep30-21swapper/307:35:503
37417222122,6sleep30-21swapper/307:26:313
37321852122,5sleep30-21swapper/307:20:013
37256742122,6sleep30-21swapper/307:15:043
37203692122,5sleep30-21swapper/307:10:013
40361082111,6sleep30-21swapper/312:26:193
40155622112,6sleep30-21swapper/312:05:523
40146842112,5sleep30-21swapper/312:01:303
39905552113,5sleep30-21swapper/311:40:243
39608602112,5sleep30-21swapper/311:11:153
39446002112,5sleep30-21swapper/310:51:253
39159392112,6sleep30-21swapper/310:25:043
39155342112,6sleep30-21swapper/310:22:523
39061462112,5sleep30-21swapper/310:16:133
38949632112,5sleep30-21swapper/310:01:283
38561112112,5sleep30-21swapper/309:25:013
38558332112,5sleep30-21swapper/309:22:243
38321452112,5sleep30-21swapper/309:01:173
38208912112,5sleep30-21swapper/308:46:333
38122282111,6sleep30-21swapper/308:41:193
37905842112,5sleep30-21swapper/308:16:233
37625532112,6sleep30-21swapper/307:51:153
37564182112,5sleep30-21swapper/307:41:323
37424572112,5sleep30-21swapper/307:31:133
40404722102,5sleep30-21swapper/312:30:043
38414482102,5sleep30-21swapper/309:10:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional