You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-07 - 03:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Tue Apr 07, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
357727421830,2sleep3471rcuc/319:16:193
378298621510,4sleep10-21swapper/122:41:271
3570147995953,4cyclictest3681245-21apt-get21:00:001
3570147995044,4cyclictest3611276-21kworker/u8:3+flush-8:019:51:361
3570147994641,3cyclictest3681724-21kworker/u8:4+events_unbound21:31:221
3570152994338,3cyclictest3800385-21kworker/u8:0+events_unbound23:56:262
3570147994337,4cyclictest3746334-21kworker/u8:3+events_unbound22:31:371
3570147994237,4cyclictest3860526-21kworker/u8:3+events_unbound00:26:271
3570147994236,4cyclictest3681724-21kworker/u8:4+events_unbound21:51:361
3570147994232,8cyclictest3671216-21cp20:50:001
38200262410,3sleep375-21kworker/3:1+events23:16:373
3570152994135,4cyclictest3621895-21kworker/u8:2+flush-8:020:26:372
3570147994136,4cyclictest3601650-21kworker/u8:0+events_unbound20:01:361
3570147994035,4cyclictest3601650-21kworker/u8:0+flush-8:020:06:371
3570147994034,5cyclictest3820756-21kworker/u8:2+flush-8:000:16:381
357014599392,35cyclictest3810660-21kworker/0:2+events23:16:210
3570147993832,4cyclictest3691619-21kworker/u8:0+flush-8:021:11:381
3570147993831,5cyclictest3621112-21grep19:56:391
3570147993830,6cyclictest3885026-21latency_hist00:25:011
3570147993826,9cyclictest280-21systemd-journal22:55:001
357014599383,28cyclictest3701368-21kworker/0:1+events21:46:210
3570147993730,5cyclictest3820756-21kworker/u8:2+flush-8:000:36:301
3570147993730,5cyclictest3384733-21kworker/u8:1+flush-8:019:31:341
3570147993728,7cyclictest3636766-21kworker/u8:1+flush-8:020:21:311
3570145993710,22cyclictest2211518-21kworker/0:0+events20:11:210
35698212374,10sleep10-21swapper/119:08:111
3570152993631,4cyclictest3706007-21kworker/u8:1+flush-8:021:31:392
3570152993626,7cyclictest3621800-21cat20:00:012
3570147993632,3cyclictest3746334-21kworker/u8:3+flush-8:022:21:321
3570147993628,6cyclictest3701679-21apt-get21:21:191
3570147993628,6cyclictest3701679-21apt-get21:21:191
3570145993631,3cyclictest3860028-21idleruntime-cro00:00:000
3570145993612,22cyclictest2211518-21kworker/0:0+events19:16:180
3570147993531,3cyclictest3771059-21kworker/u8:4+events_unbound23:06:231
3570147993531,2cyclictest3805729-21systemd-run23:05:001
3570147993531,2cyclictest3609106-21kthreadcore19:46:271
3570147993529,4cyclictest3611276-21kworker/u8:3+events_unbound20:11:341
3570145993529,4cyclictest3622102-21tr20:01:200
3570145993510,24cyclictest2211518-21kworker/0:0+events20:56:260
3570147993428,4cyclictest3771059-21kworker/u8:4+events_unbound23:50:011
3570147993428,4cyclictest3721457-21apt-get21:41:151
357014599341,31cyclictest2211518-21kworker/0:0+events21:16:310
357014599341,27cyclictest2211518-21kworker/0:0+events21:11:210
3570145993410,22cyclictest2211518-21kworker/0:0+events19:46:330
3570147993327,5cyclictest3681724-21kworker/u8:4+flush-8:021:56:331
3570147993326,5cyclictest3601978-21apt-get19:41:181
3570145993325,6cyclictest3636859-21/usr/sbin/munin20:16:360
357014599332,29cyclictest3810660-21kworker/0:2+events00:21:300
357014599332,29cyclictest3810660-21kworker/0:2+events00:16:210
357014599331,30cyclictest3810660-21kworker/0:2+events23:21:270
3570152993224,6cyclictest3751250-21turbostat.cron22:10:002
3570147993227,4cyclictest3771059-21kworker/u8:4+flush-8:023:11:321
3570147993227,4cyclictest3706007-21kworker/u8:1+events_unbound22:06:341
3570147993227,3cyclictest3832918-21kthreadcore23:31:281
3570147993227,3cyclictest3832918-21kthreadcore23:31:281
3570147993224,6cyclictest3681724-21kworker/u8:4+flush-8:021:16:331
3570147993224,6cyclictest0-21swapper/120:26:241
357014599328,19cyclictest3810660-21kworker/0:2+events00:35:330
357014599323,27cyclictest2211518-21kworker/0:0+events19:11:200
3570145993225,5cyclictest3844888-21unixbench_multi23:41:380
3570145993222,8cyclictest3794960-21ntpq22:51:320
357014599322,28cyclictest3701368-21kworker/0:1+events22:41:340
357014599322,28cyclictest3701368-21kworker/0:1+events22:26:230
357014599321,30cyclictest2211518-21kworker/0:0+events20:41:300
357014599321,26cyclictest2211518-21kworker/0:0+events19:31:190
357014599321,25cyclictest3701368-21kworker/0:1+events22:35:210
3570145993210,20cyclictest2211518-21kworker/0:0+events19:41:190
357014599320,30cyclictest3701368-21kworker/0:1+events22:21:330
3570152993125,4cyclictest3675940-21unixbench_multi20:51:392
3570147993124,5cyclictest3865252-21latency_hist00:05:011
357014599318,18cyclictest2211518-21kworker/0:0+events19:25:450
357014599313,26cyclictest2211518-21kworker/0:0+events19:36:290
3570145993128,2cyclictest3721136-21systemd-run21:40:000
357014599312,28cyclictest3800757-21kworker/0:0+events23:01:370
357014599312,27cyclictest3701368-21kworker/0:1+events22:31:350
357014599312,27cyclictest3701368-21kworker/0:1+events21:26:250
357014599312,27cyclictest2211518-21kworker/0:0+events20:36:310
3570145993121,8cyclictest3865847-21diskstats00:06:220
357014599311,28cyclictest3810660-21kworker/0:2+events23:46:260
357014599311,28cyclictest3701368-21kworker/0:1+events21:21:220
357014599311,28cyclictest3701368-21kworker/0:1+events21:21:220
3570145993111,19cyclictest2211518-21kworker/0:0+events21:06:230
3570145993110,19cyclictest3810660-21kworker/0:2+events23:36:340
3570147993025,3cyclictest3841384-21irqrtprio23:41:261
3570147993025,3cyclictest3777104-21irqrtprio22:36:271
3570147993025,3cyclictest3746339-21systemd-run22:05:011
3570147993024,4cyclictest3540568-21kworker/u8:2+flush-8:019:36:321
3570147993022,6cyclictest3601650-21kworker/u8:0+flush-8:020:31:311
3570147993021,6cyclictest280-21systemd-journal22:17:291
3570147993020,8cyclictest3581048-21ntpq19:16:311
357014599302,26cyclictest2211518-21kworker/0:0+events21:01:370
357014599301,27cyclictest3701368-21kworker/0:1+events22:01:290
357014599301,27cyclictest2211518-21kworker/0:0+events19:21:350
36724942290,2sleep00-21swapper/020:51:270
3570152992925,2cyclictest3820146-21unixbench_multi23:16:372
3570152992924,4cyclictest3636766-21kworker/u8:1+flush-8:020:21:352
3570152992924,3cyclictest3844899-21unixbench_singl23:41:392
3570152992922,5cyclictest3616179-21grep19:51:372
3570152992921,6cyclictest3732482-21kthreadcore21:51:252
3570152992919,8cyclictest3780624-21unixbench_singl22:36:392
3570147992925,2cyclictest3768302-21kthreadcore22:26:291
3570147992925,2cyclictest3731301-21grep21:50:011
3570147992925,2cyclictest3657211-21irqcore20:36:251
3570147992924,4cyclictest3820756-21kworker/u8:2+flush-8:000:06:371
3570147992924,4cyclictest3384733-21kworker/u8:1+flush-8:019:26:341
3570147992924,3cyclictest3746334-21kworker/u8:3+events_unbound22:56:211
3570147992923,4cyclictest3706007-21kworker/u8:1+events_unbound21:36:271
3570147992922,5cyclictest3665878-21grep20:41:381
3570147992921,6cyclictest3746334-21kworker/u8:3+flush-8:022:46:321
357014599299,15cyclictest3701368-21kworker/0:1+events21:55:030
3570145992924,3cyclictest3890192-21systemd-run00:30:010
357014599292,26cyclictest3810660-21kworker/0:2+events23:26:330
357014599292,22cyclictest2211518-21kworker/0:0+events20:25:220
357014599291,26cyclictest2211518-21kworker/0:0+events19:56:180
3570145992912,15cyclictest3701368-21kworker/0:1+events22:56:340
357014599290,28cyclictest3701368-21kworker/0:1+events22:11:270
357014599290,27cyclictest3810660-21kworker/0:2+events23:31:350
357014599290,27cyclictest3810660-21kworker/0:2+events23:31:350
357014599290,27cyclictest3701368-21kworker/0:1+events22:07:410
3570152992823,3cyclictest3575165-21wc19:15:012
3570147992822,4cyclictest3751597-21apt-get22:11:201
3570147992822,4cyclictest0-21swapper/123:20:001
3570147992821,5cyclictest3575004-21turbostat.cron19:15:011
357014599289,18cyclictest2211518-21kworker/0:0+events20:47:060
357014599281,26cyclictest2211518-21kworker/0:0+events20:33:220
3570145992811,15cyclictest3810660-21kworker/0:2+events00:31:320
3570152992722,4cyclictest3540568-21kworker/u8:2+flush-8:019:15:062
3570147992722,3cyclictest3800385-21kworker/u8:0+events_unbound23:26:291
3570147992722,3cyclictest3687154-21cut21:06:241
357014599278,17cyclictest3810660-21kworker/0:2+events23:51:250
3570145992723,2cyclictest0-21swapper/000:15:000
3570145992720,5cyclictest280-21systemd-journal22:50:000
3570145992710,15cyclictest3701368-21kworker/0:1+events21:51:210
3570145992710,15cyclictest2211518-21kworker/0:0+events19:51:290
3570152992623,2cyclictest3884661-21unixbench_multi00:21:382
3570152992622,3cyclictest3771671-21fschecks_count22:31:232
3570152992622,3cyclictest3771059-21kworker/u8:4+events_unbound23:06:312
3570152992622,2cyclictest3791533-21fschecks_time22:51:232
3570152992621,4cyclictest3840282-21idleruntime-cro23:40:002
3570152992621,3cyclictest3874827-21unixbench_singl00:11:392
3570152992621,3cyclictest3726640-21cpuspeed_turbos21:46:222
3570152992618,6cyclictest3885824-21cpuspeed_turbos00:26:212
3570147992622,3cyclictest3636766-21kworker/u8:1+events_unbound21:01:361
3570147992622,2cyclictest3872713-21kthreadcore00:11:281
3570147992622,2cyclictest3582937-21irqrtprio19:21:251
3570147992621,4cyclictest3636766-21kworker/u8:1+events_unbound20:51:271
3570147992620,4cyclictest3890518-21apt-get00:31:181
3570147992619,5cyclictest3681724-21kworker/u8:4+flush-8:021:26:361
357014599269,16cyclictest2211518-21kworker/0:0+events20:21:380
357014599267,18cyclictest2211518-21kworker/0:0+events20:06:290
357014599267,15cyclictest3701368-21kworker/0:1+events21:40:260
3570145992610,15cyclictest3701368-21kworker/0:1+events22:16:390
3570152992522,2cyclictest3820961-21aten2_r5power_p23:21:212
3570152992520,4cyclictest3621895-21kworker/u8:2+flush-8:020:41:252
3570152992519,4cyclictest3800340-21unixbench_multi22:56:392
3570152992515,8cyclictest20977-21cron22:45:002
3570147992520,4cyclictest3800385-21kworker/u8:0+events_unbound23:51:251
3570147992518,5cyclictest3800385-21kworker/u8:0+flush-8:023:36:381
357014599256,14cyclictest3701368-21kworker/0:1+events21:30:170
38765542240,4sleep239-21ksoftirqd/200:16:272
357015299242,10cyclictest0-21swapper/221:35:052
3570152992413,8cyclictest3788996-21cut22:46:272
357015299241,11cyclictest35880552uname19:26:262
3570147992414,8cyclictest280-21systemd-journal23:25:001
357014799241,21cyclictest3860111-21unin-run00:00:011
357014599249,14cyclictest3810660-21kworker/0:2+events23:11:220
357014599248,15cyclictest3800757-21kworker/0:0+events23:06:180
3570152992320,2cyclictest3666882-21fschecks_time20:46:222
3570152992319,2cyclictest3801288-21cpuspeed_turbos23:01:212
3570152992318,3cyclictest3627261-21fschecks_count20:06:232
3570152992318,3cyclictest3622128-21aten2_r5power_v20:01:202
3570152992316,5cyclictest3756228-21turbostat.cron22:15:002
357014799232,15cyclictest583-21snmpd20:16:191
3570152992218,3cyclictest3771059-21kworker/u8:4+events_unbound00:01:352
3570152992218,3cyclictest3680318-21tail20:56:302
3570152992217,3cyclictest0-21swapper/200:06:382
3570152992215,5cyclictest3745991-21unixbench_singl22:01:392
3570152992214,6cyclictest0-21swapper/220:11:392
3570152992212,7cyclictest3686453-21awk21:05:002
357014599227,13cyclictest3810660-21kworker/0:2+events00:00:450
366650522112,5sleep30-21swapper/320:46:173
357015299217,8cyclictest0-21swapper/219:37:012
3570152992118,2cyclictest3766817-21fschecks_time22:26:242
3570152992117,3cyclictest3582305-21aten2_r5power_p19:21:202
3570152992117,2cyclictest3736808-21aten2_r5power_e21:56:212
3570152992116,3cyclictest0-21swapper/223:35:002
3570152992116,3cyclictest0-21swapper/223:35:002
3570152992112,7cyclictest280-21systemd-journal21:15:002
357015299210,9cyclictest36908492switchtime21:06:402
357015299202,13cyclictest3890518-21apt-get00:31:202
3570152992016,3cyclictest3826073-21fschecks_count23:26:212
3570152992016,2cyclictest0-21swapper/223:51:202
3570152992011,7cyclictest3655966-21grep20:31:382
3570152992011,7cyclictest3592915-21sed19:31:262
3570152991915,2cyclictest0-21swapper/221:16:352
357015299190,17cyclictest3638315-21kthreadcore20:16:272
35697552194,9sleep20-21swapper/219:07:202
35654682193,9sleep30-21swapper/319:06:203
356541921910,3sleep00-21swapper/019:06:130
35880532180,3sleep375-21kworker/3:1+events19:26:263
357015299189,7cyclictest3721741-21expr21:41:192
357015299182,12cyclictest3896058-21ps00:36:232
3570152991812,4cyclictest3605416-21tr19:41:292
3570152991811,5cyclictest3706968-21sort21:26:242
357015299181,12cyclictest3656620-21apt-get20:36:192
3570152991810,6cyclictest3811389-21cat23:11:242
357015299172,11cyclictest3606934-21apt-get19:46:192
3570152991712,3cyclictest0-21swapper/223:46:252
3570152991710,5cyclictest3702423-21sed21:21:272
3570152991710,5cyclictest3702423-21sed21:21:272
3570152991613,2cyclictest0-21swapper/222:21:222
3570152991611,3cyclictest0-21swapper/222:16:392
37968372154,8sleep30-21swapper/322:56:273
38992202142,8sleep30-21swapper/300:36:323
36930242140,3sleep375-21kworker/3:1+events21:11:283
36069082143,6sleep30-21swapper/319:46:183
36034422144,7sleep30-21swapper/319:41:283
38714652130,2sleep3471rcuc/300:11:273
38652652132,6sleep30-21swapper/300:05:013
38411252132,7sleep30-21swapper/323:41:263
38394332132,7sleep30-21swapper/323:36:323
36815702132,6sleep30-21swapper/321:00:013
35857452132,7sleep30-21swapper/319:21:303
35708622133,7sleep30-21swapper/319:11:263
38901932122,6sleep30-21swapper/300:30:023
38854842122,6sleep30-21swapper/300:25:043
38550362122,6sleep30-21swapper/323:54:303
38459402122,6sleep30-21swapper/323:46:243
38147072122,6sleep30-21swapper/323:11:323
37908572122,5sleep30-21swapper/322:50:013
37867102122,6sleep30-21swapper/322:46:243
37701922122,6sleep30-21swapper/322:26:343
37640712122,6sleep30-21swapper/322:21:283
37562962122,5sleep30-21swapper/322:15:023
37439262122,6sleep30-21swapper/322:01:303
37380422122,6sleep30-21swapper/321:56:283
37325222122,6sleep30-21swapper/321:51:263
37220122122,6sleep30-21swapper/321:41:233
37152612122,6sleep30-21swapper/321:31:323
36766602122,6sleep30-21swapper/320:56:203
36631712122,6sleep30-21swapper/320:41:283
36562992122,5sleep30-21swapper/320:35:013
36516912123,6sleep30-21swapper/320:31:203
36316252122,5sleep30-21swapper/320:10:003
36218562122,5sleep30-21swapper/320:00:023
36168322122,6sleep30-21swapper/319:56:213
35975492122,6sleep30-21swapper/319:36:263
38803202112,5sleep30-21swapper/300:20:023
38798362112,6sleep30-21swapper/300:17:063
38605212112,6sleep30-21swapper/300:00:083
38552932112,5sleep30-21swapper/323:55:023
38307202112,5sleep30-21swapper/323:31:193
38307202112,5sleep30-21swapper/323:31:193
38257812112,5sleep30-21swapper/323:26:173
38208502112,6sleep30-21swapper/323:21:193
38059282112,5sleep30-21swapper/323:05:013
38015272112,5sleep30-21swapper/323:01:253
37812892112,5sleep30-21swapper/322:41:183
37767362112,5sleep30-21swapper/322:36:253
37716302110,7sleep30-21swapper/322:31:233
37554822112,5sleep30-21swapper/322:11:373
37511922112,5sleep30-21swapper/322:09:283
37263272113,5sleep30-21swapper/321:45:283
37208712112,6sleep30-21swapper/321:37:223
37065612112,6sleep30-21swapper/321:25:583
37015812112,5sleep30-21swapper/321:20:243
37015812112,5sleep30-21swapper/321:20:243
37004152112,5sleep30-21swapper/321:16:313
36873002112,5sleep30-21swapper/321:06:283
36715742112,5sleep30-21swapper/320:50:023
36466282112,5sleep30-21swapper/320:25:023
36455962112,5sleep30-21swapper/320:21:333
36406142112,5sleep30-21swapper/320:16:313
36273062112,6sleep30-21swapper/320:06:243
36118942113,5sleep30-21swapper/319:51:193
35958562112,5sleep30-21swapper/319:31:333
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional