You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-27 - 02:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Sat Jun 27, 2026 00:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
401884821760,5sleep3451irq_work/300:00:253
38765362880,2chrt471rcuc/321:40:233
3724991996456,6cyclictest3382387-21kworker/u8:3+flush-8:019:30:311
3724991995948,8cyclictest3751865-21/usr/sbin/munin19:35:321
3724991995447,5cyclictest2306736-21kworker/u8:2+flush-8:023:05:301
37877612520,4chrt0-21swapper/020:10:220
3724991995143,5cyclictest3756785-21kworker/u8:0+flush-8:020:45:201
3724991995042,6cyclictest2306736-21kworker/u8:2+flush-8:023:30:321
3724991995041,6cyclictest3830888-21latency_hist20:55:011
3724991994839,6cyclictest3955484-21/usr/sbin/munin23:00:251
3724991994741,4cyclictest4029207-21ntpq00:10:271
3724991994638,5cyclictest3756785-21kworker/u8:0+flush-8:019:55:191
3724991994637,7cyclictest4004039-21ntpq23:45:241
3724986994637,6cyclictest3950249-21latency_hist22:55:010
3724991994537,5cyclictest3846199-21kworker/u8:1+events_unbound21:20:011
3724991994532,9cyclictest2306736-21kworker/u8:2+flush-8:022:00:321
3724991994437,5cyclictest2306736-21kworker/u8:2+flush-8:020:30:201
3724991994436,6cyclictest2306736-21kworker/u8:2+flush-8:019:20:321
3724986994434,7cyclictest4010157-21/usr/sbin/munin23:55:260
3724991994333,8cyclictest3861403-21diskstats21:25:171
3724991994331,8cyclictest1704890-21systemd-journal20:25:551
3724991994136,3cyclictest3756785-21kworker/u8:0+flush-8:020:40:301
3724991994035,4cyclictest2306736-21kworker/u8:2+flush-8:022:30:311
3724996993933,4cyclictest3845735-21apt-get21:10:002
3724991993934,4cyclictest2306736-21kworker/u8:2+flush-8:022:46:251
3724991993932,5cyclictest3796224-21latency_hist20:20:011
3724991993928,9cyclictest3728974-21ntpq19:10:281
3724986993929,8cyclictest3775401-21ntpq19:55:270
3724996993828,7cyclictest1704890-21systemd-journal22:25:012
3724986993829,7cyclictest1704890-21systemd-journal21:25:000
3724986993829,6cyclictest3985206-21latency_hist23:30:010
3724991993731,4cyclictest3925282-21latency_hist22:30:021
3724991993730,5cyclictest3831153-21apt-get20:55:121
3724991993728,6cyclictest3850927-21latency_hist21:15:001
3724991993727,7cyclictest1704890-21systemd-journal23:24:591
37245502373,9sleep10-21swapper/119:06:391
3724996993627,7cyclictest1704890-21systemd-journal19:35:012
3724991993631,4cyclictest2306736-21kworker/u8:2+flush-8:023:40:161
3724991993631,3cyclictest4054835-21awk00:40:001
3724991993631,3cyclictest3382387-21kworker/u8:3+flush-8:019:20:001
3724991993629,5cyclictest3915008-21grep22:15:351
3724991993629,5cyclictest3875757-21kworker/u8:1+flush-8:022:50:311
3724986993629,5cyclictest3965138-21latency_hist23:10:010
372498699361,29cyclictest3761536-21kworker/0:0+events20:40:170
3724996993529,4cyclictest2306736-21kworker/u8:2+flush-8:019:40:322
3724991993528,5cyclictest2306736-21kworker/u8:2+flush-8:023:35:271
3724991993528,4cyclictest4015214-21apt-get00:00:141
3724991993516,13cyclictest1704890-21systemd-journal21:03:251
3724986993526,7cyclictest1704890-21systemd-journal23:35:000
3724986993524,8cyclictest3889638-21ntpq21:50:280
3724996993427,5cyclictest1704890-21systemd-journal23:52:162
3724996993427,5cyclictest1704890-21systemd-journal22:16:142
3724991993429,3cyclictest3805283-21kworker/u8:1+events_unbound20:35:311
3724991993428,4cyclictest3756785-21kworker/u8:0+flush-8:019:45:201
3724991993427,5cyclictest3776603-21/usr/sbin/munin20:00:281
3724991993426,6cyclictest3382387-21kworker/u8:3+flush-8:019:25:301
3724991993425,6cyclictest1704890-21systemd-journal23:25:251
3724991993419,10cyclictest1704890-21systemd-journal23:58:151
3724986993430,2cyclictest3761538-21systemd-run19:45:010
3724986993424,7cyclictest3895564-21latency_hist22:00:010
3724996993326,5cyclictest3876003-21apt-get21:40:152
3724991993327,4cyclictest3869891-21kworker/u8:0+events_unbound21:35:311
3724986993328,3cyclictest3821457-21cpuspeed_turbos20:45:180
3724986993323,8cyclictest4019960-21latency_hist00:05:010
3724986993316,14cyclictest1704890-21systemd-journal23:19:240
372498699330,31cyclictest3905516-21true22:10:010
37245662334,9sleep20-21swapper/219:06:522
3724991993227,3cyclictest4000046-21kworker/u8:3+flush-8:000:15:211
3724991993224,6cyclictest3885833-21kworker/u8:3+flush-8:022:05:301
3724986993224,6cyclictest3999077-21ntpq23:40:260
3724996993125,4cyclictest3826217-21apt-get20:50:142
3724996993125,4cyclictest3382387-21kworker/u8:3+flush-8:019:10:312
3724991993126,3cyclictest2306736-21kworker/u8:2+flush-8:019:50:181
3724991993121,7cyclictest3965157-21kworker/u8:1+flush-8:000:30:301
372498699315,20cyclictest3761536-21kworker/0:0+events20:15:150
3724986993120,8cyclictest3980013-21latency_hist23:25:010
3724986993110,20cyclictest3761536-21kworker/0:0+events21:00:010
3724996993026,2cyclictest4010414-21tr23:55:162
3724996993026,2cyclictest3959773-21unixbench_singl23:00:332
3724996993025,3cyclictest3850535-21unixbench_singl21:10:342
3724991993025,4cyclictest3875757-21kworker/u8:1+events_unbound22:40:301
372498699309,19cyclictest4044943-21kworker/0:1+events00:36:150
3724986993025,4cyclictest3855890-21awk21:20:000
3724986993025,3cyclictest1-21systemd21:09:590
3724986993020,8cyclictest3944371-21ntpq22:45:260
372498699301,27cyclictest3761536-21kworker/0:0+events20:25:250
38342742290,6sleep3451irq_work/320:55:243
3724996992925,2cyclictest3965634-21tr23:10:172
3724991992924,3cyclictest3820994-21kworker/u8:3+events_unbound21:30:351
372498699299,15cyclictest3761536-21kworker/0:0+events22:10:180
372498699296,21cyclictest3761536-21kworker/0:0+events21:35:170
3724986992925,2cyclictest3777552-21kthreadcore20:00:230
3724986992923,5cyclictest3869891-21kworker/u8:0+flush-8:021:45:310
3724986992923,5cyclictest3869891-21kworker/u8:0+flush-8:021:45:310
3724986992918,2cyclictest421rcuog/220:05:310
372498699291,27cyclictest3761536-21kworker/0:0+events22:15:270
3724986992911,17cyclictest3761536-21kworker/0:0+events22:55:230
37247902292,6sleep00-21swapper/019:09:480
3724996992824,2cyclictest3866176-21aten2_r5power_p21:30:172
3724996992822,4cyclictest3756785-21kworker/u8:0+flush-8:020:55:302
3724991992824,2cyclictest3886459-21irqcore21:50:221
3724991992822,4cyclictest3846199-21kworker/u8:1+events_unbound21:20:231
372498699289,18cyclictest3990178-21kworker/0:2+events23:50:010
3724986992818,8cyclictest3845735-21apt-get21:10:000
372498699281,26cyclictest3761536-21kworker/0:0+events21:00:270
3724986992811,15cyclictest3761536-21kworker/0:0+events20:30:310
3724986992810,16cyclictest3761536-21kworker/0:0+events20:35:320
372498699280,26cyclictest3761536-21kworker/0:0+events22:35:330
3724996992723,3cyclictest3929814-21unixbench_singl22:30:342
3724991992723,3cyclictest3875757-21kworker/u8:1+flush-8:022:20:181
3724991992723,2cyclictest0-21swapper/121:10:001
3724991992718,6cyclictest1704890-21systemd-journal23:12:251
372498699279,16cyclictest3990178-21kworker/0:2+events23:35:170
372498699279,16cyclictest3761536-21kworker/0:0+events22:20:290
372498699279,16cyclictest3761536-21kworker/0:0+events21:40:180
372498699278,17cyclictest3990178-21kworker/0:2+events23:50:220
372498699277,18cyclictest3761536-21kworker/0:0+events23:00:120
372498699275,17cyclictest3761536-21kworker/0:0+events21:30:000
3724986992723,2cyclictest4035876-21irqcore00:20:210
3724986992722,3cyclictest0-21swapper/019:55:010
3724986992721,4cyclictest1704890-21systemd-journal22:35:000
3724986992710,15cyclictest3761536-21kworker/0:0+events20:25:000
3724996992623,2cyclictest3980000-21cron23:24:592
3724996992615,8cyclictest4050098-21munin-node00:35:142
3724991992622,3cyclictest3756785-21kworker/u8:0+events_unbound20:05:251
3724991992621,4cyclictest2306736-21kworker/u8:2+flush-8:021:55:351
3724991992620,4cyclictest4000046-21kworker/u8:3+flush-8:023:50:251
3724991992620,4cyclictest3965157-21kworker/u8:1+events_unbound23:15:301
3724991992618,5cyclictest3786270-21kworker/u8:3+flush-8:020:10:291
372498699269,16cyclictest3761536-21kworker/0:0+events22:00:250
372498699269,15cyclictest3714791-21kworker/0:2+events19:45:180
372498699268,16cyclictest4044943-21kworker/0:1+events00:35:010
372498699268,16cyclictest3761536-21kworker/0:0+events23:10:170
3724986992621,4cyclictest3382387-21kworker/u8:3+flush-8:019:20:390
3724986992620,4cyclictest4029721-21unixbench_multi00:10:360
3724986992617,6cyclictest4025167-21latency_hist00:10:000
3724986992610,14cyclictest3714791-21kworker/0:2+events19:15:260
40206882250,5sleep1281rcuc/100:05:161
3724996992522,2cyclictest3895964-21aten2_r5power_v22:00:172
3724996992520,4cyclictest3786270-21kworker/u8:3+flush-8:020:15:312
3724996992520,3cyclictest3990755-21fschecks_time23:35:172
3724991992521,3cyclictest3786270-21kworker/u8:3+events_unbound20:20:241
3724991992520,2cyclictest0-21swapper/119:40:331
3724991992519,3cyclictest0-21swapper/100:25:191
3724991992515,8cyclictest4039073-21ntpq00:20:281
372498699257,16cyclictest3761536-21kworker/0:0+events20:50:300
372498699256,17cyclictest3714791-21kworker/0:2+events19:10:140
3724986992520,3cyclictest3751644-21systemd-run19:35:000
372498699251,23cyclictest3761536-21kworker/0:0+events22:25:220
3724996992421,2cyclictest4025783-21fschecks_time00:10:192
3724996992420,2cyclictest3970601-21fschecks_count23:15:182
3724996992410,2cyclictest40222882cut00:05:242
3724991992420,3cyclictest3875757-21kworker/u8:1+events_unbound22:35:181
3724991992418,4cyclictest2306736-21kworker/u8:2+events_unbound21:45:241
3724991992418,4cyclictest2306736-21kworker/u8:2+events_unbound21:45:231
3724991992418,3cyclictest0-21swapper/122:10:271
372498699247,16cyclictest3714791-21kworker/0:2+events19:35:150
372498699247,15cyclictest3761536-21kworker/0:0+events21:30:290
372498699246,16cyclictest3990178-21kworker/0:2+events00:15:170
3724996992319,2cyclictest4045503-21fschecks_time00:30:192
3724996992319,2cyclictest4030676-21fschecks_count00:15:182
3724996992318,3cyclictest3980010-21apt-get23:25:022
3724996992317,4cyclictest3935190-21gpgv22:40:002
3724996992314,7cyclictest1704890-21systemd-journal20:00:252
3724991992312,3cyclictest0-21swapper/121:40:071
372498699237,15cyclictest4035101-21kworker/0:0+events00:25:170
372498699236,16cyclictest3761536-21kworker/0:0+events22:40:170
372499699223,14cyclictest3761780-21apt-get19:45:162
372499699222,14cyclictest3920609-21apt-get22:25:162
3724996992218,2cyclictest3806433-21aten2_r5power_p20:30:172
3724996992218,2cyclictest3752241-21fschecks_time19:35:192
3724996992211,8cyclictest1704890-21systemd-journal21:40:002
3724991992218,2cyclictest0-21swapper/123:00:011
3724996992118,2cyclictest3856439-21fschecks_count21:20:192
3724996992117,3cyclictest3855879-21cron21:19:592
3724996992117,3cyclictest3776332-21cron20:00:012
3724996992117,2cyclictest3895120-21unixbench_multi21:55:342
3724996992117,2cyclictest3811441-21aten2_r5power_v20:35:182
3724996992117,2cyclictest3782510-21kthreadcore20:05:232
372498699213,16cyclictest3714791-21kworker/0:2+events19:25:150
372499699203,12cyclictest3839866-21ntpq21:00:272
3724996992017,2cyclictest3800730-21unixbench_multi20:20:352
3724996992016,2cyclictest4000321-21aten2_r5power_c23:45:142
3724996992016,2cyclictest3786781-21fschecks_count20:10:172
3724996992010,8cyclictest3938845-21tr22:40:242
372499699198,4cyclictest0-21swapper/222:06:442
372499699197,4cyclictest0-21swapper/219:20:122
372499699192,12cyclictest4015214-21apt-get00:00:162
3724996991915,3cyclictest4000018-21cron23:44:592
3724996991915,3cyclictest3382387-21kworker/u8:3+flush-8:019:25:322
3724996991915,2cyclictest0-21swapper/223:00:012
3724996991913,4cyclictest3944824-21unixbench_multi22:45:342
3724996991911,6cyclictest3736767-21cron19:20:012
3724996991813,4cyclictest3816589-21cut20:40:182
3724996991812,4cyclictest0-21swapper/222:50:342
372499699181,12cyclictest3985465-21apt-get23:30:172
372499699181,12cyclictest3767108-21/usr/sbin/munin19:50:182
3724996991810,6cyclictest3883922-21tr21:45:242
3724996991810,6cyclictest3883922-21tr21:45:242
3724996991810,6cyclictest3862163-21tr21:25:222
37201702182,9sleep30-21swapper/319:05:163
3724996991712,3cyclictest0-21swapper/222:10:252
3724996991712,3cyclictest0-21swapper/200:25:212
372499699162,11cyclictest3960449-21apt-get23:05:162
3724996991612,3cyclictest0-21swapper/220:25:332
40367312155,6sleep30-21swapper/300:20:253
39703402152,8sleep30-21swapper/323:15:153
372499699158,5cyclictest4038838-21tr00:20:262
372499699152,12cyclictest0-21swapper/221:53:062
38549342142,8sleep30-21swapper/321:15:273
38262202142,7sleep30-21swapper/320:50:163
372499699146,6cyclictest3821853-21sed20:45:222
40498732132,6sleep30-21swapper/300:35:013
40439432132,7sleep30-21swapper/300:25:263
40350452132,7sleep30-21swapper/300:20:003
39969542132,7sleep30-21swapper/323:40:223
39302402132,6sleep30-21swapper/322:35:013
39244312132,7sleep30-21swapper/322:25:313
38956392132,6sleep30-21swapper/322:00:013
38905712132,6sleep30-21swapper/321:55:013
38101362132,7sleep30-21swapper/320:30:293
37867592132,7sleep30-21swapper/320:10:173
37471832132,7sleep30-21swapper/319:30:213
37368142132,6sleep30-21swapper/319:20:013
40251542122,5sleep30-21swapper/300:10:013
40101862122,6sleep30-21swapper/323:55:153
40056162122,6sleep30-21swapper/323:50:193
39651262122,5sleep30-21swapper/323:10:003
39604242122,6sleep30-21swapper/323:05:163
39552932122,5sleep30-21swapper/323:00:023
39532162122,6sleep30-21swapper/322:55:243
39462442122,6sleep30-21swapper/322:50:223
39411232122,5sleep30-21swapper/322:45:213
39258892122,6sleep30-21swapper/322:30:203
39192652122,7sleep30-21swapper/322:20:243
39054862122,5sleep30-21swapper/322:10:023
39051352122,6sleep30-21swapper/322:05:353
38559282122,5sleep30-21swapper/321:20:013
38502752122,6sleep30-21swapper/321:10:343
38414522122,6sleep30-21swapper/321:05:213
38407842122,6sleep30-21swapper/321:04:593
38256272122,6sleep30-21swapper/320:45:573
38166512122,6sleep30-21swapper/320:40:193
38114152122,6sleep30-21swapper/320:35:193
37927882123,6sleep30-21swapper/320:15:243
37721552122,6sleep30-21swapper/319:55:213
37671072122,6sleep30-21swapper/319:50:203
37615402122,6sleep30-21swapper/319:45:023
37431792122,7sleep30-21swapper/319:25:243
37320652122,6sleep30-21swapper/319:15:163
37250292122,5sleep30-21swapper/319:10:033
40457602112,5sleep30-21swapper/300:30:233
40258052112,5sleep30-21swapper/300:10:213
40016662110,6sleep30-21swapper/323:45:213
39901572112,5sleep30-21swapper/323:35:023
39857252112,6sleep30-21swapper/323:30:203
39847422112,6sleep30-21swapper/323:25:343
39780422112,5sleep30-21swapper/323:20:253
39356242113,5sleep30-21swapper/322:40:043
39106942112,5sleep30-21swapper/322:15:153
38913442112,6sleep30-21swapper/321:55:213
38807072112,5sleep30-21swapper/321:45:023
38807072112,5sleep30-21swapper/321:45:013
38746392112,6sleep30-21swapper/321:35:253
38660722112,5sleep30-21swapper/321:30:163
38658092112,6sleep30-21swapper/321:30:013
38051402112,5sleep30-21swapper/320:25:263
37962562112,5sleep30-21swapper/320:20:023
37815882112,6sleep30-21swapper/320:05:173
37767142112,5sleep30-21swapper/320:00:193
37568252112,6sleep30-21swapper/319:40:163
37524742112,5sleep30-21swapper/319:35:233
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional