You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-09 - 17:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Thu Jul 09, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
349442322640,6sleep30-21swapper/312:05:223
335636221950,2sleep375-21kworker/3:1-events09:50:143
319340299160156,2cyclictest3424859-21gpgv11:00:002
34422652820,2chrt75-21kworker/3:1+events11:15:143
33428552700,3sleep375-21kworker/3:1+mm_percpu_wq09:35:133
3193398996461,2cyclictest0-21swapper/111:00:001
3193393996358,3cyclictest3198512-21munin-node07:15:050
34109652620,4chrt75-21kworker/3:1-events10:45:133
33893972610,3chrt3389402-21unixbench_singl10:20:260
3193398996049,8cyclictest3214452-21ntpq07:25:191
3193393995953,5cyclictest3193263-21kworker/u8:2+flush-8:007:30:210
3193402995847,8cyclictest1704890-21systemd-journal09:15:002
3193398995852,4cyclictest3390030-21kworker/u8:1+flush-8:011:05:211
32300482560,3chrt75-21kworker/3:1-events07:40:253
3193398995646,7cyclictest3255674-21latency_hist08:10:011
3193398995545,8cyclictest3439056-21ntpq11:10:171
3193393995538,15cyclictest3424870-21latency_hist11:00:010
3193398995448,5cyclictest3193263-21kworker/u8:2+flush-8:007:20:201
3193398995447,5cyclictest3197401-21ntpq07:10:191
3193398995247,4cyclictest3193263-21kworker/u8:2+events_unbound07:35:191
3193393995245,5cyclictest3193263-21kworker/u8:2+flush-8:007:20:190
32459492510,13sleep10-21swapper/108:00:001
3193398995145,4cyclictest3480525-21kworker/u8:3+flush-8:012:00:171
3193398995145,4cyclictest3424604-21apt-get11:00:031
3193398995145,4cyclictest3392184-21kworker/u8:4+events_unbound10:30:181
3193398995046,3cyclictest3193263-21kworker/u8:2+flush-8:008:20:241
3193398995045,3cyclictest3285676-21kworker/u8:1+flush-8:008:45:201
3193398995043,5cyclictest3138960-21kworker/u8:3+flush-8:008:00:211
3193398995040,8cyclictest3523701-21ntpq12:35:171
3193398995040,8cyclictest3523701-21ntpq12:35:161
3193393995038,9cyclictest3300490-21cp08:55:020
3193393995038,9cyclictest3300490-21cp08:55:010
3193398994943,5cyclictest3390030-21kworker/u8:1+flush-8:010:35:181
3193398994943,4cyclictest3390030-21kworker/u8:1+events_unbound11:20:101
3193398994936,10cyclictest1704890-21systemd-journal10:25:001
3193402994830,15cyclictest1704890-21systemd-journal12:05:192
3193398994844,3cyclictest3505058-21kworker/u8:0+events_unbound12:30:221
3193398994844,3cyclictest3138960-21kworker/u8:3+flush-8:007:45:241
3193398994841,5cyclictest3193263-21kworker/u8:2+flush-8:008:25:211
3193402994738,7cyclictest1704890-21systemd-journal12:00:012
3193398994740,6cyclictest3392184-21kworker/u8:4+events_unbound12:15:171
3193398994739,5cyclictest3285676-21kworker/u8:1+flush-8:009:40:221
3193398994539,4cyclictest3390030-21kworker/u8:1+events_unbound10:40:201
3193398994439,4cyclictest3193263-21kworker/u8:2+flush-8:007:30:211
3193398994439,4cyclictest3178721-21kworker/u8:0+events_unbound07:15:101
3193398994438,5cyclictest3138960-21kworker/u8:3+flush-8:008:10:221
3193398994435,7cyclictest1704890-21systemd-journal11:20:011
3193402994327,14cyclictest3349172-21needreboot09:40:152
3193398994339,3cyclictest3340202-21kworker/u8:3+flush-8:010:10:211
3193398994339,3cyclictest3193263-21kworker/u8:2+events_unbound09:10:201
3193398994335,6cyclictest3340202-21kworker/u8:3+flush-8:009:45:181
3193402994231,8cyclictest1704890-21systemd-journal08:45:002
3193402994231,8cyclictest1704890-21systemd-journal08:44:592
3193398994236,4cyclictest3193263-21kworker/u8:2+events_unbound08:15:181
3193398994235,5cyclictest3365339-21apt-get10:00:031
3193398994235,5cyclictest3305121-21kworker/u8:3+flush-8:009:00:181
3193398994233,7cyclictest3478976-21ntpq11:50:191
3193393994234,6cyclictest1704890-21systemd-journal07:54:590
3193393994133,6cyclictest3350172-21latency_hist09:45:000
3193398994036,3cyclictest3285676-21kworker/u8:1+events_unbound09:50:141
3193398994035,3cyclictest3480525-21kworker/u8:3+events_unbound11:55:141
3193398994034,5cyclictest3340202-21kworker/u8:3+events_unbound09:35:211
3193398994034,4cyclictest3480525-21kworker/u8:3+events_unbound12:10:131
3193398994033,5cyclictest3193263-21kworker/u8:2+events_unbound09:05:221
3193398994033,5cyclictest3193263-21kworker/u8:2+events_unbound08:30:181
3193393994034,4cyclictest3305121-21kworker/u8:3+events_unbound09:10:090
3193402993930,7cyclictest1704890-21systemd-journal09:25:012
3193402993922,15cyclictest3485413-21fschecks_count12:00:062
3193393993933,4cyclictest3193263-21kworker/u8:2+flush-8:008:30:260
3193393993932,6cyclictest3390030-21kworker/u8:1+flush-8:011:05:080
3193393993930,6cyclictest3494879-21latency_hist12:10:010
3193393993930,6cyclictest1704890-21systemd-journal10:40:000
3193402993822,14cyclictest3444533-21unixbench_singl11:15:262
3193402993822,14cyclictest3295618-21aten2_r5power_e08:50:062
3193402993822,14cyclictest3295618-21aten2_r5power_e08:50:062
3193402993816,2cyclictest0-21swapper/208:00:002
3193398993834,3cyclictest3360115-21kworker/u8:2+events_unbound10:20:001
3193393993833,4cyclictest3193263-21kworker/u8:2+flush-8:007:35:210
319340299372,13cyclictest3335510-21apt-get09:30:062
3193402993716,7cyclictest1704890-21systemd-journal10:35:002
3193398993731,4cyclictest3392184-21kworker/u8:4+events_unbound10:50:071
3193393993728,6cyclictest3505036-21/usr/sbin/munin12:20:180
3193402993625,9cyclictest1704890-21systemd-journal09:17:162
3193398993632,3cyclictest3419246-21kworker/u8:2+flush-8:011:25:201
3193398993631,4cyclictest3305121-21kworker/u8:3+events_unbound09:15:261
3193398993630,4cyclictest3193263-21kworker/u8:2+events_unbound09:30:191
3193398993629,5cyclictest3470260-21apt-get11:45:051
3193393993632,3cyclictest3480525-21kworker/u8:3+flush-8:012:10:200
3193393993626,7cyclictest3364109-21ntpq09:55:180
3193402993521,12cyclictest3255273-21unixbench_singl08:05:262
3193398993531,3cyclictest3285676-21kworker/u8:1+flush-8:008:50:091
3193398993531,3cyclictest3285676-21kworker/u8:1+flush-8:008:50:081
3193393993530,4cyclictest3305467-21sendmail09:00:000
3193393993530,3cyclictest3285676-21kworker/u8:1+events_unbound08:45:180
34770792340,9sleep3451irq_work/311:50:143
3193402993424,8cyclictest3225668-21cat07:40:012
3193402993421,11cyclictest3231186-21fschecks_count07:45:092
3193402993420,12cyclictest3515173-21cpuspeed_turbos12:30:082
3193402993419,12cyclictest0-21swapper/210:39:592
319340299341,11cyclictest3478988-21ntpq11:50:202
3193398993432,1cyclictest3178721-21kworker/u8:0+events_unbound07:40:171
3193393993430,3cyclictest3285676-21kworker/u8:1+events_unbound09:25:230
3193393993428,4cyclictest3193263-21kworker/u8:2+flush-8:008:25:190
319340299332,12cyclictest3374078-21ntpq10:05:192
3193402993318,2cyclictest3270883-21aten2_r5power_e08:25:072
3193398993324,7cyclictest3413714-21ntpq10:45:181
3193398993319,11cyclictest1704890-21systemd-journal09:59:171
31930942334,9sleep20-21swapper/207:08:332
3193402993217,2cyclictest3350483-21aten2_r5power_e09:45:052
3193402993216,2cyclictest3334241-21needreboot09:25:182
3193402993214,6cyclictest1-21systemd10:05:012
3193398993228,3cyclictest3193263-21kworker/u8:2+events_unbound09:25:081
3193398993226,5cyclictest3305121-21kworker/u8:3+events_unbound09:20:111
3193398993224,6cyclictest3390030-21kworker/u8:1+flush-8:010:25:231
3193398993221,8cyclictest1704890-21systemd-journal12:25:171
3193398993220,8cyclictest1704890-21systemd-journal12:07:171
3193398993219,10cyclictest1704890-21systemd-journal11:36:181
3193393993228,2cyclictest3524665-21latency_hist12:40:010
3193393993228,2cyclictest3524665-21latency_hist12:40:010
3193393993227,4cyclictest3390030-21kworker/u8:1+events_unbound10:25:250
3193393993224,6cyclictest3399777-21latency_hist10:35:000
3193393993223,4cyclictest0-21swapper/009:15:060
3193402993123,6cyclictest1704890-21systemd-journal11:09:172
3193402993123,6cyclictest1704890-21systemd-journal08:23:172
3193402993115,4cyclictest3310002-21unixbench_multi09:00:242
319340299311,13cyclictest3424604-21apt-get11:00:042
3193398993127,3cyclictest3390030-21kworker/u8:1+flush-8:011:30:251
3193393993127,3cyclictest3419246-21kworker/u8:2+events_unbound11:20:240
3193393993127,3cyclictest3285676-21kworker/u8:1+events_unbound09:50:260
3193393993125,4cyclictest3193263-21kworker/u8:2+flush-8:008:20:230
3193393993116,13cyclictest3489901-21cron12:05:000
319340299302,11cyclictest3469775-21apt-get11:45:022
3193398993025,4cyclictest3285676-21kworker/u8:1+flush-8:008:55:251
3193393993025,3cyclictest3475502-21fschecks_count11:50:100
3193393993024,5cyclictest3340202-21kworker/u8:3+flush-8:010:00:180
3193393993022,6cyclictest3284455-21ntpq08:35:180
3193393993022,6cyclictest3193224-21latency_hist07:10:000
319340299292,8cyclictest3246067-21apt-get08:00:042
3193398992924,4cyclictest3178721-21kworker/u8:0+flush-8:008:35:211
3193393992925,3cyclictest3479037-21kworker/u8:1+events_unbound11:55:240
3193393992925,3cyclictest3392184-21kworker/u8:4+flush-8:011:15:250
3193393992925,3cyclictest3360115-21kworker/u8:2+events_unbound10:05:080
3193393992924,3cyclictest3469764-21cron11:44:590
3193393992923,4cyclictest3503665-21latency12:15:140
3193393992919,8cyclictest3415167-21diskstats10:50:090
32034262280,3sleep375-21kworker/3:1+events07:15:163
3193402992824,3cyclictest3388783-21needreboot10:20:162
3193398992816,8cyclictest1704890-21systemd-journal12:25:001
3193393992824,3cyclictest3392184-21kworker/u8:4+events_unbound11:10:270
3193393992824,3cyclictest3193263-21kworker/u8:2+flush-8:009:20:480
3193393992824,3cyclictest3193263-21kworker/u8:2+events_unbound09:05:230
3193393992823,3cyclictest3392184-21kworker/u8:4+events_unbound10:45:060
3193393992822,4cyclictest3392184-21kworker/u8:4+events_unbound11:45:080
3193393992821,5cyclictest3178721-21kworker/u8:0+flush-8:007:40:190
3193393992820,6cyclictest3515205-21diskstats12:30:080
3193402992720,5cyclictest1704890-21systemd-journal12:20:172
3193398992723,2cyclictest3236398-21cut07:50:091
3193393992723,3cyclictest3138960-21kworker/u8:3+flush-8:007:45:300
3193393992722,3cyclictest3392184-21kworker/u8:4+events_unbound10:40:100
3193402992622,2cyclictest3255963-21aten2_r5power_c08:10:062
3193402992621,4cyclictest3178721-21kworker/u8:0+flush-8:008:55:162
3193402992621,3cyclictest3464339-21unixbench_multi11:35:262
3193402992618,6cyclictest3469880-21gpgv11:45:012
3193398992621,3cyclictest3178721-21kworker/u8:0+events_unbound08:44:021
3193398992621,3cyclictest3178721-21kworker/u8:0+events_unbound08:44:011
3193393992622,3cyclictest3178721-21kworker/u8:0+events_unbound07:25:100
3193393992622,2cyclictest0-21swapper/011:30:000
3193393992620,4cyclictest3419246-21kworker/u8:2+events_unbound11:35:250
3193393992620,4cyclictest3392184-21kworker/u8:4+flush-8:011:00:180
3193402992516,7cyclictest1704890-21systemd-journal09:40:012
3193402992515,8cyclictest1704890-21systemd-journal10:53:182
3193393992520,4cyclictest3340202-21kworker/u8:3+events_unbound09:45:180
3193393992520,3cyclictest3250330-21grep08:00:250
3193393992520,3cyclictest3193263-21kworker/u8:2+flush-8:009:00:240
3193393992519,4cyclictest3339859-21unixbench_singl09:30:260
3193393992519,4cyclictest3138960-21kworker/u8:3+flush-8:007:10:200
3193402992420,2cyclictest3219853-21unixbench_multi07:30:252
3193402992420,2cyclictest3210774-21aten2_r5power_p07:25:072
3193402992417,5cyclictest1704890-21systemd-journal09:55:292
3193398992421,2cyclictest3469377-21unixbench_singl11:40:231
3193398992410,5cyclictest0-21swapper/110:05:161
3193393992420,3cyclictest3360115-21kworker/u8:2+events_unbound10:15:060
3193393992420,2cyclictest0-21swapper/008:20:000
3193398992313,6cyclictest3193395-21cat07:10:001
3193393992319,3cyclictest3459855-21sh11:35:010
3193393992318,3cyclictest0-21swapper/012:25:190
3193402992218,2cyclictest3200528-21aten2_r5power_c07:15:082
3193402992217,3cyclictest3375312-21grep10:10:072
319340299214,3cyclictest32057902cut07:20:072
3193402992118,2cyclictest3290690-21aten2_r5power_p08:45:052
3193402992117,2cyclictest0-21swapper/207:50:192
3193393992117,3cyclictest3193263-21kworker/u8:2+events_unbound08:10:120
31930432216,9sleep30-21swapper/307:07:553
3193402992016,2cyclictest3355391-21aten2_r5power_c09:50:072
3193402992010,8cyclictest3522086-21tr12:35:142
3193402992010,8cyclictest3522086-21tr12:35:132
3193393992016,2cyclictest3290348-21cron08:44:590
3193393992016,2cyclictest3290348-21cron08:44:590
3193393992015,3cyclictest0-21swapper/009:35:180
3193393992013,5cyclictest3251288-21fschecks_count08:05:090
3193402991915,2cyclictest0-21swapper/211:30:222
3193402991910,7cyclictest3228859-21tr07:40:142
3193402991910,7cyclictest1704890-21systemd-journal10:30:002
3193393991914,4cyclictest3377380-21kthreadcore10:10:150
319339399191,13cyclictest3241094-21seq07:55:050
3193402991814,3cyclictest3499850-21cron12:15:002
3193402991814,2cyclictest0-21swapper/210:45:122
3193402991814,2cyclictest0-21swapper/207:10:162
3193402991810,6cyclictest3406879-21tr10:40:142
3193402991714,2cyclictest3510237-21cpuspeed_turbos12:25:082
3193402991713,2cyclictest0-21swapper/211:10:242
3193402991713,2cyclictest0-21swapper/208:35:132
3193402991713,2cyclictest0-21swapper/208:15:182
3193402991712,3cyclictest0-21swapper/211:20:162
319340299171,11cyclictest3275760-21apt-get08:30:062
33240782160,4sleep375-21kworker/3:1-events09:15:153
319340299167,7cyclictest3450197-21cut11:25:052
319340299162,2cyclictest0-21swapper/212:19:142
319340299160,14cyclictest3310777-21tr09:05:072
33523602150,2sleep3481ktimers/309:45:143
319340299153,8cyclictest3380164-21apt-get10:15:062
33012622142,8sleep30-21swapper/308:55:133
32943802142,8sleep30-21swapper/308:45:183
35146852134,5sleep30-21swapper/312:30:003
34488472132,7sleep30-21swapper/311:20:183
33848912132,6sleep30-21swapper/310:20:013
33352422132,6sleep30-21swapper/309:30:023
35203062122,6sleep30-21swapper/312:35:103
35203062122,6sleep30-21swapper/312:35:093
35151172122,6sleep30-21swapper/312:30:093
35048232122,5sleep30-21swapper/312:20:003
35006222122,6sleep30-21swapper/312:15:123
34950162122,6sleep30-21swapper/312:10:023
34851202122,5sleep30-21swapper/312:00:033
34698782122,5sleep30-21swapper/311:45:013
34643622122,6sleep30-21swapper/311:35:273
34305872122,7sleep30-21swapper/311:05:093
34196202123,5sleep30-21swapper/310:55:003
34087982122,6sleep30-21swapper/310:40:203
33999992122,6sleep30-21swapper/310:35:033
33952652122,6sleep30-21swapper/310:30:093
33947562122,5sleep30-21swapper/310:30:003
33806352122,6sleep30-21swapper/310:15:123
33791142122,6sleep30-21swapper/310:10:223
33738222122,6sleep30-21swapper/310:05:163
33647062122,6sleep30-21swapper/309:55:303
33360352122,6sleep30-21swapper/309:30:133
33253422122,6sleep30-21swapper/309:20:023
32793162122,6sleep30-21swapper/308:30:183
32669022122,6sleep30-21swapper/308:20:143
32655262122,6sleep30-21swapper/308:19:173
32604102122,6sleep30-21swapper/308:12:163
32507942122,5sleep30-21swapper/308:05:023
32500912122,6sleep30-21swapper/308:00:233
32414352122,6sleep30-21swapper/307:55:103
32360822122,6sleep30-21swapper/307:50:053
32207982122,6sleep30-21swapper/307:35:083
32156262122,6sleep30-21swapper/307:30:053
34806292112,5sleep30-21swapper/311:55:133
34694222112,6sleep30-21swapper/311:40:403
34551282112,5sleep30-21swapper/311:30:043
34546772112,6sleep30-21swapper/311:27:163
34351672112,5sleep30-21swapper/311:10:023
34251132112,5sleep30-21swapper/311:00:063
34149222112,5sleep30-21swapper/310:50:083
33653542112,5sleep30-21swapper/310:00:073
33454932112,6sleep30-21swapper/309:40:053
33156602112,5sleep30-21swapper/309:10:073
33106922112,5sleep30-21swapper/309:05:053
33062582112,5sleep30-21swapper/309:00:113
32957992112,5sleep30-21swapper/308:50:083
32957992112,5sleep30-21swapper/308:50:073
32854332112,5sleep30-21swapper/308:40:013
32854332112,5sleep30-21swapper/308:40:013
32807552112,5sleep30-21swapper/308:35:073
32737502111,6sleep30-21swapper/308:25:163
32346412112,5sleep30-21swapper/307:45:183
32111622112,6sleep30-21swapper/307:25:123
32103162112,6sleep30-21swapper/307:23:403
31935442112,5sleep30-21swapper/307:10:073
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional