You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-26 - 06:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Fri Jun 26, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
408245921930,2sleep3481ktimers/321:30:253
40270042630,19sleep20-21swapper/220:35:172
3940311996344,17cyclictest4075251-21ntpq21:20:290
3940313996151,6cyclictest1704890-21systemd-journal22:45:171
3940313995953,4cyclictest4036614-21kworker/u8:1+flush-8:020:55:321
3940313995953,4cyclictest4036614-21kworker/u8:1+flush-8:020:55:311
3940313995852,4cyclictest4042096-21kworker/u8:0+flush-8:022:35:351
3940313995745,8cyclictest4080792-21kworker/u8:1+flush-8:021:30:291
3940311995545,7cyclictest4032156-21diskstats20:40:200
3940311995535,8cyclictest1704890-21systemd-journal19:20:000
3940313995447,5cyclictest11380-21kworker/u8:3+events_unbound23:55:171
3940313995445,6cyclictest1704890-21systemd-journal19:25:161
3940313995244,6cyclictest3947347-21kworker/u8:1+flush-8:019:30:351
3940313995242,7cyclictest1704890-21systemd-journal23:25:001
3940311995231,6cyclictest1704890-21systemd-journal22:15:010
3940313995145,4cyclictest3989849-21kworker/u8:2+events_unbound20:45:171
3940313995144,5cyclictest4075352-21kworker/u8:3+events_unbound21:20:361
3940311995128,7cyclictest4086121-21latency_hist21:35:020
3940313995045,4cyclictest3898260-21kworker/u8:3+flush-8:020:30:311
3940317994944,3cyclictest4042096-21kworker/u8:0+flush-8:022:45:292
3940313994839,7cyclictest4154963-21ntpq22:40:291
3940317994741,4cyclictest3989849-21kworker/u8:2+flush-8:020:00:202
3940313994739,6cyclictest71190-21latency_hist00:35:021
39899562460,4sleep375-21kworker/3:1-mm_percpu_wq19:55:263
3940313994640,5cyclictest4140692-21kworker/u8:1+events_unbound23:50:331
3940313994640,5cyclictest4140692-21kworker/u8:1+events_unbound23:50:331
3940313994640,5cyclictest3898260-21kworker/u8:3+events_unbound20:40:281
3940313994639,4cyclictest4042096-21kworker/u8:0+events_unbound21:00:331
3940313994636,7cyclictest4135213-21ntpq22:20:311
3940313994635,7cyclictest1704890-21systemd-journal23:10:011
3940311994637,6cyclictest3981932-21apt-get19:50:000
3940317994539,4cyclictest4140692-21kworker/u8:1+flush-8:023:25:352
3940313994539,4cyclictest4036614-21kworker/u8:1+events_unbound21:05:181
3940313994539,4cyclictest36757-21kworker/u8:1+events_unbound00:00:341
3940313994539,4cyclictest36757-21kworker/u8:1+events_unbound00:00:341
3940313994537,6cyclictest4140692-21kworker/u8:1+events_unbound23:30:351
3940311994536,6cyclictest46470-21latency_hist00:10:000
3940311994536,6cyclictest3997042-21latency_hist20:05:010
394031199451,42cyclictest1-21systemd21:05:000
3940313994437,5cyclictest4042096-21kworker/u8:0+events_unbound21:35:301
3940313994432,9cyclictest3996128-21ntpq20:00:281
39559322430,6sleep20-21swapper/219:20:262
3940317994333,7cyclictest1704890-21systemd-journal20:25:172
3940313994334,7cyclictest1704890-21systemd-journal22:05:001
3940313994331,9cyclictest1704890-21systemd-journal23:45:001
3940311994334,6cyclictest4031626-21latency_hist20:40:010
3940313994238,3cyclictest3989849-21kworker/u8:2+flush-8:020:20:321
3940313994235,5cyclictest4080792-21kworker/u8:1+flush-8:022:05:311
3940313994135,4cyclictest4140692-21kworker/u8:1+flush-8:022:30:321
3940311994135,4cyclictest4184722-21kworker/u8:0+flush-8:023:10:360
3940317994034,4cyclictest4111284-21kworker/u8:2+flush-8:022:50:342
3940313994035,4cyclictest3947347-21kworker/u8:1+events_unbound19:40:311
3940313994035,3cyclictest4123532-21kworker/u8:3+events_unbound22:15:281
3940313994034,4cyclictest4180905-21apt-get23:10:151
3940313994033,5cyclictest3989849-21kworker/u8:2+flush-8:019:55:311
3940313994031,7cyclictest3947362-21/usr/sbin/munin19:15:331
3940311994031,6cyclictest1704890-21systemd-journal21:15:000
39368902404,7sleep00-21swapper/019:05:220
3940317993934,3cyclictest4080792-21kworker/u8:1+events_unbound22:10:242
3940317993933,4cyclictest11380-21kworker/u8:3+flush-8:000:10:302
3940313993933,4cyclictest4091313-21apt-get21:40:171
3940313993832,5cyclictest4042096-21kworker/u8:0+flush-8:022:25:211
3940313993733,3cyclictest11380-21kworker/u8:3+events_unbound00:05:361
3940313993732,4cyclictest3947347-21kworker/u8:1+events_unbound19:50:321
3940313993731,4cyclictest3089799-21kworker/u8:2+events_unbound19:15:001
3940313993729,6cyclictest36757-21kworker/u8:1+flush-8:000:35:321
3940311993728,6cyclictest3972053-21latency_hist19:40:010
3940313993632,3cyclictest3930077-21kworker/u8:0+events_unbound20:05:341
3940313993630,4cyclictest3947347-21kworker/u8:1+flush-8:019:35:361
3940313993629,5cyclictest3947347-21kworker/u8:1+flush-8:019:20:301
3940313993628,6cyclictest6790-21latency_hist23:30:001
3940313993627,6cyclictest3989849-21kworker/u8:2+flush-8:021:10:301
3940317993531,3cyclictest11380-21kworker/u8:3+flush-8:000:20:302
3940313993531,3cyclictest3989849-21kworker/u8:2+flush-8:021:25:311
3940313993531,3cyclictest3989849-21kworker/u8:2+events_unbound20:35:191
3940313993528,5cyclictest3989849-21kworker/u8:2+flush-8:021:15:361
3940313993528,5cyclictest21904-21apt-get23:45:141
3940313993528,4cyclictest4111284-21kworker/u8:2+flush-8:000:25:201
3940313993527,6cyclictest4020818-21ntpq20:25:271
3940313993527,6cyclictest3977242-21/usr/sbin/munin19:45:251
3940311993526,7cyclictest4190602-21latency_hist23:20:010
3940311993526,6cyclictest16684-21latency_hist23:40:010
3940313993429,4cyclictest3989849-21kworker/u8:2+events_unbound20:50:191
3940313993429,4cyclictest3989849-21kworker/u8:2+events_unbound20:50:181
3940313993427,5cyclictest36757-21kworker/u8:1+flush-8:000:15:221
3940311993427,5cyclictest4106370-21apt-get21:55:160
3940311993425,7cyclictest4056881-21diskstats21:05:190
3940311993424,7cyclictest61318-21latency_hist00:25:010
3940311993410,22cyclictest4081177-21kworker/0:2+events22:00:340
3940317993329,3cyclictest3089799-21kworker/u8:2+events_unbound19:15:022
3940317993325,6cyclictest31614-21cat23:55:012
3940317993325,6cyclictest31614-21cat23:55:012
3940313993328,3cyclictest3989849-21kworker/u8:2+events_unbound20:15:191
3940313993327,5cyclictest3898260-21kworker/u8:3+flush-8:020:10:301
3940313993327,4cyclictest4080792-21kworker/u8:1+flush-8:021:45:231
394031199339,23cyclictest4081177-21kworker/0:2+events21:35:190
3940311993326,5cyclictest3947347-21kworker/u8:1+flush-8:019:40:390
3940317993227,3cyclictest4111284-21kworker/u8:2+flush-8:023:35:162
3940317993222,8cyclictest4115990-21turbostat.cron22:05:012
3940313993228,3cyclictest11380-21kworker/u8:3+flush-8:023:35:261
3940313993227,3cyclictest36757-21kworker/u8:1+events_unbound00:10:251
3940313993226,4cyclictest4169831-21kworker/u8:3+flush-8:023:00:221
3940313993226,4cyclictest4111026-21cron22:00:011
3940313993225,5cyclictest4075352-21kworker/u8:3+flush-8:021:50:211
394031199329,21cyclictest4061360-21kworker/0:1+events21:20:010
3940311993225,5cyclictest4042096-21kworker/u8:0+events_unbound21:40:330
394031199322,29cyclictest3930083-21kworker/0:0+events20:50:290
394031199322,29cyclictest3930083-21kworker/0:0+events20:50:290
394031199316,23cyclictest4081177-21kworker/0:2+events23:50:350
394031199316,23cyclictest4081177-21kworker/0:2+events23:50:340
3940311993123,6cyclictest3962183-21latency_hist19:30:000
3940311993122,6cyclictest3967112-21latency_hist19:35:010
3940311993120,9cyclictest0-21swapper/021:55:010
394031799308,3cyclictest39701292kthreadcore19:35:252
3940317993022,6cyclictest1704890-21systemd-journal20:55:002
3940317993022,6cyclictest1704890-21systemd-journal20:54:592
3940313993024,4cyclictest4125940-21cron22:15:011
394031199308,18cyclictest26614-21kworker/0:0+events00:00:010
3940311993024,4cyclictest3989849-21kworker/u8:2+flush-8:020:15:350
3940311993023,5cyclictest3989849-21kworker/u8:2+flush-8:020:20:200
3940311993022,6cyclictest1704890-21systemd-journal23:03:170
3940311993021,7cyclictest11731-21latency_hist23:35:010
3940311993020,9cyclictest3930083-21kworker/0:0+events20:58:190
3940311993020,9cyclictest3930083-21kworker/0:0+events20:58:180
3940311993020,8cyclictest1704890-21systemd-journal21:30:000
394031199301,27cyclictest4081177-21kworker/0:2+events22:45:330
3940311993010,18cyclictest4081177-21kworker/0:2+events23:20:170
3940317992924,3cyclictest3945413-21sed19:15:002
3940317992923,4cyclictest4155485-21unixbench_multi22:40:352
394031199296,16cyclictest4081177-21kworker/0:2+events22:30:170
394031199294,23cyclictest4081177-21kworker/0:2+events22:55:210
394031199294,23cyclictest26614-21kworker/0:0+events00:10:330
3940311992922,5cyclictest4130908-21apt-get22:20:000
394031199291,27cyclictest4081177-21kworker/0:2+events22:05:270
394031199291,27cyclictest3930083-21kworker/0:0+events20:09:330
394031199291,26cyclictest3930083-21kworker/0:0+events20:45:160
3940311992910,17cyclictest26614-21kworker/0:0+events00:15:290
3940317992822,4cyclictest3967106-21cron19:34:592
3940317992820,6cyclictest1704890-21systemd-journal21:55:002
3940313992821,5cyclictest4165805-21cron22:55:001
3940313992820,6cyclictest4169817-21ntpq22:55:311
3940313992820,6cyclictest4111284-21kworker/u8:2+events_unbound23:15:301
394031199289,15cyclictest3930083-21kworker/0:0+events19:10:150
394031199287,15cyclictest56380-21kworker/0:1+events00:30:170
394031199286,18cyclictest4081177-21kworker/0:2+events23:45:000
394031199284,22cyclictest4081177-21kworker/0:2+events23:45:290
3940311992824,3cyclictest4123532-21kworker/u8:3+flush-8:022:25:310
394031199282,25cyclictest4081177-21kworker/0:2+events22:21:370
3940311992822,4cyclictest11380-21kworker/u8:3+flush-8:000:25:310
3940311992821,5cyclictest4111284-21kworker/u8:2+flush-8:022:35:270
3940311992818,7cyclictest1704890-21systemd-journal00:40:000
394031199281,26cyclictest4081177-21kworker/0:2+events22:50:140
3940311992810,16cyclictest3930083-21kworker/0:0+events19:50:230
3940317992723,3cyclictest4060924-21unixbench_singl21:05:352
394031199279,17cyclictest4081177-21kworker/0:2+events22:40:230
394031199279,16cyclictest3930083-21kworker/0:0+events20:25:290
394031199277,18cyclictest3930083-21kworker/0:0+events19:55:240
3940311992723,3cyclictest4096596-21fschecks_time21:45:180
40642022260,4sleep30-21swapper/321:10:273
40261742260,2sleep00-21swapper/020:30:340
3940317992622,2cyclictest51755-21aten2_r5power_p00:15:192
3940317992621,3cyclictest4016363-21unixbench_multi20:20:342
3940317992621,3cyclictest4007412-21cpuspeed_turbos20:15:172
3940311992621,4cyclictest3930077-21kworker/u8:0+events_unbound19:25:010
3940317992521,2cyclictest66846-21fschecks_time00:30:212
3940317992521,2cyclictest4136585-21cpuspeed_turbos22:25:192
3940317992520,3cyclictest71512-21aten2_r5power_e00:35:192
3940317992520,3cyclictest4081460-21aten2_r5power_e21:30:172
3940317992511,3cyclictest0-21swapper/223:56:162
394031199259,14cyclictest4081177-21kworker/0:2+events23:25:020
394031199252,17cyclictest26614-21kworker/0:0+events00:05:010
394031199251,22cyclictest3930083-21kworker/0:0+events20:10:220
3940317992421,2cyclictest3987477-21aten2_r5power_p19:55:172
3940317992421,2cyclictest22128-21cpuspeed_turbos23:45:172
3940317992418,4cyclictest2001-21cat23:25:012
394031199245,17cyclictest4081177-21kworker/0:2+events23:05:160
3940317992320,2cyclictest4036907-21aten2_r5power_e20:45:152
3940317992218,3cyclictest4126304-21aten2_r5power_p22:15:172
3940317992218,2cyclictest0-21swapper/223:19:592
3940317992215,5cyclictest4000334-21kthreadcore20:05:252
3940317992215,5cyclictest1704890-21systemd-journal00:00:172
3940317992215,5cyclictest1704890-21systemd-journal00:00:162
3940317992214,3cyclictest4170054-21mailstats22:55:352
3940317992210,4cyclictest0-21swapper/222:35:312
3940313992218,3cyclictest11380-21kworker/u8:3+events_unbound00:20:391
3940311992217,3cyclictest0-21swapper/000:00:260
3940317992117,2cyclictest46024-21unixbench_multi00:05:422
3940317992117,2cyclictest4032173-21fschecks_count20:40:202
39394202214,11sleep10-21swapper/119:05:331
3940317992017,2cyclictest4116373-21aten2_r5power_v22:05:172
3940317992016,2cyclictest4086605-21cpuspeed_turbos21:35:182
3940317992015,3cyclictest4131698-21fschecks_count22:20:202
39353612203,8sleep30-21swapper/319:05:023
3940317991915,3cyclictest61873-21fschecks_count00:25:202
3940317991915,3cyclictest3976276-21awk19:40:342
3940317991915,2cyclictest0-21swapper/222:00:012
394031799190,5cyclictest41711752cpu23:00:202
39394702194,9sleep20-21swapper/219:05:342
394031799189,7cyclictest4144797-21tr22:30:272
394031799183,9cyclictest4061593-21apt-get21:10:172
3940317991815,2cyclictest3982724-21fschecks_count19:50:192
3940317991814,2cyclictest0-21swapper/219:25:272
3940317991813,3cyclictest0-21swapper/221:45:012
3940317991812,4cyclictest0-21swapper/220:30:202
3940317991810,6cyclictest4182836-21tr23:10:242
3940317991712,3cyclictest0-21swapper/220:10:182
3940317991712,3cyclictest0-21swapper/219:45:232
394031799171,12cyclictest4046766-21apt-get20:55:172
394031799171,12cyclictest4046766-21apt-get20:55:162
394031799170,2cyclictest40779502grep21:25:252
394031799162,2cyclictest0-21swapper/223:44:592
3940317991612,2cyclictest0-21swapper/221:15:182
3940317991611,3cyclictest7320-21uniq23:30:192
3940317991611,3cyclictest0-21swapper/221:45:232
3940317991611,3cyclictest0-21swapper/221:20:262
3940317991611,3cyclictest0-21swapper/221:00:222
3940317991610,4cyclictest0-21swapper/223:05:232
41865762142,8sleep30-21swapper/323:15:243
40266482142,8sleep30-21swapper/320:35:003
39783782142,7sleep30-21swapper/319:45:243
58072132,7sleep30-21swapper/323:25:283
41848542132,7sleep30-21swapper/323:10:353
41669682132,7sleep30-21swapper/322:55:263
41651512133,6sleep30-21swapper/322:50:373
41159982132,6sleep30-21swapper/322:05:013
41009222132,7sleep30-21swapper/321:50:013
39691032132,7sleep30-21swapper/319:35:253
714592122,6sleep30-21swapper/300:35:193
68112122,5sleep30-21swapper/323:30:003
566272122,6sleep30-21swapper/300:20:183
467392122,6sleep30-21swapper/300:10:183
422752123,6sleep30-21swapper/300:05:293
41908442122,5sleep30-21swapper/323:20:023
41776422122,6sleep30-21swapper/323:05:253
41735082122,6sleep30-21swapper/323:00:273
41467832122,6sleep30-21swapper/322:35:243
41410572122,5sleep30-21swapper/322:30:023
41364392122,6sleep30-21swapper/322:25:193
41262202122,7sleep30-21swapper/322:15:173
41112972122,6sleep30-21swapper/322:00:163
41067502122,6sleep30-21swapper/321:55:223
41014532122,6sleep30-21swapper/321:50:203
40913112122,6sleep30-21swapper/321:40:183
40900142122,6sleep30-21swapper/321:35:273
40805122122,6sleep30-21swapper/321:25:373
40594532122,6sleep30-21swapper/321:05:263
40537782123,5sleep30-21swapper/321:00:233
40467382122,6sleep30-21swapper/320:55:153
40467382122,6sleep30-21swapper/320:55:153
40456742122,6sleep30-21swapper/320:50:333
40456742122,6sleep30-21swapper/320:50:323
40368542122,6sleep30-21swapper/320:45:163
40357882123,6sleep30-21swapper/320:40:333
40269042122,6sleep30-21swapper/320:35:153
40194772123,6sleep30-21swapper/320:25:253
40157412122,6sleep30-21swapper/320:20:263
40069502122,5sleep30-21swapper/320:15:023
39974092122,6sleep30-21swapper/320:05:173
39722152122,6sleep30-21swapper/319:40:023
39630292120,7sleep30-21swapper/319:30:223
39612802122,6sleep30-21swapper/319:25:293
39468152123,5sleep30-21swapper/319:15:053
39407212122,6sleep30-21swapper/319:10:203
322952122,6sleep30-21swapper/323:55:223
265792121,7sleep30-21swapper/323:50:003
169682122,6sleep30-21swapper/323:40:173
664972112,5sleep30-21swapper/300:30:163
615992112,5sleep30-21swapper/300:25:203
516412112,6sleep30-21swapper/300:15:153
41564172112,6sleep30-21swapper/322:45:183
41515812112,5sleep30-21swapper/322:40:203
41313842112,5sleep30-21swapper/322:20:033
41212442112,5sleep30-21swapper/322:10:183
40715912112,5sleep30-21swapper/321:20:183
40668032112,5sleep30-21swapper/321:15:203
40024852112,6sleep30-21swapper/320:10:203
39923472112,6sleep30-21swapper/320:00:173
39857942112,5sleep30-21swapper/319:50:253
39562142112,5sleep30-21swapper/319:20:283
375172112,5sleep30-21swapper/300:00:233
375172112,5sleep30-21swapper/300:00:223
312322112,6sleep30-21swapper/323:51:043
312322112,6sleep30-21swapper/323:51:033
122752112,5sleep30-21swapper/323:35:183
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional