You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-08 - 00:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Fri Nov 07, 2025 12:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
258215821740,4sleep3586-21kworker/3:2-events08:36:253
2495558996157,3cyclictest2495393-21kworker/u8:3+events_unbound07:31:400
27094552580,5chrt0-21swapper/010:41:310
2495558995846,9cyclictest2516319-21ntpq07:26:360
2495561995753,3cyclictest2443193-21kworker/u8:1+flush-8:009:51:381
2495561995652,3cyclictest2722180-21kworker/u8:1+flush-8:011:31:321
2495558995652,3cyclictest2651612-21kworker/u8:3+events_unbound09:56:390
2495558995650,4cyclictest2626127-21kworker/u8:0+events_unbound09:41:390
2495561995548,3cyclictest2769830-21kworker/u8:2+events_unbound11:46:401
2495558995546,3cyclictest2464046-21kworker/u8:0+events_unbound07:21:390
2495558995450,3cyclictest2591897-21kworker/u8:2+events_unbound08:51:380
2495558995446,3cyclictest2621241-21kworker/u8:2+events_unbound09:16:410
27893832530,6chrt0-21swapper/212:01:312
2495561995347,4cyclictest2722180-21kworker/u8:1+events_unbound11:41:261
2495558995350,2cyclictest2739886-21kworker/u8:0+events_unbound11:11:420
2495558995349,3cyclictest2521941-21kworker/u8:2+events_unbound08:26:390
26066962520,2sleep3586-21kworker/3:2-events09:00:013
2495558995248,3cyclictest2606947-21kworker/u8:3+events_unbound09:31:260
2495558995248,3cyclictest2443193-21kworker/u8:1+events_unbound07:51:380
2495558995246,5cyclictest2779696-21kworker/u8:1+events_unbound12:11:220
2495558995244,6cyclictest282-21systemd-journal10:46:230
249555899520,50cyclictest602-21ntpd08:40:000
2495561995143,6cyclictest2815606-21latency_hist12:30:011
2495558995147,3cyclictest2443193-21kworker/u8:1+events_unbound08:21:380
2495565995040,7cyclictest2736354-21journal-offline11:11:272
2495561995045,4cyclictest2591897-21kworker/u8:2+flush-8:008:56:411
2495561995042,6cyclictest2641393-21kworker/u8:2+flush-8:010:41:341
2495561995041,3cyclictest2586701-21kworker/u8:0+events_unbound09:11:321
2495561995039,8cyclictest282-21systemd-journal09:50:001
2495558995046,3cyclictest2755529-21kworker/u8:3+events_unbound11:36:280
2495558995046,3cyclictest2521941-21kworker/u8:2+events_unbound07:36:410
2495558995045,4cyclictest2626127-21kworker/u8:0+events_unbound09:36:340
2495561994945,3cyclictest2739886-21kworker/u8:0+flush-8:012:11:381
2495561994945,3cyclictest2521941-21kworker/u8:2+flush-8:008:11:381
2495558994945,3cyclictest2739886-21kworker/u8:0+events_unbound11:26:230
2495558994945,3cyclictest2464046-21kworker/u8:0+events_unbound07:11:240
2495565994840,5cyclictest282-21systemd-journal07:15:012
2495561994839,3cyclictest2680793-21kworker/u8:1+events_unbound10:31:341
2495561994743,3cyclictest2739886-21kworker/u8:0+events_unbound12:06:431
2495561994743,3cyclictest2722180-21kworker/u8:1+flush-8:011:01:301
2495561994743,3cyclictest2641393-21kworker/u8:2+events_unbound10:16:211
2495558994743,3cyclictest2739886-21kworker/u8:0+events_unbound12:31:250
2495558994743,3cyclictest2443193-21kworker/u8:1+events_unbound07:15:260
2495558994742,3cyclictest2641393-21kworker/u8:2+events_unbound10:01:320
2495558994739,6cyclictest2741058-21apt-get11:16:210
2495561994642,3cyclictest2443193-21kworker/u8:1+flush-8:008:31:381
2495561994642,3cyclictest2443193-21kworker/u8:1+flush-8:008:31:381
2495558994643,2cyclictest2586701-21kworker/u8:0+events_unbound08:41:230
2495558994643,2cyclictest2586701-21kworker/u8:0+events_unbound08:41:230
2495558994643,2cyclictest2495393-21kworker/u8:3+events_unbound07:56:390
2495558994642,3cyclictest2779696-21kworker/u8:1+events_unbound12:26:240
2495558994642,3cyclictest2779696-21kworker/u8:1+events_unbound12:01:340
2495558994642,3cyclictest2739886-21kworker/u8:0+events_unbound11:56:240
2495558994642,3cyclictest2651612-21kworker/u8:3+events_unbound10:36:530
2495558994642,3cyclictest2651612-21kworker/u8:3+events_unbound10:36:520
2495558994642,3cyclictest2443193-21kworker/u8:1+events_unbound08:46:210
2495561994541,3cyclictest2495393-21kworker/u8:3+flush-8:007:31:401
2495561994537,6cyclictest2586458-21latency_hist08:40:001
2495558994542,2cyclictest2755529-21kworker/u8:3+events_unbound11:46:280
2495558994541,3cyclictest2779696-21kworker/u8:1+events_unbound12:07:490
2495558994541,3cyclictest2521941-21kworker/u8:2+events_unbound08:16:270
2495558994541,3cyclictest2443193-21kworker/u8:1+events_unbound09:51:220
2495558994541,3cyclictest2443193-21kworker/u8:1+events_unbound07:41:380
2495561994440,3cyclictest2495393-21kworker/u8:3+flush-8:007:56:391
2495558994441,2cyclictest2651612-21kworker/u8:3+events_unbound11:09:500
2495558994440,3cyclictest2820307-21kworker/u8:3+events_unbound12:37:020
2495558994440,3cyclictest2443193-21kworker/u8:1+events_unbound09:21:390
2495558994439,3cyclictest2495393-21kworker/u8:3+events_unbound08:01:340
26931902430,2sleep10-21swapper/110:26:311
2495561994339,3cyclictest2722180-21kworker/u8:1+flush-8:011:16:411
2495561994339,3cyclictest2443193-21kworker/u8:1+flush-8:009:21:341
2495561994339,3cyclictest2443193-21kworker/u8:1+events_unbound07:41:281
2495561994334,4cyclictest2651612-21kworker/u8:3+events_unbound10:56:431
2495558994339,3cyclictest2785480-21kworker/u8:3+events_unbound12:16:230
2495558994339,3cyclictest2779696-21kworker/u8:1+events_unbound12:21:220
2495558994339,3cyclictest2651612-21kworker/u8:3+events_unbound10:51:480
2495558994339,3cyclictest2651612-21kworker/u8:3+events_unbound10:16:420
2495558994339,3cyclictest2606947-21kworker/u8:3+events_unbound09:26:400
2495558994339,3cyclictest2586701-21kworker/u8:0+events_unbound09:11:200
2495558994339,3cyclictest2521941-21kworker/u8:2+events_unbound08:06:430
2495558994339,3cyclictest2495393-21kworker/u8:3+events_unbound08:31:250
2495558994339,3cyclictest2495393-21kworker/u8:3+events_unbound08:31:250
2495558994339,3cyclictest2495393-21kworker/u8:3+events_unbound07:46:280
2495558994339,3cyclictest2443193-21kworker/u8:1+events_unbound08:55:130
2495565994232,8cyclictest2765571-21cat11:40:012
2495561994238,3cyclictest2779696-21kworker/u8:1+flush-8:012:16:301
2495561994238,3cyclictest2443193-21kworker/u8:1+events_unbound07:21:241
2495561994238,2cyclictest2443193-21kworker/u8:1+events_unbound09:01:341
2495561994237,4cyclictest2641393-21kworker/u8:2+flush-8:010:21:351
2495561994237,4cyclictest2495393-21kworker/u8:3+events_unbound08:26:291
2495558994238,3cyclictest2755529-21kworker/u8:3+events_unbound11:50:500
2495558994238,3cyclictest2651612-21kworker/u8:3+events_unbound10:06:220
2495558994238,3cyclictest2651612-21kworker/u8:3+events_unbound09:46:210
2495558994238,3cyclictest2641393-21kworker/u8:2+events_unbound10:21:270
2495558994237,4cyclictest2641393-21kworker/u8:2+events_unbound11:03:490
2495558994237,4cyclictest2521941-21kworker/u8:2+events_unbound08:11:220
2495561994137,3cyclictest2641393-21kworker/u8:2+events_unbound10:46:271
2495561994137,3cyclictest2443193-21kworker/u8:1+flush-8:007:51:401
2495558994137,3cyclictest2651612-21kworker/u8:3+events_unbound10:56:270
2495558994137,3cyclictest2651612-21kworker/u8:3+events_unbound10:11:390
2495558994137,3cyclictest2443193-21kworker/u8:1+events_unbound09:01:220
27535952400,1sleep10-21swapper/111:26:301
2495561994036,3cyclictest2606947-21kworker/u8:3+events_unbound09:26:351
2495561994036,3cyclictest2521941-21kworker/u8:2+flush-8:007:36:451
2495561994034,5cyclictest2591897-21kworker/u8:2+events_unbound08:51:341
2495561994030,7cyclictest282-21systemd-journal09:55:481
2495561993935,3cyclictest2779696-21kworker/u8:1+flush-8:012:21:401
2495561993934,3cyclictest2586701-21kworker/u8:0+events_unbound09:06:251
2495561993831,5cyclictest2671539-21apt-get10:06:181
2495558993834,3cyclictest2755529-21kworker/u8:3+events_unbound11:43:480
2495558993834,3cyclictest2722180-21kworker/u8:1+events_unbound11:31:260
28255452370,3sleep30-21swapper/312:40:003
2495565993726,9cyclictest282-21systemd-journal10:25:002
2495561993732,4cyclictest2755529-21kworker/u8:3+flush-8:011:36:301
2495561993632,3cyclictest2739886-21kworker/u8:0+flush-8:011:21:401
2495561993632,3cyclictest2641393-21kworker/u8:2+events_unbound09:41:431
2495561993632,3cyclictest2443193-21kworker/u8:1+events_unbound07:16:271
2495561993631,4cyclictest2701148-21kworker/u8:0+events_unbound10:51:361
2495558993632,3cyclictest2641393-21kworker/u8:2+events_unbound10:26:190
2495561993531,3cyclictest2755529-21kworker/u8:3+flush-8:011:51:341
2495561993530,4cyclictest2521941-21kworker/u8:2+events_unbound08:16:331
2495561993526,7cyclictest282-21systemd-journal07:27:491
2495558993532,2cyclictest2641393-21kworker/u8:2+events_unbound11:20:490
2495558993531,3cyclictest2586701-21kworker/u8:0+events_unbound09:05:260
2495565993429,3cyclictest2722180-21kworker/u8:1+flush-8:011:31:372
2495565993428,4cyclictest282-21systemd-journal09:40:002
2495565993427,5cyclictest2591415-21apt-get08:45:002
2495565993427,5cyclictest2591415-21apt-get08:45:002
2495561993430,3cyclictest2820307-21kworker/u8:3+events_unbound12:36:271
2495561993430,3cyclictest2641393-21kworker/u8:2+flush-8:010:36:261
2495561993430,3cyclictest2641393-21kworker/u8:2+flush-8:010:36:261
2495558993428,2cyclictest2641393-21kworker/u8:2+events_unbound10:32:580
2495561993329,3cyclictest2739886-21kworker/u8:0+flush-8:012:31:421
2495561993329,3cyclictest2443193-21kworker/u8:1+events_unbound09:35:421
2495561993325,3cyclictest2443193-21kworker/u8:1+events_unbound07:46:401
2495561993323,7cyclictest2735779-21latency_hist11:10:011
2495561993223,7cyclictest282-21systemd-journal09:15:491
2495565993124,5cyclictest282-21systemd-journal12:10:002
2495561993127,3cyclictest2739886-21kworker/u8:0+events_unbound11:56:571
2495561993127,3cyclictest2521941-21kworker/u8:2+flush-8:008:06:411
2495565993026,3cyclictest2621241-21kworker/u8:2+flush-8:009:16:352
2495565993024,4cyclictest2566278-21unixbench_multi08:16:392
2495561993026,3cyclictest2785480-21kworker/u8:3+flush-8:012:01:561
2495561993026,3cyclictest2651612-21kworker/u8:3+flush-8:010:00:261
2495561993026,3cyclictest2443193-21kworker/u8:1+flush-8:008:46:491
2495561993026,3cyclictest2443193-21kworker/u8:1+events_unbound07:10:561
2495565992922,5cyclictest2641393-21kworker/u8:2+events_unbound11:06:382
2495561992926,2cyclictest2588299-21kthreadcore08:41:281
2495561992926,2cyclictest2588299-21kthreadcore08:41:281
2495561992923,4cyclictest2676716-21cpuspeed_turbos10:11:211
2495561992922,6cyclictest2571314-21unixbench_singl08:21:401
2495565992824,3cyclictest2536668-21unixbench_multi07:46:412
2495565992822,4cyclictest2821140-21cpuspeed_turbos12:36:242
2495565992819,7cyclictest282-21systemd-journal08:10:002
24952582282,3sleep00-21swapper/007:08:460
24907932289,13sleep10-21swapper/107:05:581
2495565992724,2cyclictest2801451-21fschecks_time12:16:252
2495565992722,3cyclictest2507779-21aten2_r5power_v07:21:232
2495561992721,5cyclictest2736345-21cpuspeed_turbos11:11:271
2495565992622,2cyclictest2725559-21unixbench_singl10:56:422
2495565992620,4cyclictest282-21systemd-journal07:20:002
2495565992618,6cyclictest282-21systemd-journal12:25:002
249556599261,23cyclictest2620641-21grep09:11:292
27494772250,5sleep3451irq_work/311:21:313
2495565992522,2cyclictest2517563-21aten2_r5power_c07:31:242
2495565992521,2cyclictest2547554-21fschecks_count08:01:262
2495565992519,4cyclictest2666232-21sendmail10:00:002
2495561992520,4cyclictest2495393-21kworker/u8:3+events_unbound08:01:291
2495565992420,2cyclictest2706518-21aten2_r5power_e10:41:232
2495565992414,8cyclictest282-21systemd-journal08:15:002
281067522312,7sleep30-21swapper/312:25:003
2495565992320,2cyclictest2701748-21fschecks_count10:36:262
2495565992320,2cyclictest2701748-21fschecks_count10:36:262
2495565992319,2cyclictest2571307-21unixbench_singl08:21:402
2495565992316,5cyclictest282-21systemd-journal09:45:002
2495561992319,3cyclictest2443193-21kworker/u8:1+events_unbound09:33:051
249556599223,14cyclictest2691566-21apt-get10:26:232
2495565992218,2cyclictest0-21swapper/209:00:012
249556599219,8cyclictest2591993-21apt-get08:46:192
2495565992118,2cyclictest2597031-21aten2_r5power_p08:51:222
2495565992116,3cyclictest2712316-21kthreadcore10:46:282
2495565992114,5cyclictest282-21systemd-journal09:55:002
249556599207,5cyclictest0-21swapper/207:56:402
249556599202,12cyclictest2527449-21apt-get07:41:212
2495565992016,3cyclictest2636199-21unixbench_singl09:26:412
2495565992016,2cyclictest0-21swapper/212:00:002
2495565992016,2cyclictest0-21swapper/209:01:282
249556599192,12cyclictest2726234-21apt-get11:01:222
2495565991916,2cyclictest2641422-21cron09:35:002
2495565991916,2cyclictest2522523-21aten2_r5power_e07:36:212
2495565991915,3cyclictest0-21swapper/212:30:012
2495565991914,4cyclictest2739886-21kworker/u8:0+flush-8:012:31:412
24908522194,9sleep20-21swapper/207:06:232
249556599189,2cyclictest0-21swapper/210:51:252
249556599188,2cyclictest0-21swapper/208:26:302
249556599182,15cyclictest0-21swapper/212:14:072
2495565991814,2cyclictest0-21swapper/211:25:002
2495565991814,2cyclictest0-21swapper/210:05:002
2495565991814,2cyclictest0-21swapper/208:31:392
2495565991814,2cyclictest0-21swapper/208:31:392
2495565991813,4cyclictest0-21swapper/211:54:032
2495565991810,6cyclictest282-21systemd-journal10:35:002
2495565991810,6cyclictest2754297-21tr11:26:312
24952212183,9sleep30-21swapper/307:08:173
249556599179,6cyclictest2673764-21tr10:06:292
249556599172,11cyclictest2676491-21apt-get10:11:182
2495565991711,4cyclictest282-21systemd-journal08:35:492
2495565991613,2cyclictest2616240-21unixbench_multi09:06:412
2495565991613,2cyclictest0-21swapper/211:45:082
2495565991613,2cyclictest0-21swapper/209:21:152
2495565991613,2cyclictest0-21swapper/207:53:382
2495565991612,3cyclictest0-21swapper/207:26:332
2495565991612,2cyclictest0-21swapper/210:16:082
2495565991611,4cyclictest0-21swapper/209:46:372
249556599161,11cyclictest2766030-21apt-get11:41:192
249556599161,11cyclictest2744840-21ntpq11:16:352
27965962156,5sleep30-21swapper/312:11:283
27361302142,7sleep30-21swapper/311:11:243
27262082142,8sleep30-21swapper/311:01:213
27119252144,6sleep30-21swapper/310:46:283
25330552142,7sleep30-21swapper/307:46:303
27110252132,7sleep30-21swapper/310:45:003
26662662132,6sleep30-21swapper/310:00:013
26373542132,7sleep30-21swapper/309:31:283
26109562132,7sleep30-21swapper/309:01:383
25756762132,7sleep30-21swapper/308:26:353
25568022132,6sleep30-21swapper/308:10:013
28112852122,6sleep30-21swapper/312:26:253
27955042122,6sleep30-21swapper/312:09:273
27754892122,6sleep30-21swapper/311:49:253
27564252122,6sleep30-21swapper/311:31:273
27511962122,6sleep30-21swapper/311:26:253
27311722122,6sleep30-21swapper/311:06:233
27258352122,6sleep30-21swapper/310:59:493
27055102122,6sleep30-21swapper/310:36:413
27055102122,6sleep30-21swapper/310:36:413
26967762122,6sleep30-21swapper/310:31:313
26908722122,6sleep30-21swapper/310:23:493
26769152122,6sleep30-21swapper/310:11:253
26656942122,6sleep30-21swapper/309:56:403
26555112122,6sleep30-21swapper/309:46:333
26467842122,6sleep30-21swapper/309:41:233
26008842122,6sleep30-21swapper/308:51:393
25914252121,6sleep30-21swapper/308:45:013
25566712122,6sleep30-21swapper/308:08:493
25463182122,6sleep30-21swapper/307:56:413
25310862122,6sleep30-21swapper/307:41:323
25085922122,6sleep30-21swapper/307:21:293
25001142122,6sleep30-21swapper/307:11:423
28196632112,6sleep30-21swapper/312:31:343
28010192112,6sleep30-21swapper/312:15:373
27895212112,5sleep30-21swapper/312:01:333
27808382112,5sleep30-21swapper/311:56:233
27766842112,5sleep30-21swapper/311:51:293
27664862112,5sleep30-21swapper/311:41:263
27609302112,5sleep30-21swapper/311:36:243
27413132112,5sleep30-21swapper/311:16:263
27208812112,5sleep30-21swapper/310:54:513
26814642112,5sleep30-21swapper/310:16:223
26714462112,5sleep30-21swapper/310:05:313
26569282112,5sleep30-21swapper/309:51:223
26420242112,5sleep30-21swapper/309:36:253
26319112112,5sleep30-21swapper/309:26:223
26276852112,5sleep30-21swapper/309:21:293
26218062112,5sleep30-21swapper/309:15:313
26168942112,5sleep30-21swapper/309:10:493
26120012112,5sleep30-21swapper/309:06:033
25913012112,5sleep30-21swapper/308:43:483
25913012112,5sleep30-21swapper/308:43:483
25813532112,5sleep30-21swapper/308:33:213
25813532112,5sleep30-21swapper/308:33:213
25679382112,5sleep30-21swapper/308:21:293
25620132112,5sleep30-21swapper/308:16:193
25472622112,5sleep30-21swapper/308:01:223
25374992112,5sleep30-21swapper/307:51:233
25250982112,5sleep30-21swapper/307:36:303
25201582112,5sleep30-21swapper/307:31:333
25131062112,5sleep30-21swapper/307:26:313
25008132112,5sleep30-21swapper/307:15:033
26910862100,5sleep30-21swapper/310:25:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional