You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-26 - 16:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackfslot7s.osadl.org (updated Tue May 26, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
395015299407019,4045cyclictest3980938-21kworker/2:1+events20:47:172
395014499337714,3358cyclictest4032173-21kworker/0:0+events23:30:130
395014499335814,3340cyclictest4009521-21kworker/0:2+events22:20:010
395014499331616,3296cyclictest4045090-21kworker/0:1+events00:05:190
395014499321216,3191cyclictest3975970-21kworker/0:0+events20:50:180
395014499309810,3083cyclictest3975970-21kworker/0:0+events20:55:180
395014999301515,2995cyclictest3985356-21kworker/1:2+events21:00:181
395014499294513,2928cyclictest4042192-21kworker/0:2+events23:55:200
395014499292012,2905cyclictest3995218-21kworker/0:0+events21:35:210
395014499290414,2886cyclictest4026017-21kworker/0:2+events23:05:150
395014499287714,2858cyclictest3961788-21kworker/0:1+events19:50:130
395015499286811,2852cyclictest3993749-21kworker/3:2+events21:40:123
395015299280513,2787cyclictest3987018-21kworker/2:1+events21:09:472
395015499279813,2781cyclictest3985476-21kworker/3:2+events21:01:053
395015299276311,2745cyclictest3968279-21kworker/2:1+events20:06:422
395015299274313,2726cyclictest3957191-21kworker/2:2+events19:30:252
395014499273413,2717cyclictest4026172-21kworker/0:3+events23:10:150
395015499271511,2702cyclictest3976154-21kworker/3:2+events20:30:033
395014499270213,2687cyclictest3985386-21kworker/0:2+events21:05:170
39501549927008,2688cyclictest4004993-21kworker/3:1+events22:05:173
395015299270011,2686cyclictest4043677-21kworker/2:1+events00:00:212
395015499269513,2678cyclictest3963507-21kworker/3:2+events19:55:143
395014499269511,2680cyclictest3967955-21kworker/0:1+events20:26:110
395014499269412,2678cyclictest4045090-21kworker/0:1+events00:20:140
395014499268912,2673cyclictest3963388-21kworker/0:0+events19:56:010
395015499268613,2669cyclictest3955406-21kworker/3:0+events19:40:173
395015499268313,2668cyclictest3955406-21kworker/3:0+events19:36:283
395015499268213,2665cyclictest3977843-21kworker/3:1+events20:53:463
395015299268210,2668cyclictest3972389-21kworker/2:0+events20:23:552
395015299267913,2662cyclictest3961726-21kworker/2:2+events19:45:122
395014499267812,2662cyclictest4000283-21kworker/0:2+events22:00:170
395015499267413,2657cyclictest4046827-21kworker/3:0+events00:08:463
395015299267312,2657cyclictest3963329-21kworker/2:0+events20:02:032
395014499266913,2652cyclictest3980850-21kworker/0:2+events20:46:550
395015299266513,2648cyclictest4009552-21kworker/2:2+events22:15:292
395014499266512,2649cyclictest3979225-21kworker/0:1+events20:40:520
395014499266512,2649cyclictest3972772-21kworker/0:2+events20:21:380
395014499266412,2648cyclictest3975970-21kworker/0:0+events20:38:090
395014499266313,2646cyclictest4019462-21kworker/0:1+events23:03:440
395015299266212,2646cyclictest3969972-21kworker/2:2+events20:13:372
395014499266213,2645cyclictest4007922-21kworker/0:0+events22:14:200
395014499266211,2647cyclictest3960126-21kworker/0:0+events19:38:460
395014499266113,2645cyclictest3927666-21kworker/0:1+events19:23:530
395014499266111,2646cyclictest3957273-21kworker/0:3+events19:31:340
395014499266013,2643cyclictest4035317-21kworker/0:1+events23:47:430
395014499266012,2644cyclictest4013249-21kworker/0:3+events22:40:490
395014499265912,2643cyclictest4019462-21kworker/0:1+events22:55:250
395015299265513,2639cyclictest3953546-21kworker/2:1+events19:22:222
39501499926547,2642cyclictest3998599-21kworker/1:1+events22:46:361
395015299265213,2635cyclictest4022885-21kworker/2:0+events22:57:172
395014499265213,2635cyclictest4056460-21kworker/0:2+events00:39:070
39501549926507,2639cyclictest4021036-21kworker/3:1+events23:14:073
395015499263913,2622cyclictest4040294-21kworker/3:2+events23:48:513
395015499263913,2621cyclictest3961877-21kworker/3:1+events19:46:223
395015299263913,2622cyclictest3955433-21kworker/2:0+events19:25:272
395014999263913,2622cyclictest4042043-21kworker/1:2+events00:04:321
395015499263812,2623cyclictest4021036-21kworker/3:1+events23:05:383
395014499263613,2621cyclictest3985386-21kworker/0:2+events21:25:020
395015499263513,2618cyclictest3993749-21kworker/3:2+events21:31:303
395015499263413,2617cyclictest4053321-21kworker/3:1+events00:35:453
395015299263413,2617cyclictest3988788-21kworker/2:0+events21:20:282
395015299263412,2618cyclictest3972389-21kworker/2:0+events20:28:552
395015499263312,2617cyclictest3985476-21kworker/3:2+events21:07:063
395015499263213,2615cyclictest3972834-21kworker/3:0+events20:19:203
395015299263213,2615cyclictest3988788-21kworker/2:0+events21:10:562
39501529926319,2618cyclictest3964934-21kworker/2:1+events19:53:172
395015299263113,2614cyclictest3982536-21kworker/2:2+events20:53:032
395014499263112,2615cyclictest3975970-21kworker/0:0+events20:33:300
395015299263012,2615cyclictest4003365-21kworker/2:2+events22:03:452
395015499262912,2613cyclictest4032357-21kworker/3:1+events23:34:223
395015299262713,2610cyclictest4029171-21kworker/2:0+events23:36:412
395015499262613,2610cyclictest4041892-21kworker/3:1+events00:03:023
395015299262513,2608cyclictest4003365-21kworker/2:2+events21:58:242
395015299262413,2607cyclictest4019644-21kworker/2:1+events22:50:282
395014499262413,2608cyclictest4021066-21kworker/0:0+events22:47:440
395015499262113,2605cyclictest4021036-21kworker/3:1+events23:02:363
395015299261013,2593cyclictest3982536-21kworker/2:2+events21:01:272
395015499260913,2592cyclictest4003398-21kworker/3:2+events22:02:583
395014499260813,2591cyclictest4048605-21kworker/0:3+events00:16:300
39501549926059,2592cyclictest4003398-21kworker/3:2+events21:59:533
395015299260113,2584cyclictest4007949-21kworker/2:1+events22:11:392
395015299259812,2582cyclictest3953546-21kworker/2:1+events19:36:062
395015299259213,2576cyclictest3992922-21kworker/2:1+events21:45:532
395015499258410,2570cyclictest4001768-21kworker/3:0+events21:54:393
395015499258012,2564cyclictest4004993-21kworker/3:1+events22:10:543
395015499257312,2557cyclictest4021036-21kworker/3:1+events22:51:593
395015499257112,2557cyclictest4050091-21kworker/3:2+events00:30:043
395015499257112,2557cyclictest4013077-21kworker/3:0+events22:40:243
395015499256912,2551cyclictest3968011-21kworker/3:0+events20:03:133
395014499256912,2553cyclictest3967955-21kworker/0:1+events20:11:170
395015299256812,2553cyclictest3998338-21kworker/2:0+events21:40:332
39501549925677,2556cyclictest4033954-21kworker/3:2+events23:29:503
395015299256112,2545cyclictest4053035-21kworker/2:2+events00:32:222
395015499256010,2546cyclictest3993749-21kworker/3:2+events21:45:323
395015299256012,2544cyclictest4051449-21kworker/2:1+events00:22:062
395014499255613,2539cyclictest3960126-21kworker/0:0+events19:41:040
395015499255212,2536cyclictest3977843-21kworker/3:1+events20:56:273
395015499255211,2537cyclictest3963507-21kworker/3:2+events19:50:363
395014499254813,2531cyclictest4026172-21kworker/0:3+events23:26:050
395014999254711,2534cyclictest3998599-21kworker/1:1+events21:46:151
39501549925450,2541cyclictest3969648-21kworker/3:2+events20:13:593
395015299253912,2523cyclictest3969972-21kworker/2:2+events20:15:312
395014999253312,2517cyclictest3968311-21kworker/1:0+events20:49:111
395014499253111,2516cyclictest4000283-21kworker/0:2+events22:06:010
39501529925308,2518cyclictest3990417-21kworker/2:2+events21:18:112
395015499252913,2512cyclictest3992054-21kworker/3:0+events21:29:363
395014499252712,2511cyclictest4037071-21kworker/0:0+events23:41:370
395014499251512,2499cyclictest3967955-21kworker/0:1+events20:08:590
395015299251312,2497cyclictest4043677-21kworker/2:1+events00:14:322
395015299251112,2496cyclictest4033803-21kworker/2:2+events23:28:412
395015299251111,2496cyclictest3977584-21kworker/2:1+events20:36:592
395014999251113,2494cyclictest3955896-21kworker/1:0+events19:35:431
395015299250913,2492cyclictest4007949-21kworker/2:1+events22:07:312
395015299250612,2490cyclictest3992922-21kworker/2:1+events21:31:542
395015299250612,2490cyclictest3948108-21kworker/2:0+events19:15:092
39501549925019,2488cyclictest4004993-21kworker/3:1+events22:28:103
395014499250112,2485cyclictest4026172-21kworker/0:3+events23:21:290
39501549924986,2488cyclictest4032357-21kworker/3:1+events23:43:343
395015299249812,2482cyclictest3963329-21kworker/2:0+events19:58:172
395015499249712,2482cyclictest4032357-21kworker/3:1+events23:36:193
395015499249612,2480cyclictest4030724-21kworker/3:2+events23:21:053
395015299249612,2480cyclictest4027382-21kworker/2:1+events23:23:262
395015499249212,2478cyclictest4014689-21kworker/3:2+events22:30:063
395015499249212,2478cyclictest4014689-21kworker/3:2+events22:30:063
395015299248611,2471cyclictest4041980-21kworker/2:2+events23:58:472
395015499248512,2469cyclictest3980255-21kworker/3:0+events20:43:083
39501529924772,2471cyclictest4054686-21kworker/2:0+events00:35:232
395014499246412,2450cyclictest4048605-21kworker/0:3+events00:25:050
395014499246412,2449cyclictest4013249-21kworker/0:3+events22:32:260
395014499246412,2449cyclictest4013249-21kworker/0:3+events22:32:260
395014499246212,2446cyclictest4000283-21kworker/0:2+events21:50:310
395014499245812,2442cyclictest4004673-21kworker/0:1+events21:59:320
395014499245512,2439cyclictest4030538-21kworker/0:1+events23:16:490
395015299244912,2433cyclictest4014762-21kworker/2:0+events22:47:212
395014499244812,2432cyclictest3985386-21kworker/0:2+events21:21:150
395014499244810,2434cyclictest4009521-21kworker/0:2+events22:27:470
395014499244711,2432cyclictest3947104-21kworker/0:0+events19:14:460
39501449924445,2437cyclictest3967955-21kworker/0:1+events20:15:070
395014499244412,2428cyclictest3987110-21kworker/0:0+events21:02:580
395014499243712,2421cyclictest4015628-21kworker/0:0+events22:38:110
395014499243711,2422cyclictest4048361-21kworker/0:0+events00:14:100
39501449924369,2423cyclictest3963388-21kworker/0:0+events20:02:260
39501549924359,2423cyclictest3958620-21kworker/3:2+events19:33:503
395014499243412,2418cyclictest4007922-21kworker/0:0+events22:23:530
395014499243312,2417cyclictest4026172-21kworker/0:3+events23:35:330
395014499243312,2417cyclictest4022676-21kworker/0:2+events22:52:220
395014499243312,2417cyclictest3995218-21kworker/0:0+events21:44:460
395014499243311,2418cyclictest4042192-21kworker/0:2+events00:01:050
395015299243212,2417cyclictest3998338-21kworker/2:0+events21:37:342
39501499924329,2421cyclictest3958587-21kworker/1:1+events20:05:081
395014499243112,2415cyclictest3957007-21kworker/0:2+events19:45:360
395015499242612,2410cyclictest4029112-21kworker/3:0+events23:17:143
395014499242612,2410cyclictest4045090-21kworker/0:1+events00:33:320
395015499242512,2410cyclictest3972834-21kworker/3:0+events20:29:163
395015499242511,2410cyclictest3992054-21kworker/3:0+events21:22:223
395015299242512,2410cyclictest3984207-21kworker/2:0+events20:58:492
395014499242512,2409cyclictest3927666-21kworker/0:1+events19:27:210
395014499242411,2409cyclictest4000283-21kworker/0:2+events21:48:340
395015499242312,2407cyclictest3977843-21kworker/3:1+events20:49:333
395014999242212,2408cyclictest3955896-21kworker/1:0+events19:32:191
395014499242211,2407cyclictest3996972-21kworker/0:2+events21:34:140
395015299242012,2404cyclictest3972389-21kworker/2:0+events20:32:212
395015299242011,2406cyclictest4024489-21kworker/2:2+events23:02:582
395014499242012,2404cyclictest3985386-21kworker/0:2+events21:17:460
395015499241911,2405cyclictest3977843-21kworker/3:1+events20:37:233
395015299241511,2401cyclictest3992922-21kworker/2:1+events21:50:062
395014999241412,2398cyclictest3973114-21kworker/1:2+events20:24:421
395015299241312,2398cyclictest4033803-21kworker/2:2+events23:32:062
39501499924133,2406cyclictest3985356-21kworker/1:2+events21:39:051
395014999241312,2398cyclictest4032297-21kworker/1:2+events23:30:351
395015499241212,2396cyclictest3949843-21kworker/3:1+events19:26:573
395015499241112,2396cyclictest4050091-21kworker/3:2+events00:27:273
39501529924117,2401cyclictest4039839-21kworker/2:0+events23:48:272
395014499241010,2397cyclictest3985386-21kworker/0:2+events21:14:440
395015499240912,2393cyclictest3965384-21kworker/3:1+events20:08:373
39501449924099,2396cyclictest4035317-21kworker/0:1+events23:51:330
395014999240812,2393cyclictest3953787-21kworker/1:1+events19:20:501
395015499240711,2392cyclictest4016355-21kworker/3:1+events22:35:503
395015299240712,2391cyclictest4045389-21kworker/2:0+events00:09:322
395015499240612,2391cyclictest4004993-21kworker/3:1+events22:17:233
395015299240612,2390cyclictest4014762-21kworker/2:0+events22:37:012
39501549924048,2392cyclictest3998394-21kworker/3:0+events21:39:253
395015499240412,2388cyclictest4041892-21kworker/3:1+events23:51:533
39501529924046,2394cyclictest4017955-21kworker/2:2+events22:40:032
395015299240412,2389cyclictest4027382-21kworker/2:1+events23:15:172
395015499240312,2387cyclictest4048455-21kworker/3:1+events00:14:553
395015499240212,2386cyclictest3990448-21kworker/3:1+events21:16:383
39501529924029,2390cyclictest4029171-21kworker/2:0+events23:14:312
395015299240212,2386cyclictest3988788-21kworker/2:0+events21:25:252
395014999240212,2386cyclictest4043865-21kworker/1:3+events00:23:361
395015499240112,2385cyclictest4004993-21kworker/3:1+events22:20:443
395015499239912,2383cyclictest4040294-21kworker/3:2+events23:56:053
395015299239812,2382cyclictest4006321-21kworker/2:0+events22:20:232
395015299239810,2384cyclictest4045389-21kworker/2:0+events00:19:512
395015299239312,2377cyclictest3961726-21kworker/2:2+events19:42:592
395015299239212,2376cyclictest4013166-21kworker/2:2+events22:25:502
395015499238511,2368cyclictest3949843-21kworker/3:1+events19:18:313
395015499237211,2357cyclictest4046827-21kworker/3:0+events00:24:433
395015299235212,2337cyclictest4051449-21kworker/2:1+events00:26:162
395014499234810,2334cyclictest3927666-21kworker/0:1+events19:17:450
395014999234712,2331cyclictest4051632-21kworker/1:0+events00:33:521
395014999234611,2331cyclictest4042043-21kworker/1:2+events23:56:521
395015499234312,2327cyclictest4018266-21kworker/3:2+events22:48:073
39501499923419,2328cyclictest3985356-21kworker/1:2+events21:10:341
395015499233911,2326cyclictest3969648-21kworker/3:2+events20:20:053
395015299233112,2316cyclictest4011161-21kworker/2:1+events22:34:192
395015299233112,2316cyclictest4011161-21kworker/2:1+events22:34:182
395014999233112,2315cyclictest4029324-21kworker/1:1+events23:23:021
395015499233010,2317cyclictest3943599-21kworker/3:0+events19:14:223
395015299233012,2314cyclictest4024489-21kworker/2:2+events23:06:022
395014999232912,2314cyclictest3938540-21kworker/1:2+events19:27:441
395014999232912,2313cyclictest4009808-21kworker/1:3+events22:19:371
395015499232612,2311cyclictest3985476-21kworker/3:2+events21:14:213
395015499232512,2309cyclictest4022704-21kworker/3:0+events22:59:593
395015299232511,2311cyclictest4039839-21kworker/2:0+events23:52:172
395014999232412,2308cyclictest4021097-21kworker/1:0+events23:15:411
395014999232412,2306cyclictest4029324-21kworker/1:1+events23:25:431
395014999232011,2305cyclictest3982478-21kworker/1:1+events20:55:401
395014999231710,2304cyclictest4035259-21kworker/1:0+events23:49:381
395014999231312,2298cyclictest4039135-21kworker/1:1+events23:53:031
395015299231212,2297cyclictest3979193-21kworker/2:2+events20:42:232
395015499230412,2289cyclictest4046827-21kworker/3:0+events00:16:063
395015299230012,2283cyclictest4037441-21kworker/2:2+events23:42:462
395015499227811,2263cyclictest3955406-21kworker/3:0+events19:24:403
395015299220210,2189cyclictest3950210-21kworker/2:2+events19:11:212
39501499921477,2136cyclictest4043865-21kworker/1:3+events00:17:151
395014999214111,2126cyclictest4047068-21kworker/1:0+events00:11:051
39495862184156,23sleep20-21swapper/219:06:132
39497862155110,25sleep00-21swapper/019:08:430
395014999147144,2cyclictest3958587-21kworker/1:1+pm20:04:591
39496962144112,27sleep30-21swapper/319:07:343
39496272141108,27sleep10-21swapper/119:06:441
3950149997976,2cyclictest3938540-21kworker/1:2+pm19:19:531
395014999319,13cyclictest3978600-21ldconfig20:35:181
395014999290,22cyclictest4006390-21seq22:02:111
395014999281,23cyclictest3993725-21taskset21:25:001
395014999281,14cyclictest4015355-21irqstats22:30:151
395014999281,14cyclictest4015355-21irqstats22:30:151
3950149992714,10cyclictest3973053-21cron20:20:001
395014999261,20cyclictest4037227-21basename23:40:001
395014999261,19cyclictest3962761-21ntpq19:45:161
395014999261,12cyclictest4007471-21ntpq22:05:171
395014999261,12cyclictest4002532-21memory21:50:151
395014999260,13cyclictest3964346-21ntpq19:50:171
395014999251,20cyclictest3976251-21awk20:29:591
395014999251,12cyclictest4026946-21ntpq23:05:181
395014999251,12cyclictest3996306-21ntpq21:30:161
395014999241,19cyclictest4022969-21munin-run22:55:001
395014999241,17cyclictest4016374-21apt-get22:35:011
395014999241,16cyclictest3977061-21ntpq20:30:181
395014999241,10cyclictest3980181-21ntpq20:40:151
3950149992410,9cyclictest3966584-21sshd19:58:171
395014999232,18cyclictest3983557-21python320:50:211
395014999232,16cyclictest4014806-21munin-run22:30:001
395014999230,19cyclictest4028533-21ntpq23:10:171
395014999230,12cyclictest3951411-21sshd19:13:171
3950149992217,2cyclictest0-21swapper/123:00:001
3950149992212,8cyclictest4039059-21sh23:45:001
395014999221,17cyclictest4005059-21sleep22:00:011
395014999221,13cyclictest4012135-21hddtemp_smartct22:20:161
395014999221,11cyclictest4046407-21python300:05:201
395014999221,10cyclictest4025038-21diskstats23:00:131
395014999217,9cyclictest3987817-21smartctl21:05:151
3950149992113,5cyclictest0-21swapper/122:42:291
395014999211,18cyclictest0-21swapper/121:20:011
395014999211,17cyclictest4009004-21sshd22:10:171
395014999211,10cyclictest4055973-21gcc00:35:191
3950149992110,9cyclictest3961242-21ntpq19:40:181
395014999201,16cyclictest740-21snmpd21:25:021
395014999201,15cyclictest3970374-21df_inode20:10:131
395014999191,15cyclictest4000311-21awk21:45:001
395014999190,15cyclictest4052032-21apt-get00:25:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional