You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-06 - 11:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot7s.osadl.org (updated Thu Aug 06, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
29742799408017,4058cyclictest357108-21kworker/1:3+events22:20:011
29742499392019,3896cyclictest395647-21kworker/0:2+events00:15:000
29743299356017,3539cyclictest321378-21kworker/2:1+events20:45:192
29742799322014,3202cyclictest360165-21kworker/1:0+events22:45:131
29743299319815,3179cyclictest331252-21kworker/2:0+events21:00:102
29742799304415,3025cyclictest325020-21kworker/1:1+events20:35:271
29743299301811,3002cyclictest298539-21kworker/2:0+events19:55:192
2974249930154,3007cyclictest397654-21kworker/0:1+events00:25:140
29742799300015,2981cyclictest339634-21kworker/1:0+events21:40:231
29742499295514,2939cyclictest302940-21kworker/0:0+events19:30:010
29742499293214,2915cyclictest298762-21kworker/0:2+events19:40:230
29743299291814,2901cyclictest369733-21kworker/2:2+events23:00:212
29742799290910,2895cyclictest307262-21kworker/1:1+events19:40:011
29742499280414,2784cyclictest353618-21kworker/0:1+events22:05:300
29743899280213,2785cyclictest384392-21kworker/3:2+events23:48:243
29743899279013,2773cyclictest387622-21kworker/3:0+events23:53:433
29743899278912,2773cyclictest342368-21kworker/3:2+events21:48:243
29743899278712,2771cyclictest381190-21kworker/3:1+events23:36:573
29742499278012,2764cyclictest384453-21kworker/0:1+events23:55:120
29743899276413,2747cyclictest321468-21kworker/3:2+events20:25:593
29743299276413,2747cyclictest356978-21kworker/2:2+events22:19:142
29743299276313,2746cyclictest348646-21kworker/2:2+events21:56:442
29742499276113,2744cyclictest369710-21kworker/0:0+events22:52:010
29742499275811,2743cyclictest318181-21kworker/0:1+events20:14:140
29743899275212,2736cyclictest325106-21kworker/3:0+events20:38:533
29743299275213,2735cyclictest351874-21kworker/2:1+events22:03:142
29742799274914,2731cyclictest310512-21kworker/1:1+events20:25:151
29743299274113,2724cyclictest347020-21kworker/2:1+events21:42:172
29742499274111,2726cyclictest312232-21kworker/0:0+events19:59:280
29742499274013,2723cyclictest368104-21kworker/0:2+events22:48:330
29742799273813,2721cyclictest308904-21kworker/1:2+events19:44:391
29742799273612,2721cyclictest392784-21kworker/1:0+events00:27:341
29742799273513,2718cyclictest392784-21kworker/1:0+events00:16:081
29743899273313,2716cyclictest369974-21kworker/3:0+events23:24:423
29743899273212,2716cyclictest310661-21kworker/3:3+events19:54:353
2974249927307,2719cyclictest331142-21kworker/0:0+events20:53:410
29742499273013,2714cyclictest307141-21kworker/0:1+events20:00:140
29743299272913,2712cyclictest360479-21kworker/2:1+events22:32:422
29742499272913,2712cyclictest355280-21kworker/0:0+events22:18:510
29743299272813,2711cyclictest317439-21kworker/2:2+events20:16:082
29743299272812,2712cyclictest364879-21kworker/2:2+events22:39:322
29742799272212,2706cyclictest378096-21kworker/1:1+events23:26:141
29742499272213,2705cyclictest379635-21kworker/0:3+events23:31:570
29743299272111,2706cyclictest348646-21kworker/2:2+events21:54:272
29743299271813,2701cyclictest393858-21kworker/2:2+events00:10:472
29742499271813,2701cyclictest358360-21kworker/0:2+events22:38:480
29742499271810,2705cyclictest395647-21kworker/0:2+events00:18:260
29743299271713,2700cyclictest400598-21kworker/2:1+events00:31:462
29742499271712,2701cyclictest318181-21kworker/0:1+events20:22:380
29742799271613,2699cyclictest383678-21kworker/1:2+events23:36:131
29743299271513,2698cyclictest372953-21kworker/2:1+events23:12:042
29743299271413,2697cyclictest345375-21kworker/2:0+events21:46:302
29743299271413,2697cyclictest310518-21kworker/2:2+events19:49:592
29743299271313,2696cyclictest378043-21kworker/2:1+events23:29:412
29742799271313,2696cyclictest387564-21kworker/1:1+events23:57:511
29743299271213,2695cyclictest360479-21kworker/2:1+events22:26:562
29743299271213,2695cyclictest337725-21kworker/2:1+events21:20:362
29743299271113,2694cyclictest369733-21kworker/2:2+events22:57:182
29743299271110,2697cyclictest331252-21kworker/2:0+events20:59:262
29742499271112,2695cyclictest319869-21kworker/0:0+events20:18:010
29743299271013,2695cyclictest332848-21kworker/2:2+events21:05:302
29743299270813,2693cyclictest390584-21kworker/2:0+events00:00:082
29743299270813,2693cyclictest390584-21kworker/2:0+events00:00:072
29742799270813,2692cyclictest351797-21kworker/1:0+events22:09:421
29743299270613,2689cyclictest398982-21kworker/2:0+events00:24:502
29743299270613,2689cyclictest392253-21kworker/2:1+events00:07:222
29743299270613,2689cyclictest381342-21kworker/2:2+events23:44:592
29742799270313,2686cyclictest345663-21kworker/1:2+events21:40:011
29742499270313,2686cyclictest358360-21kworker/0:2+events22:27:180
29743299270111,2686cyclictest386990-21kworker/2:0+events23:47:162
29742799270113,2685cyclictest360165-21kworker/1:0+events22:40:431
29742799270111,2686cyclictest318239-21kworker/1:2+events20:43:491
29742499270013,2683cyclictest365236-21kworker/0:0+events22:41:290
29743299269813,2682cyclictest351874-21kworker/2:1+events22:06:152
2974279926949,2681cyclictest323120-21kworker/1:0+events20:30:331
29742799269311,2679cyclictest387564-21kworker/1:1+events00:02:281
29742799269311,2679cyclictest387564-21kworker/1:1+events00:02:281
29742799268913,2672cyclictest399014-21kworker/1:1+events00:30:591
29742799268713,2670cyclictest326663-21kworker/1:0+events21:13:061
29743899268313,2666cyclictest387622-21kworker/3:0+events00:08:563
29743899268313,2666cyclictest348826-21kworker/3:0+events21:50:153
29743299268313,2666cyclictest321378-21kworker/2:1+events20:29:462
29742799268313,2668cyclictest332889-21kworker/1:1+events21:20:111
29743899267912,2663cyclictest329537-21kworker/3:0+events20:47:143
29742799267913,2662cyclictest374649-21kworker/1:2+events23:23:331
29742799267912,2663cyclictest318239-21kworker/1:2+events20:24:311
29743299267811,2663cyclictest388997-21kworker/2:1+events23:51:042
29743899267610,2662cyclictest344608-21kworker/3:0+events21:39:153
29742799267613,2659cyclictest360165-21kworker/1:0+events22:33:041
29742799267412,2660cyclictest374649-21kworker/1:2+events23:15:061
29742799267313,2656cyclictest331169-21kworker/1:2+events20:52:121
29742799267312,2657cyclictest332889-21kworker/1:1+events21:03:131
29742799267213,2655cyclictest355040-21kworker/1:1+events22:12:461
29742799267213,2655cyclictest310512-21kworker/1:1+events20:05:551
29742799267213,2655cyclictest300795-21kworker/1:0+events19:57:341
29742799267212,2656cyclictest348563-21kworker/1:1+events21:54:031
29743299266612,2650cyclictest307232-21kworker/2:2+events19:38:282
29743299266611,2651cyclictest343787-21kworker/2:2+events21:38:532
29743899266512,2649cyclictest369974-21kworker/3:0+events23:10:353
29742799266411,2649cyclictest297054-21kworker/1:2+events19:19:431
29742799266213,2645cyclictest392784-21kworker/1:0+events00:23:221
29742799266212,2646cyclictest387564-21kworker/1:1+events23:49:331
29742799266113,2644cyclictest300795-21kworker/1:0+events19:46:081
29742799265911,2645cyclictest351797-21kworker/1:0+events22:02:051
29743899265213,2635cyclictest365017-21kworker/3:1+events22:38:243
29743899264812,2632cyclictest368368-21kworker/3:1+events22:54:413
29742499264510,2631cyclictest328349-21kworker/0:2+events20:58:390
29743899264412,2628cyclictest397246-21kworker/3:0+events00:18:043
29742799264413,2627cyclictest348563-21kworker/1:1+events21:57:091
29743899264112,2625cyclictest329537-21kworker/3:0+events20:52:323
29743899263813,2621cyclictest386017-21kworker/3:1+events23:44:353
29743899263613,2619cyclictest369974-21kworker/3:0+events23:05:203
29743299263611,2622cyclictest336064-21kworker/2:0+events21:10:262
29742799263413,2617cyclictest310512-21kworker/1:1+events20:00:381
29742799263211,2619cyclictest356999-21kworker/1:2+events22:15:051
2974389926308,2618cyclictest331256-21kworker/3:1+events20:57:293
29743899262913,2613cyclictest331256-21kworker/3:1+events21:00:343
29743899262913,2612cyclictest381190-21kworker/3:1+events23:28:093
29743899262912,2614cyclictest389224-21kworker/3:1+events23:58:353
29743899262412,2608cyclictest318211-21kworker/3:1+events20:12:213
29743899262213,2605cyclictest326816-21kworker/3:1+events20:41:343
29743899262113,2606cyclictest353348-21kworker/3:1+events22:13:563
29743899262113,2604cyclictest390847-21kworker/3:2+events00:14:143
29743899262113,2604cyclictest313477-21kworker/3:0+events19:57:113
29742499262111,2606cyclictest324785-21kworker/0:0+events20:33:350
29743899261913,2602cyclictest331256-21kworker/3:1+events21:14:113
29743899261713,2600cyclictest319836-21kworker/3:0+events20:18:253
29743299261512,2599cyclictest321378-21kworker/2:1+events20:38:072
2974279926117,2600cyclictest371335-21kworker/1:2+events22:57:421
29743899260613,2589cyclictest321468-21kworker/3:2+events20:30:103
2974249926039,2590cyclictest401955-21kworker/0:0+events00:31:220
29743299259812,2582cyclictest303956-21kworker/2:1+events19:27:432
29742799259612,2580cyclictest332889-21kworker/1:1+events21:06:141
29743899258912,2573cyclictest353348-21kworker/3:1+events22:16:563
29743899258313,2566cyclictest358604-21kworker/3:2+events22:40:183
29742799258213,2566cyclictest300795-21kworker/1:0+events19:31:311
29743899257912,2563cyclictest369974-21kworker/3:0+events23:30:503
29743899257912,2563cyclictest366681-21kworker/3:0+events22:47:033
29743899257812,2562cyclictest397246-21kworker/3:0+events00:35:333
29743899257612,2560cyclictest377842-21kworker/3:2+events23:16:343
29743899257512,2561cyclictest301943-21kworker/3:0+events19:25:023
29743899257012,2556cyclictest337451-21kworker/3:0+events21:22:313
29743899256612,2550cyclictest390847-21kworker/3:2+events00:01:173
29743899256612,2550cyclictest390847-21kworker/3:2+events00:01:173
29742499255212,2536cyclictest340852-21kworker/0:2+events21:28:360
29743299253712,2521cyclictest372953-21kworker/2:1+events23:09:052
29743299253310,2519cyclictest307232-21kworker/2:2+events19:40:462
29743899252612,2511cyclictest368368-21kworker/3:1+events22:56:323
29743299252512,2509cyclictest326425-21kworker/2:2+events20:40:232
29742799252112,2506cyclictest374649-21kworker/1:2+events23:13:581
29742499251813,2501cyclictest348652-21kworker/0:2+events21:53:400
29743899251112,2495cyclictest319836-21kworker/3:0+events20:22:153
29743299251111,2497cyclictest298539-21kworker/2:0+events19:51:302
29742799251012,2494cyclictest300795-21kworker/1:0+events19:20:511
29743299250813,2491cyclictest381342-21kworker/2:2+events23:36:342
2974249925069,2493cyclictest384453-21kworker/0:1+events23:39:380
29742499250413,2488cyclictest334545-21kworker/0:0+events21:04:430
29742499250410,2491cyclictest326633-21kworker/0:1+events20:40:000
29743299250312,2486cyclictest355111-21kworker/2:0+events22:10:272
29743299250310,2489cyclictest317439-21kworker/2:2+events20:23:472
29743899250012,2484cyclictest358604-21kworker/3:2+events22:21:333
29743299249812,2482cyclictest337725-21kworker/2:1+events21:28:582
29743899249713,2482cyclictest397246-21kworker/3:0+events00:29:053
2974389924967,2486cyclictest307322-21kworker/3:1+events19:44:153
29743899249612,2481cyclictest350711-21kworker/3:2+events21:56:213
29742499249512,2479cyclictest312232-21kworker/0:0+events20:05:330
29743899249412,2478cyclictest295510-21kworker/3:2+events19:11:293
29742499249312,2479cyclictest379533-21kworker/0:0+events23:25:270
29742499249312,2477cyclictest348652-21kworker/0:2+events21:59:280
29743899249212,2477cyclictest334572-21kworker/3:2+events21:05:513
2974249924929,2479cyclictest351995-21kworker/0:0+events22:03:340
29743299249110,2477cyclictest331252-21kworker/2:0+events20:52:542
2974249924919,2479cyclictest307141-21kworker/0:1+events19:36:570
29743899249012,2474cyclictest353348-21kworker/3:1+events22:25:253
29743899249012,2474cyclictest337451-21kworker/3:0+events21:18:413
29743899249011,2475cyclictest295510-21kworker/3:2+events19:37:203
29743299249012,2474cyclictest322962-21kworker/2:0+events20:33:142
29743299249010,2476cyclictest390584-21kworker/2:0+events23:58:132
2974249924908,2479cyclictest339077-21kworker/0:1+events21:19:480
29742499249012,2474cyclictest379635-21kworker/0:3+events23:40:250
29742499249012,2474cyclictest321498-21kworker/0:2+events20:26:220
29742499249011,2475cyclictest360371-21kworker/0:1+events22:24:140
29742499249010,2476cyclictest384453-21kworker/0:1+events23:54:040
2974249924898,2477cyclictest353618-21kworker/0:1+events22:13:090
29742499248812,2473cyclictest386079-21kworker/0:0+events00:07:440
29742499248812,2472cyclictest345393-21kworker/0:0+events21:43:490
29742499248811,2473cyclictest307141-21kworker/0:1+events19:50:430
29742499248712,2471cyclictest339077-21kworker/0:1+events21:33:290
29742499248711,2472cyclictest298762-21kworker/0:2+events19:49:360
29742499248710,2473cyclictest300764-21kworker/0:1+events19:22:200
29743299248610,2472cyclictest397334-21kworker/2:1+events00:19:322
29743299248512,2469cyclictest315353-21kworker/2:0+events20:07:272
29743299248511,2470cyclictest298539-21kworker/2:0+events19:23:082
29742799248512,2469cyclictest342335-21kworker/1:2+events21:29:201
2974249924859,2472cyclictest295354-21kworker/0:0+events19:17:050
29742499248512,2469cyclictest324785-21kworker/0:0+events20:44:110
29742499248511,2470cyclictest345393-21kworker/0:0+events21:47:140
29742499248510,2471cyclictest326633-21kworker/0:1+events20:46:300
29742799248412,2468cyclictest303171-21kworker/1:1+events19:26:561
29742499248412,2470cyclictest328349-21kworker/0:2+events21:11:100
29742499248412,2468cyclictest369710-21kworker/0:0+events23:06:500
29742499248411,2470cyclictest361981-21kworker/0:0+events22:30:470
29743299248312,2467cyclictest366525-21kworker/2:1+events22:44:292
2974249924831,2478cyclictest386079-21kworker/0:0+events23:46:060
29742499248312,2467cyclictest392184-21kworker/0:2+events00:04:430
29742499248312,2467cyclictest392184-21kworker/0:2+events00:04:430
29742499248311,2469cyclictest368104-21kworker/0:2+events22:55:260
2974329924829,2470cyclictest298539-21kworker/2:0+events19:17:272
2974329924829,2469cyclictest298539-21kworker/2:0+events19:32:412
2974329924827,2471cyclictest356978-21kworker/2:2+events22:22:422
2974329924818,2469cyclictest366525-21kworker/2:1+events22:53:112
29743299248111,2466cyclictest393858-21kworker/2:2+events00:25:382
29742499248110,2467cyclictest395647-21kworker/0:2+events00:21:260
29742499248012,2464cyclictest369710-21kworker/0:0+events23:10:580
29743299247912,2464cyclictest312120-21kworker/2:1+events20:15:002
29743299247911,2464cyclictest366525-21kworker/2:1+events22:48:112
29742499247914,2461cyclictest334545-21kworker/0:0+events21:21:220
29743899247112,2455cyclictest368368-21kworker/3:1+events23:01:533
29742499246912,2453cyclictest377493-21kworker/0:1+events23:17:220
2974329924655,2457cyclictest337725-21kworker/2:1+events21:30:482
29743899246412,2449cyclictest363384-21kworker/3:0+events22:32:213
29742799246012,2444cyclictest332889-21kworker/1:1+events21:15:191
29743899245812,2443cyclictest354952-21kworker/3:2+events22:08:563
29742799245011,2436cyclictest394927-21kworker/1:1+events00:13:041
29742799244812,2432cyclictest399014-21kworker/1:1+events00:37:261
29742799244812,2432cyclictest383678-21kworker/1:2+events23:51:491
29742799244812,2432cyclictest339634-21kworker/1:0+events21:33:501
29742799244810,2434cyclictest369679-21kworker/1:1+events22:52:251
29742799244712,2431cyclictest310512-21kworker/1:1+events20:11:351
29742799244611,2432cyclictest363503-21kworker/1:2+events22:35:461
29742799244511,2431cyclictest371335-21kworker/1:2+events23:00:451
29742799244212,2416cyclictest300795-21kworker/1:0+events19:52:171
29743899243912,2424cyclictest348826-21kworker/3:0+events22:03:583
29742799243314,2415cyclictest326663-21kworker/1:0+events20:58:151
29742799243312,2417cyclictest339634-21kworker/1:0+events21:46:061
29743299243212,2416cyclictest312120-21kworker/2:1+events20:02:302
29742499243012,2414cyclictest379635-21kworker/0:3+events23:23:560
29743299242512,2411cyclictest376143-21kworker/2:2+events23:20:042
29743899242212,2406cyclictest297144-21kworker/3:1+events19:18:593
29742499242212,2406cyclictest345393-21kworker/0:0+events21:38:310
29743299241711,2402cyclictest402192-21kworker/2:0+events00:37:492
29743899241412,2398cyclictest394102-21kworker/3:1+events00:23:443
29743299241012,2396cyclictest337725-21kworker/2:1+events21:15:412
29742499240912,2393cyclictest302940-21kworker/0:0+events19:34:590
29743299240510,2392cyclictest381342-21kworker/2:2+events23:30:262
29743899240312,2387cyclictest295510-21kworker/3:2+events19:33:033
29743899240212,2386cyclictest307322-21kworker/3:1+events20:01:223
29742799240012,2384cyclictest392784-21kworker/1:0+events00:06:591
29742499239911,2384cyclictest297072-21kworker/0:1+events19:13:260
29742499239910,2386cyclictest369710-21kworker/0:0+events23:01:080
29743299239712,2381cyclictest378043-21kworker/2:1+events23:19:162
29742499239611,2381cyclictest401955-21kworker/0:0+events00:35:540
29743899239411,2379cyclictest342368-21kworker/3:2+events21:43:263
29743899239012,2374cyclictest340761-21kworker/3:1+events21:27:523
2974389923859,2373cyclictest313477-21kworker/3:0+events20:07:043
29742499237812,2362cyclictest328349-21kworker/0:2+events21:08:540
29742799237512,2361cyclictest378096-21kworker/1:1+events23:40:021
29742799236312,2347cyclictest369679-21kworker/1:1+events23:08:421
2974279923625,2353cyclictest379767-21kworker/1:0+events23:33:071
29742799236112,2346cyclictest360165-21kworker/1:0+events22:26:111
29742799235911,2345cyclictest295464-21kworker/1:1+events19:14:311
29742799235211,2337cyclictest310512-21kworker/1:1+events20:18:471
29743899234112,2325cyclictest340761-21kworker/3:1+events21:32:413
29743899232712,2312cyclictest307322-21kworker/3:1+events19:48:263
29743899232710,2314cyclictest295510-21kworker/3:2+events19:23:303
2974389923149,2301cyclictest400650-21kworker/3:2+events00:32:313
29743299226210,2248cyclictest298539-21kworker/2:0+events19:13:022
2974279921036,2094cyclictest328288-21kworker/1:1+events20:48:251
2970922170137,30sleep30-21swapper/319:08:493
2970842154108,27sleep00-21swapper/019:08:420
2969672142108,28sleep10-21swapper/119:07:151
2968712140112,23sleep20-21swapper/219:06:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional