You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-11-17 - 14:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot2s.osadl.org (updated Tue Nov 10, 2026 12:45:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
10198699592,56cyclictest0-21swapper/310:48:207
10198699572,48cyclictest0-21swapper/310:14:247
17424725310,9sleep120-21swapper/1209:22:424
17424725310,9sleep120-21swapper/1209:22:414
10199599531,45cyclictest0-21swapper/511:20:209
10198699533,17cyclictest0-21swapper/310:40:377
10198699523,42cyclictest0-21swapper/312:39:557
10198699522,40cyclictest0-21swapper/312:01:027
10198699522,40cyclictest0-21swapper/312:01:017
10198699512,40cyclictest0-21swapper/310:00:187
10198699512,16cyclictest0-21swapper/310:35:007
10198699512,16cyclictest0-21swapper/309:54:347
4084342504,14sleep70-21swapper/711:07:1811
4084342504,14sleep70-21swapper/711:07:1811
10199599501,40cyclictest0-21swapper/509:22:069
10199599501,40cyclictest0-21swapper/509:22:059
10198699503,40cyclictest0-21swapper/311:41:077
10198699503,39cyclictest0-21swapper/311:30:257
3633712494,4sleep120-21swapper/1210:46:494
10198699493,40cyclictest0-21swapper/309:26:377
10198699492,41cyclictest0-21swapper/309:42:017
10198699492,23cyclictest0-21swapper/311:26:317
10198699492,16cyclictest0-21swapper/311:01:047
22031824815,9sleep90-21swapper/909:44:5113
10199599481,40cyclictest0-21swapper/508:06:479
10199599481,29cyclictest0-21swapper/510:31:239
10198699483,16cyclictest0-21swapper/308:00:547
10198699482,9cyclictest0-21swapper/309:45:137
10198699482,45cyclictest0-21swapper/310:39:597
10198699482,45cyclictest0-21swapper/309:16:577
10198699482,19cyclictest0-21swapper/311:05:467
10198699482,19cyclictest0-21swapper/311:05:457
10198699482,17cyclictest0-21swapper/310:20:587
10198699482,16cyclictest0-21swapper/308:20:377
101986994811,14cyclictest0-21swapper/309:10:157
101978994811,23cyclictest366-21jbd2/nvme0n1p2-811:40:591
10198699473,4cyclictest0-21swapper/307:20:587
10198699473,3cyclictest0-21swapper/309:20:477
10198699473,3cyclictest0-21swapper/309:20:477
10198699472,33cyclictest0-21swapper/309:00:477
10198699472,16cyclictest0-21swapper/312:32:007
2643502464,9sleep70-21swapper/710:03:5711
10199599461,38cyclictest0-21swapper/509:35:049
10199599461,38cyclictest0-21swapper/509:15:219
10199599461,37cyclictest0-21swapper/511:25:179
10199599461,34cyclictest0-21swapper/510:35:069
10199599461,21cyclictest0-21swapper/509:42:299
10198699464,17cyclictest0-21swapper/308:40:277
10198699463,37cyclictest0-21swapper/310:52:447
10198699463,30cyclictest0-21swapper/311:53:207
5331152457,9sleep100-21swapper/1012:05:042
4986702455,9sleep70-21swapper/711:49:2211
3298712456,8sleep130-21swapper/1310:31:535
19519224515,8sleep100-21swapper/1009:30:362
1749362455,11sleep90-21swapper/909:23:4913
1749362455,11sleep90-21swapper/909:23:4913
10199599452,36cyclictest0-21swapper/511:56:539
10199599451,39cyclictest0-21swapper/508:00:289
10199599451,24cyclictest0-21swapper/509:30:129
10198699459,20cyclictest0-21swapper/308:31:517
10198699453,35cyclictest0-21swapper/310:55:287
10198699453,33cyclictest0-21swapper/312:08:087
10198699453,23cyclictest0-21swapper/309:37:027
10198699452,4cyclictest0-21swapper/312:19:217
10198699452,41cyclictest0-21swapper/309:30:527
10198699452,38cyclictest0-21swapper/311:45:567
10198699452,38cyclictest0-21swapper/311:20:067
10198699452,37cyclictest0-21swapper/309:55:137
10198699452,36cyclictest0-21swapper/308:18:307
10198699452,35cyclictest0-21swapper/308:29:307
10198699452,34cyclictest0-21swapper/311:11:037
10199599441,36cyclictest0-21swapper/511:42:169
10199599441,35cyclictest0-21swapper/507:20:249
10199599441,18cyclictest0-21swapper/510:27:489
10198699442,4cyclictest0-21swapper/312:20:207
10198699442,41cyclictest0-21swapper/310:27:417
10198699442,34cyclictest0-21swapper/307:50:157
10198699442,16cyclictest0-21swapper/312:29:547
6079892438,8sleep130-21swapper/1312:36:265
4982592434,10sleep120-21swapper/1211:48:454
4749202435,9sleep80-21swapper/811:37:0012
4546242437,9sleep90-21swapper/911:30:0013
3654542435,11sleep60-21swapper/610:50:0010
3093492434,11sleep90-21swapper/910:24:3413
11814624315,7sleep100-21swapper/1008:19:062
10199599431,35cyclictest0-21swapper/511:33:329
10198699437,4cyclictest0-21swapper/310:15:527
10198699433,16cyclictest0-21swapper/311:57:187
10198699432,4cyclictest0-21swapper/310:05:157
10198699432,36cyclictest0-21swapper/308:52:587
10198699432,34cyclictest0-21swapper/311:15:417
10198699432,34cyclictest0-21swapper/307:40:367
10198699432,17cyclictest0-21swapper/308:14:277
101986994315,19cyclictest0-21swapper/308:47:237
5304062427,9sleep120-21swapper/1212:01:504
5304062427,9sleep120-21swapper/1212:01:504
5198312423,8sleep100-21swapper/1011:57:502
3188462424,8sleep100-21swapper/1010:27:092
3188342425,12sleep80-21swapper/810:27:0712
1420422428,9sleep110-21swapper/1109:07:563
10199599421,35cyclictest0-21swapper/510:50:499
10199599421,35cyclictest0-21swapper/510:40:369
10199599421,34cyclictest0-21swapper/509:48:529
10199599421,26cyclictest0-21swapper/510:17:349
10199599421,23cyclictest0-21swapper/510:10:199
10198699422,34cyclictest0-21swapper/309:06:537
10198699422,28cyclictest0-21swapper/307:47:457
5536832414,11sleep60-21swapper/612:13:3910
3960762414,10sleep110-21swapper/1111:00:353
3325452415,8sleep70-21swapper/710:35:0311
14214824110,8sleep120-21swapper/1209:09:354
10199599411,33cyclictest0-21swapper/511:11:569
10199599411,33cyclictest0-21swapper/511:07:469
10199599411,33cyclictest0-21swapper/511:07:459
10199599411,33cyclictest0-21swapper/510:20:399
10199599411,33cyclictest0-21swapper/510:05:289
10199199412,4cyclictest0-21swapper/410:24:228
10198699412,4cyclictest0-21swapper/311:35:167
10198699412,30cyclictest0-21swapper/307:37:187
10198699412,16cyclictest0-21swapper/312:13:187
101986994115,21cyclictest0-21swapper/307:11:117
5754472405,10sleep120-21swapper/1212:22:384
3644172404,11sleep80-21swapper/810:48:2312
3179762404,9sleep120-21swapper/1210:25:474
2185792404,8sleep60-21swapper/609:42:1310
12283024010,9sleep70-21swapper/708:43:4911
1218412404,9sleep70-21swapper/708:38:1311
10199599401,34cyclictest0-21swapper/512:00:019
10199599401,34cyclictest0-21swapper/512:00:019
10199599401,33cyclictest0-21swapper/509:25:119
10199599401,32cyclictest0-21swapper/512:31:369
10199599401,32cyclictest0-21swapper/510:01:359
10199599401,15cyclictest0-21swapper/509:00:479
10199599401,10cyclictest0-21swapper/512:20:279
10198699403,34cyclictest0-21swapper/308:06:477
10148724023,10sleep120-21swapper/1207:06:564
5528992395,24sleep120-21swapper/1212:12:214
4868772395,8sleep80-21swapper/811:43:1812
4762282394,10sleep90-21swapper/911:39:0713
3982792395,8sleep100-21swapper/1011:03:512
3525442394,9sleep90-21swapper/910:42:2013
3418432394,9sleep110-21swapper/1110:38:093
32055623919,10sleep130-21swapper/1310:29:475
1640992394,9sleep70-21swapper/709:19:2011
1618432393,9sleep60-21swapper/609:15:4910
1518072394,10sleep100-21swapper/1009:12:372
10199599391,7cyclictest0-21swapper/509:50:159
10199599391,33cyclictest0-21swapper/507:50:019
10199599391,32cyclictest0-21swapper/512:36:289
10199599391,32cyclictest0-21swapper/508:40:559
10199599391,31cyclictest0-21swapper/512:06:489
10199599391,31cyclictest0-21swapper/509:57:179
10199599391,24cyclictest0-21swapper/511:50:569
10199199393,29cyclictest0-21swapper/410:50:448
10198699392,3cyclictest0-21swapper/308:36:027
10198699392,32cyclictest0-21swapper/307:31:427
10197399392,33cyclictest0-21swapper/008:48:590
10137123912,10sleep10-21swapper/107:05:051
6092652384,9sleep70-21swapper/712:38:2611
5855082383,8sleep60-21swapper/612:26:0210
5541412384,8sleep80-21swapper/812:14:2312
5524262384,9sleep90-21swapper/912:11:3613
55200923818,11sleep130-21swapper/1312:10:585
5098132383,6sleep60-21swapper/611:54:2910
4864602385,8sleep120-21swapper/1211:42:404
4862922386,12sleep90-21swapper/911:42:2313
4517122384,10sleep130-21swapper/1311:25:245
3764892384,10sleep80-21swapper/810:54:5612
3748252385,10sleep70-21swapper/710:52:2111
3214422384,9sleep80-21swapper/810:30:1012
2648342384,9sleep110-21swapper/1110:04:433
2527132386,24sleep90-21swapper/909:58:2413
1973072383,5sleep70-21swapper/709:33:5011
18478823818,11sleep80-21swapper/809:26:5012
1750972385,9sleep80-21swapper/809:24:0212
1750972385,9sleep80-21swapper/809:24:0112
1152362386,8sleep60-21swapper/608:02:1310
1104232388,9sleep120-21swapper/1207:35:554
1066842384,8sleep130-21swapper/1307:16:325
10199599381,31cyclictest0-21swapper/507:17:009
10199599381,30cyclictest0-21swapper/512:29:559
10199599381,30cyclictest0-21swapper/511:45:199
10199599381,30cyclictest0-21swapper/511:15:169
10199599381,30cyclictest0-21swapper/507:40:419
10199599381,28cyclictest0-21swapper/509:11:019
10199599381,20cyclictest0-21swapper/511:01:059
10199199384,25cyclictest110391-21kworker/u56:0+ext4-rsv-conversion07:41:088
101991993818,15cyclictest142199-21diskmemload11:35:158
101991993815,17cyclictest0-21swapper/412:17:168
10198699383,28cyclictest0-21swapper/307:15:447
10198699382,27cyclictest0-21swapper/307:57:077
10144323826,9sleep130-21swapper/1307:06:155
5073472374,9sleep120-21swapper/1211:50:374
5064672374,5sleep80-21swapper/811:50:1912
4879342374,4sleep100-21swapper/1011:44:592
4754782374,9sleep60-21swapper/611:37:5410
3862252375,8sleep80-21swapper/810:57:4412
3624432374,8sleep100-21swapper/1010:45:232
3071962373,5sleep60-21swapper/610:21:1510
2869102374,8sleep90-21swapper/910:14:3113
2086722373,9sleep80-21swapper/809:39:1312
1730502374,8sleep130-21swapper/1309:20:505
1730502374,8sleep130-21swapper/1309:20:505
1338882378,8sleep100-21swapper/1009:03:292
1068352376,8sleep60-21swapper/607:18:4610
10199599371,29cyclictest0-21swapper/512:15:129
10199599371,29cyclictest0-21swapper/512:13:569
10199599371,29cyclictest0-21swapper/511:38:279
10199599371,29cyclictest0-21swapper/510:49:249
10199199373,27cyclictest0-21swapper/409:30:398
10198699373,28cyclictest0-21swapper/307:25:437
10198699372,29cyclictest0-21swapper/308:55:527
101978993715,16cyclictest0-21swapper/110:55:511
10197399374,23cyclictest486272-21kworker/u56:0+xprtiod11:56:010
101973993719,13cyclictest151ktimers/007:49:260
1014672377,8sleep70-21swapper/707:06:3711
10145123720,9sleep60-21swapper/607:06:2110
4534512364,8sleep100-21swapper/1011:28:092
4095422364,8sleep130-21swapper/1311:09:025
4095422364,8sleep130-21swapper/1311:09:025
3864082363,7sleep120-21swapper/1210:58:024
3514552363,8sleep60-21swapper/610:40:3910
19504923617,10sleep120-21swapper/1209:30:244
1750712363,23sleep60-21swapper/609:24:0010
1750712363,23sleep60-21swapper/609:23:5910
1236612366,9sleep80-21swapper/808:47:2112
1226352363,5sleep80-21swapper/808:40:4812
1180132368,7sleep130-21swapper/1308:17:025
1151772365,8sleep70-21swapper/708:01:1811
1124252367,8sleep100-21swapper/1007:47:332
1115782365,8sleep80-21swapper/807:43:4812
1105472366,7sleep60-21swapper/607:37:4110
10199599361,29cyclictest0-21swapper/510:59:269
10199199363,26cyclictest0-21swapper/412:37:588
10165423623,9sleep100-21swapper/1007:09:282
10147123623,10sleep110-21swapper/1107:06:413
10139023620,10sleep50-21swapper/507:05:239
5969882353,5sleep70-21swapper/712:31:4011
5874652353,8sleep100-21swapper/1012:29:092
4974712355,9sleep80-21swapper/811:47:3112
4099612354,8sleep100-21swapper/1011:09:412
4099612354,8sleep100-21swapper/1011:09:412
3301432356,8sleep100-21swapper/1010:32:182
2304182353,8sleep70-21swapper/709:48:1911
21801623516,9sleep130-21swapper/1309:41:245
1756662353,7sleep70-21swapper/709:24:5711
1756662353,7sleep70-21swapper/709:24:5611
1263742354,5sleep60-21swapper/609:00:0910
12567323520,8sleep90-21swapper/908:59:4513
1238292357,8sleep70-21swapper/708:49:5311
12164823519,8sleep90-21swapper/908:35:1313
12163723517,10sleep130-21swapper/1308:35:035
11899623519,9sleep70-21swapper/708:22:3411
11434023520,8sleep80-21swapper/807:58:0312
11417623518,10sleep90-21swapper/907:55:3013
10942423517,11sleep100-21swapper/1007:30:172
10199599351,30cyclictest0-21swapper/508:30:389
10199599351,28cyclictest0-21swapper/508:51:069
10199599351,28cyclictest0-21swapper/507:38:529
10199199353,26cyclictest0-21swapper/408:26:158
10199199353,24cyclictest0-21swapper/411:10:588
101991993514,16cyclictest0-21swapper/409:22:018
101991993514,16cyclictest0-21swapper/409:22:018
10197899353,27cyclictest0-21swapper/109:59:211
101978993512,6cyclictest0-21swapper/107:53:391
5082022343,5sleep70-21swapper/711:51:5611
4983492343,5sleep60-21swapper/611:48:5310
4655192344,21sleep70-21swapper/711:34:3811
4408932344,5sleep90-21swapper/911:20:5313
4407692343,6sleep110-21swapper/1111:20:413
3631902344,9sleep90-21swapper/910:46:3213
2510702344,8sleep130-21swapper/1309:55:545
1960082344,8sleep130-21swapper/1309:31:495
10199199343,24cyclictest0-21swapper/411:19:178
101991993423,6cyclictest77250irq/148-enp2s0-TxRx-111:34:158
10199199342,25cyclictest0-21swapper/409:40:168
10199199342,22cyclictest0-21swapper/411:05:288
10199199342,22cyclictest0-21swapper/411:05:288
10198399343,26cyclictest0-21swapper/207:10:446
10198399343,25cyclictest120870-21kworker/u56:0+xprtiod09:24:106
10198399343,25cyclictest120870-21kworker/u56:0+xprtiod09:24:106
10198399342,28cyclictest0-21swapper/212:05:046
10197899344,4cyclictest0-21swapper/107:45:581
10197899343,4cyclictest0-21swapper/110:34:231
10197899343,16cyclictest0-21swapper/109:48:071
10197899342,5cyclictest161rcu_preempt11:16:031
101978993421,9cyclictest817-21gmain10:12:181
10197399342,25cyclictest942-21rs:main0
10197399342,25cyclictest565793-21sendmail-msp12:20:050
58747323317,8sleep110-21swapper/1112:29:103
56376923315,9sleep130-21swapper/1312:17:015
49884123315,10sleep90-21swapper/911:49:3713
3979522333,7sleep90-21swapper/911:03:2113
2416342335,9sleep130-21swapper/1309:53:335
1748042334,8sleep100-21swapper/1009:23:362
1748042334,8sleep100-21swapper/1009:23:352
1624792335,9sleep90-21swapper/909:16:4813
1532452333,8sleep130-21swapper/1309:14:455
15260023320,8sleep120-21swapper/1209:13:494
12366223317,9sleep90-21swapper/908:47:2213
11611523317,9sleep90-21swapper/908:06:2813
11161023320,9sleep100-21swapper/1007:44:182
10951223314,11sleep80-21swapper/807:31:3812
1076502335,8sleep130-21swapper/1307:21:415
10199599331,26cyclictest0-21swapper/509:07:209
10199599331,25cyclictest0-21swapper/507:34:259
10199599331,17cyclictest0-21swapper/508:21:029
10199199336,18cyclictest0-21swapper/408:20:418
10199199333,25cyclictest0-21swapper/409:55:358
10199199333,25cyclictest0-21swapper/409:48:058
10199199333,23cyclictest0-21swapper/411:46:188
101991993319,9cyclictest4385-21lldpd08:37:108
10198399333,25cyclictest0-21swapper/207:28:386
10198399333,16cyclictest0-21swapper/211:56:546
10198399332,25cyclictest565793-21sendmail-msp12:20:046
10198399332,20cyclictest113500-21kworker/u56:0+kvfree_rcu_reclaim08:05:016
10197899338,24cyclictest175-21kworker/1:1-events12:01:051
10197899338,24cyclictest175-21kworker/1:1-events12:01:051
10197899333,5cyclictest0-21swapper/112:20:381
10197899333,4cyclictest0-21swapper/107:36:001
10197899333,18cyclictest0-21swapper/112:32:281
10197899333,18cyclictest0-21swapper/107:40:071
10197899333,16cyclictest0-21swapper/111:09:321
10197899333,16cyclictest0-21swapper/111:09:311
101978993326,6cyclictest301ktimers/112:10:181
10197899332,27cyclictest387773-21sendmail-msp11:01:031
10197899332,25cyclictest0-21swapper/108:36:571
101978993317,16cyclictest301ktimers/109:40:451
101978993315,13cyclictest0-21swapper/108:45:221
101978993314,6cyclictest0-21swapper/109:10:211
101978993312,17cyclictest0-21swapper/107:25:071
10197399332,25cyclictest0-21swapper/009:25:180
10165323319,9sleep90-21swapper/907:09:2813
10140823319,9sleep80-21swapper/807:05:4212
59701723220,8sleep100-21swapper/1012:31:432
58779523214,9sleep130-21swapper/1312:29:405
57495823213,10sleep90-21swapper/912:21:5313
54101823216,9sleep120-21swapper/1212:06:014
46406423212,10sleep100-21swapper/1011:32:212
44154623215,9sleep130-21swapper/1311:21:535
38729723210,12sleep100-21swapper/1010:59:232
35352923213,10sleep130-21swapper/1310:43:485
35266723210,4sleep70-21swapper/710:42:3211
29636923219,9sleep100-21swapper/1010:16:522
29591823213,10sleep110-21swapper/1110:16:113
2646592325,8sleep80-21swapper/810:04:2612
24030523210,9sleep120-21swapper/1209:51:264
18528723212,11sleep120-21swapper/1209:27:364
14208623220,8sleep100-21swapper/1009:08:382
12098423216,9sleep100-21swapper/1008:34:182
12092423219,9sleep130-21swapper/1308:33:245
11893823215,10sleep100-21swapper/1008:21:412
1113692324,8sleep110-21swapper/1107:40:343
10956123220,8sleep120-21swapper/1207:32:244
10941123217,10sleep130-21swapper/1307:30:055
10866923210,8sleep60-21swapper/607:28:0510
10690223219,9sleep90-21swapper/907:19:4413
10199599322,23cyclictest0-21swapper/507:10:069
10199599321,25cyclictest0-21swapper/507:46:389
10199599321,24cyclictest0-21swapper/507:29:249
10199199323,24cyclictest0-21swapper/412:34:488
10199199323,23cyclictest0-21swapper/411:55:408
10199199323,23cyclictest0-21swapper/410:25:088
10199199323,23cyclictest0-21swapper/410:10:338
10199199323,23cyclictest0-21swapper/409:10:158
10199199323,22cyclictest0-21swapper/412:06:198
10199199323,20cyclictest0-21swapper/412:03:238
10199199323,20cyclictest0-21swapper/412:03:238
10199199323,16cyclictest0-21swapper/411:50:118
101991993215,12cyclictest0-21swapper/410:40:068
101991993215,12cyclictest0-21swapper/409:25:448
101983993226,4cyclictest0-21swapper/207:40:336
101983993215,6cyclictest0-21swapper/211:40:446
101983993214,18cyclictest209234-21sendmail-msp09:41:056
10197899324,3cyclictest0-21swapper/112:35:221
10197899323,4cyclictest0-21swapper/110:16:261
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional