You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-09 - 17:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot1s.osadl.org (updated Thu Jan 08, 2026 12:45:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3106999125122,3cyclictest37-21ksoftirqd/311:48:413
3106599109109,0cyclictest192950irq/36-eth1-rx-11:48:562
3107699104103,1cyclictest0-21swapper/411:38:274
3105999102102,0cyclictest192950irq/36-eth1-rx-09:16:191
31093999796,1cyclictest0-21swapper/711:20:567
31048999494,0cyclictest192950irq/36-eth1-rx-11:38:270
31065998484,0cyclictest29-21ksoftirqd/210:17:542
31059996666,0cyclictest21-21ksoftirqd/111:40:001
3069626241,18sleep70-21swapper/707:07:497
3069526141,17sleep60-21swapper/607:07:486
31086995655,1cyclictest0-21swapper/611:48:566
3069424222,17sleep50-21swapper/507:07:485
3069324230,8sleep40-21swapper/407:07:474
2995724221,17sleep20-21swapper/207:05:202
31076994038,1cyclictest192950irq/36-eth1-rx-08:56:564
31093993937,1cyclictest0-21swapper/708:37:457
300742390,0sleep50-21swapper/510:40:155
3068923717,17sleep00-21swapper/007:07:430
3073723615,18sleep10-21swapper/107:08:241
3053723616,17sleep30-21swapper/307:05:373
31048993130,1cyclictest0-21swapper/008:56:560
31086993029,1cyclictest0-21swapper/610:17:546
31076992827,1cyclictest0-21swapper/410:09:194
3108299191,17cyclictest0-21swapper/511:50:135
31048991919,0cyclictest3-21ksoftirqd/010:09:190
3108699180,2cyclictest0-21swapper/612:24:306
3108699180,2cyclictest0-21swapper/612:24:296
3108699170,2cyclictest0-21swapper/611:55:296
3108699170,2cyclictest0-21swapper/609:48:596
3108299170,1cyclictest0-21swapper/507:20:185
3109399160,15cyclictest0-21swapper/709:13:447
3108699160,2cyclictest0-21swapper/607:58:286
3108699160,13cyclictest0-21swapper/607:19:296
3108299160,1cyclictest0-21swapper/508:21:585
31069991614,1cyclictest0-21swapper/311:08:063
3109399150,12cyclictest0-21swapper/711:51:447
3109399150,12cyclictest0-21swapper/710:43:447
107342150,0sleep40-21swapper/410:51:444
31093991412,1cyclictest0-21swapper/711:48:417
3109399140,12cyclictest0-21swapper/710:56:437
3109399140,11cyclictest0-21swapper/710:16:307
3107699140,13cyclictest0-21swapper/409:52:144
3107699140,13cyclictest0-21swapper/409:11:444
3106999140,13cyclictest0-21swapper/309:00:203
31093991310,2cyclictest0-21swapper/711:08:307
3108699130,1cyclictest0-21swapper/610:40:146
3108699130,13cyclictest0-21swapper/608:59:596
31082991310,2cyclictest0-21swapper/507:47:445
3107699131,1cyclictest0-21swapper/411:08:004
3107699130,1cyclictest0-21swapper/411:11:154
3107699130,1cyclictest0-21swapper/409:55:454
3107699130,12cyclictest0-21swapper/409:41:144
31059991311,1cyclictest2536-21lldpd10:46:351
31086991210,2cyclictest0-21swapper/608:30:166
3108699120,2cyclictest0-21swapper/609:31:586
3107699120,11cyclictest0-21swapper/411:30:304
3107699120,11cyclictest0-21swapper/410:37:294
31059991212,0cyclictest2487-21snmpd10:06:441
3104899127,2cyclictest0-21swapper/011:20:000
3104899121,2cyclictest0-21swapper/011:10:110
31048991212,0cyclictest2487-21snmpd11:54:140
3104899121,10cyclictest0-21swapper/008:30:000
3104899120,9cyclictest0-21swapper/008:25:010
3109399115,5cyclictest17858-21cpuspeed_turbos10:30:097
3109399110,8cyclictest9420-21perf07:30:007
3109399110,0cyclictest0-21swapper/711:55:147
3108299115,4cyclictest183050irq/39-eth009:44:245
3108299114,6cyclictest17135-21irqstats10:00:115
3108299110,2cyclictest0-21swapper/510:48:005
3108299110,1cyclictest10888-21sh10:51:575
3108299110,10cyclictest0-21swapper/512:20:135
3108299110,10cyclictest0-21swapper/512:20:135
31069991111,0cyclictest2487-21snmpd12:14:303
31069991111,0cyclictest2487-21snmpd08:45:293
3106599110,1cyclictest0-21swapper/209:15:372
3104899118,2cyclictest0-21swapper/010:20:000
3104899118,2cyclictest0-21swapper/007:25:190
3104899118,1cyclictest0-21swapper/009:40:120
3104899111,9cyclictest0-21swapper/008:15:010
3104899111,9cyclictest0-21swapper/008:15:010
3104899110,9cyclictest0-21swapper/010:31:000
3104899110,9cyclictest0-21swapper/010:26:380
3104899110,9cyclictest0-21swapper/009:45:540
3104899110,9cyclictest0-21swapper/009:25:570
3104899110,9cyclictest0-21swapper/007:45:150
3104899110,8cyclictest0-21swapper/010:15:000
3104899110,7cyclictest0-21swapper/010:05:000
3104899110,10cyclictest3649-21latency_hist12:35:000
3104899110,10cyclictest3649-21latency_hist12:35:000
3104899110,10cyclictest0-21swapper/011:25:010
3109399101,2cyclictest0-21swapper/707:58:587
3109399100,2cyclictest0-21swapper/712:17:097
3108699101,8cyclictest0-21swapper/611:42:226
3108299109,1cyclictest0-21swapper/508:48:305
3108299103,6cyclictest31313-21munin-node11:40:195
3108299101,8cyclictest16047-21crond09:30:005
3108299101,8cyclictest0-21swapper/510:40:005
3108299101,6cyclictest0-21swapper/511:22:245
3108299101,6cyclictest0-21swapper/510:21:095
3108299100,8cyclictest21607-21grep09:00:125
3108299100,7cyclictest17387-21sh11:56:555
3108299100,6cyclictest0-21swapper/511:20:005
3108299100,1cyclictest0-21swapper/512:01:345
3108299100,1cyclictest0-21swapper/511:36:535
3108299100,1cyclictest0-21swapper/511:14:325
3108299100,1cyclictest0-21swapper/511:06:115
3108299100,1cyclictest0-21swapper/510:31:375
3108299100,1cyclictest0-21swapper/510:28:315
3108299100,1cyclictest0-21swapper/510:15:125
3108299100,1cyclictest0-21swapper/509:59:365
3108299100,1cyclictest0-21swapper/509:48:005
3108299100,1cyclictest0-21swapper/509:37:215
3108299100,1cyclictest0-21swapper/509:13:435
3108299100,1cyclictest0-21swapper/508:25:535
3108299100,1cyclictest0-21swapper/507:36:325
3106999100,9cyclictest15744-21latency_hist09:59:593
3106599100,9cyclictest0-21swapper/211:02:342
3106599100,8cyclictest15704-21awk08:50:012
3106599100,1cyclictest0-21swapper/211:12:352
31059991010,0cyclictest2487-21snmpd07:55:001
3105999100,9cyclictest0-21swapper/110:37:371
3104899109,0cyclictest0-21swapper/010:45:100
3104899108,2cyclictest0-21swapper/009:20:350
3104899108,1cyclictest0-21swapper/011:55:110
3104899107,1cyclictest0-21swapper/011:43:240
3104899107,1cyclictest0-21swapper/010:35:510
3104899106,2cyclictest0-21swapper/007:40:170
3104899106,1cyclictest11965-21munin-run07:35:000
3104899100,9cyclictest0-21swapper/012:00:120
3104899100,9cyclictest0-21swapper/011:48:500
3104899100,9cyclictest0-21swapper/011:25:270
3104899100,9cyclictest0-21swapper/010:55:360
3104899100,9cyclictest0-21swapper/010:50:060
3104899100,9cyclictest0-21swapper/009:55:010
3104899100,9cyclictest0-21swapper/009:30:140
3104899100,9cyclictest0-21swapper/007:18:590
3104899100,9cyclictest0-21swapper/007:10:190
3104899100,8cyclictest0-21swapper/011:34:240
3104899100,8cyclictest0-21swapper/009:10:230
3104899100,8cyclictest0-21swapper/008:50:210
3104899100,8cyclictest0-21swapper/008:30:220
3104899100,8cyclictest0-21swapper/008:15:210
3104899100,7cyclictest0-21swapper/012:10:010
3104899100,7cyclictest0-21swapper/009:35:170
3104899100,1cyclictest27847-21latency_hist08:10:000
3104899100,1cyclictest27847-21latency_hist08:10:000
310939996,2cyclictest0-21swapper/711:04:447
310939994,4cyclictest0-21swapper/712:02:297
310939993,4cyclictest0-21swapper/708:06:587
310939993,4cyclictest0-21swapper/708:06:587
310939993,3cyclictest0-21swapper/708:40:297
310939991,5cyclictest0-21swapper/709:09:597
310869993,3cyclictest0-21swapper/610:50:296
310869993,3cyclictest0-21swapper/609:59:446
310869991,7cyclictest0-21swapper/609:24:436
310869990,8cyclictest0-21swapper/609:51:266
310869990,2cyclictest0-21swapper/610:07:296
310869990,2cyclictest0-21swapper/608:43:446
310869990,2cyclictest0-21swapper/608:00:136
310869990,1cyclictest0-21swapper/611:50:116
310829993,5cyclictest8513-21pmu-power07:25:185
310829992,6cyclictest8199-21switchtime09:50:205
310829992,6cyclictest11116-21tr08:40:115
310829991,7cyclictest13296-21tr11:25:115
310829991,7cyclictest0-21swapper/512:35:125
310829991,7cyclictest0-21swapper/512:15:185
310829991,7cyclictest0-21swapper/511:45:135
310829991,7cyclictest0-21swapper/511:30:095
310829991,7cyclictest0-21swapper/510:10:205
310829991,7cyclictest0-21swapper/509:30:115
310829991,7cyclictest0-21swapper/509:15:105
310829991,7cyclictest0-21swapper/508:55:145
310829991,7cyclictest0-21swapper/508:50:125
310829991,7cyclictest0-21swapper/508:35:115
310829991,7cyclictest0-21swapper/508:35:005
310829991,7cyclictest0-21swapper/507:50:125
310829991,7cyclictest0-21swapper/507:40:205
310829991,7cyclictest0-21swapper/507:15:015
310829991,6cyclictest0-21swapper/509:24:015
310829990,1cyclictest22339-21df_abs10:05:125
310829990,1cyclictest0-21swapper/512:27:175
310829990,1cyclictest0-21swapper/512:27:175
310829990,1cyclictest0-21swapper/512:10:105
310829990,1cyclictest0-21swapper/512:05:595
310829990,1cyclictest0-21swapper/511:00:115
310829990,1cyclictest0-21swapper/510:57:285
310829990,1cyclictest0-21swapper/509:05:565
310829990,1cyclictest0-21swapper/508:15:185
310829990,1cyclictest0-21swapper/507:55:145
310829990,1cyclictest0-21swapper/507:30:115
310829990,1cyclictest0-21swapper/507:13:505
310769998,1cyclictest0-21swapper/411:18:594
310769996,2cyclictest0-21swapper/407:32:444
310769991,2cyclictest0-21swapper/410:18:304
310769990,8cyclictest0-21swapper/410:22:514
310769990,2cyclictest0-21swapper/410:34:444
310699997,1cyclictest2487-21snmpd11:38:293
310699991,7cyclictest0-21swapper/312:25:163
310699991,7cyclictest0-21swapper/312:25:163
310699991,7cyclictest0-21swapper/312:00:133
310699991,7cyclictest0-21swapper/311:40:113
310699991,7cyclictest0-21swapper/310:30:153
310699991,7cyclictest0-21swapper/308:40:013
310699991,7cyclictest0-21swapper/307:35:143
310699991,6cyclictest0-21swapper/307:15:003
310699991,2cyclictest0-21swapper/311:15:163
310699991,2cyclictest0-21swapper/310:45:153
310699990,8cyclictest0-21swapper/309:48:113
310659999,0cyclictest2487-21snmpd09:24:152
310659996,2cyclictest0-21swapper/209:50:462
310659991,7cyclictest0-21swapper/208:25:182
310659990,8cyclictest0-21swapper/211:22:522
310599996,2cyclictest0-21swapper/109:29:381
310599991,7cyclictest0-21swapper/111:55:131
310599991,7cyclictest0-21swapper/110:20:171
310599991,7cyclictest0-21swapper/108:55:191
310599990,8cyclictest0-21swapper/110:58:291
310489997,2cyclictest0-21swapper/007:20:120
310489996,3cyclictest0-21swapper/009:03:030
310489996,1cyclictest0-21swapper/012:10:190
310489995,2cyclictest0-21swapper/012:40:000
310489990,9cyclictest0-21swapper/011:06:050
310489990,8cyclictest0-21swapper/010:20:020
310489990,8cyclictest0-21swapper/009:55:120
310489990,8cyclictest0-21swapper/008:48:240
310489990,8cyclictest0-21swapper/007:55:000
310489990,7cyclictest0-21swapper/012:15:190
310489990,7cyclictest0-21swapper/010:40:190
310489990,7cyclictest0-21swapper/007:35:170
310489990,1cyclictest0-21swapper/011:01:020
310939987,1cyclictest0-21swapper/708:18:447
310939985,1cyclictest31214-21kworker/7:211:16:497
310939985,1cyclictest25500-21kworker/7:111:10:227
310939985,1cyclictest18730-21kworker/7:210:51:157
310939985,1cyclictest18730-21kworker/7:210:26:177
310939984,3cyclictest0-21swapper/712:37:007
310939983,4cyclictest0-21swapper/712:35:007
310939983,4cyclictest0-21swapper/712:35:007
310939983,4cyclictest0-21swapper/709:37:297
310939983,4cyclictest0-21swapper/708:58:587
310939983,4cyclictest0-21swapper/707:52:597
310939983,4cyclictest0-21swapper/707:22:307
310939983,4cyclictest0-21swapper/707:20:007
310939983,3cyclictest0-21swapper/708:54:287
310939982,4cyclictest0-21swapper/708:12:307
310939982,4cyclictest0-21swapper/708:12:307
310939981,6cyclictest0-21swapper/709:25:137
310939980,6cyclictest0-21swapper/710:39:537
310939980,5cyclictest0-21swapper/711:44:157
310939980,5cyclictest0-21swapper/708:00:287
310939980,2cyclictest0-21swapper/709:57:527
310939980,2cyclictest0-21swapper/708:32:587
310869985,2cyclictest0-21swapper/610:22:306
310869985,2cyclictest0-21swapper/607:22:146
310869983,4cyclictest0-21swapper/608:46:596
310869983,2cyclictest0-21swapper/609:28:446
310869982,3cyclictest0-21swapper/611:28:456
310869982,3cyclictest0-21swapper/611:19:296
310869981,6cyclictest0-21swapper/610:01:126
310869981,6cyclictest0-21swapper/609:05:006
310869980,6cyclictest0-21swapper/610:45:316
310869980,6cyclictest0-21swapper/610:32:556
310869980,6cyclictest0-21swapper/610:13:366
310869980,6cyclictest0-21swapper/609:10:326
310869980,6cyclictest0-21swapper/608:35:566
310869980,5cyclictest0-21swapper/611:14:146
310869980,2cyclictest0-21swapper/609:35:446
310869980,2cyclictest0-21swapper/607:40:596
310829981,6cyclictest0-21swapper/508:10:075
310829981,6cyclictest0-21swapper/508:10:075
310829981,6cyclictest0-21swapper/508:05:165
310829981,6cyclictest0-21swapper/508:05:165
310829981,6cyclictest0-21swapper/508:00:145
310829980,1cyclictest14162sleep512:30:035
310829980,1cyclictest14162sleep512:30:035
310769986,2cyclictest0-21swapper/408:30:294
310769981,5cyclictest0-21swapper/409:36:444
310769980,7cyclictest0-21swapper/411:49:464
310769980,7cyclictest0-21swapper/411:41:454
310769980,7cyclictest0-21swapper/407:59:464
310769980,7cyclictest0-21swapper/407:35:464
310769980,7cyclictest0-21swapper/407:15:464
310769980,5cyclictest0-21swapper/407:53:444
310769980,2cyclictest0-21swapper/407:10:594
310769980,1cyclictest0-21swapper/410:10:294
310769980,1cyclictest0-21swapper/408:54:144
310699981,6cyclictest0-21swapper/312:35:163
310699981,6cyclictest0-21swapper/312:30:123
310699981,6cyclictest0-21swapper/312:30:123
310699981,6cyclictest0-21swapper/312:15:143
310699981,6cyclictest0-21swapper/312:05:133
310699981,6cyclictest0-21swapper/311:50:123
310699981,6cyclictest0-21swapper/311:25:113
310699981,6cyclictest0-21swapper/311:20:133
310699981,6cyclictest0-21swapper/311:10:183
310699981,6cyclictest0-21swapper/310:50:153
310699981,6cyclictest0-21swapper/310:40:223
310699981,6cyclictest0-21swapper/310:35:113
310699981,6cyclictest0-21swapper/310:25:153
310699981,6cyclictest0-21swapper/310:05:123
310699981,6cyclictest0-21swapper/309:50:123
310699981,6cyclictest0-21swapper/309:35:133
310699981,6cyclictest0-21swapper/309:30:153
310699981,6cyclictest0-21swapper/309:20:113
310699981,6cyclictest0-21swapper/309:15:123
310699981,6cyclictest0-21swapper/309:10:133
310699981,6cyclictest0-21swapper/308:55:003
310699981,6cyclictest0-21swapper/308:40:153
310699981,6cyclictest0-21swapper/308:15:183
310699981,6cyclictest0-21swapper/308:00:223
310699981,6cyclictest0-21swapper/307:55:203
310699981,6cyclictest0-21swapper/307:50:113
310699981,6cyclictest0-21swapper/307:45:183
310699981,6cyclictest0-21swapper/307:30:173
310699981,6cyclictest0-21swapper/307:25:153
310699980,7cyclictest0-21swapper/309:05:123
310699980,7cyclictest0-21swapper/308:30:163
310699980,1cyclictest0-21swapper/308:10:113
310699980,1cyclictest0-21swapper/308:10:103
310659986,1cyclictest0-21swapper/210:08:152
310659981,6cyclictest0-21swapper/212:35:152
310659981,6cyclictest0-21swapper/212:25:142
310659981,6cyclictest0-21swapper/212:25:132
310659981,6cyclictest0-21swapper/212:20:112
310659981,6cyclictest0-21swapper/212:20:112
310659981,6cyclictest0-21swapper/211:45:002
310659981,6cyclictest0-21swapper/211:35:132
310659981,6cyclictest0-21swapper/211:30:112
310659981,6cyclictest0-21swapper/211:25:172
310659981,6cyclictest0-21swapper/211:05:112
310659981,6cyclictest0-21swapper/210:50:122
310659981,6cyclictest0-21swapper/210:27:342
310659981,6cyclictest0-21swapper/210:05:002
310659981,6cyclictest0-21swapper/209:40:182
310659981,6cyclictest0-21swapper/209:35:152
310659981,6cyclictest0-21swapper/209:30:172
310659981,6cyclictest0-21swapper/209:25:122
310659981,6cyclictest0-21swapper/208:50:162
310659981,6cyclictest0-21swapper/208:10:132
310659981,6cyclictest0-21swapper/208:10:132
310659981,6cyclictest0-21swapper/207:15:162
310659980,7cyclictest0-21swapper/210:57:212
310659980,7cyclictest0-21swapper/208:18:222
310659980,7cyclictest0-21swapper/207:35:142
310659980,7cyclictest0-21swapper/207:30:132
310659980,7cyclictest0-21swapper/207:13:532
310659980,2cyclictest0-21swapper/208:40:122
310599984,3cyclictest20217-21timerandwakeup12:00:201
310599981,6cyclictest12650irq/19-ata_piix12:30:001
310599981,6cyclictest12650irq/19-ata_piix12:30:001
310599981,6cyclictest0-21swapper/111:31:101
310599981,6cyclictest0-21swapper/111:20:261
310599981,6cyclictest0-21swapper/111:15:161
310599981,6cyclictest0-21swapper/110:40:151
310599981,6cyclictest0-21swapper/110:00:141
310599981,6cyclictest0-21swapper/109:40:161
310599981,6cyclictest0-21swapper/109:35:221
310599981,6cyclictest0-21swapper/109:30:111
310599981,6cyclictest0-21swapper/109:15:011
310599981,6cyclictest0-21swapper/108:55:011
310599981,6cyclictest0-21swapper/108:40:131
310599981,6cyclictest0-21swapper/108:30:001
310599981,6cyclictest0-21swapper/108:00:181
310599981,6cyclictest0-21swapper/107:45:131
310599981,6cyclictest0-21swapper/107:35:101
310599981,6cyclictest0-21swapper/107:15:131
310599981,6cyclictest0-21swapper/107:10:161
310599980,7cyclictest0-21swapper/111:47:451
310599980,7cyclictest0-21swapper/111:10:161
310599980,7cyclictest0-21swapper/111:06:191
310599980,7cyclictest0-21swapper/111:00:401
310599980,7cyclictest0-21swapper/110:30:171
310599980,7cyclictest0-21swapper/110:15:521
310599980,7cyclictest0-21swapper/110:10:211
310599980,7cyclictest0-21swapper/109:52:081
310599980,7cyclictest0-21swapper/108:30:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional